Run python script every 5 minutes jobs

I am seeking an experienced engineer to design and implement a two-axis machine control system that is capable of: - Effectively controlling and managing the movements of the system along two axes with a LIMITED RANGE. Your expertise in designing systems with the necessary navig...Comprehensive knowledge in machine systems control and design. - A thorough understanding of motion control strategies. - A background in data analysis and logs processing. The machine is a Bandsaw to cut small logs into planks. The 2-off, NEMA 23 stepper motor movements are sequential, ie, first one moves then the second stepper moves. The controller is a Raspberry Pi 4, the prefered language is Python. Input to the controller via R Pi 7inch Touchscreen. File is to big to attach I look forward to ...

Looking for a video editor who is proficient at editing on DaVinci Resolve both in terms of color grading as well as working with black magic raw files. You need to be confident in your video editing skills, I will need short engaging social media videos up to 2 minutes long, with added elements like pop-up photos, graphics, subtitles, and subtle sound design. Tasteful and professional. Some projects will include creating engaging social media clips from prerecorded video podcasts. Event summary edits and other dialogue-focused videos. Talking head videos, and b-roll edits. (all footage will be provided) You must be detailed oriented and fluent in English, it is important that there are no typos! This job requires excellent communication and quick turnaround times! I am looking ...

I need a machine learning model developed in Python. This model should be able to evaluate prospective student applications by comparing them to historical data sets. The goal is to classify and sort the new applicants efficiently. Key Requirements: - Develop a classification-based machine learning model in Python - Understand and work with historical data sets to evaluate new student applications - Deploy the model in a web application format for ease of access Ideal Skills and Experience: - Strong background in machine learning and Python - Previous experience in developing classification models - Ability to understand and work with large data sets - Prior experience with deploying machine learning models in web applications

I'm in search of a Latin American Spanish voice-over artist for my documentary content. Requirements: - Voice-over in Latin American Spanish - For shorter documentary videos (under 10 minutes) Ideal Candidate: - Experience in voice-over work, especially for documentaries - Proficiency in Latin American Spanish - Timely delivery and professionalism Please provide a portfolio of your work. Looking forward to finding the right voice for my documentaries.

I am in need of a developer who can assist me in converting my existing Flask API into an Assistant GPT openai. The ideal candidate will be skilled in Python and GPTs Assistant and have a proficient understanding of Flask APIs. As the project involves converting the API into an Assistant GPT, experience with AI and NLP models will be a huge plus. Please note that there was a technical error in the questions, hence the repeated skips. It is highly important that the converted system maintains the functionalities of the original API while being able to run as an Assistant GPT.

I need a bash script that can import and export data from my database to CSV files. Ideal candidate should be able to: - Create a bash script that can effectively import and export data - Have experience working with database management systems such as MySQL, PostgreSQL, or MongoDB - Ensure that the script securely creates user accounts and manages their access to the database. The script will be used for daily database management tasks, so it needs to be reliable, secure, and efficient.

I'm in search of a Social Media Expert who can train me and help me implement a strategic plan to gene...English is essential. - Experience working with small businesses or in the B2B sector would be a plus. Your job will be to: - Provide training to help me implement this strategy - Suggest potential modifications or improvements to my existing strategies and techniques. - Present ideas to compliment the company plans. - carryout basic video editing. Initially you will be required around an hour every other day. Let me know your hourly rate & availability. Once we are generating plenty of leads / sales you will be given the opportunity if you like to take over the social media side of the business. Please include examples of previous similar projects in your proposal....

I'm seeking a skilled video editor to work on my YouTube channel. The videos will be a mix of Vlogs and Tutorials, each ranging between 5-10 minutes in length. Key Responsibilities: - Edit Vlog and Tutorial videos for 5-10-minute duration - Implement custom graphics in post-production The ideal candidate will have: - Proficiency in video editing software (e.g., Premiere Pro, Final Cut Pro) - Experience in editing Vlogs and Tutorials - A strong portfolio demonstrating custom graphics creation - Good communication skills to understand my vision and bring it to life If you're a talented video editor with an eye for engaging content, I'd love to hear from you.

I'm in need of a talented video editor to help bring my vlogs to life. Each video will be around 10-15 minutes long and I'm looking for someone who can match my desired style, which is a good pace and chic/elegant. In terms of video editing specifics, I'm hoping to incorporate cute and feminine transitions to make the videos more engaging. Key Requirements: - Video editing experience, especially in the realm of vlogging content - Able to maintain a good pace and chic/elegant style - Skilled in incorporating cute and feminine transitions The ideal candidate will have a keen eye for detail, a solid understanding of the Youtube vlogging landscape, and be creative in their approach to video editing. Please INCLUDE any relevant examples of your work.

I'm in need of a skilled professional who can produce a high-quality case study report focusing on marketing strategies within the retail industry. Key Deliverables: - Thorough Analysis: The case study should delve into various effective marketing strategies within the retail sector, potentially highlighting particular successes and failures. - Practi...You should have a strong track record of creating engaging and insightful case studies. - Retail Marketing Expertise: A deep understanding of the retail sector and its marketing dynamics is crucial for this project. - Strategic Thinker: The ability to identify patterns and trends in marketing strategies and translate them into practical recommendations is key. Gurobi with Python, Anaconda: Is able to use Gurobi with python...

I'm in need of a professional who has extensive experience with SharePoint, Power Apps, Power Automate, and secondary Power BI . I need support for my consultant indian time 8:30 pm to 11:30 pm Monday to Friday. 12$/hourly.. payment every saturday vai peayplea. I already have other indian guys who are working with me since 2019 to present. This support will be on zoom meeting. Which we will provide u and u will connect with my consultant for support.

I am seeking a sk...Lebanon, Canda, and USA) - You can use pictures on the web of before and after for relative projects to show how it was before and how it became after. - I expect to see Technical terminologies to demonstrate how i went from 36% Inventory Accuracy to an average of 98% using zone picking, barcoded inventory, and mixed wave picking strategies as an example. (You will need to make points like these for every relevant before and after picture. Your work will be crucial in showcasing my capabilities to potential clients and employers. You will start by making a complete template with your idea of how i can best represent myself. If your delivery is impressive i would like to Create a few more "REAL" Project examples together in more in depth details adapti...

I am a content creator on YouTube launching a course in the fall of 2024, I am offering a fantastic opportunity for an experienced video editor to create an engaging and dynamic learning journey for my audience. Project Objectives: - Edit a total of ~ 25-30 videos, which will make up the lessons for the course. Video length will be anywhere from 5-15 minutes each. Total edited video content will be 3-4 hours. Footage will include 2 camera angles and potentially some b-roll of relevant information to be supplied by me. - Integrate branding assets into edits for cohesive, sleek, professional, and engaging online course videos. - Enhancing the footage with animations and effects to maintain student engagement and improve knowledge retention. This will include some on-scre...

Fix pine script code send alert to telegram group too many signals with to dirction i need it to send once per entry only until the next signal came the code already wrote the message already wrote need to fix the issue only Pine script i dont need any1 full staked and dont know what i need i need it asap if more question what u dont understand will not accept the project its small fix dont request high the pinecoder know that ?? type 2233 if u read this

I am seeking a proficient DevOps eng...out CI/CD pipeline with supporting infrastructure as Code (Kubernetes, Docker) - Manage code releases and updates with popular orchestration tools like : Jenkins , Ansible Ideal Skills: - Proficiency with AWS and Azure cloud platforms - Strong experience with CI/CD - Adeptness with Python, PowerShell programming or any other popular scripting language This job demands the candidate to have a sound understanding of cloud computing and CI/CD implementation, coupled with the ability to comfortably work with Python or other popular scripting languages like PowerShell. The selected consultant will have to train and mentor from A to Z how all steps are implemented The project plan is provided and reviewed by hired Freelancer to avoid any ...

I'm seeking professional help to rectify a problem with one of my programmes which is presently operational on a Windows 8.1 environment but doesn't launch on Windows 11. I'm not certain about the original coding language as I skipped that question, making it necessary for the freelancer to have adept skills in multiple languages, mainly in C++, Java, and Python. I'm also unsure about specific software or hardware dependencies that might be influencing the situation. However, the freelancer must have the expertise to identify and handle this potentiality. As for specific program functions, the user left a gap as well, so an experienced developer in generic software protocols and universal functions would be highly appreciated. However, the freelancer needs to...

I'm looking for a seasoned Python developer who can assist in two main areas: - Creation of PowerPoint presentation using a CSV data file - Automate the process via a public URL to upload the CSM file Creation of Powerpoint Presentation The CSV file will feature data-points in columns. A powerpoint presentation template will be provided for reference. The graphs and tables should be present as per the data-points present in CSV file. Automating the Process This is the secondary part of the job. Once we have are successfully able to convert a CSV data in PPT format, we should create a public secured link to upload the file. It should be auto-converted and file should be ready for download. The ideal candidate should be a proficient Python Developer with a solid unde...

I'm in need of a skilled Python developer to create a custom Telegram bot for me. This bot will primarily focus on automated messaging. Key requirements: - (((meeting will be in person in Kuwait))) - The bot should be programmed in Python / any - It should be able to send automated messages - integrate payment gateway - Messages include, but aren't limited to, welcome messages for new users, notifications for updates, and reminders for appointments Please consider the following skills and experiences for this project: - Strong proficiency in Python, with a good understanding of its libraries and frameworks - Experience in developing Telegram bots specifically - A solid grasp of automation and scripting - Prior work with automated messaging systems - Ab...

...from a tax website. This involves scrapping website using the provided credentials by the client, i am looking for getting the python code as i can run the code myself in the future or integrate it to another system. Key Requirements: - I need approximately 300 data points extracted. - The output for these data points should be organized into a PDF or Word. This project is about creating an automated system to generate instant reports about a company. Only difficulty is the website has drops downs to select the period involved and in those 300 data points actually many come from the same source. Ideal Skills and Experience: - Experience in web scraping (Python) - Proficient in creating PDF documents from extracted data - Adept at handling large amounts of data -...

Please Sign Up or Login to see details.

.The scope of this project includes: 1. Data Transmission: You should be able to help in enhancing our network to ensure that it delivers data more optimally, focusing particularly on text-based data, as this is what our UDP/IP network primarily handles. 2. Error Detection and Correction: The hiree will also have to devise new methods for detecting and correction errors within our system. We've been facing some challenges in this area that need resolution. 3. Scalable Solutions: Our network system currently connects between 10 and 50 devices. While working on this project, it is important to keep scalability in mind to accommodate potential future growth.

We are looking for a developer experienced in working with the Solana network and trading bots, with a mandatory requirement of being knowledgeable about the P...one view, allowing the user to check the total bonding curve of SOLs versus SOLs owned in the project. Implement a comment bot to automatically write comments on each project. Qualifications: Proven experience in developing trading bots. Strong understanding and experience with the Solana network. Familiarity with the Pumpfun platform is mandatory. Proficiency in programming languages such as Python, C++, or Java. Experience with trading APIs and platforms (e.g., REST, WebSocket, FIX protocol). Strong problem-solving skills and attention to detail. Ability to work independently and as part of a team. Excellent communicati...

As a designer, I'm eager to help create engaging video content for your products and online presence. - I'm specifically looking for someone who can help me produce videos that are 10-15 minutes in duration. These videos will serve as both product promotion and photo video content. - In terms of elements, I am looking to include text overlays, creative editing, and animations. Your expertise in video editing and a keen sense of design will be crucial for transforming these raw materials into engaging content. The ideal candidate should be proficient with editing tools and techniques, and capable of turning my vision into reality.

Please Sign Up or Login to see details.

...identity of a self-created character and live out their life within a fictional context alongside other players. - Interaction can be via text or, preferably, voice chat for enhanced realism. - Characters can be anything from a prominent businessperson to a foreigner unfamiliar with the local language, a mafia woman, etc. The possibilities are endless. 2. **Collaborative Storytelling**: - Every player online is roleplaying their own character. - Stories, plots, and actions are developed collaboratively, with everyone staying true to their roles and following the rules. 3. **Dedicated Servers**: - Roleplaying occurs on dedicated servers for the PC version of Grand Theft Auto V, as this mode is not available on consoles. The Project Vision: - **Recreate the ...

I want a strategy for tradingview that it opens the orders manually or crossing emas, we input a range for the stop loss and take profit using % or $ and when it reachs the SL it opens a new order using the same range and different direction, if it is long, turn in to a short but with the value increase by a pre set multiplier (one for the SL ad one for the TP) and also add a possibility to multiples TP We also need to pre set a limit of times that the reversion happens and also add a option tralling stop loss. Can you make it?

I'm in need of a skilled programmer who is adept in Python, Java, and C++. Your tasks will span database management, working with algorithms and data structures, and user interface design. Here's a further breakdown of the ideal skills and experience I'm looking for: - Programming skills: Proficient in Python, Java, and C++. Familiarity with various coding patterns and best practices. - Database management: Experience in handling large datasets, querying databases in an optimized manner, and ensuring the integrity and safety of the data. - Algorithms and Data Structures: Demonstrated understanding of algorithms and data structures. The ability to use this knowledge to solve problems efficiently is a must. - User Interface Design: Skills in creating intu...

I have a data in my excel sheet. They are from column A - J, 10 column, 4137 rows of data. The data are in mixed string format, which means all long text mentioning about their company. I need to do some data analysis. So i need help in doing NLP for those data to clean and filter the data. I need help in doing NLP for the data and provide me the python code use to do the analysis, I will need like the summaries of the text. For example, for column Funder Purpose the row contain info like "Since the business started, we have been fully relying on our internal fund. We plan to utilize this fund to support our working capital requirement and operating expenses. Based on our business growth progress, we are confident in our repayment capacity." I want the summary as "...

I am seeking a talented designer to construct an informative presentation slideshow that lasts more than 10 minutes, with the primary objective of educating my audience about a new product/service. This project needs alignment with my brand, which requires working with a white background, and incorporating green elements and black text. Ideal candidates will have: - Proficiency in creating sleek, simple slide designs - Experience in structuring presentations for educational purposes - Ability to effectively mirror brand identity in design elements - Ability to effectively mirror the content of the proposal in a simlpe presetnation with using the right local images and icons The final output should hold the company we're pitching the attention and make complex product concep...

Looking for a Python & Active Directory Expert to create a script and test data to capture all meta data linked to and which describes the confined parameters of an AD account, group policy etc. and export to a MS Excel File. More information attached.

I'm seeking a skilled video editor with ample experience in creating engaging, 1-2 minute long animated advertising videos. These will be based on ready-made templates and will come complete with a pre-recorded voice-over. Some key requirements you should be prepared for are: - **Duration:** The video should be between 1-2 minutes long. This is ample time to convey our key messages and establish our brand. - **Goal:** The primary aim of this video is brand awareness. You should have a clear understanding of how to translate this into compelling visuals and message framing. - **Style:** The preference here is for an animated video. It's important to have a portfolio that demonstrates your proficiency in this style. The ideal candidate should demonstrate: - Proficiency...

Spanish Recording Project We have a project, that needs Native Spanish speakers, we will give you the text, and you need to record 50-60 short sentences. you just need to download our software, to read our text and record it, it's a very e...text, and you need to record 50-60 short sentences. you just need to download our software, to read our text and record it, it's a very easy job. 1. You will need to record in a quiet place without loud background noise. and without an echo. 2. Each person Price is 3$ for 50-60 short sentences record. Every sentences is 2 word. 4. It will take time to finished 10-15 mins only. If you are interested please let me know sure. I will contact u. A Good Opportunity For New Freelancers For taking 5 Star Review after their completio...

I am in need of a versatile video editor who can create engaging and captivating YouTube Kids videos. Add sound effects and animation where needed. Key Responsibilities: - Edit and enhance video content for educational, animated, and music videos - Incorporate suitable cartoon effects, sound effects, and background music - Ensure that the final video is between 20-40 minutes in length Ideal Candidate: - Proficiency in using cartoon and sound effects, as well as selecting suitable background music - Ability to create engaging content that captures the attention of young viewers - Capacity to deliver high-quality, polished video content within the specified length Payment will be done per video. We will provide you with the videos and you have to combine them together, add sounds ...

I'm looking for someone proficient in both Hindi and English to assist me with translating a personal audio recording from Hindi to English. Key requirements: - Native or fluent in both Hindi and English. - Proven experience in voice translation work. - Able to capture the nuances, tone, and emotions of the orig...recording from Hindi to English. Key requirements: - Native or fluent in both Hindi and English. - Proven experience in voice translation work. - Able to capture the nuances, tone, and emotions of the original content in the translation. This translation is for personal documentation purposes, so it's important that the translated content is accurate and authentic. The original audio is around 30 minutes in length. Experience in personal documentation translat...

Searching for a skilled video editor to transform 1-4 hours of wedding footage recorded from 2 different caneras into a cinematic masterpiece. Looking for full length, extended duration film (only cutting out blanks and downtime). Your...ceremony, and reception highlights. The ideal freelancer has: - Experience in creating cinematic-style edits - Proficiency in video editing software - Attention to detail in order to capture and enhance the most poignant moments - Good listening skills to correctly implement speech segments. Let's bring the magic of this special day to life! This will be an ongoing project and I shoot almost every weekend! Looking for consistency, clean and creative work, fast delivery (I don't want it rushed and half way done, take the time it needs to ...

I'm in need of a proficient Python developer who can help compile a Python code, that I have acquired from GitHub, into an executable format for Windows. As the client, I expect: - Understanding the existing Python code and its dependencies - Transforming the Python code into a Windows executable file Successful freelancers should provide a detailed project proposal illustrating how they plan to compile the code to exe on a Windows operating system. Though no specific Python libraries or frameworks were mentioned, a background in Python coding and debugging is paramount. The ideal freelancer should have a deep understanding of Python code, dependencies, and experience dealing with code from GitHub. Experience in generating Windows e...

I am seeking a proficient Pine Script specialist with a proven track record in creating high-accuracy indicators for TradingView. The goal is to produce an indicator that can deliver buy and sell signals with exceptional precision, particularly when applied to short timeframes ranging from 1 to 5 minutes. Key Requirements: - Development of a Pine Script Indicator: The main task is to design an indicator that generates both buy and sell signals. The accuracy of these signals is crucial, and they should be specifically tailored for the 1-5 mins timeframe. - Incorporation of Multiple Trading Indicators: While I do not have a specific strategy in mind, the ideal candidate should be well-versed in using a variety of indicators to create a robust and reliable ...

I'm looking for a professional who can convert my Amibroker AFL script into a TradingView Pine Script. The converted script should be able to generate buy/sell signals and provide backtesting capability. The ideal candidate should have experience in: - Amibroker AFL and TradingView Pine Script languages - Developing buy/sell signals - Implementing backtesting functionality Moreover, my trading strategy is based on breakout patterns. The converted script should reflect this strategy and incorporate the following indicators: - Moving Averages - Relative Strength Index (RSI) - Supertrend I'm looking for a freelancer who can deliver a polished and fully functional script that mirrors the performance of the original AFL script in Tr...

...GUI interface, currently built on the MATLAB compiler, into a Python application. The source code for SPM12 is available at SPM12 GitHub repository Objectives: • Translate the entire SPM12 codebase from MATLAB to Python while maintaining functionality. • Develop a Python-based GUI that replicates the current MATLAB interface. • Ensure the converted application integrates well with Python scientific computing stacks. Key Deliverables: • A fully functional Python version of SPM12. • Source code with comments and documentation. • A user guide for the Python-based GUI. Skills Required: • Proficiency in MATLAB and Python programming languages. • Experience with GUI development in Pyth...

I'm in need of a skilled video editor to work on my music videos. Here are some relevant details about the work: - Video type: Music videos. - Duration: The videos are short, lasting less than 3 minutes. - Mood: I'm looking for an editor who can create a dark and edgy vibe. Ideal skills and experiences: - Strong understanding of music videos editing techniques. - Good at creating dark and edgy aesthetics. - Experience in working with short-duration projects. Please share your portfolio with similar works you've completed along your rates and estimated timeline per video in your proposal.

...am looking for a skilled programmer to develop an interactive chemistry experiment for me. You may code using JavaScript, HTML5 or using Python, so experience or proficiency in this language is crucial. Key Requirements: - Users should be able to drag and drop objects using mouse or in case of mobile- fingers. - It should offer a moderate level of interactivity. This includes features such as adjusting quantities and temperatures. If a user pours something in a beaker, it should show the beaker full. If emptied, beaker is empty. - Vector images of lab equipments like Test tube, beaker, burner etc can be found online. Ideal Skills: - Proficiency in Python or JavaScript. You may use CreateJS libraries. If you are a programmer with a passion for chemistry, this is a great...

I'm seeking a skilled developer to creat...limit. - Predefined Output Path: Users should have the option to assign a default output path for the signed files. - PDF Signature Display: For PDF documents, the utility should display the signature as an optional feature. The goal is to have this utility developed within a month. Ideal skills for this project include: - Proficiency in programming languages suitable for file processing (e.g. Python, Java) - Experience in developing software utilities or tools - Familiarity with e-signing mechanisms and standards - Prior experience in working with PDF, XML, JSON, and Text files - Ability to create a user-friendly interface for the utility. If you have the required skills and can deliver within the specified time frame, please s...

I'm in need of a skilled builder who can create a powerful cross-platform crypto mining app. The app should not only facilitate the mining of a new crypto every hour, but also give users the option to purchase premium packages using a variety of crypto wallets. Key Requirements: - Development for both iOS and Android platforms - User-initiated mining process - Support for mining of a new, specific cryptocurrency - Inclusion of secure transactions for premium package purchases Your role in this project will be to design and implement a user-friendly interface that enables seamless navigation and functionality across both iOS and Android. You'll also need to integrate secure and reliable crypto wallet options to facilitate premium package purchases. Prior experience in b...

Hello, we are looking for a person or a team to create websites for us. Creative, clear and modern designs should be created. Most of the Projects are company website like : main page incl. 4 subpages. The primary goal of this site is designs that are creative, clear, and modern, with a focus on incorporating animations. We have numerous projects every month. Key elements I'm looking for: - Proficiency in creating modern, visually appealing websites with clean design. - Strong expertise in UI/UX design principles to ensure an intuitive user experience. - Attention to detail and a commitment to delivering websites that are both visually striking and user-friendly. Skills and experience required: - Proven experience in designing and developing modern, professional websites - S...

I am seeking an experienced Python web application developer to construct a user-friendly platform for cryptocurrency airdrop and telegram integration. The final product should be similar to notcoin. Key requirements: - User registration and verification. - Airdrop distribution capabilities. - Integration with Telegram. Professional skills and experience: -Familiarity with Python. -Past work demonstrating ability to create robust web applications. -Understanding of cryptocurrency airdrop processes. Applicants should include their relevant experience in their applications. Working examples of similar projects will be highly appreciated.

I need a tool that extracts specific content (text and images) from PDF files and adds this data into a CSV file under designated headers. Key Requirements: - The tool should be designed specifically for Windows OS. PDF Data Extraction: - Need the tool to extract both text and images from the PDFs. CSV Insertion: - The extracted data should be sorted correctly under...Insertion: - The extracted data should be sorted correctly under their respective column headers in a CSV file. Consistent PDF Structure: - It is important that the tool can handle data extraction from PDFs with a consistent structure. Ideal Skills and Experience: - Proficiency in developing Windows-based tools. - Experience with PDF data extraction. - Familiarity with CSV file manipulation in Python or related ...

I am seeking an AI developer with significant expertise in reinforcement learning. Key Responsibilities: * Apply reinforcement learning techniques to solve complex problems. Required Skills and Experience: * Proficiency in Python. * Expert-level knowledge and hands-on experience in reinforcement learning. Only apply if you possess an excellent understanding of reinforcement learning algorithms, and Python programming. This project is demanding and requires a high level of competency, therefore, only experts in the field are sought. Your expertise will be crucial in optimizing our current models and laying down the roads for future developments.

I'm searching for a proficient video editor to help with my YouTube and social media content. Your primary task will be editing videos that will be within the 5-10 minutes range. Key Responsibilities: - Edit YouTube and social media videos - Implement a cinematic editing style Ideal Skills: - Proficient in video editing software - Previous experience in editing YouTube or social media content - Ability to deliver high-quality work - Strong understanding of cinematic editing Please, apply with your portfolio that showcases your previous video editing work.

We are looking for people to help with monitoring that it works properly. Key Responsibilities: Almost no involvement, just checking it quickly for 5-15 minutes every week. It is designed to work fully autonomously and may take no time at your ideal candidate should have: No previous experience is required. Monthly ongoing compensation. Please apply if interested. There is additional important information that will be discussed with interested candidates.

Looking for help in modifying an existing python script and related sql database table The current script - (1) scrapes company financial data from website and populates database (2) scrapes news related to keywords from google news (3)sentiment classification of news items (4)pushes data to sql database The company names and keywords are currently hardcoded in the script Requirement- (1) Company names/urls/keywords (will be provided) to be put in master table in the database (2) The script to loop through and scrape the relevant data and put in database