Web scraping programmer jobs

I am looking for a skilled programmer who can help me develop an application that will scrape a specific online store for updates on product pages on a daily basis. When a specific string shows up on that type of pages, the scraping of the page that meets the criteria should switch to hourly and the changes on that string should be put in the app dashboard with date & time, link and a photo. Key Requirements: - The app should monitor and notify about updates specifically on product pages of the online store. - Notifications should be in-app, once updates are detected. Skills and Experience: - Proven experience in web scraping, particularly from e-commerce websites. - Proficiency in developing web applications, with focus on in-app notifications. - ...

We are looking for a skilled professional to scrape our competitors' platforms and retrieve their lead database, with a specific focus on contact numbers. This project requires someone with expertise in web scraping and data extraction. The successful candidate will need to have experience in handling large volumes of data and possess excellent attention to detail. The main tasks will include accessing the target platform, collecting the required contact information, and organizing it into a structured database. Additionally, the ability to handle any potential obstacles, such as CAPTCHAs or IP blocking, is crucial. This is a medium-sized project with an estimated duration of a few days or weeks. We require an expert-level freelancer to ensure the highest quality results...

I have a database that I need to extract specific textual information from, in a one-time extraction. The data needs to be structured in an Excel file. Key Requirements: - Extracting Textual Data: You'll need to retrieve text from the database. - Data Structuring: The extracted data should be organized and presented in an Excel format. Ideal Skills and Experience: - Database Scraping: Experience in extracting information from various types of databases. - Data Structuring: Proficiency in organizing and presenting data in Excel. - Attention to Detail: Ensuring that all relevant text is accurately extracted and included in the final Excel sheet.

I am looking for a skilled Scala programmer to assist me in developing a new Scala program. This task involves writing code from scratch, with the specific focus on utilizing the Spark framework. Key Responsibilities: - Developing a new Scala program using Spark - Ensuring the code is optimized and efficient for the desired data processing application Ideal Skills: - Proficiency in Scala programming, with a strong understanding of Spark - Experience with writing code from scratch - Background in data processing applications would be a plus

I'm in need of a seasoned C# programmer with a proven track record in REST API integration and MS SQL Database management. Your primary task will be to create an interface between a C# application and FactoryTalk Optix software. Key Requirements: - Comprehensive experience in C# programming - Proven track record in developing REST APIs - Proficiency with MS SQL Database - Very familiar with FactoryTalk Optix software The primary goal of the REST API interface is to facilitate data exchange between applications. The interface should be able to handle text and numerical data. Please provide examples of previous REST API integrations and your specific experience with FactoryTalk Optix. Your understanding of data management and exchange will be crucial for this project.

I'm in need of a seasoned programmer who specializes in bots and scripts. This project is for an existing business, specifically, to assist in booking appointments on the 'Mafiva Egypt' website. Ideal candidates should be proficient in using Python for bot development. The bot should automate the appointment booking process on the website and should do so rapidly. Furthermore, the bot should be versatile and not tied to a specific platform (cross-platform support). Key requirements include: - Proficiency in Python - Experience in bot development - Understanding of appointment booking processes - Efficient, fast-paced coding - Cross-platform compatibility If you have the necessary skills and experience, I would like to discuss this project further. Please provide e...

I'm looking for a skilled programmer with robust knowledge of Scala, Hive and Spark to work on a data-related project. Key Points: - The project focuses on coding - The primary tools involved are Scala, Spark, Hive - No specific area of computer science is listed, just the programming languages Ideal candidate should be proficient in: - Scala, Spark, Hive - Data analysis and processing - Building scalable applications Previous experience in these areas would be a big plus.

scraping site: list scoreboards of a competition

This short video will demonstrate what I need I'm looking for a skilled programmer who can create a script that will automatically insert a timestamp into my Google Sheets document each time new data is entered. Key Requirements: - The time stamp should consist of both the current date and time. - The script should insert the time stamp in the column immediately to the right of the cell where new data is entered. - The format of the time stamp should be fully customizable. Ideal skills for this role: - Proficiency in Google Apps Script - Strong understanding of Google Sheets - Experience in developing scripts for automated processes - Ability to create customizable timestamp formats - Excellent problem-solving skills and attention to detail Please

I'm seeking a skilled professional to help in the scraping and generation of high-quality B2B leads specifically in the healthcare and other industry in Spain. Your primary task will be to extract verified email addresses useing tools as apollo. I need between 2000-5000 verified emails and phone number if its possibble. Key Responsibilities: - Utilize lead scraping tools and strategies to extract B2B leads in the healthcare sector. - Generate and verify email addresses for each lead Preferable skills and qualifications: - Proven experience with lead generation and email scraping in the B2B sector - Previous projects or expertise specifically within the healthcare industry is a significant advantage - Familiarity with data verification and the ability to provide...

Data Scraping from a website. I will explain in detail while hiring you.

We are in need of a highly skilled and experienced Python Developer who specializes in Large Language Mo...Augmented Generation (RAG) tasks. Key Tasks: -Your main responsibility will be to create a custom AI Chatbot by combining LLM (Large Language Model) with RAG (Retrieval-Augmented Generation) using custom data. General Requirements: - Demonstrable proficiency in Python and understanding of LLM and RAG is a generally necessary. - Familiarity with Chatbot modeling, data analysis, model building, web scraping, data extraction, and task automation will be regarded as additional advantages. This project provides an excellent opportunity for individuals deeply interested in language models and augmented generation. Interested and qualified bidders are advised to place their ...

Note: make millions after see results The AI Influencer Agency Bot would function as a middleman between businesses seeking to promote their products or services and influencers interested in collaboration. Here's how it would work: 1. **Business Search**: The bot would search for businesses looking to promote their products through influencer marketing. This could involve scanning social media platforms, websites, and other online channels for potential leads. 2. **Influencer Search**: Simultaneously, the bot would also search for suitable influencers who align with the business's target audience and marketing objectives. It could analyze factors such as follower demographics, engagement rates, and content relevance to identify the best matches. 3. **Initiating Contact**: O...

I'm looking for an experienced Pinescript programmer who can apply their skills uniquely to the financial sector. It's highly important that you possess: - I WANNA MAKE SOME TRADINGVIEW INDICATOR USING PINESCRIPT

I'm in need of someone to help me scrape a website daily, note down a list of traders and run some checks on them. Qualifications: - Knowing how to use a computer. Tasks Involved: - Visit the website daily, note down a list of traders, and run some checks on them. - This needs to be done by hand, as it cannot be automated due to Cloudflare.

I'm in need of an experienced programmer to dabble into creating new movements for an ABB IRB 6700 robot. Specific Tasks: - Program new movements for the ABB IRB 6700 - Iteratively test and refine the movements as required It's not necessary to adhere to any pre-set programming standard; rather, you'll have the freedom to apply your own judgement and expertise in this task. Ideal Skills: - Profound knowledge in ABB robots - Exceptional programming skills - Problem-solving abilities - Excellent communication skills to effectively report the progress It's an advantage if you have previous experience on similar projects. Looking forward to reviewing your bids!

...project: 1. Develop a web scraping script using Python (e.g., BeautifulSoup, Scrapy) to extract data from relevant grant databases and websites (if possible, considering anti-scraping measures). Sites to be scraped: 2. Design a database schema to store the extracted data. 3. Write scripts to clean, transform, and load the data into the database. 4. Design a WordPress directory listing interface with search filters to display the grant information. 5. Develop a user interface to query and display the grant information based on customer criteria 6. Create a Python plugin for WordPress to automate the scraping work, using tools like WP-Python or PyWP. This plugin would allow for scheduled scraping, data updates, and

...experience in developing software that can parse and interpret SERP data effectively. - While I'm not looking for a full suite of features, ensuring that the tool can provide a comprehensive SERP analysis is crucial. - The tool should be user-friendly, intuitive, and capable of generating clear and concise reports based on the analysis conducted. Given the nature of the project, expertise in web scraping and data analysis would be highly beneficial. Familiarity with Google's search algorithms and ranking factors would also be advantageous. Budget for this project is in parts and long term. The first stage it to get a platform to launch with. Then we will add more tools. We LOVE the project and look to offer something similar. IT is easy to use and easy ...

Please Sign Up or Login to see details.

I'm looking for a proficient web scraper who can extract text content from a specific website on a daily basis. The scraped data should be compiled and delivered in a spreadsheet. Key requirements include: - Daily scraping of text content from the designated website - Compilation and formatting of this data into a spreadsheet Your experience in web scraping, data compiling, and spreadsheet management will be greatly valued for this project. Accuracy, timeliness, and consistent daily delivery are crucial aspects of this job. Understanding of automation tools for data scraping would be a big plus. I am looking to collate some data from this website and need an ongoing scrape of this website to set up an ever-updating excel spreadsheet with the fie...

I'm searching for a skilled programmer proficient in the language Luau. The aim of the project is to develop a script or program that will enable the duplication of digital items within a game inventory. I am in need of a skilled programmer to help implement an item duplication feature for my PC game. The goal is to have this feature seamlessly integrate into the existing inventory system without causing any disruptions. Key responsibilities: - Implementing an item duplication feature for the game's inventory - Ensuring that the duplication process is seamless and does not interfere with the existing gameplay Ideal skills and experience: - Proficiency in PC game development - Experience with inventory systems in games - Prior work on item duplication features i...

I'm seeking a dependable freelancer for a weekly web data extraction task. The primary purpose of this extraction is for market research analysis. Key Responsibilities: - Conduct weekly web data extraction for market research purposes - Deliver the extracted data in an Excel spreadsheet format Ideal Skills and Experience: - Proficiency in web scraping and data extraction - Previous experience with market research data - Strong attention to detail and reliable turnaround time

...site pages. Key Requirements: - Aggregating Business Ratings: The system should specifically focus on collecting the business ratings of security installation services available on Google. Data Points: The key data points that need to be collected include each business's overall rating and star reviews listed on Google SERPs. for Ideal Candidate: - Proficient in Web Scraping: Experience extracting and aggregating data from websites is essential. - Familiar with Google API: Knowledge of Google's API for harvesting ratings and review stars would be a plus. - Data Analytics Skills: Ability to process and analyze large amounts of data efficiently. - Rich Results and Schema Markup Please provide examples of similar projects you've worked on, and a brief ex...

I'm looking for a skilled professional to scrape and collect specific sports-related statistics from Website A. The template is made, its really jsut a copy and paste exercise. Code is already written. Key Responsibilities: - Extract sports statistics from Website A. Your Skills and Qualifications: - Proficiency in web scraping and data extraction. - Previous experience with similar projects. - Understanding of sports statistics is a plus. This is a one-time project with the potential for future work if successful. I look forward to discussing the project further with you.

We're looking to recruit a rockstar virtual assistant to execute admin tasks with SPEED. Plenty of room for advan...sheets - Basic knowledge of Wordpress - Flexibility with working time and hours Job roles include but are not limited to… - Scraping basic information from website lists - Navigate Wordpress and add needed information Note - put the number ‘88’ in your application so we know you’ve taken the time to read this description!! Required personal attributes: - Strong work ethic - Focus and efficiency - Great English skills Expect a long term role with plenty of room for growth. Approx 2-4 hours per day to start, but this can grow if you are good! Ideal candidates should be detail-oriented, able to work with speed, and have a good grasp ...

I am looking for a data scraper to collect product information and pricing from various websites. Key Requirements: - The scraper should be able to collect data from multiple websites and be ea...future. - The data to be scraped includes product title, description, and price information. - The scraper will need to be able to navigate through the websites and accurately collect the required data. - The scraper should be able to work efficiently and provide timely data updates. Ideal Skills and Experience: - Proficient in web scraping techniques. - Experience working with product data and pricing. - Familiarity with tools and technologies used for web scraping. - Ability to develop a scalable and reliable data scraper. Please let me know if you have any que...

I require an expert in web scraping. The project involves extracting content, images, and product details from Amazon, eBay, and Craigslist. Key Project Requirements: - Extracting text content, images, and product details from Amazon, eBay, and Craigslist - Timely completion is crucial - the deadline is set as ASAP Skills Required: - Proficiency in web scraping tools and techniques - Experience in scraping from various types of e-commerce websites - Ability to deliver results quickly and efficiently This is a time-sensitive project and I'm looking for a professional who can deliver high-quality work promptly.

I'm in search of a proficient web app programmer, seasoned in trading algorithms and AI to build a personal usage tool. This project involves creating an algorithm, specifically for a lot size calculator of fixed amount on every trade, implementable on Angelone's platform. Key Components: - Design an intuitive, user-friendly interface for using the trading algorithm - Integrate the algorithm with Angelone's trading platform Ideal Skills & Experience: - Proven experience creating web apps and trading algorithms - Understanding of lot size calculators in trading and automatic stoploss of 5% in every trade in bracket order (robo order) - Familiarity with Angelone's trading system - Strong coding and AI skills - Experience in user interface/UI de...

I'm looking for a proficient NLP programmer to help me implement a Spell Checking algorithm using the BERT model. The ideal candidate should have expertise in NLP and should be comfortable working with the following requirements: - Expertise in NLP: Proficiency with BERT model in particular - Programming Language: Comfortable working with Python - Accuracy Expectation: The spell checking algorithm should provide balanced accuracy and performance, particularly for large texts. The project's main goal is to deliver an efficient and effective spell checker that can handle large datasets. This will require a nuanced understanding of NLP, particularly the BERT model, as well as Python programming skills. The balance between accuracy and performance is crucial, as the spell c...

I need a seasoned expert to scrape data from a specific website for data analysis. The scope of the project, types of data to be scraped, and further details will be discussed once we move forward. Ideal Skills: - Strong understanding of web scraping techniques - Proficiency in data scrapers (ex: Octoparse, Content Grabber) - Understanding of data analysis Your application should highlight your experiences in these areas, provide examples of past projects, and present a brief proposal on how you'd tackle this project. Creativity, clarity, and specificity will be highly appreciated.

I'm in need of a Swift programmer to give my existing iOS gaming app a fresh breath of life. This entails: - Adding new levels and challenges to the gameplay, thus enhancing the user engagement and experience. A potential candidate ideally has: - Extensive experience in developing and improving gaming apps, particularly in Swift - A strong understanding and creativity in designing engaging levels and challenges - A proven track record in delivering projects on time and to a high standard. By taking on this project, you are ensuring an improvement in user engagement and overall satisfaction with the game. Your creativity and programming skills can make a great impact here.

I'm in need of a skilled web scraper who can extract product details from Website 1 and deliver them to me in an Excel spreadsheet. Key requirements: - Extracting specific product details from Website 1. - Organizing and delivering this data in an Excel spreadsheet. Ideal skills and experience: - Proficiency in web scraping. - Strong understanding of data organization and delivery methods. - Experience in working with Excel for data delivery. Your role will be crucial in helping me access and utilize specific product data from Website 1. The neat and organized delivery in Excel will ensure I can efficiently work with this information.

...potential programmer, this project involves creating a local program capable of extracting a single line of data with multiple fields from a Google Sheet and transferring it to 10+ different multi-page website forms that require unique login information. Additionally, the program should generate PDF documents on the target websites based on the transferred data and save them with named files corresponding to the original Google Sheet. It is crucial to incorporate error handling, data validation, mapping, and security measures into the program. If you are interested in working on this project, please provide details of your relevant experience and approach for ensuring its successful completion. The program must be compatible with the MAC operating system. Mapping Automation Par...

I'm looking for an experienced programmer to assist with the design and development of a Windows Remote Access Trojan (RAT). - SPECIFIC FUNCTIONALITY: The RAT should be specifically designed for system control, enabling legitimate access and manipulation of systems when necessary. - DEVELOPMENT SKILLS REQUIRED: A comprehensive understanding of Windows OS, solid coding skills (particularly in C++ & Python), and a deep familiarity with system's internals and protocols are necessary. - SECURITY ASPECTS: The freelancer should also possess a strong understanding of security practices to ensure our software is robust and secure against external threats. Please note, that this is strictly for ethical, white-hat purposes, including penetration testing and system security ...

I'm looking for a Python expert to help me with some specific tasks. The tasks are varied and I will provide more details upon chatting with interested freelancers. Ideal skills and experience: - Proficient in Python - Experience in data analysis, web scraping, and automation - Able to understand and tackle various Python tasks efficiently - Good communication skills for explaining concepts and discussing project details. - Flexible and able to adapt to changing requirements Please note that due to the nature of this project, I can only provide specific details once we have a direct discussion.

We have one upcoming project for which we need PLC programmer for 3 days who must know programming and maintenance.

I am searching for an experienced Fanuc PLC programmer who is proficient in Ladder Logic. Your primary role in this project will be to develop new programs for an industrial manufacturing setup. Key Responsibilities: - Building and maintaining concept-to-production PLC systems - Offering creative, scalable solutions to drive our automation forward Skills and Experience Required: - Proven experience as a PLC programmer, especially with Fanuc systems - Proficiency in Ladder Logic is a must - Experience in industrial manufacturing projects I look forward to reviewing your applications and discussing our collaborative journey in the realm of industrial automation.

...of data analysis. Key Requirements: - Data Collection: The primary task is to source and gather text data in a systematic manner. This may involve scraping data from websites, social media platforms, academic articles, or other relevant sources. - Data Analysis: The collected text data will be used for in-depth data analysis. Therefore, the freelancer should have a keen understanding of data analysis techniques, trends, and tools. Prior experience in text data analysis is a plus. Ideal Freelancer: - Proficient in data collection with a focus on text data - Skilled in data analysis particularly with text data - Familiarity with data scraping tools and techniques - Strong attention to detail and data accuracy This project offers an excellent opportunity for a talented...

I'm in need of a web security expert with comprehensive knowledge in Secure Coding Practices. Ideally, you'll have: - Proficient experience in Python, Java, or C++ - Look for a programmer, web developer, or cybersecurity person who has experience in authenticating accounts or experience using Burp Suite tools.

...of a skilled Laravel programmer with a solid experience in web application development. Key Requirements: - Proficiency in Laravel: You should be adept at using Laravel framework to build web applications. - Strong Understanding of Web Development: A background in web development is essential, as we're focusing on a web-based project. - Effective Communication: You will need to be able to communicate effectively to ensure that the project is developed in accordance with the requirements and within the timeline. The project will entail: - Building a web application using Laravel framework - Implementing functionalities and features as required - Ensuring the application is responsive and optimized for performance Ideal Candidate:...

...sites may have more complex structures, requiring the freelancer to navigate and extract data accurately. - **Excel Formatting:** The extracted data needs to be entered neatly into an Excel spreadsheet. - **Advanced Level Detail:** The data extracted should be detailed and comprehensive, including historical data and analytics where relevant. The ideal freelancer should have experience in web scraping and data entry, as well as a good understanding of Excel. They should be meticulous, capable of handling potentially complex website structures, and able to work with a high level of detail. Excel: Analyze Data with Tables and Conditional Formatting Position: Virtual Assistant (VA) from Phillipines. Location: Remote Type: Long-Term Ongoing work (Not full time) but will tr...

I have a list of 2060 SKUs in an Excel sheet that I need corresponding images scraped from Website A. Each image should be saved with the SKU number as the filename (e.g., 324...Scrape images from Website A for 2060 SKUs - Save each image as a high-resolution jpg with the SKU number as the filename Delivery: - I will provide you with the Excel sheet containing the list of SKUs via email. - You should deliver the images in a compressed file with 2060 images, each named according to the corresponding SKU. Ideal Skills and Experience: - Experience in web scraping, particularly image scraping - Proficient in Excel for managing SKU lists - Ability to deliver high-resolution images - Attention to detail to ensure correct matching of SKUs and images Please, let me know if...

I need a proficient data scraper to help in generating Instagram leads. The focus will be on the extr...data scraper to help in generating Instagram leads. The focus will be on the extraction of Instagram usernames from the followers of a specific account, which I will provide. The successful freelancer should demonstrate advanced web scraping skills with a track record of similar projects. Attention to detail, ensuring accuracy, and maintaining a high level of confidentiality are desired traits essential for this project. Key responsibilities: - Scraping Instagram usernames - Ensuring high data accuracy - Ensure no duplication of leads Ideal Skills: - Web Scraping - Data Mining - Instagram API - Strong Attention to Detail - A strong understanding of p...

I require a Python script that can scrape specific data and ...property websites, and the script should be able to work across them all. Since these websites might have different structures, the script should be flexible enough to adapt to these differences. I would also accept 10 different scripts of varying logic if that helps the project to success. Skills and experience needed for this project: - Proficiency in Python programming - Prior experience with web scraping, particularly from dynamic websites - Ability to work with and manipulate large amounts of data - Understanding of property listing sites and their structures would be a plus Your solution should output all the data in an organized and easy-to-access format. Please highlight any similar projects you've ...

I need a skilled PHP developer who can create a script that fetches information from a specific website when a user inputs a serial ID. Example serial : 2X0BHSB6AUXW5QAX (use this serial to test with) Site B : where the info need to retrive from to scrape information from to site A. Sorry for the bad image...$50 USD for this. If you cant meet this budget, dont bid on this work. Key Requirements: - Develop a PHP script to scrape information from Website B when a user inputs a serial ID on website A. - Ensure the script is efficient and able to handle multiple requests without performance degradation. Ideal Skills and Experience: - Proficient in PHP and web scraping techniques. - Familiarity with handling user input and displaying output in a web interface.

I'm in search for an experienced Java programmer with a clear understanding of the .mp4 standard to build a code that encapsulates a data stream in a previously recorded video. Specific knowledge of Ffmpeg is needed. The task at hand mainly revolves around end-processing, as the text file needs to be submerged after the final video compression. The text file will be in the .srt format, and no encryption or compression will be required for this item. Ideal candidate should be familiar with handling these types of video data stream manipulations.

I am looking for a freelancer to replicate a website () for personal use. It is in arabic and is a text based site there is no copyright issues which i want translated into English through chatgpt. Ideal skills and experience for this job include: - Strong web development skills - Experience in website replication - Attention to detail to ensure accurate replication - Proficiency in web scraping techniques - Knowledge of HTML, CSS, and JavaScript - Ability to work independently and meet deadlines If you have the skills and experience necessary for this project, please submit your proposal. Thank you.

I'm in need of a skilled Python programmer to create a code for an automated student ID card detection system at the entrance of our college campus. When the system detects a student ID, it should open the gate automatically without any manual intervention. Key Requirements: - The code should be able to specifically identify student ID cards. - The system should be designed to trigger the gate automatically upon detection of an ID card. Alert Notification: - Upon detection, I need the system to provide an intermediate level alert: - ID number - Name - Time of detection Ideal Skills & Experience: - Proficient in Python programming - Experience with image processing and recognition - Previous work with automated systems will be highly beneficial. This project is c...

Hi, I need to extract data from some sites and compare them in a unique database. In few words i need a scraping code in python that extract data from some sites and the data have to saved in a mysql database.

I'm in need of a skilled individual who can scrape data from various websites for the purpose of lead generation. The data should be delivered in Excel or CSV format. Key Requirements: - Proficient in web scraping - Experience with lead generation - Ability to deliver data in Excel/CSV Ideal Skills: - Proficiency in Python/R for web scraping - Previous experience in similar projects - Strong understanding of lead generation techniques If you have experience in web scraping and lead generation, I'd love to hear from you.