How to detect web scraping jobs

I'm seeking an experienced Python developer to scrape a specific website and extract text data for the purpose of analysis. Your role will be the following: - Scrapping the text data from the specified website. - Cleaning the data to prepare it for analysis. High data quality is crucial so attention to detail is necessary. Ideal candidate would have proven experience in Python, data extraction, and data cleaning. Familiarity with data analysis will be beneficial.

I'm in need of a Python script that can crawl through a list ...export all the webpages it finds into a new Excel file. This task is aimed at scraping the entire content of the websites, not just a specific piece of information. Key Requirements: - The script must be able to read a list of websites from an Excel file. - The script should use natural crawling mechanisms, not sitemap, to find all the webpages on each website. - All the webpages found on the websites should be exported into a new Excel file. The purpose of this script is to aid in analyzing the content of these websites, so it's crucial that all pages are scraped. Ideal Skills: - Proficiency in Python programming, particularly web scraping. - Knowledge of Excel file hand...

I need a professional who can help me extract photos fro...professional who can help me extract photos from various websites for data analysis purpose. Key Requirements: - Image Extraction: The main task is to extract photos from a multitude of websites. The photos will be used for data analysis, so accuracy and completeness in this task is vital. Ideal Freelancer: - Data Extraction Expert: The ideal candidate would have experience in extracting data from websites. - Web Scraping Proficiency: Knowledge of web scraping tools and techniques would be highly beneficial. - Attention to Detail: The successful candidate will be diligent in ensuring all relevant photos are extracted. If you are confident in your ability to deliver a high-quali...

...Python developer to help with web scraping and data analysis tasks. Key Tasks: - Web Scraping: Proficiency in using Beautiful Soup or Scrapy is essential. The person should be able to extract specific data sets from websites and present them in a structured format. - Data Analysis: Experience with Pandas and NumPy is crucial for this role. The ideal candidate should be able to manipulate and analyze large data sets efficiently. - Automation: Familiarity with Selenium for automating tasks is a plus. What I'm Looking For: - Experience: Please include details of your past projects and your experience with Python in your application. - Specific Libraries/Frameworks: A strong grasp of Pandas, NumPy, Beautiful Soup, Scrapy, and Sele...

I'm looking for a proficient Chrome Extension Developer to assist with my Google Images Downloader extension. I'm encountering two primary issues with the extension; it's failing to download images and images are not loading correctly. Key Tasks: - Fix the issue causing the extension to be unable to download images - Resolve the problem with images not loading properly - Identify the specific changes in Google's image classes and div elements that caused the extension malfunction. - Modify the extension code accordingly to adapt to these changes and ensure compatibility with the latest Google Images layout. Please note that I've already attempted to reinstall the extension in Google Chrome, but this hasn't res...

I'm looking for a skilled business developer who can assist in turning my idea for a brain computer interface device into a marketable product. Key Requirements: - **Market Research**: You'll need to conduct thorough market research to understand the competitive landscape and identify potential target markets. - **Business Development**: Leveraging your experience, guide me through the process of transforming the idea into an actual product. - **Wireless Connectivity & Real-time Data Analysis**: The device should have these features to cater to gamers, individuals with disabilities, and consumers interested in brain health. Ideal Skills: - Proven track record in business development, especially in tech-related products. - Market research expe...

Hi Azabache Producciones , As previously discussed we'd like th..., As previously discussed we'd like this video edited in a similar style to Matt Starky's :// I have provided a Guide Edit for timings and rough placements. A clean 4K resolution hosted recording - with same timings as the Guide. I've also included all screenshots and stock within the Guide Edit, but am open to you suggestions if you think other images or graphics might be better. Please let me know if there is anything missing. We'd like the design to fit on a page like this https://www.freelancer.com/ai-for-business so tonally and colour wise it should feel like it belongs to this page.

I have a web application build in Angular. In this application i also want to gather real-time score data from football games, providing dynamic updates to users. And send notifications when goals are made. Key Features Required: - Robust scraping solution to ensure constant, consistent live score updates - User-friendly interface showcasing live scores in a digestible manner Ideal Skills and Experience: - Proficient in Angular-related development - Previous experience with web scraping technologies - Familiarity with designing user-friendly web interfaces - Excellent problem-solving skills to ensure the smooth delivery of live data updates and notifications.

...proficient script writer to extract specific business data from an online directory, specifically Myagedcare.gov.au. This project will need a freelancer that possesses: • Significant knowledge and experience in data scraping technology • An understanding of the structure and functioning of online directories • Keen attention to detail The successful freelancer will carry out: 1. Extraction of business data: I require accurate extraction of contact details and business names from businesses listed on the directory. 2. Specific Directory Focus: The targeted directory for this exercise is Myagedcare.gov.au. The end goal is to create a clean and organized database of businesses in the aged care sector. Prior experience with online directori...

...seeking a skilled Python developer with experience in using Playwright to develop a set of flexible data scraper tools. These tools will be deployed to capture data and screenshots from a variety of popularly visited websites such as e-commerce platforms, directories, social media and news sites which includes but not limited to eBay and clinicaltrials.gov. Key functionalities should include: - Capturing various data types such as product details, pricing information, ratings, reviews, and any other elements visible in a full-page screenshot. - Organizing the captured data and screenshots in a clear, easy-to-navigate folder structure. - Being adaptive enough to scrape data from a widely diverse set of websites. To be successful in this role...

I need a professional to scrape data from the URL provided and deliver the extracted details in a CSV format. - The specific data elements required are the agent name and phone number. The scraping process does not require any filters or search criteria as it's a one-time extraction. The data should be organised and easily readable in a CSV document for further analysis. Ideal skills for this project would include: - Proficient in web scraping with experience in extracting data from similar websites - Strong expertise in delivering data in structured formats (CSV, Excel) - Attention to detail to ensure accuracy in the extracted data

I am seeking a data aggregator to formulate inclusive and accurate contact lists for my upcoming marketing campaigns. The information required in each list is a blend of phone numbers, email addresses, and the names of company owners. I'll be providing SIC codes as an accurate reference channel for the industries we'll be focusing on. Any freelancer applying for this project should exhibit a well-versed understanding of data aggregation, web scraping, and should be detail-oriented. A knowledge or background in marketing would also be beneficial. Please note information accuracy is paramount, as these lists will directly impact the effectiveness of our campaigns. Your tasks will include: - Gathering the aforementioned contact details - Aligning data with S...

...(see details). The service must also include preventive analysis that will allow us to establish whether the platform is “healthy” in order to reduce these types of events. DETAIL OF EXTENDED SUPPORT The Extended Support service will have the following scope: • Support Hours: Monday to Friday from 18:00 to 23:00 and Saturdays, Sundays and Holidays from 9:00 to 23:00. The service will cover the resolution of critical incidents (service outage) in this time slot. • The committed SLA, for this time slot, will be 3 hours from the report sent from our Help Desk. • The service must contemplate 7 x 24 monitoring of the platform with an alarm system to detect service outages. This capacity will allow an event to...

...Transportation Studies module and will be assessed by an individual report submitted via canvas. In your report you would need to include the experimental and the model results of your selected noise barriers. You will be judged on how you have been innovative in your conceive, design and how you improved the performance rating of your noise barrier. Assessment Criteria 1) Conceive (research noise barriers) = weight age (10%) 2) Project 1: Performance of reflective/absorbing noise barriers = weight age (40%) 3) Project 2: Traffic noise mapping = weight age (40%) 4) Modelling of noise barrier = weight age (10%) Project Details: Project Description: We are seeking a skilled freelancer to assist with a project that involves in-depth research and document a...

I need a professional web scraping expert to scrape information from medical service providers directories that are publically available from the providers' websites. Requirements: - Extract data including name, address, phone, and location from the directories - Ensure the information is accurate and up-to-date I'm looking for a freelancer who: - Has extensive experience in web scraping - Can deliver high-quality results quickly - Has excellent attention to detail The project is urgent so I require someone who can work on it immediately and complete it as soon as possible.

I'm in need of an expert to carry an advanced data scraping task on Github. Key project specifics: - The kind of data to be harvested includes not only text content and links, but also user IDs, emails and names. Therefore, this project requires someone with a skill set that allows for scraping beyond the surface level. Ideal Freelancer: - Ability to implement advanced scraping techniques to ensure quality and completeness of obtained data. - Experience in harvesting sensitive information like User IDs, emails and names. - Respectful of privacy laws and legal restrictions regarding data scraping. - Self-motivated, detail-oriented, and reliable. Please be ready to provide examples of similar projects you have comple...

I am looking for someone who whill help me to create Firefox Add-On for basic scraping on a website. Looking for fast delivery. Ready to award today.

I need a skilled web developer to create a website that will fetch and display HTML pages from another website. Here's what the project involves: - Users should be able to view these pages online on our website. - Users should also be able to download these pages as PDF files. - The site should be programmed to automatically update the HTML pages from the other site each time a user accesses a page. - We haven't yet decided how to handle multiple users accessing the same content simultaneously, so flexibility in your approach is key here. Ideal candidates would have experience with HTML5, CSS3, PHP, and knowledge of automated web tasks and conversion of various file formats. Previous experience with handling high traffic i...

I am seeking a skilled Python developer with expertise in troubleshooting to resolve an issue with an application. The main purpose of the application is data analysis, web scraping and automation. Currently, the application has been crashing or freezing right at the startup. The ideal candidate for this job should have: - Extensive experience in Python programming - A background in data analysis, automation and web scraping domains - Proven track records troubleshooting application start-up crashes or freezing - Good problem-solving skills, ability to diagnose and fix bugs efficiently. Your main task will be to identify and fix the issue causing the application to crash during the startup. This is a critical project, so a timel...

I'm looking for someone to develop a real-time human movement speed detection system using Python and a dynamic vision camera. Key Requirements: - Real-time Monitoring: The system should be able to monitor and calculate the speed of human movement in real-time. - Moderate Precision: Speed calculation should be at a moderate level of precision. It's crucial that the system can accurately detect and measure the speed of human movement in a real-time scenario. Ideal Skills: - Proficiency in Python programming - Experience with real-time monitoring systems - Understanding of image processing and computer vision - Knowledge of camera systems and their integration with software Your deliverable will be a well-documented Python program that can calculate and di...

...analysis. Key Requirements: - Data Scraping: The primary task is to extract text data from various e-commerce websites. This includes product descriptions, reviews, and any other relevant textual information. - Data Cleaning: Ensure the scraped data is accurate, clean and ready for analysis. - Data Analysis: This project is focused on data analysis, so experience in this area is a must. The ability to extract meaningful insights and trends from the scraped text data is crucial. Ideal Skills and Experience: - Proficiency in Web Scraping: A strong background in web scraping and working with text data is essential. - Data Analysis Skills: Experience in data analysis, data visualization, and the ability to draw actionable insights fr...

I require an experienced professional to obtain text and images from a blog and store them in a CSV file. The ideal candidate should: - Have experience in scraping content from websites - Be adept at data management, specifically CSV files - Be proficient in handling both texts and images and store in easy way to manage and retrieve A strong track record of similar projects will be a plus. This job requires accuracy and attention to detail. I look forward to seeing your bids.

...a proficient programmer to develop a scraping application for the purpose of extracting text data from NETFLIX. This project is sensitive, considering that the targeted websites demand API keys for access. Accordingly, the ideal candidate should be familiar with both GET and POST methods as well as API integration and management. Experience with data extraction and web scraping from API authenticated websites is a must. Skill requirements: • Web scraping • HEADERS • CUSTOM HEADEARS • STRINGS • URLLIB • Working knowledge of GET & POST methods • Experience with API authentication • Exceptional skills in data extraction, especially text. • loliscript • SilverBullet i need to get a netfl...

I need a Python script to retrain a MobileBERT model for a Named Entity Recognition (NER) task in Tensorflow. The model should be able to detect specific entities in text queries relating to various types of media files. The ideal freelancer for this project would have a solid understanding of Python, machine learning, NLP, and experience with BERT models. Features of the Python Script: - Process text queries obtained from a CSV file (example CSV attached) - Detect entities such as: - Persons - Places - Events (e.g., weddings) - Dates - Number of individuals visible - Media type (Image, Video, Audio, Text) - Detailed type (Interview, Landscape, Close Up, Group, etc.) - Length - Content - Retraining should be based on a provided CSV fi...

I'm looking for a proficient Python developer to create a script that can efficiently scrape active IPs from a text file I will provide. The following specifics are required in this project: - The Skill-set: Strong Python programming skills, experience in IP scraping and working with text files would be an advantage. - Task Details: You need to extract the 'Activity Data' from these IPs. Profound knowledge in network protocols is a must-have. - Output Handling: The activity data extracted should directly be written to a text file. A clear understanding of FileIO operations in Python would be crucial. A successful completion of this project might lead to more future collaborations. I'm looking forward to seeing your propos...

I'm currently looking for an expert who can design a data scraping script for me. However, I haven't decided on which particular website and kind of data (text content, images, links etc) should be scraped yet. Furthermore, the frequency for data collection hasn't been specified. Ideal Skills and Experience: - Commercial experience with Python or JavaScript - Proficiency in web scraping using tools such as BeautifulSoup, Scrapy, or Selenium - Ability to add flexibility for target URLs, data type, and collection frequency Please note: the project details will be finalized upon discussion. Your recommendations are welcome and appreciated. Only apply if you're comfortable proceeding considering these conditions.

I need an expert in Arduino programming to develop a code that connects to an OV7670 camera, recognizes specific patterns (like a person's head) and triggers an LED. Key Requirements: - Use an Arduino Uno or Nano to interface with an OV7670 camera and LED. - The code should have a pattern recognition feature - specifically, recognizing a person's head. - When the pattern is detected, the LED should light up to indicate an event has occurred. Additional Details: - The code should be able to differentiate a specific pattern (a person's head) from other objects or patterns that may be in the camera's view. - This is an intermediate level project, hence the recognition should be accurate enough to detect the specific object...

My aim is to effectively scrape forum posts from community.st.com. Currently, I have a Python-based web scraping code that requires debugging and optimization as the current JSON output presents inconsistencies. I am in need of a developer with: - Strong Python experience - Proven web scraping skills to optimize and debug data scraping code - Proficiency in handling and troubleshooting JSON data - Familiarity with structure will be a plus As a result, the corrected script should deliver complete and well-structured JSON data of forum posts within community.st.com.

My aim is to effectively scrape forum posts from community.st.com. Currently, I have a Python-based web scraping code that requires debugging and optimization as the current JSON output presents inconsistencies. I am in need of a developer with: - Strong Python experience - Proven web scraping skills to optimize and debug data scraping code - Proficiency in handling and troubleshooting JSON data - Familiarity with structure will be a plus As a result, the corrected script should deliver complete and well-structured JSON data of forum posts within community.st.com.

...skilled freelancer who can help me with a unique project involving Raspberry Pis and AWS Greengrass. Your main task would be to develop a system that allows Raspberry Pis to share updates with nearby devices offline. Key Requirements: - The system should be designed to share updates specifically with other Raspberry Pi devices running Raspbian, offline. - The purpose of sharing these updates is to cater to locations with limited internet access. This is essential for our project as it ensures that the devices can remain updated despite the lack of connectivity. - The system should be able to initiate the update process automatically. This means it should be able to detect nearby devices and share the necessary updates without requ...

I'm looking for an experienced data scraper who can extract text data from marketing websites for subsequent data analysis.

I need a professional to scrape specific details from a website directory for a one-time project. - Specifics: The data of interest includes the company names, their URLs, and their expertise. This information is laid out in rows on the website. - I wish for the freelancer to carefully extract this data, ensuring no errors or omissions are made. - The final output is essential to be in a CSV file format. I require this scraping to be done just once, and I do not foresee a need for ongoing scraping after this initial task. As the data is crucial for my business development, I am seeking someone who can deliver accurate and complete results in a timely fashion. Prior experience with web scraping and proficiency in data managem...

Hi, I'm trying to update my workflow. I currently manage a lot of images, and I need to do the following: 1) Bulk scan and assess the images for quality. In the past I've used but this isn't the most accurate method. Sometimes it will miss images that are extremely pixelated and blurry, or filter out good images by mistake. I'm not sure if I should be using something like Amazon Rekognition, Google Cloud Vision, or Microsoft Azure instead? Or if I can save money and still get good results with a local option like OpenCV? I guess it depends on speed and accuracy. 2) I'd also like to be able to scan images in bulk and detect any text. Same question as far as whether or not

I need a data scraping tool to pull business names and addresses from Google and Google Maps. - The tool should be able to extract this information in an organized and comprehensive manner, enabling me to create a database for further analysis. Ideal skills and experience for this job include: - Proficiency in web scraping tools and techniques. - Experience working with Google and Google Maps APIs. - Ability to organize and structure data effectively. - Data to be compiled in an excel spreadsheet - Prior knowledge of extracting business information from online sources is a plus. Looking forward to your proposals.

Title: Expert Web Scraper Needed for Advanced Sales Lead Generation Description: We're in search of an expert web scraper proficient in niche database search techniques and advanced web scraping beyond Google and mainstream platforms. The ideal candidate will specialize in extracting company information from platforms like LinkedIn, focusing on contact details for sales lead generation. Key Details: Target Data: Company Information on LinkedIn Purpose: Sales Lead Generation Responsibilities: Utilize advanced web scraping tools and niche database search techniques to extract company information, emphasizing contact details. Ensure accuracy and reliability in gathering and organizing contact information from various sources. Collabor...

...main functionality would be to forward SMS/Text messages to other SMS, Telegram, and email addresses. Key Objectives: - App development competence in cross-platform development primarily focusing on iOS and Android smartphones. - The app should have the ability to forward incoming SMS/Text messages to other SMS numbers, Telegram, and email addresses. - An eye for detail to design a professional and corporate-looking app to resonate with our company's ethos. Ideal Expertise: - Expert in iOS and Android development - Experience with integrating third-party messaging and email services - Strong graphic design skills to create a professional and corporate aesthetic. Requirements: - app starts with system / smartphone start and run...

I need a Python expert who can create a trading bot for me. This bot will not be tied to any specific trading platform, only related to Indian Stocks but rather designed to be adaptable and functional across various platforms. The bot will need to be able to perform the following tasks: - Data analysis: The bot should be equipped with moving averages, MACD, and RSI indicators for effective analysis and decision-making. - Web scraping: The ability to gather data from various sources is crucial for the bot's functionality. - Automation: The trading bot should be capable of executing trades autonomously based on predefined trading strategies and indicators. Ideal candidates for this project would have: - Profound knowledge and ex...

...a specialty in data mining. - Required Skills: You should be able to comfortably scrape both text and numeric information off a webpage, particularly from Website 1. Your expertise should shine in extracting specific types of data, ensuring highly accurate data acquisitions. - Project Requirements: I don't need all information from the entire site. I am targeting very specific sections for data mining. Therefore, your ability to scrutinize site details and pinpoint the highest quality information will be essential for this project. I am looking to data scrap the real estate agents of 20 suburbs but will do this in smaller projects depending on the cost so if you do a good job I will come back and give you more work. To summarize, this job requires a...

My project requires the assistance of an experienced data analyst or data miner. I'm working on a market research project, which requires the extraction of text data from a specified website. Here are the specific details: - Task: Extracting text data from a website for data analy...experienced data analyst or data miner. I'm working on a market research project, which requires the extraction of text data from a specified website. Here are the specific details: - Task: Extracting text data from a website for data analysis - Output: All extracted text data should be provided in a CSV file Given the nature of this project, prior experience in web scraping, data extraction, or data mining is highly desirable. The ability to accurately extract data and transfe...

I need assistance in extracting or scraping the subscriber data from a large Telegram channel ONLY (NOT GROUP). The ultimate goal is to invite these subscribers to my own channel. Key Deliverables: - Extracting or scraping the subscriber data from the specified Telegram channel - Providing a comprehensive list of the extracted subscribers - Ensuring the subscriber data is ready for easy import into my channel for invitation Ideal Skills & Experience: - Proficiency in web scraping tools and techniques - Experience with Telegram API or similar platforms - A proven track record of handling and managing large volumes of data - Strong communication skills to provide detailed project proposals Please ensure that your application contains a ...

...WordPress developer for making adjustments to an existing data scraping plugin. The task to perform is to skip/skip cloudflare so that the plugin can extract the data without problem I explain: I have a custom plugin in WordPress, which extracts information all right, it turns out that the website activates Cloudflare on its side and that is preventing the plugin from being able to extract the information correctly. What I need: I'm looking for someone who can modify the plugin or do what is necessary so that it skips or bypasses Cloudflare and can extract the information without problem. ? Budget: $10 - $50 - I need it no later than Monday. For an expert it would have no problem solving this. I REPEAT THE PLUGIN IS ALREADY MADE, IT IS ONLY ...

I'm looking for a professional writer to draft a comprehensive, easy-to-follow guide on how to "l7as tizi" for personal use. The final output must be a text-only document. Key requirements include: - Comprehensive: The guide should cover all aspects of "l7as tizi" that are crucial for a beginner to know. - Easy-to-Follow: It should be written in a clear, concise, and engaging manner. Avoid using technical jargon or overly complex language. - Personal Use: The guide is intended for my personal use, so it should be tailored to suit my needs and knowledge level. Ideal skills and experience for this project include: - Proven experience in technical writing or creating how-to guides. - Excellent written co...

I'm looking for a talented...illustrative Instagram graphic for my latest blog post titled "How to Get Your Business Phone Registered to Avoid Spam Labels". Key Requirements: - Minimalistic Design: The graphic should be clean, simple, and in line with a minimalistic aesthetic. - Illustrative Style: I'm looking for an illustration rather than a photographic or typographic design. - Business/Communication Elements: Incorporating telephone or mobile icons into the design is a must. The design should subtly communicate the main theme of the blog post without being overly busy or cluttered. The winner will be asked to provide a Canva template, so please design your samples in Canva. Here's the blog post:

We're looking for a programmer skilled in scraping and converting APIs into PHP or Python code (reverse engineering)! If you have the following skills, join us: 1. Proficiency in JavaScript: Ability to work with this popular programming language and fully interpret and modify codes. 2. Knowledge of Cryptography: Ability to understand and use cryptographic algorithms and methods to comprehend how data is encoded and to transform unencrypted data. 3. Familiarity with Progressive Web Apps (PWA): Deep understanding of PWA structure and methods to bypass installation on iOS. 4. Experience with network monitoring and traffic analysis software such as Fiddler: Ability to use these tools for analyzing network traffic and relat...

I'm in need of a proficient data scraper to pull a list of specific job titles for my list of Property management companies. I already have the Company name, state, street address, and zip code for these firms, but now I need someone to mine the contacts within them. I would like to start with 150 companies but I will need thousands very soon. This will be an ongoing relationship. Specifics include, but are not limited to: - Facility Managers - Construction Managers - Building Managers - Maintenance Managers You should have experience in data mining and web scraping, showcasing a solid understanding of how to extract specific information from given sources. A background in extracting information specifically for real estate in...

I need a Firefox Add-On urgently that can scrape specific text content from a website. The data doesn't need to be saved in any specific format; it's only important that it can be extracted and shown.

...building a Gmail email scraper/notifier. The ideal candidate should have a strong understanding of data scraping and email handling. The aim of the project is to: - Extract and display specific emails from Gmail in a user-friendly card format within an application grid. - The information to display on each card will include part of email body, phone numbers and web links. The phone numbers should be displayed in a clickable link format so that they seamlessly work with a soft phone application like RingCentral without need to use their API. Emails containing web link will have the option to automatically open the link in new tab in default browser. Skills required: - Proficiency in data scraping - Experience with Gmail API - Exc...

I'm looking for a Python developer to assist with web scraping and script automation tasks. Key Responsibilities: - Web Scraping: You need to be proficient in web scraping techniques using Python, specifically with BeautifulSoup. The task will involve extracting data from websites. - Script Automation: Automating repetitive tasks will be another key aspect of this role. Experience in automation is a must. Ideal Candidate: - Proficient in Python with experience in Flask and BeautifulSoup. - Prior experience in web scraping and automation. - Detail-oriented, with the ability to follow instructions carefully. - Open to both experienced professionals and newbies with a strong grasp of Python. Looking fo...