Web crawler data scrap jobs

I own a business and I'm in need of a sourcing agent who can help me purchase a minimum of one 20ft container load of copper metal scrap from the Democratic Republic of the Congo. This task needs to be completed within a month. • Task: Secure a supplier of copper wire scrap in the Democratic Republic of the Congo • Quantity: Minimum 1 - 20ft container • Timeline: Must be completed within a month The candidate should possess: • Proven experience in sourcing and procurement • Strong negotiation skills • Knowledge of copper scrap market in the Democratic Republic of the Congo • Ability to deliver within the stipulated timeline.

...the integration of a web crawler that will search and gather coupon codes from various online sources. Key Requirements: - Development of a coupon code aggregator website - Integration of a web crawler that will search for coupon codes on a daily basis - A search bar where users can enter websites like they are browsing normally and coupon codes will be applied similar to how microsoft edge or Honey does it - The website should have the functionality to automatically apply coupon codes to a shopping cart - Ability for users to sign up and receive daily coupon codes and deals - Ability for the website admin to be able to add deals or coupon codes sourced from advertisers/partners - Payment functionality Ideal Skills and Experience: - Proficiency in web...

Hi! Your job 1. Go to a website (url in brief) every day to every other day 2. On that website click a link to open another website. This website is NOT live/active yet. 3. Open the list of names we have (about 30 names) 4. If one of the names from our list is listed on the website then send an email to us (not to the person) 5. Allow us to add names to the list, change where the email is sent, change body of email and when the scraping starts/stops as well as frequency (daily or every other day).

i need a backend preferably in nodejs. one endpoint. that submit some birh date data. then the backend should request the html from anotherwebsite, fill its form click on submit get the data and send them

As a detailed-minded individual who needs precise data for my endeavors, I am currently in need of enthusiastic freelancers with a specialty in data mining. - Required Skills: You should be able to comfortably scrape both text and numeric information off a webpage, particularly from Website 1. Your expertise should shine in extracting specific types of data, ensuring highly accurate data acquisitions. - Project Requirements: I don't need all information from the entire site. I am targeting very specific sections for data mining. Therefore, your ability to scrutinize site details and pinpoint the highest quality information will be essential for this project. I am looking to data scrap the real estate agents of 20 suburbs but will do ...

...scraping and converting APIs into PHP or Python code (reverse engineering)! If you have the following skills, join us: 1. Proficiency in JavaScript: Ability to work with this popular programming language and fully interpret and modify codes. 2. Knowledge of Cryptography: Ability to understand and use cryptographic algorithms and methods to comprehend how data is encoded and to transform unencrypted data. 3. Familiarity with Progressive Web Apps (PWA): Deep understanding of PWA structure and methods to bypass installation on iOS. 4. Experience with network monitoring and traffic analysis software such as Fiddler: Ability to use these tools for analyzing network traffic and related information, including identifying and addressing PWA activities. 5. Experience wi...

Need someone to develop an app for my business, will need a lot of codes for my products to be able to look up and change according to the markets and live markets. It’s for my scrap business. Also want a website as well for my business.

I am in need of a data mining expert proficient in Python, machine learning, and Selenium to facilitate a data mining project. If you are interested, so there would be 2 contract fix rate $50/country flow, and $3-5/hr for code's maintainance. Depends on your profile’s experience. $10/script for easier works (like scrap-data transferring between GS&SQL), - Purpose of the project: The primary objective is to extract valuable information from a large set of data. The specific type of data to be mined will be shared with the successful candidate. - Skills and Experience: - Proficient in Python - Hands-on experience with Selenium - Thorough understanding of machine learning algorithms - Experience in handling large s...

Our corporation is seeking a qualified professional specialized in advertisement posting on Alibaba.com. The ideal candidate will have a background in advertising agricultural, scrap, industrial, electronics, and automotive products. A comprehensive understanding of the platform is critical along with a proven ability in reaching a wide target audience including consumers, wholesale buyers, and retailers. Proficiency in writing engaging ad content and monitoring ad performance are assets.

I'm looking for an experienced developer to build me a tool that can scrape specific data from YouTube videos based on the presence of a single word in the video transcript. The tool should: - Check the transcript of YouTube videos for the presence of a specific word. - Return the video title, description, and number of views of videos containing the word in their transcript. Ideal skills for this project: - Proficiency in web scraping and data extraction - Good knowledge of YouTube's API and data structure - Experience with Python or a similar language - Ability to create functioning, user-friendly tools for data mining This project is perfect for someone who's interested in data analysis and content curation. If you're exc...

I'm looking for an experienced crawler specialist to help me crawl databases, and specifically collect certain datasets. Key Project Requirements: - Crawler Type: The focus for this project will be on databases, not websites or APIs. - Objective: The primary goal is to extract specific datasets from these databases. - Data Format: The extracted data should be delivered in CSV format. Ideal Skills and Experience: - Proficiency in database crawling and data extraction is a must. - Previous experience in collecting specific datasets from databases is highly preferred. - Familiarity with working with CSV data format. Please share relevant experience when bidding.

Hi Amir N., I noticed your profile and would like to offer you my project. there is male and female data We need to scrap person data including phone number No matter how many people. My job only lasts for half a year. 100,000 data. Half a year. 100,000 data. It doesn’t matter whether you’re a man or a woman.

I'm seeking a meticulous and experienced professional in Octoparse to construct a responsive web crawling template. This crawler will be solely focused on an eCommerce platform, aiming to capture extensive product information. Key Responsibilities: - Capture specifics like the URL, category, and SKU for every product. Ideal Candidate: - Knowledgeable in Octoparse. - Proven experience in data mining and web crawling. - Detailed understanding of eCommerce platforms and product specifications. - Ability to maintain precision across multiple product categories and large datasets. I look forward to seeing your proposals and discussing this project further with you.

I'm looking for an experienced web crawler developer to build a tool for me. This tool needs to be able to extract text content and links from various websites. I need data from the whale watch section of The full crypto address within the links should be associated with their name counter part in a spreadsheet or organized file. I have included a highlted picture demostrating the fields I need. They should be done for the full 6 pages. Requirements: - Experience: Please detail your experience in web crawling and provide examples of previous work. - Delivery: The extracted data should be delivered in a spreadsheet file. It's crucial for the freelancer to have in-depth knowledge of web scraping and data extraction. The tool...

I am seeking an expert to build a web crawler specifically suited for extracting a broad range of data from social media platforms. The unique objective of this project is to efficiently and accurately amass textual content, images, links and more from social media sources. Specifically, the project will revolve around: - Gathering user posts and related content - Documenting user interactions, encompassing likes, comments, and shares - Extracting comprehensive details from user profile Ideal candidates for this project will have: - Proven experience in Data Extraction and Web Crawling - Knowhow of Social Media platforms and their structure - Proficiency in programming languages used for web crawling - Excellent attention to detail an...

I need to scrap and send DM or massage to people in facebook, telegram and instagram

Hello, I need a complete professional in scrap, java, python flask, composer. more details in private

I am seeking an expert capable of creating a highly detailed and intricate graphic line art rendition of a lattice boom crawler crane with a luffing jib (two independently controlled booms). This rendition must strictly capture the exterior features of the equipment ( there's a lot). Your focus should also be on all the components that make up the crane. I am open to starting with a more basic line art (outline) and seeing what we need to add. This would be the first design for a construction apparel line You need to have a meticulous eye for detail and at least have a portfolio that showcases any automotive art.

Hey everyone, i search someone who can do a task for my existing Wordpress Website. Actually i scrap every morning the data from soccer results from a website with WINHTTRACK and upload this to my website. Now i need automation. - Data Scraping from other website to my website - Data Refresh every Day 7 o'clock - 1:1 Copy with Design and my login - Only 3 Site ! I provide wordpress test access. On This access u can build a scraping automation. I can migrate myself. THANKS :)

Provide old leads interested in doing online courses, Scrap data from LinkedIn or any social media or any educational websites, but interested in doing Job oriented courses

...creating a customized web crawler for eBay and AliExpress. The primary function for this crawler will be to accept a list of keywords of any length and return specific data about those products. Here's what I need in detail: • Find top hot selling products at any given time • Crawl eBay and AliExpress for specific product data based on entered keywords. • The data retrieved should include product names, quantities sold and locations of sellers, images, • The crawler should be capable of providing this information for a variable timescale, ranging from 1 to 30 days in the past. • The results should be sortable. Php or python preferably The task would best suit a freelancer with previous experience de...

I need a capable team to help kickstart my new scrap business's online presence. The primary goal is to boost web traffic by both improving search engine rankings, and generating new leads. Required functionalities for the website include: - Product catalog and ordering - Live chat support - User profile creation I am seeking help with strategic online marketing targeting local customers and those in a specific industry niche. Ideal freelancers have strong experience in SEO, SMO, and PPC, along with skilled web development capabilities to incorporate the necessary functionalities onto the website. Their adeptness in creating targeted marketing campaigns and strategies is essential.

I'm looking for a skilled professional who can crop the complete content of a website and save it in a zip file to be deployed on a new server. The website is a small Wordpress with about 41 pages (as per sitemap). Content must not be saved as Wordpress, but static html to be deployed on another server. Key Requirements: - Crop all website content including subpages. - Save the cropped content in a compressed zip file. - The purpose of this cropping is to save the content for future use. - all files must be included, esprecially but not limited to images, js, css, ... - inner paths must be relative paths. If you're confident in your ability to deliver this and can ensure all the content is correctly saved, please bid accordingly. IMPORTANT READ THIS: Auto-generated bids wil...

I'm in need of an expert who can execute a data mining project whose goal is the extraction of both textual and numerical data from various websites. This extracted data will be used for research and analysis purposes. Ideal Skills and Experience: - Strong experience in web scraping and data extraction - Proficiency in data mining techniques and tools - Excellent knowledge of textual and numerical data handling - High attention to detail - Experience in data analysis Responsibilities: - Scrap websites and extract required textual and numerical data - Ensure accuracy of extracted data - Organize and deliver data in an accessible format.

I'm looking for an expert to design a web crawler to extract email addresses from specific company websites. The ideal candidate should be experienced both in web crawling and email data extraction. Key Tasks: - Crawl targeted company websites for email data extraction - Ensure the accuracy and integrity of all extracted emails Skills and Experience: - Experience with web crawling and data extraction technologies - Proven track record in email data extraction - Excellent analytical and problem-solving abilities - Familiarity with common web interrogatories for more efficient data capture is an asset - Strong attention to detail in order to capture complete and valid email addresses The successful candidate wil...

As the titel describes, I want to hire one freelancer to scrap out these following data: Compan ynamne/phonenumber/email from this website: Their is 10 146 companies i want to collect data from. All of them! Thanks

In this critical project, my objective is to work closely with an expert in web scraping who will establish an effective daily automated scraping system from Website A. The focus of this scraping will be: • News articles: Leveraging tools for expansive retrieval of the articles and their related details. The purpose behind this data scraping and database management task is to: • Collect data for Scrap purposes The ideal candidate possessing skills and experience in: • Proficient in web scraping. • Expertise in automated systems for scraping. • Excellent knowledge of database management and updating. • Experience with Website A scraping will be advantageous. Upon successful scraping, the data will be systematica...

As the project lead, I'm seeking a highly skilled developer to construct a Scrapy web crawler for multiple sites. Although I omitted website specifics for now, rest assured we will provide the necessary details post-engagement. The ideal candidate is capable of: - Building an optimized web crawler with Scrapy - Extracting text data proficiently from various web pages, accurately and efficiently For the application, please provide: - Detailed project proposals outlining your approach Experience in web crawling design and Scrapy framework are a must for this project. Your technical capacity to generate the explained particulars is critical for success here. This is a golden opportunity to exhibit your proficiencies and contribute t...

We are seeking someone to create multiple promotional videos for our company, which will be continuously displayed on the TVs in our store. The television faces towards the street, meaning people passing by or driving past should be able to read it. We operate a gold buying business. The promotional videos should include information such as: We purchase: Scrap gold (photos of scrap gold) Fine gold (photos of gold bars) And more, with captivating animations. Can you create something like this for us? Stock images can be used for visuals. The ultimate goal is to create captivating, memorable videos that will imprint our brand in the minds of the general public. This project will require both imagination and expertise in marketing techniques. I'm excited to work with a c...

...and feel of dirty, rugged and battle-worn. Vehicles should be simply rigged and have at least 1 usable entry point for player to access cockpit (for sequences and game-play). No need for rotating turret heads, Gunn barrels, wing flaps, wheels, etc. List of vehicles: Light Fighter/scout Tank Heavy tank Stationary Turret Heavy bomber Walker/mech Tug Howitzer Scavenger (picks up destroyed unit scrap for building material) Mobile building construction unit...

...50 Tons LDPE plastic rolls per month from USA. We need some one who can find ideal vendors who have a proven background in large scale LDPE sales. Familiarity with policies and procedures for transporting bulk goods, knowledge on various quality grades of LDPE, and a commitment to long term sustainable business practices. The right partner can research and find vendors who are selling these scrap/used LDPE rolls. The idea is to find this vendor and then start with a sample batch of rolls and then start a routine business of qty 50Tons per month....

I need a python project to scrap all public groups related to a keyword and join and comment publish something on the group.

I need to scrap an airtable document. this document. for info the table's owner has disabled copying. there is 5316 records. More details: Is this project for business or personal use? Personal What specific information or data do you need to scrape from the Airtable document? Text content How do you plan to use the scraped data? Analysis or reporting

I'm looking for developer to build automation to scrape web page information to Airtable (or Google Sheets), so that I can later upsert it to Pinecone vector database. Total 4 pages: This is the information I need from the laws to Airtable. Text is Finnish but all pages have almost same structure, so no need to understand the content: Name of the law, Number of chapter, Chapter title, Number of clause, Clause title, url link, Clause text". template is provided Dokumentation provided for possible scipts, functions and variable used on the automation Possible external

...://www.facebook.com/oefabc/&docid=bW04nRkl5sarEM&w=1631&h=1631&hl=en-US&source=sh/x/im/m1/3&kgs=944815503abde356&shem=abme,trie Key Design Elements: - Main Colors: Blue, Yellow, and White. Certainly, the combination should reflect intensity, energy and teamwork. Ideal Candidate: The perfect freelancer will have a significant experience in logo designing, specifically for sports brands. They should also have a deep understanding of color theory and be able to deliver high-quality designs in a tight timeframe. Your Task: - Design high-quality logo, using the specified colors - Delivery required ASAP - Final product should be optimized for different platforms-print, web, within-stadium display

I'm seeking an experienced freelancer to develop a script capable of accurately extracting vehicle tax data from 'a website'. The program should be adaptable, allowing for export in various formats per requirements. **Core Task:** - Create a script to scrape 'a website' for specific data. **Data Points:** - Vehicle registration number - Vehicle make and model - Vehicle tax amount,etc **Output Requirements:** - Script must allow data export to be configurable (CSV, Excel, JSON). - The script should allow proxy configurations - The script shoud be able to update each record once in every 3 days. ( to be scheduled in cron ) *** VERY IMPORTANT *** - You will deploy the script in a given VPS - We'll need to see the script working to ...

I require an IAM role with specific permissions to interact with s3, glue, and Athena on AWS. This role will allow for efficient management of the AWS stack, specifically enabling the creation of a crawler to populate a glue catalog database and tables, and also allowing interaction with an Athena workgroup. What I need: - Read-only access: This permission should allow the IAM role to view S3 bucket contents, view Glue catalog information, and view Athena workgroup details. - Write access: This level of permission should enable the IAM role to create or update tables in the Glue catalog and modify Athena workgroup settings. Ideal Experience and Skills: - Solid understanding of IAM roles and permissions on AWS - Experience with AWS s3, Glue, and Athena - Capability to work on AWS I...

I need an experienced and proficient website crawler who can help me extract Text content from Database Tables on my website. Key requirements: • Acing in finding, fetching, and structuring data. • Proficient in delivering the retrieved data in Plain text format. • Emphasis on fetching Text content from the Database Table, thus understanding of database structures is a must. Ideal skills include web scraping, data mining, and database understanding. It would be best if you had an eye for detail as accuracy is key in this project. With your expertise, you should be able to navigate through complex website layers to get to the desired content.

Hello all, I want to create a tool that creates content for me. The tool would have the following flow: 1. Scrapes relevant predefined sites for content (AI, Freelancing, ...form and short form pieces of content (1500 words roughly and 75-200) Additionally: 1. If possible, sends those scripts to my Heygen API, which is an AI avatar creation tool 2. Produces finished pieces of content that can be published to social (Maybe publishing API like Hootsuite, Buffr or similar) Questions: 1. What is your experience doing something similar 2. How are you planning to scrap content, as I think that this will be incredibly challenging 3. Do you have additional recommendations to enrich this tool (Optional) 4. What is your price Please answer all questions to be considered, ...

...agreements with mines , mining finance opportunities, parcel hedging and finance funding, the company is privately owned with th access to funding from banks . This is a new venture for the company - they have limited experience in base metals. They are experienced in soft bulk commodities. They trade small scrap at present . Perhaps Expand the scrap yards - refine the metal at souce ,Ali refinery , copper smelter, nickel smelter - refining thr product at souce would give more wadded value to the scrap as a Product . -Potential freelancer should not only have proficient skills in business plan writing but also have a solid understanding of the base metals industry. -Awareness and experience with small scaled businesses and their unique challenges will be an added a...

I am looking for a website for my scrap business that will serve as an informational resource for potential customers. While I don't have a specific design in mind, I do have some general ideas about the layout and style I would like to see incorporated. Additionally, I would like the website to feature a contact form so that interested parties can easily get in touch with me. Ideal candidates for this project should have experience designing and developing websites for small businesses, and be able to provide suggestions and guidance on design choices. Familiarity with integrating contact forms is also a must.

I'm looking for a creative designer to create a logo for DeScrap, my business focused on recycling and upcycling products. Our logo needs to reflect our eco-friendly mission and appeal to everyone who has scrap to dispose of. Ideal Skills and Experience: - Proven experience in logo design - Knowledge about environmental topics and sustainable design - Ability to translate brand identity into visual elements Responsibilities: - Create a unique, simple, and easily identifiable logo - Present the logo in various formats This role is perfect for someone petrified by the idea of waste, nurturing an innovative mind and passionate about eco-conscious initiatives.

We are in need of a knowledgeable and skillful programmer who can edit on GoLang code. The main task involves Ethereum network crawling. We already have a running code to crawling the Ethereum network. However, we still need to do some changes on GoLang code (designing crawler), such as partition the ID_space into sections, and crawl using multiple crawlers in Ethereum not only single crawler as what we have. In addition, there might be more few changes on the code. The ideal candidate will: - Understand DHT-based network and Kademlia - Knows a little about Ethereum (blockchain) - Have experience in GoLang - Possess a deep understanding of DHT network crawling (p2p) - Have previous experience with crawling networks Your responsibility will be building on top of running code...

I'm seeking a talented developer with experience in AWS Lambda, Python 3.12, Selenium, and Chrome WebDriver to ****create a docker file**** that effic...the Docker to scrape URLs from a website, for instance, google.com. - Using Python 3.12 as the programming language and Selenium alongside Chrome WebDriver in headless mode for web scraping. Ideal Skills: - Proficiency in AWS Lambda, Docker. - Good command of Python 3.12. - Experience with Selenium, Chrome WebDriver. - Understanding of web scraping best practices. - Capability to work with headless browsers. Your expertise will make this project a success! Briefly: just need a docker file which can deploy as aws lambda container. This docker file uses python, Selenium, chrome driver to scrap website. You c...

Tasked with a data scraping project to extract extensive information about all courses from 400 different university websites. I require specific course details, including eligibility and admission criteria for international students. Freelancers willing to bid should have the following: - Robust skills in data scraping - Familiarity with different university websites - Ability to pull out important information like course details, admission information etc. - Capacity to handle a large amount of data Expectations: - Scrap text content, images, and links where appropriate - Compartmentalization of data for each course from each university - Seamless extraction of data in a time-sensitive manner Kindly ensure all the course information is inclusi...

HI, I wanted to read vcf files from folder and scrap data fields into csv file 1 file will be add as new row in csv file wanted to scrap fields mentioned in screenshot attached in chat. approx. 19 important fields: as follow 1-Title,2-First name,3-Middel Name,4-last name,5-Suffix,6-company,7-job title,8-file as,9-email,10-website link,11-business phone,12-home phone,13-business fax,14-mobile, for business address 15-street,16-city,17-state,18-zip,19-country

Requiring a candidate with excellent data scrapping skills and a firm understanding of CSV file formatting for a customised project. The task, at its core, involves fetching specific data points from an EAN (Product Code) list file obtained from an online URL. The upcoming task specifics include: - Scrap data from the identified EAN list online, including Product Name, Product Price, Product Description, Image Link, Brand, and Category. - Organise and present the data in a comprehensively structured CSV file. The ideal candidate should possess a keen understanding of web data extraction, CSV file formatting and the ability to work accurately with online URLs. Prior experience in projects involving EANs (Product Codes) or related fields is ...

Collect data from Ig and TikTok

I want to scrap all the french leads of the website. I have only a free trial and i want to download the 300.000 leads. Domain, Platform, Estimated Sales, Created, adress email, employees, phone number, estimated sales, linkedin,

Google Jobs Scraper project requiring skills in .NET, Python, Selenium and SQL. The task is to create a crawler to extract job listings based on predefined queries, manage the data in a structured manner, and provide an interface for controlling and monitoring the scraping process. The solution requires adept handling of rate limits and the use of rotating proxies for efficient data scraping. Data To Be Scraped: - Scrape all specified job listing data points. - Store and manage the scraped data in a SQL database for effective access and organization.