Closed

Enhance or Build a Scrapy scraper

Scrape a real estate website for all properties and agents

Utilizing Scrapy & Scrapinghub

You may utilize an existing scraper built-in Portia and exported to Scrapy or build your own from scratch using Scrapy

All fields to be scrape will be provided

• Scraper must be efficient

○ Don't check every URL on the site

○ Fast to find items

• Scraper must be accurate

○ No false negatives with regards to duplication

○ Limited or no duplication

○ Field values are populated if they exist

○ Field values contain correct data

• Scraper must include a data sanitation pipeline

○ Scraper will output to a file any item removed

• Scraper must include a pipeline to feed to a Wordpress site via a custom API

○ Feed properties into WP site with no dupes and correct values in fields

○ Feed agents into WP site with no dupes and correct values in fields

○ Associate agents to properties utilizing an existing property field

○ Upload images and associate to property utilizing existing WP field

○ Upload images and associate to agent

○ Export a list of statuses, types, locations, etc. that did not match

• Source Controlled Codebase

• Before payment

○ Scraper must run on the entire site at least once for results to be verified

Spot checking will be performed to ensure accuracy

First complete the scraper logic then complete the pipelines

Skills: Data Scraping, Python, Scrapy, Web Scraping

See more: scrape wordpress list, scrapy scraper, scrapy image scraper, python scraper scrapy, scrapy website scraper examples, scrape scraping mining spider scraper data extraction parser parsing harvest harvesting collect collection, scrape scraping mining spider scraper data extraction parser parsing harvest harvesting collect, scrape scraping mining spider scraper data extraction parser parsing harvest harvesting, scrape scraping mining spider scraper data extraction parser parsing harvest, scrape scraping mining spider scraper data extraction parser parsing, scrape scraping mining spider scraper data extraction parser, scrape scraping mining spider scraper data extraction, scrape scraping mining spider scraper, scrape scraper scraping, scrapy scraper python, scrape google using google scraper websites, wordpress drop list posts, wordpress mailing list tribulant, wordpress display list posts dropdown, query wordpress database list posts, wordpress multicolumn list, locate wordpress pages list, wordpress drop list sidebar menu, build database scraper, wordpress sidebar list categories subcategories

About the Employer:
( 5 reviews ) Anytown, United States

Project ID: #15044239

9 freelancers are bidding on average $62 for this job

mantislin

Hi sir, I am scraping expert, I have did more than 350+ scraping project, please check my feedback then you will know. Can we discuss more details about this project? then I will provide example data/scr More

$50 USD in 1 day
(174 Reviews)
7.0
bestfreelancer52

We are interested in offering our Web Scrapping services for this job requirement. We specialize in web scraping jobs like this one. Waiting for your responds to send you a sample list . Relevant Skills and Experience More

$100 USD in 10 days
(70 Reviews)
6.6
furqanorpiv

Hi, I am  FURKAN a CERTIFIED WEB SCRAPPING EXPERT .   I would love to provide you Quality data by Scraping Real Estate Website with full information of Properties and Agents as per your requirements. I can complete y More

$15 USD in 1 day
(41 Reviews)
6.1
imraz2016

I'm a very experienced Web developer in .Net. I am a web scraping expert and developed a very dyamic web application to do complicated scraping [url removed, login to view] Relevant Skills and Experience Data Scraping, Python, Scrapy, More

$50 USD in 10 days
(50 Reviews)
5.1
farooq4161

Its my daily job to make website scrapers, I have already made 100+ scrapers of different websites. I can make any website scraper within 4 hour. Relevant Skills and Experience I have Master degree in Software Engin More

$50 USD in 0 days
(30 Reviews)
5.0
schoudhary1553

Greetings sir, i am an expert freelancer for this job and your 100% satisfaction is assured if you allow me to serve. I can do this task as per your requirement Relevant Skills and Experience I have the 5 years of ex More

$100 USD in 2 days
(11 Reviews)
5.0
OvaisNazir

Hello, i have reviewed your job description, i can the required real estate website and extract all the needed database of properties, agents into any format so please message me Relevant Skills and Experience i have More

$45 USD in 3 days
(7 Reviews)
4.5
startechoffshore

Proposed Milestones $50 USD - on completion of project

$50 USD in 10 days
(1 Review)
1.5
attsoftwarellc

Hi employer, Hey, I am Rishi I have experience of fetching information and images from dynamic websites and save processed results parallelly into database/Xls/CSV etc. Relevant Skills and Experience Some sample of wo More

$100 USD in 5 days
(0 Reviews)
0.0