Create Price Scraping Spider (Scrapy Framework) and automate to output daily to an excel spreadsheet -- 2

Completed Posted 7 years ago Paid on delivery
Completed Paid on delivery

We are a small distribution company in the US with showroom customers and web retailers selling our products across North America (Heated Towel Racks) — We need to have an automatic way to scrape websites daily for our product and capture their listed price into a spreadsheet. (Each domain having it's own sheet within the workbook) This spreadsheet should show how much % they are discounted off of our list price, and if they are beyond our threshold (20% and 30%) we need an email to be sent to our sales director listing which sites/models are outside of the discount. We want to be able to add sites in the future, and have basic Scrapy framework knowledge (how to point spiders to the correct css/xpath), so either have a front-end component to make changes or just allowing us to be duplicating and changing selectors/names/domains within a spider.

I have included a PDF with more details

Updated to include original PDF brief

Coding Excel HTML Python Web Scraping

Project ID: #11954192

About the project

26 proposals Remote project Active 7 years ago

Awarded to:

phpXpertbd

Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database More

$500 USD in 10 days
(67 Reviews)
7.1

26 freelancers are bidding on average $600 for this job

mantislin

Dear sir, I am scraping expert, I have did too many scraping projects, please check my reviews then you will know. Can you tell me more details? then I will provide example data/script for you. Thanks, More

$466 USD in 6 days
(276 Reviews)
7.4
cugamelover

I can do exactly what you need. I'm a computer science professional with a PhD degree and extensive experience in automation of data acquisition, processing, analysis, and presentation in Excel using custom dashboards, More

$500 USD in 7 days
(189 Reviews)
7.1
chirgeo

Hi. I have experience with tool that you mention you need and I think I can help you with that. I see that there is no PDF with more description , can you add it? Also, I would like to know how many sites you More

$750 USD in 4 days
(81 Reviews)
7.0
AleenaIlyas

Hello I have read what you exactly need. I would like to ask you a few questions. Please feel free to contact me anytime so we can have a detailed discussion and finalize our budget and timeline. I will deliver in best More

$555 USD in 10 days
(11 Reviews)
6.5
mike199

My name is Mike and I’m from UK. I work with individual clients and also provide outsourcing services for a number of UK and USA based agencies. Your project description sounds interesting to me and I do have skills & More

$555 USD in 10 days
(33 Reviews)
6.7
mmadi

Dear Client, Greetings from Flowgica technologies, I have experience with these skills. We do have similar experience doing something similar to yours therefore I am looking forward to discuss and move ahead. please ch More

$450 USD in 12 days
(22 Reviews)
6.7
alwaysanshuman

Hi, this is Anshuman. I have 6 yrs of experience in scraping, crawling, processing and mining data. My previous projects include- [1.] Automated Crawling of Google for SEO Keywords [2.] E-Commerce Crawling. Crawli More

$555 USD in 10 days
(48 Reviews)
7.0
dpune

Hi, I have more than 14 years of web scarping exp and I am expert in this kind of work. I have completed more than 290 projects. Please look at the feedback left by my employers to know more about my work. More

$750 USD in 10 days
(127 Reviews)
6.3
yogeshssanwal

Hi there - My name is Jhalak. I’ve read your brief and can see that you’d like to build an Website. My team has years experience designing and developing mobile apps and Websites as well as SEO.I would approach your p More

$1388 USD in 10 days
(176 Reviews)
6.7
DesignIntellect

Ready to start. Please open a chat session to discuss the details..............................................

$555 USD in 10 days
(5 Reviews)
4.7
manmande

Hi, I have experience in python and webspider project, also I have scripts to send emails to customers automatically. You can send me your pdf file and let me check the details. Let me help u with ur work~

$555 USD in 10 days
(1 Review)
3.5
chbchb55

I have been writing Python Code for 3-4 years now and I have become fluent in it. I have also built multiple web scraping tools in the past. If chosen for this project I am willing to work diligently in order to comple More

$500 USD in 2 days
(1 Review)
0.6
seohelp71

I believe I am the best candidate for this project. Please share your budget and time frame. Get your project completed in your budget and timeduration.

$250 USD in 10 days
(0 Reviews)
0.0
toportman2001

Hi, I can make this in Python+Scrapy. A front-end webpage can be used for configuring XPath/Selectors or Regex if required. This will be admin area, which will modify XML setting files of the bot. Please send PDF More

$805 USD in 15 days
(0 Reviews)
0.0
sherifelhefnawi

A proposal has not yet been provided

$277 USD in 1 day
(0 Reviews)
0.0
simar242

I will create a simple and elegant solution to the given problem and will write clean, generic and error free code and will test it completely before delivering the software. The code written by me will adhere complet More

$444 USD in 10 days
(0 Reviews)
0.0
hsottany

Working With US clients Good Knowledge On Scraping You may test my skills before awarding the product I can provide you the small demo for your product

$555 USD in 10 days
(0 Reviews)
0.0