Data scraping from 3 Dutch websites
€30-50 EUR
Paid on delivery
Hi!
For marketing research we need to collect public data form three websites.
REQUIREMENTS MUST HAVE
* PHP as programming language
* Use CURL library for HTTP requests
* PHP script should be run in commandline
* Efficient crawler to minimize number of requests
* Store data in MySQL database
* Configuration part in the script which sets database user/pass/dbname and other settings in one place
REQUIREMETS NICE TO HAVE
* Possibility to extend with new websites
* Possibility to stop the script and to continue where is left off. Do not crawl already crawled data more than once.
FIELDS TO SCRAPE AND STORE
source_website = name of the website
scrape_url = url where data form scraped from
contact_name
visit_adress1
visit_zipcode
visit_city
visit_country
post_address1
post_zipcode
post_city
post_country
phone1
fax1
website
company_name
company_vat_number
company_coc_number
company_description
company_url_logo
company_size
company_start
member_from
member_status
category
DELIVERABLES
* Database structure for MySQL tables.
* One PHP script, which can be run in command line. This script fills the database with data from the websites.
PAYMENT
* 2 milestones; 1) 50% when script is running and working and 2) 50% when everything is checked to be working properly.
WEBSITES
== 1 ==
Index page:
[login to view URL]
Data page:
[login to view URL]
Data example:
* URL to company logo
* URL: [login to view URL]
== 2 ==
Index page:
[login to view URL]
Data page:
[login to view URL]
Data example:
* URL to company logo
* [login to view URL]
== 3 ==
Index page (use the # A B C D … subpages for all entries):
[login to view URL]
Data page:
[login to view URL],CompanyId
Data example:
* [login to view URL]
* [login to view URL]
Project ID: #1053510
About the project
Awarded to:
Hello! i read your project details, i`m familiar with CURL and done similar projects, check PM please for more info.
14 freelancers are bidding on average €131 for this job
We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.
