548034 Product scraping/mining scriptwriter expert wanted

In Progress Posted Jan 27, 2012 Paid on delivery
In Progress Paid on delivery

We are in need of a data mining script which runs on a monthy base.

The data comes from a suppliers website where all products can be called through a simple procedure.

We want the script to collect all the products for us and insert them into oscommerce webshop database.

First will be in development server to test, when approved will be on live site.

script has to login and collect:

EAN code

Title

Description (display in HTML)

price

EGS Code (category code for which a list is provided)

The images are already available on our server, all images are linked to product-id, so product-id 123 has [url removed, login to view] as image

EGS code explained: We need a way to process the id's into normal category structure. Now is like 23-45-67 means maincategory-sub-sub. The script must replace the numbers with the text given. This conversion list will be emailed.

There are a total of 1.3 million products to scrape/mined, so we need a way to do it in parts and also re-run the script every month to check for updates and insert there accordingly.

We cannot show the suppliers website here as you can understand so please give pm and we will show you the url and what we need.

Data Mining Data Processing eCommerce MySQL Odd Jobs OSCommerce PHP Web Scraping

Project ID: #2293978

About the project

Remote project Active Jul 11, 2012