548034 Product scraping/mining scriptwriter expert wanted
N/A
Paid on delivery
We are in need of a data mining script which runs on a monthy base.
The data comes from a suppliers website where all products can be called through a simple procedure.
We want the script to collect all the products for us and insert them into oscommerce webshop database.
First will be in development server to test, when approved will be on live site.
script has to login and collect:
EAN code
Title
Description (display in HTML)
price
EGS Code (category code for which a list is provided)
The images are already available on our server, all images are linked to product-id, so product-id 123 has [url removed, login to view] as image
EGS code explained: We need a way to process the id's into normal category structure. Now is like 23-45-67 means maincategory-sub-sub. The script must replace the numbers with the text given. This conversion list will be emailed.
There are a total of 1.3 million products to scrape/mined, so we need a way to do it in parts and also re-run the script every month to check for updates and insert there accordingly.
We cannot show the suppliers website here as you can understand so please give pm and we will show you the url and what we need.
Project ID: #2293978