amazon screen scrapping and magento db (project not suitable for anybody)

im looking for a skilled developer to help archive the following, please include relevant information about the project in your bid OR YOU WILL BE COMPLETELY IGNORED 1) Introduction Our Business consist in resell Amazon products in a specific country, for this we screen scrap Amazon's : Price (from "new" offerlist based in some rules), Shipping Weight, Product Dimensions and Stock availability. This information is vital and needs to be updated in order to output the right price for the Magento platform, so once we get this information we use it in together with a Excell formula that give us the price we need to insert later in the Magento DB. 2) Current Technology Manually scrap from 3 different machine/ip's let us get updated for 250.000 products every 3 days, we use php script with dead by captcha feature. 3) What we looking for We need to update price/availability automatically in the Magento DB upon customer visiting the product link (real-time update), so he can be able to visualize the price (processed price based in our needs and formula) 4) Problems we might face - Since the process would scrape information and update the DB, there would be a considerable delay for the product page loading - Once we update the DB, the price and other information might still not be updated instantly due to magento cache and indexes - Amazon blocking or amazon throttling 5) Technology to consider Proxies with IP rotation to avoid being detected as bots. Use python with wget, scrapy, urllib and other tools to fetch webpages and parsers like HtmlXPathSelector, regular expressions etc to extract information from the html. 6) Other possible solution Provide us with updated Price/Shipping Weight (in pounds)/Dimensions/Stock Availability on daily basis, this option might not be suitable if you don't have the right hardware or scrapping technology. Out DB consist in 250.000 Sku's/ASIN and its growing every day, that's why live-update solution fits better.