Hello. I can make it for you in shortest time.
I've made professional tool for Web Crawling and parsing in Python (executable version also - 32 and 64 bits), also i have modules to populate posts.
1. Multi Threading. (parallel execution)
2. Very Simple Crawl rules language. (Based on XPath and CSS. I'll send you examples in private message).
3. Automatically store crawl results into any database system or other data format to filesystem (html,csv,xml).
(Oracle, MySQL, MSSQL, MSACCESS, DB2, PostGres, FireBird, etc)
There is some custom modules (from opensource projects) and support for python sqlalchemy.
Also it will create database structure with all tables if they do not exists.
4. Proxies. SSL. (with custom user-agent header, cookies, auto-redirect etc).
5. Any encodings support (with auto detecting encoding of website and content).
6. Cache support (for web content with auto refresh by expiration time)
7. Auto-login on web-site (automatically find and fill the login form).
+ Captcha detection + Allow to enter captcha :
With user dialog or
Web site. Send captcha to website (post image via url post) and waiting for answer (so anyone with access rights can enter it).
All settings stored in parameters file.
Finished projects (using PyWebCrawler) :
booking.com. All Countries and Hotels information+images.
market.yandex.ru. All categories, goods, their descriptions and pictures.
and many others.
My profile : http://www.freelancer.com/u/kamosion.html.