consultancy for large database project

We have a large database project that we are struggling with and we need some help. Basically we are a bit out of our depth with it - we need someone to help us who has worked with incredibly large databases before. We have a database of 100,000,000 records (seriously!). This is currently in a MySQL database and we have a good guy working on it already. We're just after someone who can help us do the following: - take the raw data, which is a series of text files, parse them and input them into the database. WHAT is the best way to do this? Both in terms of database set up and in technology - The BEST way for us to build this in MySQL - We were thinking of using PHP to access this database, but we need help with how we process it. We also ONLY use Linux servers, so NO Microsoft people please So, in the first instance I would be very interested in speaking with someone who can do the following: a) Demonstrate that they have done this kind of thing before including references b) Give us some loose (not specific as thats what we're looking for a consultant to help us with!) thoughts on how you would strategically do this and assist us I look forward to talking with you ## Deliverables 1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables): a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment. b) For all others including desktop software or software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request. 3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement). ## Platform Linux