185442 Bad Link Crawler

Completed Posted Dec 11, 2007 Paid on delivery
Completed Paid on delivery

Starting with an input URL or list of URLs, this script will crawl the web checking for links to non-existent domains. We can discuss what kind of limits or delays would make sense (i.e. whether to run for a certain amount of time or process a certain number of links or depth of links or certain TLDs etc.). Ideally this can just run continually.

We should have an efficient scheme to identify unresolved IPs/Domains rather than simply bad page requests. The domains which appear qualified should then be checked with domain registrars for availability. Please advise if APIs will be needed for this.

The user interface should have an input form for URLs to crawl and the parameters if any, and a browsing page to see the available or expiring domains.

This should be coded and commented on in an organized and extensible fashion so that additional functions or changes can be made in the future.

Delivery will include installation assistance on my linux server if needed.

This should probably go without saying, however I must have full and sole legal rights to all the code. I reserve the right to have the code checked by a third-party programmer of my choice before official completion. This is for my protection, please advise if you have any questions or concerns.

Thank you for looking at this project. All legitimate bids will be considered, and I may choose a winning bid at any time.

MySQL Odd Jobs PHP Script Install

Project ID: #1931651

About the project

1 proposal Remote project Active Jul 11, 2012

Awarded to:

$400 USD in 8 days
(0 Reviews)
0.0