I need you to develop some software for me. I would like this software to be developed for Windows . Crawler that finds websites associated with each other and tests them against a proxy
Hello.
I have made scripts to search website content using search engines.
I also wrote parsers for these websites and can compare them.
I have ready to work proxy environment.
I prefer Linux.
Could You describe what exactly application should do?
It may work as a script with input of websites or search keywords. Then crawl these sites, save to database and give some rating according to params ( which params ). It can also go through internet all time and collect data. Could You specify more what You need or what for?
Regards.