Create a webcrawler for me

$250-750 USD

Closed

Posted

about 5 years ago

$250-750 USD

Paid on delivery

I need a webcrawler that can find websites that are written in German and English language. The project literally requires that I find ALL websites in Germany, UK, USA, South Africa and Australia. That could be a whole number of different domain endings such as .de .com .at .ch .[login to view URL] .[login to view URL] etc. But I don't want websites that are in any other language (french, spanish, italian, polish, russian etc.) The crawler needs to generate a list of all the domains for that language. If he can also find an e-mail address that would be nice, but is not really necessary. What I really need is a list of all German and English language domains.

Project ID: 18930861

About the project

9 proposals

Remote project

Active 5 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

9 freelancers are bidding on average $529 USD for this job

@e3d

Hi, those will be hundreds of millions. I can crawl those for you, detect language by keywords and locale pages, filter out ones that are not english/german and give you back list of domains (along with emails if needed). pricing is for first 1 million domains. if those works good - we can discuss cheaper price for the rest of them. oh and thousands of such websites appear each day, so you'll never run out of the data :)

$899 USD in 3 days

5.0

(334 reviews)

9.0

@mingxiao2008

Hello, Dear How are you? I have read your project description and am ready for discussing with you about project for now. I have experienced in developing Data Entry, PHP, Python, Web Scraping, Web Search. I will work very had and best for you. Best Regards

$400 USD in 10 days

5.0

(107 reviews)

8.2

@mhmhz

Hi I did previous project that fetches Australian domains. Thanks

$800 USD in 5 days

5.0

(172 reviews)

7.8

@Max01

hello hope you are doing well I am interested to work on this project. Gladly waiting to serve you with my extensive skills.

$750 USD in 26 days

4.9

(260 reviews)

6.7

@hassanalvi95

Hi sir, I wrote many crawlers and I have their codes as well. And I can use checks which will eliminate the other sites. I can extract emails from sites as well. Just let me know if you are interested. Thanks .

$555 USD in 10 days

4.8

(37 reviews)

5.9

@Stephenrajs

Hi there, I Have Scraped Amazon, Aliexpress, Yellow Pages, Yelp, Zomoto Etc. I Have 500 GB Internet With 20 Mbps Speed. I Have 6 Systems. I can do it. I have done many related projects like this. If you are provide this work, it will help my career also. Give me a chance to do this. Waiting for your precious reply. Thank you. Please Check my mastery work at:- https://www.freelancer.in/u/Stephenrajs *Why you are choose me 1. 24/7 hours support 2. Quick response 3. Deliver on time 4. Smooth communication. I assure that I can satisfy you completely and want to have a long term relationship with you. Best Regards Stephenrajs

$300 USD in 10 days

4.8

(108 reviews)

5.4

@SecureForYou

Flag of LAO PEOPLE'S DEMOCRATIC REPUBLIC

Hi, I have already completed the similar web scraping projects, so i can finish it as you want. I have experiences of 10+ years on IT business. Please discuss with me more details and start project. Thanks.

$555 USD in 10 days