Broken link checker

$30-250 USD

Completed

Posted

about 9 years ago

$30-250 USD

Paid on delivery

The idea: a 'tool' that checks the web for outgoing broken links on a website Steps: 1. User specifies a target keyword 1.1 script scrapes Google search results 1.2 script that follows every link it finds on the target website and registers when a link is broken (status 404 and only external DO FOLLOW links) 2. it inserts the data into a database (e.g. microsoft access) - the data needed would be: 2.1 the url of the page where it found the broken links, as well as the website domain age, Google PR, Alexa ranking 2.2 the url of the broken page (status 404) 2.3 an email address if found on the contact page Please let me know 'how' you would approach this project.

Data Mining

Data Processing

Web Search

Project ID: 7249515

About the project

7 proposals

Remote project

Active 9 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@sby

A proposal has not yet been provided

$166 USD in 1 day

5.0

(6 reviews)

4.2

7 freelancers are bidding on average $261 USD for this job

@Sonatic

First of all I want you to keep in mind that if you're going to to scrape google you'll need proxies. A lot of proxies. Also multithreading, response validation, some kind of background task runner and supervisor in case that you wanna get something stable enough. You'll need to limit the link crawling depth for websites at most to 3. I can provide you all of about, even proxies. Needs to be discussed.

$277 USD in 3 days

5.0

(2 reviews)

2.3

@ExpertScraper1

I work with some useful tools which is check websites broken. I am a professional data supplier now. My skills and services include: - Web scraping - Data entry - Data mining - Data processing - Excel - MySQL - Oracle - etc. Hope my skill and work can help you with your business. Thanks.

$80 USD in 3 days

5.0

(3 reviews)

1.9

@FabioFelgueiras

Hi, i can do this lets chat about it .........................................................................................................

$555 USD in 15 days

0.0

(0 reviews)

0.0

@mihairapciuc

Hi, I've done some scrapping projects before and I would handle this task by making a simple php frontend that calls a phantomjs scrapper behind the scenes. This scrapper will parse the google search resuls as well as any additional websites required for collecting the data you need. I know from experience that getting the domain age may be tricky because not all registrars use the same format in their whois protocol search results and some don't even have a publicly accesible whois address.

$277 USD in 3 days

0.0

(0 reviews)

0.0

@razvand70

Hi, expert web/data scraper here with over 17 years experience in programming and RDBMS - please see my reviews. I'm using Mozenda and Perl for this kind of jobs. My offer is 20 usd (without fees) per 1 000 records. I'm able to extract data fast.

$250 USD in 3 days