Find Jobs
Hire Freelancers

Create a script to take a list of domains and pull stats on them via API (Majestic.com)

$250-750 USD

Closed
Posted about 4 years ago

$250-750 USD

Paid on delivery
Project summary/goal. We are processing domains in bulk for spam, we check tens of thousands of domains per day. We want to quickly find which domains have spam sites linking to them by checking the incoming link anchors. When we have that data, we want to check the anchors against a keyword blacklist and remove the domains that have anchors that contain keywords from the blacklist. ========== We want to create a web script that will take a list of domains and send them to the [login to view URL] API for processing. API Docs: [login to view URL] We want to send the domains and pull back the anchors associated for each domain. Specifically this API call - [login to view URL] Once we have the data back, we want the script to take a list of keywords we provide and filter the anchors to see which keywords. We will want to use a simple web interface, where we can provide a list of domains and a set of blacklist keywords. The script will send the domains for processing and then process the results into 2 csv files. Output 1: A csv file with all non blacklist keyword domains and anchors in 2 columns Output 2: A csv file with all blacklisted keyword domains and anchors in 2 columns The interface would have a project list where we can create a project and start it, and also a settings page where we can update the blacklist keywords. We can use a web template like this: [login to view URL] - we’ve used it extensively in the past already. Thanks!
Project ID: 24692017

About the project

15 proposals
Remote project
Active 4 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
15 freelancers are bidding on average $537 USD for this job
User Avatar
Hi I can implement a desktop tool if this acceptable Thanks
$800 USD in 7 days
5.0 (179 reviews)
7.9
7.9
User Avatar
I am a professional web data scraper specialized using Python program, PHP script, .Net program, Crawler and Bot. My tool can search data and get information from Aa to Zz with an existing lists of english words.
$500 USD in 7 days
4.9 (219 reviews)
7.3
7.3
User Avatar
Hi, How are you? Upon reading brief details I believe its a doable job I have great experience doing projects with PHP, Python, Web Scraping and Web API. I am confident about getting this done. While I believe we need to have detailed discussion about it. I work as per Eastern time daily so that would be good for us to catch up on this job, Lets discuss this further and get started for you as soon as possible. Thanks! Shamshad
$750 USD in 11 days
5.0 (45 reviews)
6.8
6.8
User Avatar
Hi, I am an expert in web scraping. I can create a script to take a list of domains and pull stats on them via API through my experience of the past. I worked on projects like your project. I will finish more quickly than others. i will take less than 1 day I wait for your reply, I can start work now.
$250 USD in 1 day
5.0 (32 reviews)
6.1
6.1
User Avatar
Hello, sir. I have read your project requirements carefully. i am very familiar with API so I can do your projects perfectly as you wish. I have ever done many api projects before like yours. So I have enough experience about any API tasks. Please chat with me for more details. I will wait for your chatting anytime. Thanks for your time.
$500 USD in 7 days
5.0 (26 reviews)
5.9
5.9
User Avatar
I Hope you are doing well! Firstly, I'd like to make familiar with my background so you can check my work out. Expert in BOTH Backend and Front-end Programming, PHP - OOP, MVC, REST API, HTML/CSS/JAVASCRIPT, Codeigniter, Laravel, Angular Js, React, Node JS, Wordpress Theme Integration, Woocommerce/Ecommerce, Magneto,Shopify, Responsive Design, Plugin Development, Adaptive websites, White Hat SEO, Android and IOS App Development. Thank you for taking the time to read my proposal. Hope to hear you soon! Best Regards, Vij
$500 USD in 5 days
5.0 (3 reviews)
3.6
3.6
User Avatar
hello. i am python and web scraping expert. I've read your project description and would like to know more about the project and goals. i can build your project with python. i want to work with u on your project. regards.
$750 USD in 10 days
3.8 (10 reviews)
4.6
4.6
User Avatar
hi, we have 12+ years experienced in this so you can also check our website www.vrickson.com. hope you ll hire me . ty Tulika
$710 USD in 20 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Dear madam/sir, I am an experienced programmer with more than 12 years of experience. I have developed several web-scraping projects, mainly on Python using Selenium. I can help you with the project. Here is the details of one of my projects that is similar to yours: The project is a headless webscraping service designed to work on Ubuntu server. Python and Selenium with ChromeDriver is used for this project. The application runs 4 headless browsers (Chrome) on 4 CPUs of the host (using python multiprocessor programming). The app also consists of a webserver that listens on port 80 and shows a search-engine-like interface with a few textboxes for the user to fill. After filling the required fields, user clicks on a "Search" button. Then the application uses these 4 browsers to go through a list of predefined websites, perform some operations and scrape some data. Four browsers work in parallel so the application scrapes 4 websites at a time. At the same time, the scraped information is shown on the interface using Javascript in realtime. I would like to know more about your project. Regards, Ali Hajiabadi.
$499 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I am a 6+ years experienced python developer. I can get this up and running with tests and all in a weeks time.
$694 USD in 5 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of AUSTRALIA
Melbourne, Australia
5.0
216
Payment method verified
Member since Apr 20, 2012

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.