Scrap user data from a website (ASAP)


1) Login to [url removed, login to view] (or [url removed, login to view] if it makes your job easier). Without login, crawling is not possible in the way explained below. The username and password will be given to you.

2) Go to [url removed, login to view] and take IDs (ID is also part of URL) of all users in 1104 pages.

3.1) Go to each user's follower list page. Example: [url removed, login to view] . Here, "serkan" is the ID of the user.

3.2) Get IDs of all followers for each user.

4.1) Go to each user's profile page. [url removed, login to view]

4.2) On top right, it says "55022 Puan" or similar. Get the number from there. (Puan means point).

4.3) Get the name of top-5 subjects in "Ilgilendigi Konular' section on the right.

There should be two output files:

First file should show connections between users. It consists of two columns.

Followee Follower

serkan mike

serkan joe

serkan wang

mike khan

mike joe

khan pablo

... ...

It means that: mike follows serkan, joe follows serkan, wang follows serkan, khan follows mike, joe follows mike, pablo follows khan and so on.

Second file should show profile information of users and consists of 7 columns.

userid points topic1 topic2 topic3 topic4 topic5

serkan 55022 'Kisisel Gelisim' 'Turkiye' 'ASP.NET' 'inploiders' 'Yazilim'

mike 34 'Software' 'Soccer' 'Video games' 'Travel' 'jazz'

... ... ... ... ... ... ...

It means that serkan has 55022 points (puan) and interested in the following subjects: 'Kisisel Gelisim', 'Turkiye', 'ASP.NET', 'inploiders', and 'Yazilim'.

ps. Users other than 'serkan' are made up users.

Please feel free to ask if you have any questions.

Skills: Web Scraping

See more: Data scrap website, excel vba scrap website data, website for scrap data, php, web scraping, scrap website data, software write mq4, software write chip epson, useful software write book, software write web specs, free software write user guide, software write edid, free software write company profile, software write websites idea, software write book images, software write books, software write protection, free software write book, email data scrap website, software write book

About the Employer:
( 1 review ) Istanbul, Turkey

Project ID: #14591808

Awarded to:

$12 USD in 1 day
(0 Reviews)

22 freelancers are bidding on average $55 for this job


Hello Sr. Hope you read my proposal and take a look into my Portfolio to see my reputation and capabilities. I suggest you to msg. me to talk about this project. I've some doubts/questions. Relevant Skills and Experie More

$150 USD in 3 days
(137 Reviews)

Hi sir, I am scraping expert, I have did more than 350+ scraping project, please check my feedback then you will know. Can we discuss more details about this project? then I will provide example data/scr More

$38 USD in 1 day
(158 Reviews)

I can collect information for both files in less than a day for just $35. Thanks. Roman Relevant Skills and Experience I have worked on similar projects many times before that's why I'm sure you'll be impressed with More

$35 USD in 0 days
(148 Reviews)
$20 USD in 0 days
(107 Reviews)
$50 USD in 1 day
(22 Reviews)
$49 USD in 1 day
(33 Reviews)

Hi, I'll write a python script for you. I will also let you know how to run it. Relevant Skills and Experience You can check reviews on my profile. Proposed Milestones $55.5 USD - fina, $55.5 USD - final

$111 USD in 2 days
(8 Reviews)

hi, I have over two years experience in web scraping. I can scrape this site. please ping to discuss

$45 USD in 2 days
(10 Reviews)

Hello sir, I have completed many scrap projects in the past. I will use a python script to collect the requested data. Please let me know if i can help

$30 USD in 4 days
(11 Reviews)

hey this is kartikeya with 3+ years of experience in browser automation. I have read and can do the job quickly Relevant Skills and Experience pythom/selenium Proposed Milestones $12.5 USD - work $12.5 USD - work

$25 USD in 1 day
(3 Reviews)

hello i'm a java developer highly skilled in web scraping ,i make my own crawlers so you can specify anything, i suggest for you a script implemented in java with beautiful UI so let's discuss more Relevant Skills and More

$25 USD in 1 day
(4 Reviews)

Hello Sir I read the job description and understood the job. I can start this job right now an can finish it within 1day. Please contact me for more discussion. Sincerely Sabbib

$20 USD in 1 day
(3 Reviews)

Hello? I am very interesting in your project. I checked your details very carefully and understood all. I can do this in a short time with high quality. I am expert in php, c#, python, web automation, simulation, a More

$111 USD in 1 day
(2 Reviews)

Hi, i am available now, contact me Relevant Skills and Experience h Proposed Milestones $15 USD - h $15 USD - h

$30 USD in 1 day
(1 Review)

I read the project details and I understand what do you need and I'm interested to work in this project. Thank you, Fakrul

$30 USD in 3 days
(0 Reviews)

I can create a web scraper for you in PHP language which allows you to get all users' followers as well as profile information for all users. You can count on me for your project. Relevant Skills and Experience I'm an More

$60 USD in 5 days
(0 Reviews)

will code a program with Java Programming with easy and beautiful User Interface , will do your job perfectly . Relevant Skills and Experience example >> Last eBay Seller Scraping >> [login to view URL] More

$35 USD in 2 days
(0 Reviews)

i am a serious bidder with similar technical skills and experience i have checked the details & have already worked on a similar project before and can deliver this as u have mentioned Relevant Skills and Experie More

$25 USD in 1 day
(0 Reviews)

We are a work-at-home team turned to legal business in the Philippines and can start immediately. Relevant Skills and Experience Dedicated in-house team Proposed Milestones $25 USD - fee

$25 USD in 1 day
(0 Reviews)

We have hands-on experience of projects related to data and web scrapping. We basically use following software to automate this task: 1. Visual Web Ripper 2. Data Tool Bar Relevant Skills and Experience Please visit More

$250 USD in 3 days
(0 Reviews)