1) Login to [url removed, login to view] (or [url removed, login to view] if it makes your job easier). Without login, crawling is not possible in the way explained below. The username and password will be given to you.
2) Go to [url removed, login to view] and take IDs (ID is also part of URL) of all users in 1104 pages.
3.1) Go to each user's follower list page. Example: [url removed, login to view] . Here, "serkan" is the ID of the user.
3.2) Get IDs of all followers for each user.
4.1) Go to each user's profile page. [url removed, login to view]
4.2) On top right, it says "55022 Puan" or similar. Get the number from there. (Puan means point).
4.3) Get the name of top-5 subjects in "Ilgilendigi Konular' section on the right.
There should be two output files:
First file should show connections between users. It consists of two columns.
It means that: mike follows serkan, joe follows serkan, wang follows serkan, khan follows mike, joe follows mike, pablo follows khan and so on.
Second file should show profile information of users and consists of 7 columns.
userid points topic1 topic2 topic3 topic4 topic5
serkan 55022 'Kisisel Gelisim' 'Turkiye' 'ASP.NET' 'inploiders' 'Yazilim'
mike 34 'Software' 'Soccer' 'Video games' 'Travel' 'jazz'
... ... ... ... ... ... ...
It means that serkan has 55022 points (puan) and interested in the following subjects: 'Kisisel Gelisim', 'Turkiye', 'ASP.NET', 'inploiders', and 'Yazilim'.
ps. Users other than 'serkan' are made up users.
Please feel free to ask if you have any questions.
22 freelancers are bidding on average $55 for this job
Hi, I'll write a python script for you. I will also let you know how to run it. Relevant Skills and Experience You can check reviews on my profile. Proposed Milestones $55.5 USD - fina, $55.5 USD - final
hey this is kartikeya with 3+ years of experience in browser automation. I have read and can do the job quickly Relevant Skills and Experience pythom/selenium Proposed Milestones $12.5 USD - work $12.5 USD - work
Hello Sir I read the job description and understood the job. I can start this job right now an can finish it within 1day. Please contact me for more discussion. Sincerely Sabbib
We are a work-at-home team turned to legal business in the Philippines and can start immediately. Relevant Skills and Experience Dedicated in-house team Proposed Milestones $25 USD - fee