Scraping data python jobs

...You will only be required to generate a list of followed accounts' IDs for each user that is provided - The data you collect will be used to predict trends in user behavior and preferences Ideal Skills and Experience: - Proficiency in data scraping, particularly from social media platforms - Familiarity with Instagram's API and limitations Further notes - I am very familiar with scraping in general myself. There are many obstacles with Instagram - namely, the endpoint where the 'following' list is found requires a logged in sessionid. I have a very large list of users (11 million overall) that I need this data found for. Honestly, I'd prefer to have the methodology to scrape this data rather than have it all scraped as...

The name of my site is "". I am the owner of this domain. I want stu...student feels comfortable on the site and does not want to leave the site. So, because universities and students are international, we have to pay as much attention to legal issues as possible. Since we collect sensitive data and it is a payment system, data security is of utmost importance. We want each student to have his own personal profile that can track status of their application. In the future, we aim to obtain data automatically and integrate it into the site. Our site aims for 100,000 visits per month, so our systems must be able to withstand language is Python. Please let me know if you have any questions or concerns. The budget was selected as say with your bids.

...is created, will move through 91 days of time. On set numbers of days (20, 30, 60, 90, 91) a hard coded reminder notification occurs. This can be on screen, or also emailed or texted.. eventually id want to check a box or select from a drop menu an yes/no indicator that that notification step was completed. In the attachments is the fields and titles of the notifications.. also I have a complete python script of the logic and steps. The small picture attachments are what's needed to be duplicated and enhanced with this project.. I also have a very detailed breakdown of each reminders title, when it should display in the 91 day cycle. Quotes need to be accurate and I need this in 5 days. This would principally setting up a rudimentary password protected web page and a dat...

I'm looking for an experienced IoT developer who can create an Arduino-based system that triggers actions or alerts based on scraped text data from a website. Key Responsibilities: - Develop a system using Arduino, Raspberry Pi, and ESP32 microcontroller - Implement website scraping functionality to extract specific text content - Design a mechanism to trigger predefined actions or alerts based on the scraped data Ideal Experience: - Proficient in Arduino programming - Familiarity with ESP32 microcontroller and Raspberry Pi - Experience with website scraping techniques - Ability to integrate scraped data to trigger actions or alerts on an IoT system Please note that my preferred programming language wasn't specified. Feel free to suggest the...

I need a Python script to be deployed as a Lambda function and capable of processing tokens and handling verification and info retrieval tasks successfully. The Lambda function will handle both Google Sign-in ID and Access tokens. Summary: "Users creation" will be in DDB. "Endpoint creation" using API gateway. "User Authentication" using JWT "User Login" is via Google Sign-in

I'm seeking an expert Python developer to integrate the Sales, Inventory, and Accounting modules of Odoo with WooCommerce. This is an advanced task that requires deep knowledge of Python programming language and a strong understanding of Odoo and WooCommerce platforms. KEY TASKS: - Develop a robust API connection between Odoo and WooCommerce. - Ensure seamless data exchange between the Sales, Inventory, and Accounting modules. REQUIRED SKILLS/EXPERIENCE: - Expert-level Python programming skills. - Extensive experience with Odoo and WooCommerce integration. - Experience with API development and integration. This project is not for beginners or intermediate level programmers. I need someone with a high degree of skill and proven proficiency in Python...

For my project, I need a freelancer with strong skills in data scraping and extraction, particularly with textual content and figures, from a specified public website - Tasks: - Effectively pull relevant textual content and figures - Ensuring the scraped data is comprehensive, accurate, and neatly organized Excel Skills: - The data collected must be meticulously stored in an Excel database - The organization method within the database is by entity An effective freelancer must be detail-oriented, proficient in using Excel and knowledgeable about data scraping techniques from public websites. A background in handling similar tasks would be advantageous. Accuracy and neatness in data organization are also paramount. Please indicate you ...

I'm in need of an Android app developer who can build an application primarily aimed at driving user engagement. This dynamic application should prominently feature the use of push notifications to keep our users connected and engaged. Skills and Experience: * Extensive experience in Android app development * Proven ability in implementing effective push notifications * Under...ability in implementing effective push notifications * Understanding of user engagement strategies within applications The aim is to build an app that not only engages the user but encourages regular active use via well-timed and strategic push notifications. The developer should also value user experience, making sure the app is intuitive and user-friendly. the app must be working based on only Python...

I need to extract pricing information and contact details from a Chinese website for market resear...- The project also involves obtaining contact details from the website. This would typically include email addresses, phone numbers, names of suppliers, and any other relevant contact information. - It is important that this data is collected accurately and in a structured format for use in supplier outreach. Ideal Skills: - Proficiency in web scraping and data extraction. - Familiarity with Chinese websites and text. - Experience in market research and supplier sourcing. - Ability to organize data for easy analysis. - Attention to detail and accuracy in data collection. If you have experience in these areas and are comfortable navigating Chinese we...

I'm in need of a skilled developer who can create a chat client-server program . The focus should be specifically on enabling text messaging and group chat functionality. The Language for this project is Python 3 You should write a client program and hence a client process should be running. Also. You should write a server program and hence a server process should be running. Specifically, you must implement two independent applications. One, called chatClient, implements the client component. The other one, called chatServer, implements the server component. You must design your own protocol for the communication between the client and the server. Key Features: Basic Functionalities • Administration Capabilities o A client will start by contacting the server to registe...

I am looking to have a PDF fillable form designed and coded to fit specific needs. This project involves integrating text fields, checkboxes, and dropdown menus into the form design. The purpose of integrating custom code into the PDF form is predominantly for customizing its appearance. It would be greatly appreciated if the form design could align with a minimali...The purpose of integrating custom code into the PDF form is predominantly for customizing its appearance. It would be greatly appreciated if the form design could align with a minimalist and clean style. Ideal candidates for this project should have strong skills in both form design and coding. Experience in Adobe Acrobat or similar PDF editing tools and programming languages such as JavaScript, Python, or C# would be b...

I'm seeking a developer to help me create a system that can archive web-based content, including text and...like HTTrack, Wget, or WebCopy to mirror the website. - Single archive process: The content will require archiving only once, as it won't be updated frequently. Ideal Skills: - Proficient in web scraping: Ability to extract and save content from websites. - Experience with archiving systems: Previous work on systems that save web content for offline use. - Knowledge of offline storage: Understanding of how to save and retrieve content without requiring an internet connection. This project is ideal for someone who is looking to work on a one-time archiving system, and who has a background in web scraping and offline content storage. Please detail your relevan...

I'm urgently looking for a web scraping expert who can help me gather information from various medical service provider websites. Key Requirements: - Extract doctor names, contact information, medical service details, and additional data such as phone numbers, specialties, and participating plans. - The information should be pulled from three specific websites - Website 1, Website 2, and Website 3. Your deliverable: - The scraped data should be compiled into a CSV format for easy analysis and integration into our system. Ideal Skills: - Proficient in web scraping and data extraction - Advanced knowledge in handling and exporting data formats like CSV - Experience in scraping medical websites or similar domains would be a plus. P...

I am looking for an expert freelancer to develop a software that will expedite my web scraping process. I have identified the need to automate if possible the solving of image-based reCAPTCHA challenges. Key Requirements: - Practiced experience in automation and CAPTCHA solving. - Familiarity with various web scraping technologies and debugging will be vital to this project's success. The ideal freelancer for this project would have a proven track record in web scraping, specifically with handling reCAPTCHA challenges and previous experience with 2captcha will be considered an advantage. Let's bypass these hurdles together and get the necessary data!

I'm seeking a skilled software developer to join our dynamic IT team. The ideal candidate will possess expertise in Perl, Python, and XML/XSLT, and should be familiar with MySQL. Responsibilities: Develop And Maintain Software Applications Using Perl, Python, XML, XSLT, And Database Technologies. Design And Implement Data Transformation Processes Using XML And XSLT. Write Efficient, Clean, And Reusable Code That Complies With Company Standards And Best Practices. Collaborate With Project Managers, Business Analysts, And Other Team Members To Understand The Requirements And Provide Technical Solutions. Perform Database Management Tasks, Including Design, Modifications, And Performance Tuning. Assist In The Integration Of New Software And Systems Into Existing Env...

Hello, We are seeking a skilled developer to construct a straightforward pipeline for processing data annotated with multiple categories, including cars, bikes, and number plates. Our project aims to leverage foundational models such as Grounding Dino, SAM, and various visual question answering models akin to GPT-4V (e.g., CogVLM, Qwen VLM). The goal is to enhance existing labels with additional attributes and generate new annotations based on the provided data. Your primary responsibility will be to update existing JSON files formatted in COCO using these foundational models. Detailed instructions regarding the types of modifications and any additional requirements will be provided. This project is initially short-term but has the potential to evolve into a long-term coll...

I need a professional to scrape specific information from an one page weblink and present it in an Excel file. The details will include: - IMAGE LINK - Product Name - Price1 -Price 2 - Link to Product Page - Stock Availability (I lager) The freelancer that can deliver fast will be prefered.

I'm in need ...customizable lighting effects, allowing the user to interact with them via a remote control, and connecting them to an external API. - Deposit Button: I also need a deposit button integrated into the website, to allow users to easily deposit funds. I'd prefer the button to be compatible with PayPal, Stripe and Square. Ideal skills and experience for this job would include: - Proficiency in JavaScript, Python and Ruby - Experience with hardware programming, particularly customizable lighting - Strong understanding of integrating payment gateways, especially PayPal, Stripe and Square - Previous experience in developing IoT devices and remote control systems. If you think you have what it takes to complete this project successfully, please reach out. I...

...knowledge in web scraping and building mobile apps. Please do not apply if you don't have experience in both. As we are in the final stretch of our MVP (native iOS and Android mobile app), this individual will help us finish a critical feature in the app (i.e., web scraping) + other small features and help us launch in app stores. Please take a look at the attached high level SOW before you submit the bid AND include your time commitment (hours/week) and hourly rate. We will select candidates based on the bids. The detailed SOW will then be shared with the selected candidate/s before finalizing timeline & budget. Acceptance criteria will be provided once we move forward with the selected candidates. Tech stack: Frontend: React Native, Expo, Typescrip...

...confirmation email. With animated banner and QR code. SQL database. All data from the users, questionnaires, orders, and ratings will be stored in a postgres SQL. I have specified the database design (see below). Currently there is no API to warehouse/shipping (postage of orders are handled manually, but please set up the database with the future API integrations in mind). Manual order (in backend). Basically, I want to be able to look at the sample ratings for each sample order and manually decide on what product to send the user. I will need an easy way to assign sample_order_id to a new product_id (see ORDERS table) Pop-up window for visitors outside shipping region, with email/name collection form. Backend interface to python environment Another page/workflow that make...

Please Sign Up or Login to see details.

Google Play Store Reviews and Sentiment Analysis Website- The website offers a user-friendly interface and provide sentiment analysis of reviews from the Google Play Store. 1. User Module a. User Registration Module To get started, users need to register themselves by providing the following details: Username, Password, E...provides an interface for admins to perform various operations. Admins can view all the reviews, analyze the results of the reviews, and manage user profiles. d. User Manage Module- The user manage module allows admins to manage user profiles. Admins can view all user profiles, edit user profiles, and delete user profiles if required. Technologies Used Frontend: HTML, CSS, JavaScript Developed in : Python Database: MySQL Sentiment Analysis: Google Play Store Re...

I am seeking a skilled data scrapper to retrieve specific information from 'Website 1'. a full comprehension of various types of data is needed for a successful scrape. The types of data required include: - Textual content - Metadata Specifically, within the textual content, I require: - Titles - Descriptions - Prices - Linked products - Related products An ideal candidate would demonstrate extensive experience in data scraping, with a keen focus on retrieving accurate and relevant information. A good understanding of e-commerce sites and familiarity with Metadata and APIs will be advantageous. Please, I urge you to utilize ethical scraping methods in accordance with the rules and regulations of the source website. Looking forwa...

I require a seasoned Python expert with specific skills in data analysis and scripting and automation. The key tasks will involve working with numerical data to accomplish two prime goals - data visualization and processing/transformation. Direct experience in the following areas is crucial: - Strong Data Analysis: Ability to dissect and interpret complex numerical datasets - Skilled in Scripting and Automation: Can systematically automate data processing and transformation tasks - Proficient in Data Visualization: Capable of creating intuitive visualizations to contextualize processed data Assured understanding of numerical data handling is a prerequisite. If the above resonates with your skills set, feel free to place you...

Hello, Im looking to fix a Python website monitor

I'm in need of a skilled Python/Java developer who can help me build a full-stack accounting web application. Key aspects of this project include: - **Main Feature:** The most crucial aspect of this accounting web application is its financial reporting capabilities. The financial data will be taken from Excel and XML. There will be financial reports (P&L, Balance Sheet, Cash Flow) and graphs to show the financial status. - **Technology Stack:** I require the project to be developed using Python/Java as the primary programming language. - **Database:** The application should be built using MongoDB for its databases. Ideal candidates should have: - Proficiency in Python/Java and MongoDB. - Experience in developing accounting or financial applications...

...Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! Furthermore, I need a BILINGUAL freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English via video) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. T...

I need AWS Lambda function that handles Google signin JWT token and creates a new user in DynamoDB. For Endpoint creation - API Gateway For User auth - Google signin JWT token

I'm in need of an experienced fullstack developer who will help me determine an effective solution for my project. -Proficiency in Python, specifically Django and Flask, and PHP, particularly Laravel and CodeIgniter, is a must. -Despite skipping on certain details, I presume features such as user authentication and database management, plus API integration may be needed. -I haven't chosen a design yet but preferably, I'm looking forward to someone who can contribute to the style discussion. Your experience in multifaceted projects will be a huge plus.

I need Crypto market making bot which is generate Volume without any loss. I need python code means I can run on AWS cloud. I have one code if you do changes on that then that's also Okay for me.

I'm in need of a skilled developer who can help me with my entire software lifecycle. The project will involve...expected to run Snyk vulnerability tests to identify and mitigate potential security risks in the codebase. - Integrate Slack notifications: You'll need to set up a mechanism for notifying the team via Slack about the progress, issues, and other relevant updates of the project. The ideal candidate for this project should have experience and proficiency in the following programming languages: - Python - JavaScript - Your expertise in these languages will be crucial to successfully fulfilling the tasks at hand. Also, a strong understanding of software development practices, particularly CI/CD pipelines, and experience with SonarQube, Snyk, and Slack integration ...

I'm in need of an original Scheme language interpreter tailored specifically for Windows. This tool is to be primarily used for educational purposes, hence it should be user-friendly and efficient. A command line interface is sufficient for this tool. Must be written using python. Please include small simple technical report and simple design schematic. Ideal Skills: - Proficiency in Scheme language - Experience in developing Windows applications - Understanding of educational software design

I'm seeking an experienced and knowledgeable data scraping professional to collect specific information from three major platforms - RERA websites (specifically Maharashtra, Telangana, Haryana, and Delhi), Google, and Justdial. Here's what I am looking for: Details to Scrape: - Name - Mobile Numbers - Locality - City - Address - Pincode Platforms: - RERA Websites (Maharashtra, Telangana, Haryana, Delhi) - Google (DSA and Loan Agents data) - Justdial (DSA and Loan Agents data) The ideal freelancer for this job will be highly experienced in data scraping and will be able to deliver the results in an organized manner. Proficiency in scraping from Google, RERA websites, and Justdial is particularly important. Delivery Format: -...

For this project, I need a proficient python developer with expertise in AI and human-computer interactions. I aim to implement AI probing into cyber-physical systems with a focus on human error analysis. Key Responsibilities: - Design and develop algorithms using Artificial Intelligence for cyber-physical systems. - The AI project will be implemented on a desktop computer. - The primary task is to conduct a comprehensive human error analysis, understand user behaviors in different scenarios, and generate actionable feedback. Ideal Skills & Experience: - Strong Python programming skills. - Deep understanding of AI, Machine Learning. - Expertise in Human-Computer interactions. - Experience with cyber-physical systems. - Background in HCI research, particularly human erro...

Hello I am looking for a python code to scrape a large number pages and save them as html. In order to get to the page to save, you must click a radio button, submit, and then enter a string of numbers, then submit and then save the html. If the string entered provides an error then you must skip to the next iteration. There is no human verification. I already have a version I made myself that works with Selenium, however I need to increase the speed, so I am looking for someone to see if its possible to do this without even opening a browser and possibly using direct call methods (get, request, cURL, response, JSON?). It should be a simply project for someone who knows how to do this. Please enter the result of 3+2 for your message to be received.

...the best-fit programming language for my project, you are given the flexibility to choose between Python, JavaScript and Ruby, based on your expertise and the bot's needs. 2. Required Functionality: I'm not certain about all the functionalities needed yet. Hence, I expect you to suggest essential attributes during development, keeping in mind a bot that can handle referrals efficiently and incorporate an earning system. 3. Bot Purpose: The primary purpose of this bot is to encourage users to refer and earn rewards. It must be able to streamline this process, making it user-friendly and effective. Ideal skills and experience: - Past experience in coding telegram bots - Proficiency in Python, JavaScript or Ruby - Excellent understanding of referral functions ...

I'm looking for a skilled Python programmer to improve the functionality of my code which automates downloading and generating reports from a specific website. Key requirements include: - Deep understanding of Python and proficiency in code repair and maintenance. - Experience with highly efficient report generation. The goal is to improve quality of code and reduce the time it takes to generate and download these reports. - The ability to critically analyze existing scripts and identify potential optimizations. The task will be considered successful when our report generation process is noticeably faster and more efficient. Having experience in similar projects is a plus.

A tool using equations and generating a graph & excel report showing how variations in some of the variables change the value of a model.

I have a backend code for a pre-existing fully function website and mobile app. The backend code is currently all written in php. I need someone to convert this existing php code into fully functional python code which I can deploy.

I'm on the lookout for a specialist ...using ASHLAR and MIST for seamless task execution. Your bid should evidence your understanding and experience in these software along with VB.NET. Ready to use explanation are available on various sites : Purpose is to understand and learn these two techniques, in VB.NET. It is quite possible that we may find an expert of ASHLAR, but they may not know VB.Net. ASHLAR and MIST are both in JAVA... I will accept if some one can make a simple demo app in JAVA also, My aim is simple to understand this technique and also to see this in practical demonstration using sample Images. Not too strict about text in Project Details.

...provide a scraping sample (2-3 lines) aligned with the instructions below. Scrape data from this website: Filters to be used: - "CAR": 203 and 16348 - "Anno di Concessione": 2020, 2021, 2022, 2023, 2024 - "Importo": select "Compreso fra 100000 e 200000", "Compreso fra 200000 e 500000" and "Maggiore di 500000" We need to scrape the results from all the possible combinations of the above filters. The outcome table should contain all the columns of the initial table AND all the data contained inside each result (you can access in it by clicking on the magnifiying lens). To be clear: - identificativo di riferimento - numero di riferimento - titolo misura - tipo misura - COR - titolo progetto - data...

I'm looking for an experienced freelancer to install Python on my cPanel shared hosting account and run several cron jobs daily using a ready-made Python script. Budget is $20.

...seeking a seasoned data analyst with expertise in data science who can thoroughly clean, preprocess, and visualize a dataset sourced from CSV files. The chosen candidate: - Should first start with cleaning and preprocessing the data to create a reliable foundation for analysis. - Should then interpret and present that same data through meaningful visuals to explore its intricate properties and characteristics. - Should additionally facilitate statistical analysis to derive patterns and trends otherwise invisible to the naked eye. The hoped-for end-product of this project is not just predictive analytics but insight and data-driven recommendations that will inform future decision-making. Proficient use of Python or R for these tasks is essentia...

I'm in need of an experienced Python developer to assist with the development of critical web security tools. While specific tools aren't outlined below - Subdomain Enumeration: Subdomains to be listed and categorized. - Directory Enumeration - Sensitive Parameter Detection - XSS Testing - SQL Testing

I'm looking for a skilled data scraping professional to assist me with a project. I had a working script in Python using an API, but the company implemented a Cloudflare protection that is always blocking me. You would need to find a solution how this could be circumvented (e.g. proxies) and large amounts of data be scraped. If you are interested, I am happy to provide more details privately.

I'm looking for a freelancer that can integrate my Quickbooks software with Booqable, Shogo, and Lightspeed. The integra...and need it to be in sync with my other tools - The integration should be scheduled, with the ability to set the frequency of the sync - It should be able to handle a large amount of data and ensure that all transactions are accurately reflected in Quickbooks - Python integration is created for Booqable, but needs adjustment The ideal candidate for this project should have: - Proven experience in integrating Quickbooks with other software, ideally Booqable, Shogo, and Lightspeed - Proficiency in working with APIs and ensuring scheduled syncs are set up correctly - Strong attention to detail to ensure that all data is accurately captured and ...

We're searching for an experienced Full Stack Developer to assist with an undisclosed project. While the specific programming languages and frameworks have not been indicated, a comprehensive understanding of JavaScript, Python, and Ruby on Rails is usually desired in this role. The purpose of the project is unknown at this moment; however, a versatile developer who can adapt to various situation would serve our goals best. Skills and Experience: - Proficiency in JavaScript, Python, Ruby on Rails - Experience in creating a website, developing a mobile application, building a web application - Ability to adapt and learn quickly - Proven track record in full-stack development - Excellent problem-solving skills

I'm looking for a skilled developer who is proficient in both Android and Python development to create an app centered around social media analytics. The primary goal of this project is the development of a functional app that is capable of analyzing data across multiple platforms namely Facebook, Instagram, and Twitter. IDEAL CANDIDATE: - Solid experience in Android and Python app development - Proven track record in creating apps related to social media analytics - Understanding of API integrations for Facebook, Instagram, and Twitter is a must TASKS: - Design and develop an Android app using Python - Incorporate capabilities to analyze social media activity and data from Facebook, Instagram, and Twitter - Ensure reliable interpretation and pres...

I'm seeking an experienced web developer who can create a high-quality mockup generator website tailored for e-commerce companies. example website Key Aspects: - The main audience for this website is website developers, so the interface and functionalities have to align with their needs. Ideal Skills and Experiences: - Proficiency in either Python Django, JavaScript React, or Ruby on Rails. The choice of technology should be based on what guarantees the perfect performance and optimum results for this project. - Extensive experience in developing mockup generators or similar tools. - Deep understanding of the needs and preferences of website developers. - Strong knowledge of e-commerce businesses and their design needs will be an advantage. The goal

We are seeking an expert in algorithmic trading or financial engineering to assist wi...algorithmic trading or financial engineering to assist with completing the code for our High-Frequency Trading (HFT) Bot. The ideal candidate will have a deep understanding of algorithmic trading strategies, market data analysis, and the ability to optimize trading systems for high-speed execution. This project involves refining and enhancing the existing codebase to improve performance and profitability. Required skills: - Proficiency in algorithmic trading and financial engineering - Experience with HFT strategies and market data analysis - Strong programming skills in languages such as Python or C++ - Knowledge of trading platforms and APIs - Ability to optimize trading systems ...