Web scraping big data jobs

...from Ghana. I'm writing to you today with a big dream and an even bigger hope. Since I was young, I've always wanted to be independent and help my family. My mom is a single parent, raising both me and my younger sister. Seeing her struggle to provide for everything is incredibly difficult. I know I'm the elder one, and I can't bear to watch her carry this burden alone. That's why I'm so passionate about starting my own e-commerce business. It's a chance for me to contribute financially and ease some of the pressure on my mom. However, my biggest hurdle right now is creating a website. I've tried building one myself, but with limited resources and knowledge, it just hasn't worked out. Thankfully, I came across your profile and your ...

I'm seeking an experienced Python developer to scrape a specific website and extract text data for the purpose of analysis. Your role will be the following: - Scrapping the text data from the specified website. - Cleaning the data to prepare it for analysis. High data quality is crucial so attention to detail is necessary. Ideal candidate would have proven experience in Python, data extraction, and data cleaning. Familiarity with data analysis will be beneficial.

I'm in need of a Python script that can crawl through a list ...export all the webpages it finds into a new Excel file. This task is aimed at scraping the entire content of the websites, not just a specific piece of information. Key Requirements: - The script must be able to read a list of websites from an Excel file. - The script should use natural crawling mechanisms, not sitemap, to find all the webpages on each website. - All the webpages found on the websites should be exported into a new Excel file. The purpose of this script is to aid in analyzing the content of these websites, so it's crucial that all pages are scraped. Ideal Skills: - Proficiency in Python programming, particularly web scraping. - Knowledge of Excel file handling in Python. - Exp...

I need a professional who can help me extract photos from various websites for data analysis purpose. Key Requirements: - Image Extraction: The main task is to extract photos from a multitude of websites. The photos will be used for data analysis, so accuracy and completeness in this task is vital. Ideal Freelancer: - Data Extraction Expert: The ideal candidate would have experience in extracting data from websites. - Web Scraping Proficiency: Knowledge of web scraping tools and techniques would be highly beneficial. - Attention to Detail: The successful candidate will be diligent in ensuring all relevant photos are extracted. If you are confident in your ability to deliver a high-quality image extraction service, please submit ...

I'm looking for a skilled Python developer to help with web scraping and data analysis tasks. Key Tasks: - Web Scraping: Proficiency in using Beautiful Soup or Scrapy is essential. The person should be able to extract specific data sets from websites and present them in a structured format. - Data Analysis: Experience with Pandas and NumPy is crucial for this role. The ideal candidate should be able to manipulate and analyze large data sets efficiently. - Automation: Familiarity with Selenium for automating tasks is a plus. What I'm Looking For: - Experience: Please include details of your past projects and your experience with Python in your application. - Specific Libraries/Frameworks: A strong grasp of Pandas, NumP...

...can do DAYTIME testing inside Thailand. We are NOT seeking testers located outside Thailand. We are NOT seeking night time testers. Either Thai or English language speakers are ok. If you speak both that's a big bonus. You will need both an Apple or Android smart phone to use for testing. We are just about to launch and our app is available for download. We must verify we have a MVP (Minimum Viable Product) with core functions functioning properly. Just need to verify big functions, we are not worried about smaller bugs or improvements now. We keep finding a lot of bugs so big they prevent us from launching. Learn as much as you can about because it offers a huge benefit to the world and should take the world by storm. Join us in the beginning of th...

I'm looking for a proficient Chrome Extension...the extension malfunction. - Modify the extension code accordingly to adapt to these changes and ensure compatibility with the latest Google Images layout. Please note that I've already attempted to reinstall the extension in Google Chrome, but this hasn't resolved the issues. Ideal skills & experience: - Proficient in Chrome Extension Development - Familiarity with Google Images API and web scraping techniques. - Strong experience with debugging & enhancing extensions - Previous experience with image downloading tools/extensions would be an advantage Your work will help me enhance the functionality of the extension for myself and other users, so a focus on delivering robust and reliable solutions is k...

I'm in need of a talented video editor who can transform my longer video into engaging, bite-sized content for Facebook and Instagram. The original video is more than 3 minutes long and I need it to be broken down into shorter, captivating sequences. I'd ...broken down into shorter, captivating sequences. I'd like the editing style to be trendy and modern, suited for social media. Key requirements: - Expertise in video editing, particularly for social media platforms such as Facebook and Instagram. - Ability to understand the essence of longer content and distill it into shorter, engaging clips. - Experience in trendy/modern video editing styles is a big plus. Please provide examples of your previous work that demonstrate your skills in this area. Looking forward t...

I have a web application build in Angular. In this application i also want to gather real-time score data from football games, providing dynamic updates to users. And send notifications when goals are made. Key Features Required: - Robust scraping solution to ensure constant, consistent live score updates - User-friendly interface showcasing live scores in a digestible manner Ideal Skills and Experience: - Proficient in Angular-related development - Previous experience with web scraping technologies - Familiarity with designing user-friendly web interfaces - Excellent problem-solving skills to ensure the smooth delivery of live data updates and notifications.

...writer to extract specific business data from an online directory, specifically Myagedcare.gov.au. This project will need a freelancer that possesses: • Significant knowledge and experience in data scraping technology • An understanding of the structure and functioning of online directories • Keen attention to detail The successful freelancer will carry out: 1. Extraction of business data: I require accurate extraction of contact details and business names from businesses listed on the directory. 2. Specific Directory Focus: The targeted directory for this exercise is Myagedcare.gov.au. The end goal is to create a clean and organized database of businesses in the aged care sector. Prior experience with online directories and specificall...

...flexible data scraper tools. These tools will be deployed to capture data and screenshots from a variety of popularly visited websites such as e-commerce platforms, directories, social media and news sites which includes but not limited to eBay and clinicaltrials.gov. Key functionalities should include: - Capturing various data types such as product details, pricing information, ratings, reviews, and any other elements visible in a full-page screenshot. - Organizing the captured data and screenshots in a clear, easy-to-navigate folder structure. - Being adaptive enough to scrape data from a widely diverse set of websites. To be successful in this role, you should have a solid knowledge of Python and possess considerable experience with the Playwri...

I need a professional to scrape data from the URL provided and deliver the extracted details in a CSV format. - The specific data elements required are the agent name and phone number. The scraping process does not require any filters or search criteria as it's a one-time extraction. The data should be organised and easily readable in a CSV document for further analysis. Ideal skills for this project would include: - Proficient in web scraping with experience in extracting data from similar websites - Strong expertise in delivering data in structured formats (CSV, Excel) - Attention to detail to ensure accuracy in the extracted data

I'm looking for an experienced video creator to produce a humorous and entertaining gameplay commentary video for my PC gaming channel. Key Requirements: - Specialization in creating gaming content - Proficient in editing, adding effects, and polishing videos - St...sense of humor and creativity to make the video entertaining - Knowledge of PC gaming and popular titles - Understanding of pacing and storytelling in video editing The ideal candidate should be able to not only commentate on the gameplay but also add humor and personal anecdotes to keep the viewers engaged. Previous experience in creating similar content and a portfolio of gaming videos would be a big plus. The final video should be a balanced blend of commentary, humor, and engaging content that aligns with my c...

I am seeking a data aggregator to formulate inclusive and accurate contact lists for my upcoming marketing campaigns. The information required in each list is a blend of phone numbers, email addresses, and the names of company owners. I'll be providing SIC codes as an accurate reference channel for the industries we'll be focusing on. Any freelancer applying for this project should exhibit a well-versed understanding of data aggregation, web scraping, and should be detail-oriented. A knowledge or background in marketing would also be beneficial. Please note information accuracy is paramount, as these lists will directly impact the effectiveness of our campaigns. Your tasks will include: - Gathering the aforementioned contact details - Aligning d...

I need a professional web scraping expert to scrape information from medical service providers directories that are publically available from the providers' websites. Requirements: - Extract data including name, address, phone, and location from the directories - Ensure the information is accurate and up-to-date I'm looking for a freelancer who: - Has extensive experience in web scraping - Can deliver high-quality results quickly - Has excellent attention to detail The project is urgent so I require someone who can work on it immediately and complete it as soon as possible.

I need assistance to solve three coding tasks using Python, Java, and SQL. The challenge involves - Analytical problem-solving - Implementing quality checks - Code compilation The challenges require proficient skills in the aforementioned languages, while also ensuring code efficiency. Prior experience in problem-solving and understanding how to efficiently check and maintain the quali...assistance to solve three coding tasks using Python, Java, and SQL. The challenge involves - Analytical problem-solving - Implementing quality checks - Code compilation The challenges require proficient skills in the aforementioned languages, while also ensuring code efficiency. Prior experience in problem-solving and understanding how to efficiently check and maintain the quality of code is a big...

I'm in need of skilled programmers to develop interfaces for my Place and Route EDA flows. The ideal candidate will have experience in the following: - Proficiency in Python and/or C++ - Familiarity with VHDL, Verilog, and SystemVerilog - Experience in file input generation - Strong file parsing capabilities - Ability to manage EDA fl...have experience in the following: - Proficiency in Python and/or C++ - Familiarity with VHDL, Verilog, and SystemVerilog - Experience in file input generation - Strong file parsing capabilities - Ability to manage EDA flows using TCL The interfaces need to be able to handle the entire EDA flow, from file input generation to error reporting. Experience in developing similar interfaces will be a big advantage. Please include relevant work sampl...

I'm in need of an expert to carry an advanced data scraping task on Github. Key project specifics: - The kind of data to be harvested includes not only text content and links, but also user IDs, emails and names. Therefore, this project requires someone with a skill set that allows for scraping beyond the surface level. Ideal Freelancer: - Ability to implement advanced scraping techniques to ensure quality and completeness of obtained data. - Experience in harvesting sensitive information like User IDs, emails and names. - Respectful of privacy laws and legal restrictions regarding data scraping. - Self-motivated, detail-oriented, and reliable. Please be ready to provide examples of similar projects you have completed. Th...

I am looking for someone who whill help me to create Firefox Add-On for basic scraping on a website. Looking for fast delivery. Ready to award today.

I need a skilled web developer to create a website that will fetch and display HTML pages from another website. Here's what the project involves: - Users should be able to view these pages online on our website. - Users should also be able to download these pages as PDF files. - The site should be programmed to automatically update the HTML pages from the other site each time a user accesses a page. - We haven't yet decided how to handle multiple users accessing the same content simultaneously, so flexibility in your approach is key here. Ideal candidates would have experience with HTML5, CSS3, PHP, and knowledge of automated web tasks and conversion of various file formats. Previous experience with handling high traffic is a plus. Please provide examples of your ...

I am seeking a skilled Python developer with expertise in troubleshooting to resolve an issue with an application. The main purpose of the application is data analysis, web scraping and automation. Currently, the application has been crashing or freezing right at the startup. The ideal candidate for this job should have: - Extensive experience in Python programming - A background in data analysis, automation and web scraping domains - Proven track records troubleshooting application start-up crashes or freezing - Good problem-solving skills, ability to diagnose and fix bugs efficiently. Your main task will be to identify and fix the issue causing the application to crash during the startup. This is a critical project, so a timely resolution i...

...skilled professional who can help me scrape text data from e-commerce sites for data analysis. Key Requirements: - Data Scraping: The primary task is to extract text data from various e-commerce websites. This includes product descriptions, reviews, and any other relevant textual information. - Data Cleaning: Ensure the scraped data is accurate, clean and ready for analysis. - Data Analysis: This project is focused on data analysis, so experience in this area is a must. The ability to extract meaningful insights and trends from the scraped text data is crucial. Ideal Skills and Experience: - Proficiency in Web Scraping: A strong background in web scraping and working with text data...

I require an experienced professional to obtain text and images from a blog and store them in a CSV file. The ideal candidate should: - Have experience in scraping content from websites - Be adept at data management, specifically CSV files - Be proficient in handling both texts and images and store in easy way to manage and retrieve A strong track record of similar projects will be a plus. This job requires accuracy and attention to detail. I look forward to seeing your bids.

...cater to the different personas. - Entertainment Spaces: The entertainment areas I envision include interactive exhibits, live performances, and games & arcades. These should be engaging and entertaining, while still fitting into the castle theme. Ideal Skills: - Creative Design: You should have a strong background in creative design, with experience in theme park or amusement park design being a big plus. - Concept Development: Ability to understand and translate a unique concept into a tangible design. - Attention to Detail: The devil is in the details, and I'm looking for someone who can bring this castle-themed amusement park to life in a detailed, whimsical way. If you're someone who can turn a concept into a reality and create a memorable and engaging exper...

My main focus for this project is the Java code implementation. I'm looking to hire a freelancer who can create class diagram and help me translate a class diagram into well-crafted Java classes. Key Tasks: -Create diagrams - Translate a modified class diagram into Java classes - Ensure the Java classes are correctly implemented according to the diagram Your responsibilities will incl...payment - Generating a rental invoice Your expertise in Java and software design will be crucial for this project. I anticipate that this task will involve a deep understanding of class design as well as an understanding of the rental business process. Please include examples of your previous Java projects in your bid, and any experience with class and sequence diagram interpretation would be a ...

I am seeking a proficient programmer to develop a scraping application for the purpose of extracting text data from NETFLIX. This project is sensitive, considering that the targeted websites demand API keys for access. Accordingly, the ideal candidate should be familiar with both GET and POST methods as well as API integration and management. Experience with data extraction and web scraping from API authenticated websites is a must. Skill requirements: • Web scraping • HEADERS • CUSTOM HEADEARS • STRINGS • URLLIB • Working knowledge of GET & POST methods • Experience with API authentication • Exceptional skills in data extraction, especially text. • loliscript • SilverBullet i ne...

I'm looking to create a new crypto token on Binance Smart Chain with a total supply of 1 million. The token's primary purpose is for investment. The ideal freelancer for this project should be well-versed in token creation on Binance Smart Chain, and have experience with listing tokens on KuCoin. Experience wi...Tokenomics: I require the implementation of specific tokenomics features, including: - Rewards for holders - Transaction taxes (a tax on each transaction that is redistributed to existing token holders) - Income generation for the token owner Please provide a detailed proposal outlining your approach to the token creation and listing process. Any previous experience with similar projects is a big plus. Looking forward to working with a skilled profess...

I'm looking for a proficient Python developer to create a script that can efficiently scrape active IPs from a text file I will provide. The following specifics are required in this project: - The Skill-set: Strong Python programming skills, experience in IP scraping and working with text files would be an advantage. - Task Details: You need to extract the 'Activity Data' from these IPs. Profound knowledge in network protocols is a must-have. - Output Handling: The activity data extracted should directly be written to a text file. A clear understanding of FileIO operations in Python would be crucial. A successful completion of this project might lead to more future collaborations. I'm looking forward to seeing your proposals.

I'm in need of an expert in social media marketing to help me boost my online presence across Facebook, Instagram, and Twitter. Your key responsibilities will include: - Developing a comprehensive social media marketing strategy that aligns with my business goals of increasing brand awareness, driving websi...Managing the day-to-day operations of social media accounts and ensuring content is posted at optimal times. You should have a proven track record of success in social media marketing, ideally including experience with Facebook, Instagram, and Twitter, and an understanding of how to drive real business results through these channels. Experience in the relevant industry or similar projects would be a big plus. Please share any relevant work samples or case studies in...

I'm looking for a skilled photo editor to conduct numerous touch-ups on a specific image. Some of the tasks include: - Logo Removal: There are logos present on the chest and sleeve of the subject's shirt that need to be completely removed. - Skin Retouch: Some minor adjustments to be made to the subject's sk...subject's skin to ensure a cleaner look. - Hair Correction: I would like some fly aways in the hair to be retouched out of the image. The perfect candidate for this project needs a strong understanding of photo editing software, a keen attention to detail, and previous experience in similar projects. Demonstrating an ability to work with hair and skin retouching in a photo editing software will be a big plus. This project could potentially lead to more wo...

I'm in need of a highly experienced Executive Assistant. The ideal candidate will have over 5 years of relevant experience, a strong command of English, and be able to handle a variety of tasks including: - Email and calendar management - Screening calls - Attending meetings and taking notes The successful candidate will be proactive, detail-oriented, and reliable. It's important...meetings and taking notes The successful candidate will be proactive, detail-oriented, and reliable. It's important that they can work independently and take ownership of their responsibilities. Ideal skills for this position would include strong organizational abilities, excellent written and verbal communication, and a high level of proficiency in time management. Experience in a similar r...

I need an engaging and creative video to promote an e-book aimed at children between 5 and 10 years old. The script and image are both ready. I'm looking for someone with experience in video creation and artificial intelligence, who has a talent for developing child-friendly content. Experience in promoting products, people and digital products is a big advantage. The essence of the video is to follow the already existing text. Video speaking in Portuguese with English subtitles in a way that attracts our target audience. The objective, first and foremost, is to capture attention, arouse curiosity and, ultimately, motivate purchases.

I'm currently looking for an expert who can design a data scraping script for me. However, I haven't decided on which particular website and kind of data (text content, images, links etc) should be scraped yet. Furthermore, the frequency for data collection hasn't been specified. Ideal Skills and Experience: - Commercial experience with Python or JavaScript - Proficiency in web scraping using tools such as BeautifulSoup, Scrapy, or Selenium - Ability to add flexibility for target URLs, data type, and collection frequency Please note: the project details will be finalized upon discussion. Your recommendations are welcome and appreciated. Only apply if you're comfortable proceeding considering these conditions.

My aim is to effectively scrape forum posts from community.st.com. Currently, I have a Python-based web scraping code that requires debugging and optimization as the current JSON output presents inconsistencies. I am in need of a developer with: - Strong Python experience - Proven web scraping skills to optimize and debug data scraping code - Proficiency in handling and troubleshooting JSON data - Familiarity with structure will be a plus As a result, the corrected script should deliver complete and well-structured JSON data of forum posts within community.st.com.

I need a simple form that will look good on a small screen iPhone and also a big screen iPad. The form will collect NAME EMAIL CITY PHONE NUMBER phone number will be a formatted 10 digit max, and email will need validation for properly formatted. This will take the data and post it to our existing base and will then revert form back to a page that says success, and then auto redirect to the form page. The form page will look neat and clean and also contain a couple lines of text and our logo. You will use the existing config file to connect to our base, instead of creating a new one. This project needs completed today and should only take an hour to complete. This is to be written in php 8.2 and connected to sql dbase. You will be paid $30 when it is complete and ver...

My aim is to effectively scrape forum posts from community.st.com. Currently, I have a Python-based web scraping code that requires debugging and optimization as the current JSON output presents inconsistencies. I am in need of a developer with: - Strong Python experience - Proven web scraping skills to optimize and debug data scraping code - Proficiency in handling and troubleshooting JSON data - Familiarity with structure will be a plus As a result, the corrected script should deliver complete and well-structured JSON data of forum posts within community.st.com.

You will find and pitch stories using analytics and tools to tell you what’s already trending, as well as finding the next big stories yourself. Editing and posting stories and videos on our social pages while coming up with new creative ways to drive traffic to our sites and grow our audiences. You will be forward planning social media content and coverage, covering live events and breaking news on social media while monitoring the external landscape to identify trends – and communicate findings while sharing knowledge and best practice across the business, but particularly in the newsroom. Shift Patterns & Working Location This is an office based role working from our New York office, we are therefore open to candidates based in or commutable to New York. Please...

...visuals: The main content types I'm focusing on are images, videos, and infographics. You should be skilled in creating compelling and eye-catching visuals specifically for these social media platforms. - Understanding engagement: Your designs should not only look great but also be tailored towards increasing engagement with our target audience. Knowledge of social media engagement strategies is a big plus. Ideal Skills and Experience: - Proficiency in graphic design tools like Adobe Photoshop, Illustrator, and Canva - Experience in social media design, particularly on Instagram and Facebook - A strong portfolio of visually appealing and engaging social media content - Understanding of social media engagement strategies and best practices This is a great opportunity for ...

As an online business owner, I'm experiencing slow loading times, large file sizes, and high server response times on my Wordpress site, and would like to do everything possible to i...implemented some performance optimization techniques, such as minifying CSS and JavaScript files, enabling caching, and compressing images. For this job, I'd highly value your expertise in: - Additional Wordpress page speed improvements - Identifying areas that I might have overlooked - Further technical optimization techniques Being familiar with Litespeed Cache - the plugin I have used - would be a big plus. I am hoping to find a meticulous, experienced freelancer who can quickly and effectively enhance my site's performance to provide the best user experience possible. Looking for...

...experienced AI developer, proficient in data analysis, a variety of machine learning model development, and natural language processing to bring an image recognition project to life. Specifically, I'm looking for your contributions to: - Thoroughly analyze large quantities of data and draw insightful conclusions from it - Develop advanced machine learning models to fulfill our needs - Apply natural language processing techniques for improved project outcomes - Design and develop AI models to meet project requirements - Convert AI/ML models into APIs that other developers can use - Perform statistical analysis on big data sets - Manage project infrastructure and the development of AI models and projects - Work with other machine learning engineers, d...

I'm in need of a sales agent who can work 10-20 hours per week to help me generate leads. The ideal candidate should be able to perform cold calls to potential clients and effectively generate leads. The project is in the Yacht brokerages industry, so experience in this field, particularly with B2C sales, would be a big plus. The main tasks involved in this project will be cold calling and lead generation.

I'm looking for an experienced data scraper who can extract text data from marketing websites for subsequent data analysis.

I am on the hunt for a creative and imaginative writer with a deep understanding and love for fantasy MMORPG's (Massively multiplayer online role-playing games). I need someone with deep knowledge who can supply me with an article that will be published on a very big MMO news website.

All previous SEO "Expert" here on freelancer have FAILED to delivery good results for us. Its big PLUS if you have expirence to work on Swedish marcet and backlinks. On domain .SE links You need provide SEO audit and suggestions on improvements of our website We run online store in woocomerce and we are selling pet products in Sweden. We have already do lot of SEO work. We have set upp all the most important things like meta tags, titel etc. We are looking for 15-20 keywords get high ranking on Swedish Google. Our products need be listed on first page as well with good SEO work You need do full analytics of our website and come up with suggestions on what elements we can improve When you bid please explain why we coice just you?

I need a professional to scrape specific details from a ...scrape specific details from a website directory for a one-time project. - Specifics: The data of interest includes the company names, their URLs, and their expertise. This information is laid out in rows on the website. - I wish for the freelancer to carefully extract this data, ensuring no errors or omissions are made. - The final output is essential to be in a CSV file format. I require this scraping to be done just once, and I do not foresee a need for ongoing scraping after this initial task. As the data is crucial for my business development, I am seeking someone who can deliver accurate and complete results in a timely fashion. Prior experience with web scraping and ...

...prospects for the right developers, based on the performances evaluated over a period of time, once you established your skills. Need to provide the changed code details and sql queries if any at the end of each sub-task, with the changed code line numbers. Unlimited Revisions are needed. Any bugs created due to your own developments are to be fixed on free of Charge. Recruitment is for a long-term big project as such, all the developers are subject to practical skill test for which not paid. Please send your details for the below-mentioned questions. 1. What type of Software you have done in Laravel+Vue? 2. How many years of Industry experience do you have in Laravel software development? 3. How many years of Industry experience do you have in Vue software development? 4. H...

I am in need of an experienced and dynamic Lab Technician with knowledge in various lab tools and procedures. Your role will be three-fold: - Conducting experiments: Demonstrable experience in the field is crucial as I will require you to conduct different types of experiments within a short duration. - Analysis of test samples: I need someone with an analytical mind t...interpret test results from water, soil, and biological samples taken from a bio tank. - Maintenance of laboratory equipment: The ideal candidate should be able to handle and maintain sensitive laboratory equipment like microscopes, centrifuges, and spectrophotometers. Please provide evidence of your capacity to perform these tasks effectively. Adeptness at multitasking and keenness to detail is a big plus for thi...

I need a data scraping tool to pull business names and addresses from Google and Google Maps. - The tool should be able to extract this information in an organized and comprehensive manner, enabling me to create a database for further analysis. Ideal skills and experience for this job include: - Proficiency in web scraping tools and techniques. - Experience working with Google and Google Maps APIs. - Ability to organize and structure data effectively. - Data to be compiled in an excel spreadsheet - Prior knowledge of extracting business information from online sources is a plus. Looking forward to your proposals.

Title: Expert Web Scraper Needed for Advanced Sales Lead Generation Description: We're in search of an expert web scraper proficient in niche database search techniques and advanced web scraping beyond Google and mainstream platforms. The ideal candidate will specialize in extracting company information from platforms like LinkedIn, focusing on contact details for sales lead generation. Key Details: Target Data: Company Information on LinkedIn Purpose: Sales Lead Generation Responsibilities: Utilize advanced web scraping tools and niche database search techniques to extract company information, emphasizing contact details. Ensure accuracy and reliability in gathering and organizing contact information from various sources. Collabor...