Find Jobs
Hire Freelancers

PostgreSQL / Python developer for comparison website system improvement

€250-750 EUR

Closed
Posted 8 months ago

€250-750 EUR

Paid on delivery
We are a watch comparison website seeking a developer or team to enhance our system. We require a developer familiar with three primary technologies utilized in our comparison system: - Pipeline is developed in Python. - Database is developed in PostgreSQL. - Scraping bots are developed in NodeJS. About Our Website: We gather various second-hand products from numerous online stores, listing them on our site. This allows a broad audience to see which store offers the best price for a particular product. Problems: Problem #1: We source attributes and reference numbers from a primary website that acts like a product database. However, some online shops from which we gather data sometimes provide inaccurate attributes or reference numbers. For instance: Original data: Ref number #1111111 - material: stainless steel - retail price: $100 Web shop data: Ref number #1111111 - material: gold - retail price: $999 This discrepancy results in two seemingly different products under the same reference number on our site, causing confusion. We aim to introduce sub-models (e.g., #1111111-1 for stainless steel, #1111111-2 for gold). This process should be automated based on the attributes we get from anchor database with 100% relative data, with a well-defined hierarchy for prioritizing attributes (anchoring attributes that affects the price the most). Problem #2: Currently, manually deleting a single data entry from a database table disrupts the entire system, sometimes leading to inaccurate extreme prices because we can not delete a single data. The solution should allow us to remove a specific entry by its unique ID without affecting other tables. Additionally, we'd like a notification system that flags price anomalies (without putting them to the live version), ensuring manual review before they affect our charts. Problem #3: We intend to integrate several major online stores but lack the expertise for this expansion. Any developer or team with knowledge in API, NodeJS, and scraper creation would be invaluable. Requirements: The developer or team will be expected to sign agreements such as: Non-Disclosure Agreement (NDA) Non-Compete Agreement (NCA) And other relevant contracts. Only direct teams and developers should pitch us, we don't want to work with contractors or dropservicers. This is a big red flag for us and if we find out you are using them, by the termination contract you'll not be paid a single dollar. You need to use a CRM system and update us on which parts are you working. You will be paid in milestones which is the best way for both parties (you and us). We prefer to work with people from Europe due to the better time-zone, but we will not exclude other developers from other places, hiding under different nationalities will not help. Before signing a contract, we will have live video meeting just to ensure the compatibility. Slow internet speed and excuses you can not turn the camera are also red flag for us. Let your portfolio speaks for itself. Also a contract will be written on a $1M dollar damage even our project is maybe worth only a few thousand of dollars. If you are confident in yourself and your knowledge, this does not have to worry you at all. We are writing all that stuff because we worked with tons of developers on previous projects and we have seen everything. Also there is a simple workflow on how our system currently works.
Project ID: 37271268

About the project

15 proposals
Remote project
Active 6 mos ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
15 freelancers are bidding on average €657 EUR for this job
User Avatar
I am an experienced PostgreSQL/Python developer with a deep understanding of the watch comparison website system requirements. I have extensive knowledge of Python for developing pipelines, PostgreSQL for database management, and NodeJS for scraping bots. Problem #1: I have expertise in handling data inconsistencies and can automate the process of introducing sub-models based on accurate attributes from the anchor database. I will ensure a well-defined hierarchy for prioritizing attributes, which will eliminate confusion caused by discrepancies. Problem #2: I will resolve the issue of disrupting the entire system when deleting a single data entry by implementing a solution that allows specific entry removal without affecting other tables. I will also create a notification system to flag price anomalies, ensuring manual review before they impact charts. Problem #3: My experience in API integration, NodeJS, and scraper creation makes me well-suited to handle the task of integrating major online stores into the comparison website. I am ready to start working on your project and would appreciate it if you could review my profile for feedback and portfolio. Let's start a chat to discuss the project in more detail. Thank you.
€600 EUR in 7 days
5.0 (9 reviews)
6.5
6.5
User Avatar
Hello client, my name is Salman ullah and I am a freelance developer with expertise in Data Science, Python, machine learning, and Django. I understand you are seeking a developer or team to enhance your system. Specifically, you require someone who is familiar with three primary technologies used in your comparison website system - Pipeline developed in Python, the database developed in PostgreSQL, and scraping bots developed in NodeJS. I believe that I am the perfect fit for this project due to my extensive experience in data science, programming languages such as Python and Django, along with other related technologies such as web scraping. This combination gives me unique skillsets that will be invaluable when it comes to enhancing your website system. With my skillset at hand, I am confident that I can deliver high quality solutions for your project requirements. Plus, because of my commitment to communication, collaboration and transparency I am well suited for this project - both during the development phase as well as after its completion.
€500 EUR in 7 days
5.0 (8 reviews)
5.0
5.0
User Avatar
Hi there, Thank you for considering us for your project. We have reviewed the details provided and are confident in our ability to enhance your watch comparison system. Our team is experienced in the technologies you mentioned: Python for the pipeline, PostgreSQL for the database, and NodeJS for the scraping bots. About Your Website: We understand that your website gathers second-hand products from various online stores and lists them for comparison. However, you are facing a few problems that need to be addressed. Problem #1: We understand that you are encountering discrepancies in the attributes and reference numbers sourced from online shops. To resolve this, we propose introducing sub-models based on the attributes obtained from the anchor database. This process will be automated, ensuring accurate and consistent data. We will establish a well-defined hierarchy for prioritizing attributes, with a focus on anchoring attributes that have the most significant impact on the price. Problem #2: You mentioned that deleting a single data entry from a database table disrupts the entire system. We will develop a solution that allows you to remove specific entries by their unique IDs without affecting other tables. Additionally, we will implement a notification system that flags price anomalies for manual review before they impact your charts. This will ensure data accuracy and prevent inaccurate extreme prices. Problem #3: We understand that you want to integrate several...
€500 EUR in 15 days
5.0 (2 reviews)
2.8
2.8

About the client

Flag of CROATIA
Mursko Sredisce, Croatia
5.0
2
Payment method verified
Member since Aug 20, 2021

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.