productand price comparison web-portal project

Looking for one or more frontend, backend, full-stake developer who can help to realize an upcoming project.

With your hourly price offer, please share some project references you worked on during the last month/years.

We can also negotiate a fixed price later, when all requirements are fixed so that you get a clear project size.

Nice to have would be german knowledge, but it's not required.

The project includes 3 major parts

***************************************

1. creating a design for the new portal frontend

2. developing and design of a backend inclusiv databasestructure

3. creating a webscraper system that connects via different proxies to scrape product information of predefined sources (onlinestores)

Important part of the is a high grade of automation of the backend and scraping processes.

More insights

##########

1. Details - frontend

--------------------

a. responsive layout (mobile first layout)

b. site speed importance - load time should be less then 1sec.

c. seo optimazed structure

d. seo friendly URLs

e. search function to search products based on set master data attributes like width, diameter, ....

f. show only products/prices of active flagged sources

...

>> all details will be defined in a requirement sheet

2. Details - backend

--------------------

a. design and create a database structure that fits best with the requirements functions defined for backend and frontend processes

b. updating and extend scraping sources of point 3.c. incl. possibility to turn them active and de-active. store source data separatly in a database table. possibility to manually update that data and flagg them as manually updated so that they will not be overwritten.

c. create and lead a product master data table that is used to list all products in the frontend and to show all available offers of different scraped store sources

d. assignment process to assign/link scraped products data (product source data) to master data.

>> all details will be defined in a requirement sheet

3. Details - scraping process

--------------------

a. proxy usage to prevent blocking the scraper by the source site

b. automatically run the scarper via predefined time interval

c. configure scraping sources via stored configuration options in a database or file system

...your experience and suggestions how to realize a save scraper are warmly welcome

>> all details will be defined in a requirement sheet

To give you an idea (examples) about the project goal check

idealo Domain extension .[login to view URL]

Backend Development Frontend Development Web Crawling

Project ID: #17656055

About the project