Build a web crawler

Big Data Expert at your service. I have 15 years of IT experience. I have used Big Data technologies to downloaded hugh datasets & ingested into HDFS- Hadoop Distributed File System to remove junk data for further processing and sync it with database. I have even used perl/python/php scripts to scrap data from 3rd party websites, clean and store it in database. Cron jobs were created to automate the scraping, cleaning and storing process. I can complete the task with quality. Ready to start asap.

Hello, My name is Tarun Singh, We have read your project description and would like to offer our services: We have 4 years of work experience in Java, J2ee, Spring , Struts, Jsp, Jsf, Ejb, Hibernate, Ibaitis, Camel, Maven, Gradle, Ant, MySQL, Multi threading, Oracle, Mongo, Json, Xml, HTML, CSS, Bootstrap, AngularJS, Jquery, JavaScript, Hyperjaxb3 and many more. We have created may crawlers to get information like broken links, images and so call other stuff. Our Codes are Clean and Robust As always we did. # OUR Process of Development : We would expect to be able to provide the complete solution by following SDLC method with Protocol method which is included • Preliminary Analysis • Requirements gathering • Systems design • Development • Integration and testing • Acceptance, installation, deployment • Maintenance # Safety and Security: We guarantee to keep secure all project related information i.e. ftp details, CM details, DB details etc. If required, NDA (Non-disclosure agreement) can be signed. Lets connect over chat to discuss it further. Please let me know if you have any queries. Regards Tarun,

I have already implemented Facebook and Twitter crawlers (Java) and store data into a relational database (mySQL)

A proposal has not yet been provided

I'm currently on a break so I have a lot of time to work specifically on this project in the desired time frame.

I have an experience with a web crawler as in developed two applications which used to get information from other sites. I'm a very passionate coder and i would love to do this job for you.

Need details for the project