Building a Web Scrapping and Comparison Tool

This project received 24 bids from talented freelancers with an average bid price of €252 EUR.

Get free quotes for a project like this
Project Budget
€30 - €250 EUR
Total Bids
Project Description


I´m looking for a data scraping expert, to do a scraping job in the most efficient way. Because of the big amount of data perhaps Phyton (e.g. scrapy) is the best way to do it. But in the end tecnical details doesn´t belong to me. If you do it in another way thats fine. Please read the full project description including the attached pdf before giving a quote. Especially look at the expected amount of data before giving your quote. be sure that you fullfill the project within your quote. Manual scraping is not an option, so please don´t give a quote if you are going to scrape by hand.

Step 1 getting buying data from two buying websites.

Step 2 Collecting and aggregate the scraped ISBN from Step 1

Step 3a Using the collected ISBN to get selling data from one comparison website. This is the prefered option. If this doesn´t work go to Step3b

Step 3b Using the collected ISBN to get selling data from four selling websites.

Step 4 Creating an xls or csv file with the given structure

Step 5 Creating a chance to schedule (daily, weekly, 2 weekly, by date) the scraping in future on my own.

After setting up the scraping for the first time, the scraping must be done automatically. So you have to create a solution to do this. The scraper and scheduler has to be build in a way, that the scraping (in future) can be done for given ISBN and not scraping the whole websites all the time. First time there must be a full scrape. I attache a pdf with more details. Please check if you are able to fulfill the full requirements. If you have further questions, please contact me. Please just give a quote if you can fulfil all the requierements. I´m looking for a long term partnership, because I want to integrate more vendor and buyer pages in future. Please note that I can only use a full set of the data. Scraping just one or two sites is completely useless for me. If you have specific questions or your have a lack of understanding, do not hesitate conatcting me. Please no general questions like "Sir, I need more details". Please ask specific questions.

Looking forward to hear from you. Best regards Tobias

Skills Required

Looking to make some money?

  • Set your budget and the timeframe
  • Outline your proposal
  • Get paid for your work

Hire Freelancers who also bid on this project

    • Forbes
    • The New York Times
    • Time
    • Wall Street Journal
    • Times Online