Building a Web Scrapping and Comparison Tool


I´m looking for a data scraping expert, to do a scraping job in the most efficient way. Because of the big amount of data perhaps Phyton (e.g. scrapy) is the best way to do it. But in the end tecnical details doesn´t belong to me. If you do it in another way thats fine. Please read the full project description including the attached pdf before giving a quote. Especially look at the expected amount of data before giving your quote. be sure that you fullfill the project within your quote. Manual scraping is not an option, so please don´t give a quote if you are going to scrape by hand.

Step 1 getting buying data from two buying websites.

Step 2 Collecting and aggregate the scraped ISBN from Step 1

Step 3a Using the collected ISBN to get selling data from one comparison website. This is the prefered option. If this doesn´t work go to Step3b

Step 3b Using the collected ISBN to get selling data from four selling websites.

Step 4 Creating an xls or csv file with the given structure

Step 5 Creating a chance to schedule (daily, weekly, 2 weekly, by date) the scraping in future on my own.

After setting up the scraping for the first time, the scraping must be done automatically. So you have to create a solution to do this. The scraper and scheduler has to be build in a way, that the scraping (in future) can be done for given ISBN and not scraping the whole websites all the time. First time there must be a full scrape. I attache a pdf with more details. Please check if you are able to fulfill the full requirements. If you have further questions, please contact me. Please just give a quote if you can fulfil all the requierements. I´m looking for a long term partnership, because I want to integrate more vendor and buyer pages in future. Please note that I can only use a full set of the data. Scraping just one or two sites is completely useless for me. If you have specific questions or your have a lack of understanding, do not hesitate conatcting me. Please no general questions like "Sir, I need more details". Please ask specific questions.

Looking forward to hear from you. Best regards Tobias

Skills: Big Data Sales, Excel, Python, Web Scraping

See more: erstellen eines online stores, web scraping xls csv, building simple web form outputs csv, xls csv web service, web services read csv, tranfer xls csv, script xls csv, world warcraft web building, transfer xls csv, script export xls csv, web form write csv, perl script xls csv, scrapping web, xls csv delimited, perl scripts xls csv, getafreelancercom web data extraction softwares scripts, flash games converter softwares, database softwares, softwares taurusweb, softwares needed develop net application

About the Employer:
( 1 review ) Germersheim, Germany

Project ID: #11707990

21 freelancers are bidding on average €268 for this job


Dear sir, I am scraping expert, I have did too many scraping projects, please check my reviews then you will know. Can you tell me more details? then I will provide example data/script for you. Thanks, More

€124 EUR in 3 days
(258 Reviews)

Hello there, my name is Daniel and I would love to help you out with this project. I have experience developing similar price comparison tools so I think I can really useful. What I can offer to you is a Web applicatio More

€398 EUR in 10 days
(128 Reviews)

Hello! I am a professional programmer with many years of web scraping experience using Python. I have read your project description, and I can create the scraping and comparison program(s) you require. To do so, I will More

€222 EUR in 3 days
(58 Reviews)

Hello. 35 % of employers hiring me once hired me again. I have experience in the same. I CAN do this job, and do it well!

€200 EUR in 3 days
(115 Reviews)

Hello! I'm web-scraping and web-automation expert and i can done your project. I use python language and scrapy framework. My scripts works on windows, mac or linux, but linux is preferably. I can schedule scripts on More

€198 EUR in 5 days
(109 Reviews)

i have professional past experience in excel regarding log entering using numeric formulas excel bar graph or any type graph proficiency also can give redial and logical analysis in excel simply i am fit for your job s More

€30 EUR in 3 days
(18 Reviews)

Hey, I will do it in Java. I have 4 years of experience in Java . I have recently scraped several websites for my clients. You can check below link . This is the latest scraping I have done. [login to view URL] More

€166 EUR in 3 days
(22 Reviews)
€250 EUR in 7 days
(2 Reviews)

Hi! Please check my profile videos. Note these are only samples how my scrapping works, its manupilate a browser i can manipulate firefox, chrome or even tor if you want that. As I see your project kinda simple jus More

€100 EUR in 3 days
(7 Reviews)
€155 EUR in 3 days
(7 Reviews)

sir I need more details. I have understood all your requirements. I can do this project

€197 EUR in 15 days
(2 Reviews)

HI Hello Sir, We have gone through the details you have provided and would be pleased to work on this with you to deliver the results that you have expected and We are sure you will not be disappointed if you give More

€155 EUR in 3 days
(1 Review)

I have already completed similar projects and I'm absolutely confident I will build you a valuable and useful scraper.

€99 EUR in 3 days
(0 Reviews)

Hi, this is Anshuman. I love scraping, crawling and getting data from various dom structures. I have 6 yrs of experience in scraping, crawling, processing and mining data. My previous projects include- 1. Automated Cr More

€222 EUR in 7 days
(28 Reviews)

Hey Tobias, I understand what you need from this project and what you need from your developer. I have a good vibe about this. Best of luck. Stefan Z.

€222 EUR in 2 days
(0 Reviews)

Hello. Understand, how to do this job. Skills in VBA, excel, experience in getting information from websites. No problem with this job and those tasks from discription.

€100 EUR in 10 days
(5 Reviews)

hi, im a professional web scrapping. my last project is get all NIK on my country and the data is really big its +150.000.000 data. im using the latest technology like golang. and the output is mysql data, excel, its More

€1111 EUR in 7 days
(0 Reviews)

Hello. I read all the information and I'm glad to say I can easily help you. Send me a message to start the work immediately.

€199 EUR in 5 days
(21 Reviews)

I've worked on many scrapping projects during my studies. I mostly did scrapping from news website, however your task is not much a different from that idea. Here's a short description of my work: I’ve already worke More

€155 EUR in 3 days
(0 Reviews)

Yes, we can do it, for the specified amount. We are experts in scrapping anf development and we have dedicated intelligent servers for scrapping.

€1000 EUR in 14 days
(0 Reviews)