Classified ads scrapping
€10-30 EUR
Paid on delivery
- scrap classified ads from 2 web sites and write the data into sqllite db
- after initial run only scrap new records
- track changes of already scrapped ads and write changes into a history table
- prevent duplicates
No requirement on the scripting language used for the scrapping, but please mention what you would use.
I've decided to limit the project scope to only one web site, not 2 as originally planned.
The adds served on the page are of different categories, about 10 of them. There's a large overlap between different categories, but not all categories have all the data.
The scrapping must handle that. The schema needs to be capable of storing all different types, and the columns not needed by a certain type should be null.
Some columns have data which would be stored in many-to-may lookup tables in a proper normalised database, but we don't need a complex schema. Instead, a column can have schema within a column with key/value pars, stored in JSON.
Project ID: #11328684
About the project
Awarded to:
Hi Can you send me over the 2 URLs' of the 2 target web site and let me know which data to extract from [login to view URL] i will make a demo scrapper in PHP or Python. Once i have more details then i will be able to give More
8 freelancers are bidding on average €47 for this job
===Automatic Web Scrapping=== ===Automatic Web Scrapping=== ===Automatic Web Scrapping=== if you like contact me. thanks zubair
I can do any kind of scrapping like, Emails, Phone Numbers, Articles, Web Reviews and Classified Ads Scrapping for your specific needs. I have very fast and highly flexible web scrapping agents that are developed by me More