Authenticated website listings scraper & file downloaders
$30-250 USD
Paid on delivery
Looking for a Go developer to create a scraper for 3 websites:
1: login & download excel -> extract rows and send to DB
2: login & download csv -> send to DB
3: login & scrape listings (3 pages):
a) paginated listing page
b) listing admin page
c) listing public page
d) send to DB
Scraper should be 3 Go packages, one for each website. Each package should have:
a) an interface to start/stop
b) detect failure (connection & html format change)
c) configurable retry on connection fail (retry max X times, every Y seconds)
d) delay of X seconds between page requests
e) concurrent listing data export interface
The projects must be developed in the Go programming language.
Project ID: #17319885
About the project
6 freelancers are bidding on average $213 for this job
1) I am confident to extract the row in Excel and send to the DB 2) also can do CSV and send to DB. 3) 3 pages which you have mentioned will also get scrapped. it is easy for me And Scrapping will be done as you have More
Hello There, I can develop a scraper for scraping data from different websites. Can also show some samples of your given task. I have extreme experience in Web Scraping. Have done a lot of work of Scrapping. I use More
