I can complete you project using scrapy framework using concurrent multiple request (multi threading) 480k products in 2 hours or less then 2 hours.
I have 6+ years industry experience in Python, Machine Learning, Web crawling, Web Scraping, Data extraction, Excel, MySQL (RDBMS), Mongo DB (No Sql) database etc.
Expert in excel data manipulation, excel auto report generation using pandas, numpy in python. (Fully automation)
I have built crawler for approx. 400+ website like Amazon, ebay, flipkart, walmart, bestbuy, shopee, snapdeal, and most of OEM website etc.
I have done advance level of crawling using “API” and “POST” method also.
I can scrape any difficult site so can you please provide me this project. I can start to work immediately.
Thank you.