Crawled more than 100 various domains using Python Scrapy. scraped 10 million records. Can provide extraction sample in chat. Let's discuss the fields that are required from that page, we could use scrapy. thanks
Hello sir,
I have gone through the requirements.
I am well versed with crawling whole sites using Sitemaps, Country/Language selectors using Scrapy. I like to craft scalable and stealthy spiders which are designed with keeping the anti bot measures of modern site in mind.
Little bit about my experience, I have maintained a web crawler that have scrapped 7 million records for a single semiconductor marketplace. I have crawled more than 100 e-commence domains using Scrapy. If sites are ajax rendered, I like to simulate XHR requests whenever possible. I have experience with web scrapping using Scrapy, Scrapy-Splash, BeautifulSoup, and NodeJS for one and a half year.
I am akin to tackle and work on challenging problems. I have exposure with task management tools like Jira and versioning tools such as git/bitbucket. Can provide live extraction as skill reference.
I had the opportunity to explore long-term collaboration with clients by delivering value through quality work. My paramount focus is to provide an authentic customer experience throughout the process. I would carry the same values and contribute to this project.
Feel free to chat to discuss the problems
Thanks for reading