Hello. I've been working professionally with Python and have completed numerous web scraping projects before. I have a well-tested and efficient workflow for web scraping using the Scrapy framework that will work perfectly for a larger project such as this. If you could check your PMB for a more in-depth explanation, I would appreciate it. Regards, Blender3D.