I need a Python expert to code a website crawler and then deploy to Azure Functions.
1. Highly multi-threaded > 1000 threads or more per sec
2. Use multiple HTTP proxies
3. Implement multiple user-agents, resolution, referals, random page stroll and random page stay time
4. Automatically set the timezone, language, DNS and location etc. to match that of the proxy server used
5. Automatic clearing of cookies after each visit
6. Deploy and execute in Azure Functions
8 freelancers are bidding on average $165 for this job
I have solid experience writing website crawlers. Very simple job for me. Available to start immediately and finish as soon as possible. Please contact to discuss details if you are interested. Thank you.
Hey, I will use Python Scrapy ([login to view URL]) framework for your project and it has most of the features out of the box. Message me and lets talk. Best regards, Povilas Kudriavcevas