Find Jobs
Hire Freelancers

Convert / Multithread an existing php scraper script

$30-250 USD

In Progress
Posted over 13 years ago

$30-250 USD

Paid on delivery
I don't even know if this is possible, but if it is, I expect it to be very easy for the person with the right kind of skill-set. I had a PHP web-scraping script made up which works through the command prompt (PHP CLI) to access a secure server, scrape through A LOT of pages and to store the scraped information in a local database. Now, the script works fantastically well, but a single scrape can take HOURS to complete and I need it to work MUCH faster!! What I would like to know is if you could take my script and either make it multi-thread in PHP (which, if it can be done, I'm guessing would be pretty quick and fairly easy to do), or take the program and convert it into another language / have it (in whatever way) run in a multi-threaded or any other / faster way. Quite honestly, I don't care how the result comes about - All I care about is that it continues to get the job done, doesn't get me banned off the site I'm scraping from and works FAST! If you can do this, please let me know through PMB how you envision your solution working and how long you will take to get it done. Also, since I have some REALLY bad experiences with some of my other freelancers, please write the message "I really read this" in your response to me so I know you really read this entire posting. If I don't see those words written, your bid will automatically be ignored since it means you did not read my project posting well enough. Please ask whatever questions you may need clarified and ONLY BID IF YOU CAN DO THIS - I have **ZERO TOLERANCE** for bad / incompetent freelancers - I need this job done. If you can do it, I am GREAT to work with (my feedback will tell you that), but if you don't feel *****100% SURE YOU CAN DO THIS*****, then PLEASE don't even bother bidding. Extra Information: The site this script scrapes from is a "https:" site which requires a user name and password, but I can create as many user-names as you need. Also, I have proxy IP's that I rent monthly that can be used for this program if needed. Basically, as I said, my one main concern is not getting banned from this site for excessive usage. Thanks!
Project ID: 851401

About the project

17 proposals
Remote project
Active 13 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs

About the client

Flag of UNITED STATES
Lauderhill, United States
5.0
7
Payment method verified
Member since May 20, 2009

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.