Find Jobs
Hire Freelancers

16949 freelance site project crawler

N/A

In Progress
Posted almost 18 years ago

N/A

Paid on delivery
I need a crawler which does the following: -crawls scriptlance, rentacoder, elance, sologig, odesk, ifreelance etc. and stores in a db [project name, project description, project start date, project end date, project category for all projects (open, frozen, closed, cancelled), username and bids + the bid amounts (if no bid amount, nothing)] -the intervals at which the crawl will happen, can be specified for each site and changed via a config file. -the project category can also be specified (because some sites have random categories ... I can build the initial set of categories to scour or so) -if the site offers RSS, we can also use RSS to gather this data. -(optional) the crawler also crawls for the unique users, their profiles (as plain page dump) and stores their feedback ratings and their usernames + a link to their profile pages. crawler can be perl, php whatever language you like. it needs to not fail. we'll set the cron and let it go. Please keep the bidding at a reasonable price.
Project ID: 1767792

About the project

Remote project
Active 12 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs

About the client

Flag of UNITED STATES
Leominster, United States
2.8
2
Payment method verified
Member since Apr 11, 2004

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.