Classified Crawler or Scraper

Closed Posted May 10, 2012 Paid on delivery
Closed Paid on delivery

I need a custom crawler setup to automatically search up to 15 URLs at different times during the day for different keywords. Please email for a list of the websites. Websites include major classified sites but also some other smaller newspapers and online forums. This project could be longer term since this might need troubleshooting and I am adding new URLs periodically.

I am only interested in the most recent postings and ads, def. nothing older than 2 or 3 days.

If you have experience with this or can point me to a service that already exists I would appreciate it. Please include your past experience or sample of your work with your bid.

Currently, I use RSS feeds to retrieve data from some websites but I am open on how it is delivered to me or the user interface.

If you can create a custom scraper for each website that works as well since some of my queries are pretty broad and simple keyword search doesn't work for some websites. Your suggestions are welcome.

In the long run, I am also interested in applying the above to social networking sites (automated keyword search).

Thanks !

MySQL PHP Software Architecture

Project ID: #1623852

About the project

5 proposals Remote project Active Jun 14, 2012

5 freelancers are bidding on average $199 for this job

SigmaVisual

We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.

$200 USD in 7 days
(223 Reviews)
7.7
amusto

I can create customized scrape engine. Please send me your website url and I'll send you a demo asap.

$250 USD in 5 days
(3 Reviews)
2.4
yilmazhuseyin

I can write a nice tool for this job. pm me for details.

$200 USD in 5 days
(0 Reviews)
0.0
Oi3E4N9Bh

<b><i>Removed by Admin</i></b> - Custom software development - skpye: <b><i>Removed by Admin</i></b>

$250 USD in 1 day
(0 Reviews)
0.0