Looking for a spider/crawler to collect information from a online indexing site. We already have 2 crawlers developed but looking for another to measure against speed/accuracy
Can give details as to site - very organized site - after bid acceptance.
## Deliverables
Looking at a crawler that will crawl through 100,000 pages of content