eBay record scraper

This project will replace an application written in C whose job it is to scrape closed eBay auctions and upload the auction information to a specialized database dealing with ancient Roman coins. The present client works correctly but is slow and has several bugs. The programmer who wrote the code did not provide the source files, only the executables, and is unable to be contacted. The backend software at the website has been completed with all of the basic functionality and categories working correctly. Bot functionality: 1) When run the scraper will gather a list of open auctions in the Roman coins section and store the closing date in a temp file. 2) When the auction closes the scraper will analyze the contents of the auction to filter out unwanted auctions. The filter rules are encoded within the scraper AI logic and CSV files, which have been completed and will be provided to the coder. a) The scraper rejects auctions which did not sell (received no winning bids) b) The scraper rejects auctions which have a "bad" trigger word (listed in CSV) c) The scraper rejects auctions which have a "bad" trigger seller name (listed in CSV) d) When the scraper comes across two "good" trigger words it is to file on the first one (continued description below under "deliverables") ## Deliverables Here is a screenshot of the present client scraping eBay records: <[login to view URL]> Note that the new client should not need an eBay login nor work in any way with the eBay API since closed auctions are viewable to the public when the number of the closed auction is known beforehand. 3) For those auctions which pass the filter the scraper strips the first two images and the following information: the auction title, the seller name, the buyer, the item number, auction end and winning bid amount. It then downloads the information to a temp folder on client PC then uploads to coinnut in the correct category. Here is a screenshot of all the categories on the database: <[login to view URL]> 4) When the process is complete the database assigns a unique ID to the new record and uses eBay's own thumbnail image (if any). Once successfully uploaded the database records new entries like in this screenshot: <[login to view URL]> 5) Clicking on any of those records from the screenshot above brings us to the individual record created such as: <[login to view URL]> Note that linkbacks have been disabled and only the essential information has been captured. 6) During the initial testing period the scraper should file all new records into a duplicate section to protect the records already present on the website. 7) The new section should also have a new category "Other". In this category should be filed up to 1,000 records that the bot has filtered out as rejects; once 1,000 rejected records have been uploaded the bot should store no more until the records have been deleted. The category should therefore have a delete button to wipe the category clean (but not affect any other categories!). The purpose of this new category is to manually catch and analyze records which the bot has wrongfully rejected and come up with coding to catch those in a future code edit. The project will be considered a success when the new scraper can replace the old scraper at which point the test category may be deleted. The programmer should release the source code to enable the site owner to continue future development. Any prospective bidder is encouraged to login to [login to view URL] (username rasiel, password butterpip) to see how the database works and get a better feel for what the project entails. 1) Complete and fully-functional working program(s) in executable form as well as complete source code of all work done. 2) Deliverables must be in ready-to-run condition, as follows (depending on the nature of the deliverables): a) For web sites or other server-side deliverables intended to only ever exist in one place in the Buyer's environment--Deliverables must be installed by the Seller in ready-to-run condition in the Buyer's environment. b) For all others including desktop software or software the buyer intends to distribute: A software installation package that will install the software in ready-to-run condition on the platform(s) specified in this bid request. 3) All deliverables will be considered "work made for hire" under U.S. Copyright law. Buyer will receive exclusive and complete copyrights to all work purchased. (No GPL, GNU, 3rd party components, etc. unless all copyright ramifications are explained AND AGREED TO by the buyer on the site per the coder's Seller Legal Agreement). ## Platform The coder should test under IE7 and Firefox browsers.