Find Jobs
Hire Freelancers

Java/Perl/Perl Web Scraper & Logger

$10-30 USD

Cancelled
Posted over 7 years ago

$10-30 USD

Paid on delivery
I am looking to have a web-scraping script written that does not require additional dependencies (ie nothing other than the base installf of perl, python or jvm). Script will log to an excel document. Sample URL for testing: [login to view URL]|&bedrooms=0&bathrooms=1&Accessible=False&pictures=False&pets=False&ac=False&AgeRestricted=False&smoking=False&coveredParking=False&MaxSqFt=5000&MinSqFt=0&keyword=&sortBy=LastUpdate Script requirements: - remember the last 5 base URLs used - be able to configure the URL / select previous or enter new - select an output file / option to type or browse to target file location - - scraper must log data into an excel document - - if file exists, data will be appended to the existing file - - - set all entries in the "Active" column to "No" - - if file does not exist, scraper must create the target file - - - First row must contain the following headings: Active, Last Active, Landlord Name, Phone, Contacted, Notes - connect to website - determine # of listings/pages returned - visit each listing's page - save each landlord's name and telephone number (on the right side of the page) - - if excel file selected earlier exists, scan the file to see if landlord information is already in the file (excluding ' - - if already in the file - - - update record's "Active" field to "Yes" - - - update record's "Last Active" field to current date (YYYY/MM/DD format) - - - go to next property - - if not already in file - - - add a record to the file using field structure below Scraper must go through each page of returned results to get all data - links for each page are at the bottom of the page. Visual progress should be displayed as scraper runs, and stored in a log file named "[login to view URL]" representing the date and time the scraper was executed. For example: - Scraping [URL] - 23 listings found ------------------------------------------------------------------------------------------------------- | Progress | Landlord | Phone | Status | ------------------------------------------------------------------------------------------------------- | 1/23 | William Ellis | 214-111-2222 | New Contact | | 2/23 | John Sno | 555-444-3333 | Existing Contact | | 3/23 | Arya Stark | 555-867-5309 | New Contact | ------------------------------------------------------------------------------------------------------- - Existing Contacts: 15 - New Contacts: 7 Fields: Active (Yes/No) Last Active (YYYY/MM/DD format) Landlord Name (as it appears) Phone (###-###-#### format, no ( ) around first digits) Contacted ("No" by default for all new contacts. do not alter for existing contacts) Then end-state is to have an excel document i can use to keep updating and adding new contacts based on the scrape of the [login to view URL] website. Deliverable includes all source code files
Project ID: 11382461

About the project

9 proposals
Remote project
Active 8 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
9 freelancers are bidding on average $81 USD for this job
User Avatar
Hi Sir/Madam, I'm expert in Python programming and I have a lot of experience in web scraping. This will require more than 2 hours of coding, so I put little higher price. Best regards, Fejs.
$60 USD in 2 days
5.0 (46 reviews)
5.4
5.4
User Avatar
Hi. I'm senior java developer. This job is simple to me. I'm surely satisfy you in this project :)
$30 USD in 2 days
4.9 (23 reviews)
4.8
4.8
User Avatar
We are team of excellent developers. We have 2 year experience related to your project field. We can do your project and solve your all problems according to your requirements. We have read your description for projects and we understand what you want so we are confident that we can do it easily in mention time. We assure you that you will be completely satisfy with our work. And after delivering your project if you feel some issue in understanding the projects then we will teach you free until you understand. If you have any question then feel free to ask. We are here for you. Thank you Demon Developer Team
$30 USD in 1 day
4.9 (15 reviews)
4.1
4.1
User Avatar
Hey there, I'd like to work with you on this project, if you're considering me I'd like to know few more details, thanks and good luck with the project
$40 USD in 6 days
5.0 (2 reviews)
2.6
2.6
User Avatar
Java isn't just coffee I will use Java/PHP for that. Similar work I have done earlier, But I don't have any demo with me now for the same. This is max 1 day task. Thanks
$35 USD in 1 day
0.0 (0 reviews)
0.0
0.0
User Avatar
I build web scrapers professionally. My name is Anson, and I am a programmer of 10 years with a background in retail, educated at the University of California, Davis. I can deliver to you a very robust Python script to perform the scraping for you. While it would be faster to cleaner to use additional more specialized packages, I have a technique to do it with just a base installation of Python. I can also include features such as complete error logging, automatic retries, logging problem links so they may be retried or checked manually and also measures to prevent the scraping IP from being blacklisted such as configurable, randomized wait intervals between requests, and support for rotating proxies and headers. Please contact me, and we can discuss a final feature set and I can give you a more acurate estimate about development time and costs. I would be willing to provide you with a sample scrape as well as my portfolio and profile. If you are willing to pay for quality, and for it to be done right, I can work with you to deliver to you that and much more Java isn't just coffee and Python isn't just a snake.
$100 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
x, United States
4.6
4
Payment method verified
Member since Dec 19, 2012

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.