Completed

Need new web spider scraping program written for the following username DFUSER8493

I need a web scraper written for the .xlsx file in the following directory:

[login to view URL]

The latest .xlsx file within that directory will need to be downloaded.

The name of the file is subject to change daily and will need to be identified by the latest .xlsx extension.

All information needed is available on the main page. The number of rows will vary.

The output should be a pipe (|) delimited file with the following column mappings:

origin_city --> data located in Column B

origin_state --> data located in Column C

ship_date --> data located in Column A, change to the YYYY-MM-DD format

destination_city --> data located in Column D

destination_state --> data located in Column E

receive_date --> leave blank

trailer_type --> data located in Column F

load_size --> data located in Column G

weight --> data located in Column O, add three zeros to the end of the

data if there are only 2 numbers (ie. 48 = 48000)

length --> data located in Column N

width --> leave blank

height --> leave blank

trip_miles --> data located in Column H

pay_rate --> data located in Column M

contact_phone --> leave blank

contact_name --> add data from Columns J & K

tarp_required --> leave blank

comment --> data located in Column L

load_number --> leave blank

commodity --> data located in Column I

The first line of the output should contain all of the column headers.

Any field that contains no data should be left blank.

Please do not use words like "null" or "blank" in blank columns.

Below is a sample output of the first 5 columns using sample data:

origin_city|origin_state|ship_date|destination_city|destination_state|

chicago|IL|2017-03-15|new york|NY|

kansas city|MO|2017-03-15|houston|TX|

The deliverable will be a Perl .pl file that must run on

Ubuntu Linux and must use Modern::Perl. The Perl .pl file

should be called '[login to view URL]' and the output file should be

called '[login to view URL]'

It will be scheduled in cron to run unattended every 15 minutes.

Please specific what language/OS/modules you plan to use.

Also, please include the word "raccoon" in your bid so I know that

you read this description.

Skills: Linux, Perl, Web Scraping

See more: write web spider, web spider development, need end web designer, web spider source, web spider crawling website robot vbnet, need adult web designer right, web spider collect data, email scraping program, need magento web designer, build program written, game dont need flash web, need create web community, web scraping program, need program written, need program written website, i need a developer to help develop a web based software program i will provide full project details once you place a placeholder, i need for new web designer, need a new web site designed, need new web designers

About the Employer:
( 62 reviews ) Chillicothe, United States

Project ID: #17660176

Awarded to:

gangabass

I can provide you updated scraping program version (DFUSER8493) using Perl and WWW::Mechanize in less than a day.

$88 USD in 1 day
(405 Reviews)
7.2

14 freelancers are bidding on average $165 for this job

uumarkhalid31

HI I am expert in web scraping and i have done several scraping project. I have made many scrapers for differernt clients for different websites and directories. Please contact me so we can discuss it in detail. reg More

$200 USD in 3 days
(218 Reviews)
6.9
zekovicm

Hi there,I am Miljan,Web Scraping expert from Bosnia & Herzegovina,Europe. I have carefully gone through with your requirements and I would like to help you with this job ! I can start immediately and finish it within More

$222 USD in 3 days
(54 Reviews)
6.4
stevobujica91

Hello, ###raccoon I'm a python developer with a lot of experience in web scraping. I will do it using python requests module and it can be run on any OS, Please contact me over chat to discuss more. Best regards.

$166 USD in 2 days
(18 Reviews)
4.9
Programmer59

raccoon Hello Sir, We read your description We have lot of experience in this filed We can do that also If you want We are available for start work right now I am waiting your response. We have completed many More

$200 USD in 5 days
(12 Reviews)
5.0
wobits

raccoon Dear Sir, dear Madam, I can do this job obeying the requirements specified within the next 14 days (currently ny workload is quite high). I have successfully done several web-scraping projects in the rec More

$150 USD in 14 days
(8 Reviews)
5.0
mladenbiz

Greetings i can make you scraper that you need but in Python. It will run nativly on ubuntu linux. Sincerely Mladen

$250 USD in 3 days
(18 Reviews)
5.0
dslc

Keyword: 'raccoon' I propose to use the LWP::UserAgent module for retrieving the data over the network, and Spreadsheet::ParseExcel for parsing the Excel spreadsheet. Can you confirm that you are authorized to 's More

$150 USD in 5 days
(9 Reviews)
4.3
BestPartner4You

Hi,there. I am very interested in your project - 'Need new web spider scraping program written for the following username DFUSER8493'. I've already done this kind of project before. I'm a professional programmer with 1 More

$155 USD in 2 days
(5 Reviews)
3.0
kjdev616

raccoon Hi, Thank you for your job posting. I am a senior web developer with rich experience in python web scraping. I've gone through your job posting and I am pretty sure I can do it. I can start now. Loo More

$155 USD in 1 day
(3 Reviews)
2.2
mtriettruong

"raccoon" and hi, I got your requirements completely. And the below is my approach to implement them: - I will write a script call DFUSER8493.pl. It will be a Perl script to work in Linux environments (Ubuntu Or More

$155 USD in 3 days
(3 Reviews)
2.3
binarytiger

raccoon Hi, so the task is to make a Perl script which works on Ubuntu and uses Modern::Perl , which does the following: 1) Download the xlsx file from [login to view URL] 2) Parse the da More

$111 USD in 2 days
(0 Reviews)
0.0
VakiYT

I can finish Your project with PHP instead Perl. I send You my offer, if You are interested contact me. Have a nice day. raccoon

$30 USD in 3 days
(0 Reviews)
0.0
$277 USD in 5 days
(0 Reviews)
0.0