Completed

Need a web spider scraping program written for the following username DFUSER1233

I need a web scraper written for the following url:

[login to view URL]

Click on "Swift" tab at the top of the page, in the middle. Data to be scraped will be under the "Swift" tab.

All pages will need to be retrieved not just page one.

The data on this site changes and the number of pages will vary, however, we need to scrape data from all available pages.

The output should be a pipe (|) delimited file with the following column mappings:

origin_city --> data located in the "Origin" column before the comma

origin_state --> data is the 2 letter abbreviation in the "Origin" column after the comma

the 5 digit zip code after the abbreviation is not needed

ship_date --> data located below the origin_city in the "Origin" column, changed to the

YYYY-MM-DD format, the time located after the date is not needed

destination_city --> data located in the "Destination" column before the comma

destination_state --> data is the 2 letter abbreviation in the "Destination" column after the

comma, the 5 digit zip code after the abbreviation is not needed

receive_date --> data located below the destination_city in the "Destination" column,

changed to the YYYY-MM-DD format, the time located after the date is not needed

trailer_type --> data located in the "Equipment" column

load_size --> add the text "Full" to this column

weight --> data located in the "Weight" column

length --> Leave blank

width --> leave blank

height --> leave blank

trip_miles --> data located in the "Miles" column

pay_rate --> leave blank

contact_phone --> 800-477-8025

contact_name --> leave blank

tarp_required --> leave blank

comment --> leave blank

load_number --> leave blank

commodity --> leave blank

The first line of the output should contain all of the column headers.

Any field that contain no data should be left blank.

Please do not use words like "null" or "blank" in blank columns.

Below is a sample output of the first 5 columns using sample data:

origin_city|origin_state|ship_date|destination_city|destination_state|

chicago|IL|2017-03-15|new york|NY|

kansas city|MO|2017-03-15|houston|TX|

The deliverable will be a Perl .pl file that must run on

Ubuntu Linux and must use Modern::Perl. The Perl .pl file

should be called '[login to view URL]' and the output file should be

called '[login to view URL]'

It will be scheduled in cron to run unattended every 15 minutes.

Please specify what language/OS/modules you plan to use.

Also, please include the word "raccoon" in your bid so I know that

you read this description.

Skills: Perl, Web Scraping, Linux

See more: need web master, need web designer landing page, write web spider, clickbank need web site, web spider development, need web site, web spider source, web spider crawling website robot vbnet, software experience need web designer, need web developer, web spider collect data, email scraping program, build program written, need web scraper takes search data excel, web scraping program, need program written, need program written website, need web program, i need a developer to help develop a web based software program i will provide full project details once you place a placeholder

About the Employer:
( 73 reviews ) Chillicothe, United States

Project ID: #21957310

Awarded to:

gangabass

Thank you for your invitation! I can provide you a simple Perl scraper (WWW::Mechanize etc) that will work exactly like you want.

$88 USD in 1 day
(522 Reviews)
7.6

4 freelancers are bidding on average $122 for this job

mantislin

Hi there, This is Lin and I am scraping expert, I have did many scraping projects, please check my reviews then you wil know. I have checked all details for your project, but there are some details that i want to dis More

$144 USD in 3 days
(303 Reviews)
7.6
smsaurabhv

Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON More

$100 USD in 4 days
(88 Reviews)
5.7
ayesha0124

Hi there,. I have checked the details, I have rich experience with Linux, Perl, Web Scraping. Please initiate the chat so that we can discuss in detail.. Hi Jon G.! Please Send me a message so that we can discuss more More

$155 USD in 9 days
(3 Reviews)
4.9