Need a web spider scraping program written for the following username TRE2661

I need a web scraper written for the following url:

[login to view URL]

The latest .csv file within that directory will need to be downloaded.

The name of the file is subject to change daily and will need to be identified by the latest .csv extension.

All information needed is available on the main page. The number of rows will vary.

The output should be a pipe (|) delimited file with the following column mappings:

origin_city --> data located in column "A"

origin_state --> data located in column "B"

ship_date --> data located in column "K", change to the YYYY-MM-DD format

destination_city --> data located in column "E"

destination_state --> data located in column "F"

receive_date --> leave blank

trailer_type --> data located in column "I"

load_size --> data located in column "O", if data in column "O" contains "TL" add the text

"Full", if data in column "O" contains "LTL" add the text "Partial"

weight --> data located in column "Q"

length --> data located in column "R"

width --> leave blank

height --> leave blank

trip_miles --> leave blank

pay_rate --> data located in column "J"

contact_phone --> leave blank

contact_name --> leave blank

tarp_required --> if data in column "P" contains "Tarps", add the text "Tarp" to column "I"

comment --> data located in column "W"

load_number --> leave blank

commodity --> leave blank

The first line of the output should contain all of the column headers.

Any field that contains no data should be left blank.

Please do not use words like "null" or "blank" in blank columns.

Below is a sample output of the first 5 columns using sample data:


chicago|IL|2017-03-15|new york|NY|

kansas city|MO|2017-03-15|houston|TX|

The deliverable will be a Perl .pl file that must run on

Ubuntu Linux and must use Modern::Perl. The Perl .pl file

should be called '[login to view URL]' and the output file should be

called '[login to view URL]'

It will be scheduled in cron to run unattended every 15 minutes.

Please specific what language/OS/modules you plan to use.

Also, please include the word "raccoon" in your bid so I know that

you read this description.

Skills: Perl, Web Scraping, Linux

See more: need web master, need web designer landing page, write web spider, clickbank need web site, web spider development, need web site, web spider source, web spider crawling website robot vbnet, software experience need web designer, need web developer, web spider collect data, email scraping program, build program written, web scraping program, need program written, need program written website, need web program, i need a developer to help develop a web based software program i will provide full project details once you place a placeholder, why do we need web scraping

About the Employer:
( 74 reviews ) Chillicothe, United States

Project ID: #21456892

Awarded to:


Thank you for your invitation! I can provide you a Perl scraper that will work exactly like you want: I'll use WWW::Mechanize and Text::CSV_XS modules etc.

$88 USD in 1 day
(522 Reviews)

9 freelancers are bidding on average $150 for this job


Hi there, This is Lin, Can we discuss more details about your project? then i can do example data or script for you, we can continue after you checked example data. I did more than 380+ scraping project, please view More

$142 USD in 3 days
(310 Reviews)

Hello, How are you? I'm very interested in your job post.I believe my skills would be ideal for your project. I am Python Expert and I have rich experience with Web Scraping and I can help you perfectly. And then I am More

$120 USD in 2 days
(5 Reviews)

Hello, I have experience in web scraping with Python. I can use Selenium, Scrapy, BeautifulSoup and Requests to make the best web scrapers! I have scraped websites like: Amazon, eBay, Instagram, Yelp, Groupon, Yellow More

$200 USD in 7 days
(4 Reviews)

Hi Dear I read your requirements carefully. I have rich experience with Python Django, Flask, selenium, Web Scrapy, software architecture and so on. You can see my good reviews for python projects. I can complete your More

$200 USD in 7 days
(3 Reviews)

Hello, "raccoon" requirements are clear. I m ready to start working on it right now and will deliver on 2 days MAX. I will use Perl/Linux (modules will be specified later) Best regards Houssame

$100 USD in 2 days
(8 Reviews)

Hi there, Your website designer and developer here. Graduated recently from Kings College, England ; I have been doing numerous Website and app design projects. I feel I will be comfortable to work with you and perfor More

$220 USD in 5 days
(1 Review)

Hello I have reviewed your job description as well and very confident to handle this project perfectly. I specialize in WordPress [login to view URL] More

$140 USD in 7 days
(2 Reviews)

Greetings, This project is not that complicated and should take no more than 2 days to complete. Your requirements are well defined and easy to understand. I have several years of Perl development in my past and will b More

$140 USD in 2 days
(0 Reviews)