Completed

Need a web spider scraping program written for the following username TRE2661

I need a web scraper written for the following url:

[login to view URL]

The latest .csv file within that directory will need to be downloaded.

The name of the file is subject to change daily and will need to be identified by the latest .csv extension.

All information needed is available on the main page. The number of rows will vary.

The output should be a pipe (|) delimited file with the following column mappings:

origin_city --> data located in column "A"

origin_state --> data located in column "B"

ship_date --> data located in column "K", change to the YYYY-MM-DD format

destination_city --> data located in column "E"

destination_state --> data located in column "F"

receive_date --> leave blank

trailer_type --> data located in column "I"

load_size --> data located in column "O", if data in column "O" contains "TL" add the text

"Full", if data in column "O" contains "LTL" add the text "Partial"

weight --> data located in column "Q"

length --> data located in column "R"

width --> leave blank

height --> leave blank

trip_miles --> leave blank

pay_rate --> data located in column "J"

contact_phone --> leave blank

contact_name --> leave blank

tarp_required --> if data in column "P" contains "Tarps", add the text "Tarp" to column "I"

comment --> data located in column "W"

load_number --> leave blank

commodity --> leave blank

The first line of the output should contain all of the column headers.

Any field that contains no data should be left blank.

Please do not use words like "null" or "blank" in blank columns.

Below is a sample output of the first 5 columns using sample data:

origin_city|origin_state|ship_date|destination_city|destination_state|

chicago|IL|2017-03-15|new york|NY|

kansas city|MO|2017-03-15|houston|TX|

The deliverable will be a Perl .pl file that must run on

Ubuntu Linux and must use Modern::Perl. The Perl .pl file

should be called '[login to view URL]' and the output file should be

called '[login to view URL]'

It will be scheduled in cron to run unattended every 15 minutes.

Please specific what language/OS/modules you plan to use.

Also, please include the word "raccoon" in your bid so I know that

you read this description.

Skills: Perl, Web Scraping, Linux

See more: need web master, need web designer landing page, write web spider, clickbank need web site, web spider development, need web site, web spider source, web spider crawling website robot vbnet, software experience need web designer, need web developer, web spider collect data, email scraping program, build program written, web scraping program, need program written, need program written website, need web program, i need a developer to help develop a web based software program i will provide full project details once you place a placeholder, why do we need web scraping

About the Employer:
( 68 reviews ) Chillicothe, United States

Project ID: #21456892

Awarded to:

gangabass

Thank you for your invitation! I can provide you a Perl scraper that will work exactly like you want: I'll use WWW::Mechanize and Text::CSV_XS modules etc.

$88 USD in 1 day
(476 Reviews)
7.4

15 freelancers are bidding on average $142 for this job

mantislin

Hi there, This is Lin, Can we discuss more details about your project? then i can do example data or script for you, we can continue after you checked example data. I did more than 380+ scraping project, please view More

$142 USD in 3 days
(288 Reviews)
7.6
crazyunix

hello , how are you , i wrote this after i checked your project details i can work on your project ,due to my experience and skills . you are welcome to contact me to discuss your project

$140 USD in 7 days
(21 Reviews)
4.1
phantom1222

Hello, How are you? I'm very interested in your job post.I believe my skills would be ideal for your project. I am Python Expert and I have rich experience with Web Scraping and I can help you perfectly. And then I am More

$120 USD in 2 days
(3 Reviews)
3.9
oswaldoodavidal

Hello, I have experience in web scraping with Python. I can use Selenium, Scrapy, BeautifulSoup and Requests to make the best web scrapers! I have scraped websites like: Amazon, eBay, Instagram, Yelp, Groupon, Yellow More

$200 USD in 7 days
(2 Reviews)
4.1
StephanChebyshev

Hi.Dear.. Credit is my motto. I am a freelancer working in 24/7 service. I can scrape anything.I know all the angles of website scraping. I have much experience for 10+ years such as avoiding recaptcha, using multi thr More

$30 USD in 1 day
(5 Reviews)
3.5
AlexanderPGR

Hi Dear I read your requirements carefully. I have rich experience with Python Django, Flask, selenium, Web Scrapy, software architecture and so on. You can see my good reviews for python projects. I can complete your More

$200 USD in 7 days
(3 Reviews)
3.5
Houssamix

Hello, "raccoon" requirements are clear. I m ready to start working on it right now and will deliver on 2 days MAX. I will use Perl/Linux (modules will be specified later) Best regards Houssame

$100 USD in 2 days
(3 Reviews)
3.5
meshivanshsinghh

Hi There, I recently completed a Web Scraper Project in which I created a scraper for Amazon and eBay Website. You can check the review of mine from the employer. I have 1-year experience in Web Scraping and can guar More

$120 USD in 1 day
(4 Reviews)
3.3
sunearthdolpin

Dear client. I have over 4 years experience with Website scraping. As a highly skilled full stack developer and I can help you perfectly. I am very confident with my skills and I'd like to help your work by doing my be More

$140 USD in 7 days
(8 Reviews)
2.9
Jng93Slv3

Hello! I’m really glad to submit my proposal. ---raccoon--- I had a look at your given job post and came to know that you are looking for scrape Development as per your requirement. I got pretty much experience in web More

$150 USD in 3 days
(1 Review)
2.6
cooolwriter

Hi there, Your website designer and developer here. Graduated recently from Kings College, England ; I have been doing numerous Website and app design projects. I feel I will be comfortable to work with you and perfor More

$220 USD in 5 days
(1 Review)
2.5
topexpert713

raccoon Hi, Nice to meet you! I am very interesting your project and I am confident of I can help your job. I am confident of this project as I'm a professional SCraping expert with over 7 years of experience. Seems t More

$200 USD in 3 days
(3 Reviews)
2.0
perfectcoder2019

Hello I have reviewed your job description as well and very confident to handle this project perfectly. I specialize in WordPress [login to view URL] More

$140 USD in 7 days
(2 Reviews)
1.6
dinatural

Greetings, This project is not that complicated and should take no more than 2 days to complete. Your requirements are well defined and easy to understand. I have several years of Perl development in my past and will b More

$140 USD in 2 days
(0 Reviews)
0.0