Completed

Need a web spider scraping program written for the following username DFUSER1233

I need a web scraper written for the following url:

[login to view URL]

Click on "Swift" tab at the top of the page, in the middle. Data to be scraped will be under the "Swift" tab.

All pages will need to be retrieved not just page one.

The data on this site changes and the number of pages will vary, however, we need to scrape data from all available pages.

The output should be a pipe (|) delimited file with the following column mappings:

origin_city --> data located in the "Origin" column before the comma

origin_state --> data is the 2 letter abbreviation in the "Origin" column after the comma

the 5 digit zip code after the abbreviation is not needed

ship_date --> data located below the origin_city in the "Origin" column, changed to the

YYYY-MM-DD format, the time located after the date is not needed

destination_city --> data located in the "Destination" column before the comma

destination_state --> data is the 2 letter abbreviation in the "Destination" column after the

comma, the 5 digit zip code after the abbreviation is not needed

receive_date --> data located below the destination_city in the "Destination" column,

changed to the YYYY-MM-DD format, the time located after the date is not needed

trailer_type --> data located in the "Equipment" column

load_size --> add the text "Full" to this column

weight --> data located in the "Weight" column

length --> Leave blank

width --> leave blank

height --> leave blank

trip_miles --> data located in the "Miles" column

pay_rate --> leave blank

contact_phone --> 800-477-8025

contact_name --> leave blank

tarp_required --> leave blank

comment --> leave blank

load_number --> leave blank

commodity --> leave blank

The first line of the output should contain all of the column headers.

Any field that contain no data should be left blank.

Please do not use words like "null" or "blank" in blank columns.

Below is a sample output of the first 5 columns using sample data:

origin_city|origin_state|ship_date|destination_city|destination_state|

chicago|IL|2017-03-15|new york|NY|

kansas city|MO|2017-03-15|houston|TX|

The deliverable will be a Perl .pl file that must run on

Ubuntu Linux and must use Modern::Perl. The Perl .pl file

should be called '[login to view URL]' and the output file should be

called '[login to view URL]'

It will be scheduled in cron to run unattended every 15 minutes.

Please specify what language/OS/modules you plan to use.

Also, please include the word "raccoon" in your bid so I know that

you read this description.

Skills: Perl, Web Scraping, Linux

See more: need web master, need web designer landing page, write web spider, clickbank need web site, web spider development, need web site, web spider source, web spider crawling website robot vbnet, software experience need web designer, need web developer, web spider collect data, email scraping program, build program written, need web scraper takes search data excel, web scraping program, need program written, need program written website, need web program, i need a developer to help develop a web based software program i will provide full project details once you place a placeholder

About the Employer:
( 68 reviews ) Chillicothe, United States

Project ID: #21957310

Awarded to:

gangabass

Thank you for your invitation! I can provide you a simple Perl scraper (WWW::Mechanize etc) that will work exactly like you want.

$88 USD in 1 day
(480 Reviews)
7.4

12 freelancers are bidding on average $140 for this job

mantislin

Hi there, This is Lin and I am scraping expert, I have did many scraping projects, please check my reviews then you wil know. I have checked all details for your project, but there are some details that i want to dis More

$144 USD in 3 days
(291 Reviews)
7.6
smsaurabhv

Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON More

$100 USD in 4 days
(67 Reviews)
5.4
ayesha0124

Hi there,. I have checked the details, I have rich experience with Linux, Perl, Web Scraping. Please initiate the chat so that we can discuss in detail.. Hi Jon G.! Please Send me a message so that we can discuss more More

$155 USD in 9 days
(3 Reviews)
4.9
michaels225

It's a piece of cake for me. Hi, sir. I am a Web scraping expert. I have many experiences like your project. I am very confident to complete this task in a few days. I am ready for your project and I will provide the b More

$140 USD in 3 days
(3 Reviews)
3.2
wwwTom

Hello! I am very interested in your post project. While I read your description carefully, I was excited with feeling that I would be able to satisfy for your requirements in this job. We can negotiate on price/Budge More

$140 USD in 7 days
(2 Reviews)
2.4
xuwentao821

Raccoon. Thank you for your great job posting. I am a webscraping expert and I understood your all requirements. I can do it. But I have some questions. Please feel free to contact me and let's discuss more details. R More

$100 USD in 1 day
(8 Reviews)
2.2
vSanta727

Hello. I'm a Web Scraping expert. I have many experiences in Web Scraping. I'm confident that I can complete your work perfectly within a short time. Hope to contact. Thank you.!

$140 USD in 7 days
(1 Review)
1.4
KDC999

"raccoon" Hello. How are you. My name is Meiling Cai, from China. I am a scraping expert with great experiences. I had read your job posting and understood fully what you want to get. But I recommend python instead of More

$140 USD in 1 day
(1 Review)
1.0
codestar0714

Hello Sir! I'm skilled in web scraping with Scrapy framework, and scraping automation with Selenium and beautifulsoup. If you need to get information off the web in an automatic fashion, I can write you a special scrip More

$140 USD in 7 days
(1 Review)
0.0
aleksandr201906

As an experienced developer, I am sure I can handle your project perfectly in the quick timeline. I am an excellent PHP developer that has powerful expertise in backend and frontend development. I will use the PHP CURL More

$250 USD in 2 days
(0 Reviews)
0.0
lesteraguilar

***raccoon*** I have full experience about web scrapping. I am going to use node js library such as puppeteer or python library such as urllib. I am confident about your project. Warm Regards.

$140 USD in 7 days
(0 Reviews)
0.0