Determine Ajax Query for a Website

Closed Posted Apr 21, 2012 Paid on delivery
Closed Paid on delivery

I need to scrape some data from completed auctions at quibids.com. That data presented on the page I need to scrape, is presented to you in the browser using AJAX. That means that what I need scraped can't be seen in the HTML source code. I need to replicate the AJAX query that presents the data I need scraped. I have already found the AJAX query to do this, but I can't figure out how to replicate the required "tokens" in the URL which are calculated using JavaScript.

Here is the URL of a completed auction at quibids:

[url removed, login to view]

Please have that URL open so you can reference what I need scraped from that page.

I need the following information scraped from that page

Winning Bidder

File Sale Price

Real Bids

Voucher Bids

You'll notice that if you visit the following URL, that you're given all the information I need scraped.:

[url removed, login to view];cs=0ddf653dde72041e41ec&a=34

The thing is, I can't figure out how the "id=" & the "cs=" tokens are determined. The "a=" token is always 34.

The "id=" token & the "cs=" token are determined in this script:

[url removed, login to view]

The [url removed, login to view] page is called upon in this script:

[url removed, login to view]

I need a simple blank white webpage designed, that has an input box on it. In that input box, I need to be able to enter an auction ID number (the number at the end of every quibids auction URL, like the one posted above). When input the ID number, I then should click a submit button, and when that submit button is clicked, it should display to me all of the data displayed on this page:

[url removed, login to view];cs=0ddf653dde72041e41ec&a=34

Alright, it looks like that second eoa.php URL is going to be different for everybody, as it is somehow related to cookies. When I clear my cookies, that URL just shows as blank.

To then get the updated URL that doesn't show as blank, I have to use HttpFox & reload the ended auction page to see the eoa.php URL with the proper tokens in it.

If I don't clear my cookies, the tokens don't change.

AJAX HTML JavaScript PHP Web Scraping

Project ID: #1579470

About the project

11 proposals Remote project Active May 26, 2012

11 freelancers are bidding on average $152 for this job

zeke

I have lots of experience writhing web automation scripts. Please see PMB for examples of my previous web automation related projects. Available to start immediately and finish as soon as possible. Best Regards, Ze More

$200 USD in 2 days
(156 Reviews)
6.9
VileGnosis

Details in PMB

$150 USD in 0 days
(199 Reviews)
6.7
MarcusPan

Simple! Let me do that for you in an hour.

$99 USD in 1 day
(136 Reviews)
6.7
inspire007

hi...please check PM

$150 USD in 1 day
(79 Reviews)
6.1
piaoxin

Hi, rjeaton1. I can do it. Please check PM. Thanks and regards.

$200 USD in 2 days
(33 Reviews)
5.5
nicky789

Hi I looked into the website that you give. Please check your pmb

$150 USD in 2 days
(7 Reviews)
5.1
NetworkTech

Hi - I have a demo of this in action for you. Please check your inbox.

$85 USD in 0 days
(24 Reviews)
4.9
EvanKos

Hi, i can help you with that, check pm.

$80 USD in 4 days
(10 Reviews)
4.8
mati233

Check your PMB please.

$150 USD in 1 day
(1 Review)
2.6
hijeenu

Expert scraper here. I have scraped many fully ajax dependent sites. I assure you 100% satisfaction and quality job.

$160 USD in 1 day
(0 Reviews)
0.0
HV06mN4tH

Pls check PMB.

$250 USD in 1 day
(0 Reviews)
0.0