Scrape a URL (http request) a specific website searches (need in javascript - nodejs)
R$30-90 BRL
Paid on delivery
Well, I had a working version to scrape the URL I am looking for with phantomJS (using async, await), but the website changed the backend and I got stuck...
Here is the story:
When I access a specific website address, it makes an HTTPS Request to another website using a specific key. Each time the first website is accessed it changes the key randomly, and thus the HTTPS Request.
I need to grab this HTTPS Request URL with NodeJS.
I can get easily get the desired URL via Chrome DevTools (Network/XHR).
Summary:
. I will need a printscreen of the website (to make sure you got the new version, that I got stuck with);
. I will need a simple [login to view URL] that I can run and outputs me ([login to view URL]) this specific URL.
Project ID: #16475595
About the project
Awarded to:
I have experience with both nodejs and web scraping so I can surely help you with this project. I have solved a similar problem before where a site was trying to prevent automation.
4 freelancers are bidding on average R$72 for this job
Hi, I have very good experience in web scraping using Python and Node.js. I have gone through your requirements and can quickly create a script in node.js to return that https url. Looking forward to hear from More
Hello, I can analyse the website and all it's requests and follow each request till i get the source of the random key .