Website Scraping using node.js

Web Scape ( using node.js )

*** These are currently the manual steps I use to generate our desired output ***

I want to automate this task !!!

I Login to a secure website with a single username/password

Once logged in, I click on a link which brings us to a web form.

now I need to enter an applicant ID into a field (this is the applicant form)

Then I need to click on a "magnifier icon" which open a popup and I type in a product item, I click on search and it provides a list of all sub-product items ( there can be up to 5 sub-product items ).

When I click the sub-product link, it goes back to the original applicant form and inserts our selection into a readonly field

Then I click on search and some status info is returned on the same page. (which is what I need collected, along with the sub-product item name )

* I will repeat the process of using the same applicant ID while searching for the other sub-product items.

When all sub-product items have been verified, then I go onto the next applicant ID... etc...


I would like this program to get the username/password also from a simple csv file

I would like this program to get the data required from a simple csv file at runtime that contains the applicant IDs and product items.

I would also like the extracted data, output to a csv file.


Because it's already 5PM in my time, I will only make a decision in terms of hiring tomorrow. Thanks.

Skills: Node.js, JavaScript, Web Scraping, Software Architecture

See more: website scraping using vba, freelancers node js web design bangalore, companies using node.js, node.js web service, node js web scraping login, create website using node js, node js web scraping library, node js web scraping, using node js in web application, an introduction to web scraping with node js, how to build a web application using node js, how to create a dynamic website using node js, node js web scraping framework, ecommerce website using node js, how to build a website using node js, web application development using node js, web crawler using node js, node js web scraping github, full stack web development using node js, web scraping using node js with projects from scratch

About the Employer:
( 12 reviews ) laval, Canada

Project ID: #21681913

60 freelancers are bidding on average $1103 for this job


Dear employer as a custom Node.js (for Rest API) developer i am having relevant skills and experience as you requested in your project description...i can share some demo as well in further chat. can we discuss more on More

$2500 CAD in 15 days
(89 Reviews)

Hi, my name is Selim. I am from UK. I read your `Website Scraping using node.js` project descriptions carefully before bidding. I checked the your requirements as well... I got what you need and ready to go ahead as so More

$950 CAD in 7 days
(295 Reviews)

Hi there, I am scraping expert, I have did more than 350+ scraping project, please check my feedback then you will know. Can we discuss more details about this project? then I will provide example data/script for you More

$1440 CAD in 6 days
(364 Reviews)

Hello, Its been 4 years working with Node.js and surely able to help you for scraping. **Kindly open your PMB for further discussion. Best Regards, Lx.

$900 CAD in 7 days
(342 Reviews)

Hi, I have gone through the brief details mentioned on the job. I have done multiple jobs with Javascript, node.js, Software Architecture, Web Scraping which are the skills required to get this job done. Lets start the More

$1500 CAD in 10 days
(83 Reviews)

Hello Sr./Madam Hope you read my proposal and take a look into my Portfolio to see my reputation and capabilities. I am an experienced Windows Desktop Apps Developer (C#, C++), Web Data Extractor & Automator (using dif More

$750 CAD in 7 days
(223 Reviews)

Hello there, This is Tahsinul Alam, CEO of Workspace InfoTech Limited. We have 52 engineers in 14 teams who are serving the world wide client in different ways. Our expertise are given below: Technology: ----------- More

$1125 CAD in 7 days
(22 Reviews)

Hi there,I am Web Scraping/automation ( node.js) expert from Bosnia & Herzegovina,Europe. We can definitely automate that process for you as you mentioned . You will put input csv in the folder where the node.js code w More

$850 CAD in 5 days
(147 Reviews)

If you wanted to use Python, I would use Python + selenium. As long as you want Node.js, I will use puppeteer. It is webbrowser-automation library. I recently made an Instagram b0t using it. Don't worry and don't dou More

$750 CAD in 3 days
(51 Reviews)

Dear Sir! I’d like to describe myself as someone who is versatile and determined and someone who loves learning. I am creative, open-minded and easy going and I enjoy working with others. And I tried to use all these q More

$1125 CAD in 7 days
(75 Reviews)

Hi there, I have read your project description and i'm confident i can do this project for you perfectly.I still have a few questions. please leave a message on my chat so we can discuss the budget and deadline of the More

$1500 CAD in 5 days
(59 Reviews)

Hello, We have 6+ years of experienced JavaScript MEAN/MERN stack developers Team for your project. You could hire full-stack Python, MongoDB, NodeJS and AngularJS technologies experts remotely with us for full tim More

$2000 CAD in 30 days
(43 Reviews)

Hi, I'm reaching out about i have done scrapping almost on Half of Worldwide web including eCommerce giants (Amazon, eBay, craigslist) News Feed, Social media websites, API's. I develop my own scrapers and Bots More

$1050 CAD in 7 days
(48 Reviews)

Hi, I like your project very much. What I can do is write fast and stable script that runs on demand, consuming the input csv. You mentioned that you want input to be on runtime (which means during the execution), wh More

$876 CAD in 7 days
(20 Reviews)

Hi,dear. I am very interested in your project - 'Website Scraping using node.js'. I've already done this kind of project before. I'm a professional programmer with 12 years of experience. If you award me, I'll implemen More

$1250 CAD in 5 days
(13 Reviews)

Hello Sir. As a web scraping and data mining expert, I am glad to place the bid on your project. I have already developed the auto scraper using the node and selenium and cron job. I have experienced in web site scrapi More

$1000 CAD in 3 days
(55 Reviews)

Can make automation tool in nodejs Can follow all the steps. want to Know more about the website. Can take username password as input from csv file This is our web scraping platform [login to view URL] have More

$1111 CAD in 4 days
(54 Reviews)

Hi, I have gone through project requirements in detail and understand what needs to be done. I can build a scraper for you based on your requirements. I have 3 years of experience in making web scraping tools. I assu More

$1200 CAD in 10 days
(131 Reviews)

We already have built large scale applications, CRMs, ERPs and huge systems can be found at our website. Like [login to view URL] [login to view URL] [login to view URL] [login to view URL] https: More

$1463 CAD in 5 days
(48 Reviews)

Greetings to you my dear!. How are you? I think that your project is good for me with my skills. I have experiences in Web Scraping using python, Java/JavaFX, c# using selenium, scrapy, beautifulsoup. Amazon, Ebay, Bet More

$1000 CAD in 7 days
(38 Reviews)