Fixing two bugs in a webscraping project in R / rvest (only 5 lines of code!)

Closed Posted 6 years ago Paid on delivery
Closed Paid on delivery

I want to scrape some data on this page here:

[login to view URL]

which has the CSS selector ".paddTD10"

The data is invisible until you hover your mouse over an item in the table. I'm unable to extract any data (empty list returned). However, I confirmed that the CSS selector is correct, as you can tell from the yellow markings from SelectorGadget on screenshot #1. (Bug #1)

If one clicks on an item in the "symbol" column and scrapes the subpage that gets opened, the very same selector works with only one problem: The html_table() function ignores the last column (Bug #2), even if SelectorGadget marks the whole table. -> screenshot #2

I'm paying you because I want to learn from my mistakes and improve my own coding.

My priority is (from highest to lowest) fix for bug #1, if not possible then workaround for bug #1, then fix for bug #2 (I already have a workaround).

Therefore we will break down the project into these milestones:

Workaround for Bug #1: 40% of total payment

Direct fix for Bug #1: 40% of total payment -> 80% of total payment (including 40% for the workaround that is not needed)

Direct fix for Bug #2: rest (=20% of total payment)

This is my R script:

library('rvest')

url <- "[login to view URL]"

allassetdata <- read_html(url) %>% html_nodes(".paddTD10") %>% html_table(fill = T)

url <- "[login to view URL]"

singleassetdata <- read_html(url) %>% html_nodes(".paddTD10") %>% html_table(fill = T)

CSS HTML

Project ID: #16593214

About the project

10 proposals Remote project Active 5 years ago

10 freelancers are bidding on average €23 for this job

royalwebraisers

HI, I can help you in getting the data which comes on hover of the website. Let me know when we can discuss and start working. Looking forward for your response. Thanks.

€31 EUR in 1 day
(118 Reviews)
6.5
ludwig333

Hi I am an expert in python and R. I have a lot of experiences in Web scraping by using R and selenium. I have an interested about your project. I would like to have a discussion with you.

€23 EUR in 1 day
(47 Reviews)
5.9
baphpwordress

Hi, we can decide rates from your side (price can be negotiated) I understood your requirement I have knowledge in this filed 5+ yr so many projects I have done. kindly let me know in brief what kind of req More

€19 EUR in 1 day
(11 Reviews)
3.8
jamesmatuie0422

Hello, Thanks you for your job posting. I read your job description carefully and I'm sure I'm the most perfect candidate for this job. Please feel free to contact me. Thanks, James

€8 EUR in 1 day
(0 Reviews)
0.0