Nice to meet you.
My name is Da Zhang. I am an experienced data scraper. I checked the website. In fact, it's really simple.
Please take a look at this page, scrolling down 1 page.
* [login to view URL]
Then visit this page:
[login to view URL]
See it?
The jobs data are in the ajax call's response.
In your job description, the first 3 columns are very clear: job title, location, post date. But what do you want to save in the last field - job sepc?
The job detail page contains job description, job type etc information, it also sent through ajax call in JSON format. We can just send HTTP request, set the accept header to "application/json".
This project looks not that complex, do we need to use scrapy must? When generate a scrapy project, it create many other files (item, middlewares etc), Why don't just create a simple py file to do this work? See below:
- HTTP requests: requests or urllib
- Parse JSON: json library.
I can start immediately. Let me know what do you think.
Thank you very much.