Periodic web crawler in Python/Rails for read data from web/download latest files and upload it to another sites via API
$30-250 USD
Paid on delivery
Hello,
I need a Python or Ruby or PHP program to scrap one website and store the results in a PostgreSQL database. And also download file from to website and push it to another specified website via API. The program needs to keep running periodically to read the latest posts on the websites.
Sample website : https://app[dot]any[dot]run/tasks/d771a9a1-31ae-4d64-adb6-74e747ec3e16/
Please answer me 3 questions before you offer, I will not respond to anyone who haven't answer the following questions,
1. What is the sample website topic?
2. How will you make the program run periodically
3. What library will you use for crawler? Thanks.
Project ID: #20007155
About the project
7 freelancers are bidding on average $144 for this job
Greetings Sir, I am Muhammad Faisal and we are professional Software Developer and i will use Java Selenium to Scrap this website and we provide you quality work within your budget and time duration so, lets get start More
Experience in latest development tools and technologies like Php, Node Js, Magento, Laravel, Wordpress, Html, Css, Typescript, GraphQL, React JS, React Native, Angular Js. Also handle server and deployments in AWS.