Douyin Data Power-Scrape
$15-25 USD / hour
I require a skilled Python developer to build a robust data scraping system for my project. The focus will be on extracting large volumes of data daily from Douyin e-commerce and compiling information from [login to view URL], specifically tailored to select criteria.
Requirements:
- Develop a scraper that can handle 500,000 data points daily.
- Collect user profiles, product details, and live broadcast comments from Douyin.
- From [login to view URL], gather relevant product information.
Data Points Needed:
- **User Profiles:** No specific criteria, but must be efficiently extracted to assist in broad market analysis.
- **Product Details:** Focus on price, availability, product specifications, and ratings/reviews to inform pricing strategies and stock decisions.
- **Live Broadcast Comments:** Capture the sentiment and feedback during live streams for real-time consumer insights.
Ideal Candidate:
- Proficiency in Python scripting and web scraping.
- Experience with large-scale data extraction and automation.
- Knowledge of e-commerce platforms, particularly Douyin & JD.com.
- Ability to manage and manipulate large datasets.
- Familiarity with data scraping ethics and legality.
This role will require a detail-oriented freelancer with a knack for handling complex data structures and providing reliable, actionable insights. Looking forward to your proposals!
Can pay daily!Can pay daily!Can pay daily!
I am looking for a long-term collaboration, ideally lasting for at least one year
Project ID: #37715808
About the project
22 freelancers are bidding on average $20/hour for this job
Good day Hannuo, I have read initial high level requirements of your project & discussed with my technical team lead too. I was wondering, if you can please spare few minutes to discuss requirements thru' chat? I can t More
I am an experienced Python developer specializing in web scraping and large-scale data extraction. I have the expertise to build a robust data scraping system for your project, focusing on extracting extensive data fro More
Hello! As a skilled Python developer, I'm well-equipped to build a robust data scraping system tailored to your project's needs. I'll create a scraper capable of handling 500,000 data points daily, extracting user prof More
Hello, I understand your need for a Python developer to create a robust data scraping system, targeting Douyin and JD.com. With my expertise in Python scripting and web scraping, I can develop a solution capable of han More
Greetings! Dear Hannuo., How are you? This is Maksim from Belarus. I am a candidate for your project. I have just read your proposal and understood the requirements. I’m a PRO Software Architecture, Data Mining, Web Sc More
? ?Dear Hannuo Z. ?? Thanks for your project. Your project fits on my main skills perfectly and I can provide the best result . I am familiar with Web Scraping, Python, Data Mining, Software Architecture and Data Pro More
Hello there, Thank you for sharing your project with me! Your project aligns perfectly with my main skills, and I'm confident in delivering the best results. I'm well-versed in Web Scraping, Python, Data Mining, and Da More