Douyin Data Power-Scrape

Closed Posted 3 months ago Paid on delivery
Closed

I require a skilled Python developer to build a robust data scraping system for my project. The focus will be on extracting large volumes of data daily from Douyin e-commerce and compiling information from [login to view URL], specifically tailored to select criteria.

Requirements:

- Develop a scraper that can handle 500,000 data points daily.

- Collect user profiles, product details, and live broadcast comments from Douyin.

- From [login to view URL], gather relevant product information.

Data Points Needed:

- **User Profiles:** No specific criteria, but must be efficiently extracted to assist in broad market analysis.

- **Product Details:** Focus on price, availability, product specifications, and ratings/reviews to inform pricing strategies and stock decisions.

- **Live Broadcast Comments:** Capture the sentiment and feedback during live streams for real-time consumer insights.

Ideal Candidate:

- Proficiency in Python scripting and web scraping.

- Experience with large-scale data extraction and automation.

- Knowledge of e-commerce platforms, particularly Douyin & JD.com.

- Ability to manage and manipulate large datasets.

- Familiarity with data scraping ethics and legality.

This role will require a detail-oriented freelancer with a knack for handling complex data structures and providing reliable, actionable insights. Looking forward to your proposals!

Can pay daily!Can pay daily!Can pay daily!

I am looking for a long-term collaboration, ideally lasting for at least one year

Python Web Scraping Data Mining Software Architecture Data Processing

Project ID: #37715808

About the project

22 proposals Remote project Active 2 mos ago

22 freelancers are bidding on average $20/hour for this job

leadconcept

Good day Hannuo, I have read initial high level requirements of your project & discussed with my technical team lead too. I was wondering, if you can please spare few minutes to discuss requirements thru' chat? I can t More

$25 USD / hour
(54 Reviews)
8.6
MashoodurRehman1

I am an experienced Python developer specializing in web scraping and large-scale data extraction. I have the expertise to build a robust data scraping system for your project, focusing on extracting extensive data fro More

$25 USD / hour
(171 Reviews)
7.7
uumarkhalid31

Hello! As a skilled Python developer, I'm well-equipped to build a robust data scraping system tailored to your project's needs. I'll create a scraper capable of handling 500,000 data points daily, extracting user prof More

$20 USD / hour
(287 Reviews)
7.4
HNMN3

As an experienced python engineer with a strong background in data engineering, web scraping, and a love for my craft, I believe my skills align perfectly with your project requirements. Over the past six years, I have More

$20 USD / hour
(27 Reviews)
6.1
Isoropisths

Hello, I understand your need for a Python developer to create a robust data scraping system, targeting Douyin and JD.com. With my expertise in Python scripting and web scraping, I can develop a solution capable of han More

$20 USD / hour
(6 Reviews)
5.4
maksabakanovich

Greetings! Dear Hannuo., How are you? This is Maksim from Belarus. I am a candidate for your project. I have just read your proposal and understood the requirements. I’m a PRO Software Architecture, Data Mining, Web Sc More

$20 USD / hour
(7 Reviews)
4.7
dataspro

Nice to meet you hannuo,The requirements of your project match my areas of work and skills, to introduce myself. My name is Anthony Muñoz and i am the lead engineer for DS Pro IT agency. I have worked for over 10 year More

$36 USD / hour
(4 Reviews)
4.7
shekinahjoy1

? ?Dear Hannuo Z. ?? Thanks for your project. Your project fits on my main skills perfectly and I can provide the best result . I am familiar with Web Scraping, Python, Data Mining, Software Architecture and Data Pro More

$15 USD / hour
(0 Reviews)
0.0
vivek370

Dear Esteemed Hiring Team, I am Vivek Jamlia, an accomplished Full Stack Developer with a rich background of over 5 years in creating sophisticated and robust solutions. My expertise spans a wide array of technologies More

$18 USD / hour
(0 Reviews)
0.0
abdf2010

Hi, I am a professional web developer and I can do this project Douyin Data Power-Scrape, I have 5 years of experience in web development. I have done many projects like this. I can do this job for you. I can start rig More

$15 USD / hour
(0 Reviews)
0.0
navinfeb15

Hello there, Thank you for sharing your project with me! Your project aligns perfectly with my main skills, and I'm confident in delivering the best results. I'm well-versed in Web Scraping, Python, Data Mining, and Da More

$15 USD / hour
(0 Reviews)
0.0
jerry329

Hello, everyone! We are newly arrived on freelancer and hope to be successful here. We are a team of expert developers who have expertise in website design. Over the last 10+ years, we have developed several websites More

$15 USD / hour
(0 Reviews)
0.0
mamansani

Hello, I would like to offer you my expertise in Web Scraping for the development of your project. I have extensive experience in crawling development. I've developed crawlers for social networks, forums, e-commerce More

$20 USD / hour
(0 Reviews)
0.0