Data mining web scraping jobs

I need a Python script that will create an endpoint for a Prometheus scraper to pull data from. I have the data already prepared, and it's ready to be pulled. Key Points: - The data to be pulled is in an unspecified format, so the script will need to be able to handle various data formats. - The specific data fields the script should include in the endpoint for the Prometheus scraper are not defined. I'm looking for an experienced Python developer who has worked with Prometheus in the past and has a good understanding of data scraping. Knowledge of various data formats and the ability to handle dynamic data fields will be a big plus.

Hi Berty J. I hope you are fine. Remember the Skyscanner project you did? I need a cmd tool to get parcel tracking histories from where the last number is the parameter I need to call the tool and I expect a JSON on stdout with either the li...Remember the Skyscanner project you did? I need a cmd tool to get parcel tracking histories from where the last number is the parameter I need to call the tool and I expect a JSON on stdout with either the list of events (shipmentCourse entries) or anything they want to tell me like "expecting your shipment data soon." pls check and let's discuss availability and effort.

I'm looking for a skilled programmer who can quickly correct the issues in my web scraping project in python. The task involves scraping data from Website A. Specifically, I need to retrieve player, tournament, records and runs and bowlers information. Ideal Skills and Experience: - Proficient in web scraping techniques - Experience working with CSV format - Familiarity with data extraction from dynamic sources - Ability to troubleshoot and fix existing code - Strong attention to detail and accuracy Please note that I need this task completed urgently within few hours as base code is already written, need to fix details, so quick turnaround time is essential. Thank you!

...in need of a data mining expert proficient in Python, machine learning, and Selenium to facilitate a data mining project. If you are interested, so there would be 2 contract fix rate $50/country flow, and $3-5/hr for code's maintainance. Depends on your profile’s experience. $10/script for easier works (like scrap-data transferring between GS&SQL), - Purpose of the project: The primary objective is to extract valuable information from a large set of data. The specific type of data to be mined will be shared with the successful candidate. - Skills and Experience: - Proficient in Python - Hands-on experience with Selenium - Thorough understanding of machine learning algorithms - Experience in handling la...

I am seeking a proficient web scraper to extract specific data from The data I need includes venue details and contact information. I require the end product to be delivered as a well-organised Excel file. Key aspects to focus on: * Meticulous detail on venue data * Comprehensive contact information * High level data formatting skills The ideal candidate has demonstrated experience in web scraping, data management and Excel. A background in music or event-based data is a plus. Efficiency, precision and respect for the source website's terms of service are crucial for this project.

I'm in urgent need of someone who can scrape a website for me. So the intent is that we open the first page, and set a filter, and then go to each profile and open the websites/social profiles to see if they have any emails addresses. Output is a spreadsheet with rank, name, socials, website, email address. Skills required: - Web scraping - Ability to deliver results in a timely manner

I am urgently looking for an experienced Python expert with exceptional web scraping skills to extract text content from various sites. Your proficiency in data extraction and handling is paramount for this project. Specifics of the types of websites to be targeted will be discussed later. Ideally, you should have: 1. Proven experience in Python based web scraping. 2. Strong understanding of different types of websites and their structures. 3. Availability to start and complete the job ASAP. Please ensure your bid reflects your strong standing experience and your immediate availability to commence the task. Expect more details upon assignment. Let's get started!

Seeking Expert...business operations. How to Apply: If you're confident in your ability to deliver high-quality leads meeting the outlined criteria, we want to hear from you! Please provide the following information in your application: Experience: Share details of your experience with lead scraping, particularly within the specified industry and geographical location. Methodology: Outline your approach to sourcing and verifying leads to ensure accuracy and reliability. Samples: If available, provide samples of previous lead scraping work demonstrating your capabilities. Timeline: Estimate the time required to deliver the specified number of leads. Contact Information: We look forward to partnering with a talented freelancer to fulfill our lead generation needs effici...

I'm looking for an expert with significant experience in web scraping and script debugging to help address an issue with one of my scripts. The issue I'm encountering is with Website 1, specifically in relation to URL scraping. Despite providing the necessary command, the script is not collecting URLs as it should be. Ideal candidate: - Experienced in web scraping and script debugging - Proven track record with similar projects - Ability to resolve the issue in a quick, efficient manner Your task will not be deemed complete until the script is able to successfully and accurately scrape URLs from Website 1.

I require detailed drawings for a zoning/permitting project, specifically a site plan and floor plan. We need someone to do some as-built site renderings of bitcoin mining sites we operate in nebraska.

I'm in need of a skilled python developer to create a fully-automated program for me that operates o...engage with a specific post's link also provided. The engagement should include likes, comments, and shares, and there should be an option to track and verify these actions. Skill and Experience Requirements: - Excellent knowledge of Python programming - Familiarity with social media API, especially Facebook's API - Experience in developing automated tools on a Windows platform - Knowledge of web scraping and automation - Great problem-solving and debugging skills I expect the resultant tool to be user-friendly, efficient, and free from bugs or errors. As this task involves potentially sensitive information (Facebook login credentials), a commitment to priva...

I need the responses from a list to be categorized as positive or negative and sent to WhatsApp in the most human-like manner possible to avoid blocking, separating the positive from the negative responses. The process doesn't need to be too fast to avoid blocks, but there is a large database list to process, so we must work smartly.

...need of a highly proficient data extraction specialist who can effectively collect details from 8,000 Facebook group members for market research purposes. Your main task will involve extracting the following data: - Member's name - Current job title - Date of group membership - Page URL Key Project Requirements: - All data must be scraped without violating Facebook's terms of service. - Information needs to be organized according to the date of joining the group. - Extracted data should be handed over in the form of an Excel spreadsheet. Skills and Experience: - You need to have proven experience in data scraping, particularly from social media sites like Facebook. - Good knowledge of Excel is required. - Familiarity with the Fa...

I'm looking for an expert in data scraping to effectively extract text data from online databases. Primarily, I am interested in customer details. This data will be pivotal to my operations. Key tasks include but are not limited to: - Extracting textual data from specified online databases - Focusing on customer details during extraction - Organizing the extracted data in an easily accessible format The ideal candidate is proficient in data scraping and has a deep understanding of online databases. Proficiency in using tools and scripts for scraping is necessary. Previous experience with customer data extraction will be a plus. A rigid approach to data privacy and ethical scraping standards is imper...

I'm in need of an experienced Python programmer for a singular web scraping task on booking.com. The data obtained from this scraping will be instrumental for our competitor analysis. Key Tasks: - Implementing a web scraping script specifically for Ideal Skills: - Proficient in Python - Experience in web scraping - Ability to deliver clean and structurable data - Previous experience in competitor analysis (preferred)

Project Description: We are seeking a proficient Python developer to complete and refine a web crawling application with a graphical user interface (GUI). The primary function of this application is to extract specific job-related data from websites based on input parameters such as job title and location. Key Responsibilities: Review and refine existing Python code for web crawling to ensure robust and efficient data extraction. Develop and implement a user-friendly GUI that allows users to input search criteria easily. Ensure the application can parse and extract data accurately from various webpage structures. Output the extracted data into a structured spreadsheet format. Test the application to ensure its reliability and accuracy under diffe...

I'm in need of a competent API builder for scraping data, with the project completion expected within a month. Key Requirements: - Creation of a web scraping API without specifying the website(s) for now - Experience in similar projects - Ability to complete the task within the allotted time - Proficiency in communication for updates and information exchange - A commitment to quality and a proactive approach in suggesting improvements where necessary. Since the exact source of the data is unspecified, flexibility and adaptability are crucial. Moreover, experience in creating APIs for data scraping is a must. Please highlight any past work or projects that demonstrate your expertise in this area. Ideal candidates should be able ...

I am looking for an expert in web scraping who can efficiently extract business leads. While the primary purpose of the project was not specified, it is undeniable that these leads will play a pivotal role in marketing efforts, like sales lead generation, market research, and contact information collection. Although I did not mention a specific source site, note that the target is business owners, and their revenue and contact information. Therefore, having experience in scraping from professional networking and business directory websites such as LinkedIn or Yellow Pages would be welcomed. Lastly, the exact number of leads that I need hasn't been defined, so I am open to both small and large-scale operations. Ultimately, their quality is of more importance tha...

...experience in web automation, proxy management, and creating user-friendly interfaces. Application Process: If you're confident in your ability to meet our needs and are looking for a challenging project that pushes the boundaries of traditional development, reach out to us. Ensure your application reflects your best qualities and aligns with the skills we need. Key Skills and Qualifications: 1. Programming Languages: - Proficiency in C# or .NET Framework: Since the tool is intended to be Windows-based, these are essential for building robust, scalable applications on Windows. - Familiarity with JavaScript and web automation libraries (like Selenium or Puppeteer) for simulating user interactions with web browsers. 2. Web Automat...

I'm seeking an experienced freelancer to lead a data collection project targeting mobile contact numbers from India exclusively. Key tasks: - Collect a substantial database of mobile contact numbers within India for market research purposes. - Guarantee the accuracy and legitimacy of all collected data. - Strictly adhere to data privacy and protection standards. Ideal Candidates: - Prior experience in data collection specifically with mobile numbers. - Proficiency in data mining and scraping. - Detailed knowledge of data privacy laws in India. - Market research background would be a plus. Your understanding of these requirements and your capabilities in fulfilling them will be critically evaluated. Apply if you believe you...

I need a python script which can use captcha cookies to loop and get data fields. I have already checked using Burp Suite or postman it's working. Using same captcha value we are getting request results. Videos to explain are attached

I'm looking to data scrape the price of popular electronics across different retailers and online marketplaces in Australia. Some of these Australian websites/competitors include: - - - - - There is also a similar competitor called , that gets the prices of thousands of retailers across australia and displays it to the customer. If we can see how they are achieving this or tap into that data, that will add to this perfectly. if possible, we also need to collect data from the bigger marketplace giants such as , facebook marketplace (AU) and even amazon. If not possible, we can discuss getting data through external API tools such as

...Research and Data Collection: The freelancer should be proficient in online research and data scraping. Identify reputable sources, databases, and directories where radiologist information can be found. Collect accurate and up-to-date details for each radiologist. Data Fields: Full Name Clinic/Hospital Name Clinic Address Phone Number Email Address (if available) Specialization (e.g., diagnostic radiology, nuclear medicine, etc.) Creativity and Resourcefulness: Think creatively to find hidden or less obvious sources of information. Explore medical association websites, healthcare directories, and professional networks. Utilize search engines, social media, and other platforms to extract relevant data. Quality Assurance: Ensure the accuracy and com...

...companies within the hi vis industry in Australia. Key Responsibilities: - Expand the market reach of the designer clothing to various industries including Construction, Mining, Logistics, Retail and Healthcare in Australia. - Develop and maintain relationships with clients to ensure repeat business. - Achieve set sales targets and report on sales performance. Ideal Skills and Experience: - Proven experience in sales of designer clothing or related high-end fashion products. - Strong communication and negotiation skills. - Familiarity with the hi vis industry and/or experience in B2B sales within Construction, Mining, Logistics, Retail or Healthcare. - Ability to work independently and meet sales targets. - Knowledge of the Australian market and previous sales experien...

I will do your project as per your requirments ! I was already done the projects as a web scraper ! Thank you and have a good day !

I'm looking for a professional to scrape restaurant data from Google Maps in New Zealand. This project will require the following skills: - Expertise in web scraping technologies - An understanding of Google Maps and its API The specifics of the data required are: - Restaurant Name - Address - Ratings - Google unique business ID Data output should be organized into a CSV file and updated monthly. Candidates with prior experience in similar projects are preferred. Also, proof of proficiency in web scraping and data organization is a must.

I'm in need of a Python developer to create a script for my custom CRM. Scrape sku numbers,prices and images from website to update database. Primary duties include: Scrape sku numbers,prices and images from website to update database. Primary duties include: Skills and Experience: - Proficiency in Python scripting is required - Prior experience with data scraping is essential - Familiarity with custom CRM platforms would be highly beneficial

I'm in need of a Python developer to create a script for my custom CRM. Scrape sku numbers,prices and images from website to update database. Primary duties include: Scrape sku numbers,prices and images from website to update database. Primary duties include: Skills and Experience: - Proficiency in Python scripting is required - Prior experience with data scraping is essential - Familiarity with custom CRM platforms would be highly beneficial

...I do not desire; Pakistan, Bangladesh, India, etc. I need a freelancer from LATIN AMERICA only. I need close to EST time!! I need BILINGUAL a freelancer!! So READ before biding. I need a fully bilingual professional (I will interview in English) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress (change text, add a button, upload a file, etc) And others related to the position You must be a FAST learner, attentive to details, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. This jo...

I'm after detailed data on different YouTube channels and content creators of those channels for the purpose of market research. This project will require you to compile data on 100 YouTube Channels and channel owners with more than 100,000 subscribers in a set of categories (details provided in a spreadsheet to be filled). The data will include, subscriber counts, video counts, monetization activity, other social media presence and activity, and different engagement metrics including likes, comments, and shares from YouTube channels. This is currently a one-time requirement, but may lead to further projects in the future. - Ideal Skills: - Web Scraping - Data Mining - Social media search and scraping - Experience: - Previ...

I'm looking for a skilled Python developer to create a script that can download videos from shasha.com. The script should: - Be able to download videos from - Provide a simple interface to input video URLs - Not require any categorization of the downloaded videos Ideal skills and experience: - Proficiency in Python - Experience with web scraping - Knowledge of handling media downloads Please note the need for simplicity and efficiency in the script, as it will be used for bulk downloads of videos from shasha.com.

I require a competent professional with database gathering skills to generate a list of 50 email addresses. The key details for this task are: - The email address list should only pe...addresses. The key details for this task are: - The email address list should only pertain to US workers. Familiarity with US working sectors will be useful in this task. - The list should only include email addresses. No other personal information (like name or phone number) is necessary. - The task needs to be completed as soon as possible, so rapid work efficiency is desired. Your experience in data mining, particularly email lists gathering, will be a deciding factor for this project. Please include any relevant information on your ability to complete this task efficiently and ethically ...

...programmer with experience in web scripting, data handling, and automation. They should be comfortable working with online marketplaces as the aim of this project is to create a tool or script that can automatically determine the monetary value of various trading cards in a online collection, on , lets say Ebay, specifically using data from Cardmarket. Key Aspects of the Project: - The automatic calculation of the value of each trading card based on its rarity and age, using data extracted from Cardmarket. - A system should take into account external resources for determining each card's value, mimicking how a human would manually determine the value on the chosen online platform. Ideal Candidate: - Excellent programming skills. - Background in we...

I need someone with finesse in web scraping to gather and deliver specific horse racing data from Racing Post. The focus is on two main statistics: Speed figures and Racing form. Since my need is pressing, I require this project's completion to be as soon as possible. Ideal Skills: - Past successful experience in web scraping - Familiarity with horse racing statistics - Ability to deliver quickly The chosen freelancer will not only pull data but ensure its accuracy and understand what these statistics represent in the broader context of horse racing. This understanding is critical for my project's success.

...generation software. This software should primarily focus on scraping phone numbers and emails from LinkedIn profiles. Key Features: - Cross-platform compatibility: I need the software to function seamlessly on Windows, Mac, and Linux operating systems. - LinkedIn Scraping: The software should be able to efficiently scrape phone numbers and emails from LinkedIn profiles. - User-friendly Interface: The software needs to have a simple and intuitive interface for easy use. -Integration with CRM's like Hubspot, Pipedrive, Salesforce and more. Ideal Skills and Experience: - Proficiency in software development, with experience in creating lead generation tools. - Familiarity with LinkedIn API or web scraping techniques. - Strong understanding of data...

...individual with strong computer skills to join our marketing team as an Information Scraping and Data Entry Specialist. The primary responsibility of this role is to assist in building lists by extracting information from specified websites, particularly LinkedIn, and entering it accurately into our database. The ideal candidate should be able to perform this task efficiently, with the goal of reaching a target of up to 60 entries per day. Responsibilities: 1. Navigate specified websites provided by the team to extract required information. 2. Create accounts on designated platforms and gather data such as first name, last name, company name, email address, and phone number. 3. Ensure accuracy and completeness of data entered into our database. 4. Meet daily...

I'm in immediate need of a skilled data miner to copy the results from 1,000 Google search links into a Google Sheets document. TASKS: - Mining data from 1000 Google search results - Transferring these results into a Google Sheets document REQUIRED DATA: - The URL of the website - Additional details such as Company name, Address, and Phone numbers ALL TOGETHER INTO ONE CELL DESIRED SKILLS/EXPERIENCE: - Competency in data extraction - Proficiency with Google Sheets - Attention to detail is a must - Previous experience in a similar project would be beneficial Please note, I need this project completed ASAP. Flat fees; 10 NZD Please start your bid with 10NZD Thank you

I am searching for a talented illustrator to bring my concept to life. This project involves designing a mining sticker with a humoristic theme targeted at miners. The sticker will depict two cartoon characters in high visibility gear trying to access an underground coal face. One character, the miner operator, will be uttering the phrase "Seek approval before coming on my face". To be successful in this project, you ideally should: * Have experience in creating cartoon character designs. * Be able to effectively merge humor with illustration, as the humor in the design is crucial and should be conveyed through both text and character expressions. * Understand the mining industry to create a relatable and enjoyable design for miners. This project provides an opp...

I'm looking...focused on wholesale and retail medical stores located in India. Here are a few additional details about the project: - Sourcing: I will purchase leads from a known data provider, therefore, the freelancer must have experience in lead purchasing and data mining. - Criteria: Leads should be from the wholesale and retail medical stores industry, with a specific emphasis on leads located in India. - Quantity: The scale of this project is significant, as I'm looking to acquire more than one lakh (100,000) leads, implying the freelancer should be capable of working with large datasets. Ideal Skills: - Experience in lead mining and data acquisition - Familiarity with medical store industries - Ability to work with large datasets - Pr...

I need a proficient Embedded Engineer to design a PCB prototype for cryptocurrency mining. More details will be shared over a chat

I require the assistance of a skilled professional in web data scraping from Website 1. Your primary task will be to extract contact details. Upon successful scraping, these data needs to be cleaned and formatted before being delivered in an Excel sheet. The ideal candidate for this job would have solid experience in data mining, data cleaning and Excel. Skills and Experience: - Data Scraping - Data Cleaning - Microsoft Excel proficiency

I need a professional to help me generate a list of retail businesses from three specific markets - USA, UK, and UAE. - The businesses I want to be listed include Bakers, Clothing companies, Jewellery companies, and all other types of Retail businesses. The total quantity required are 200 each Bakers, Clothi...For each business, I require the following details: - Contact details (especially email addresses) - Location - City, State, Country - Business Domain / Industry It's important that the contact details are all provided in email format. You should be able to source and collate lists efficiently, ensuring the information is up-to-date and accurate. Experience in lead generation and data mining would be a huge asset for this task. Accuracy and attention ...

I am seeking an innovative financial technology freelancer to develop an AI system for personalized finance. This system will primarily focus on facilitating better financial decisions for users. It uses web UI with subscription base as well as Mobile app Key AI Features: - Predictive analytics capability to forecast potential financial outcomes - Implementation of NLP for easy user interaction - A recommendation engine for personalized advice Data Analysis: The system must be proficient in analyzing various types of financial data, including but not limited to: - The user's income and expenses to track financial habits and frequent expenditures - Investment portfolios for trend analysis, risk assessments, and potential growth opportunities - Credit card trans...

THIRD time posting this, it seems people do not read the requirements and conditions. I need a fully bilingual professional (I will interview in English) to do some tasks for my agency, such as: PR Outreach Social media Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress And others You must be a FAST learner, attentive, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes over and over. Attention to detail. Common sense. This job will part-time as a test period, after that it will be full-time. First there is a task I’ll give as a test. Payment for part-time during trial period: Fee: 250 USD Per...

...success rate and profitability of each trader based on their trading history. Provide a user-friendly interface to view and analyze the collected data, including visualizations and filtering options. Implement robust error handling and data validation mechanisms. Ensure the tool is scalable and can handle a large number of wallets and transactions. Desired Skills and Experience: Proficiency in blockchain development, preferably with experience in the Base Blockchain or similar networks. Strong understanding of cryptocurrency trading, wallets, and DEX protocols. Expertise in data analysis, data mining, and web scraping techniques. Familiarity with data visualization libraries and creating user-friendly interfaces. Solid problem-so...

As a developer of static information websites, I'm seeking the skills of an AI and Python specialist to develop a solution that can effectively test and validate my projec...These tasks are integral to ensuring the efficiency of my websites and I'm confident they can be adequately performed using AI technologies. I'm open to using Python or C#, if that's what you're proficient in. Preferred skills and experience include: - Python or C# programming - AI or Machine Learning - Web scraping - Knowledge in building and testing static information websites This project will require creativity and precision to build an AI tool that can effectively learn from web scraping to validate websites. I am looking forward to seeing your brilliant prop...

...specific type of data from a social platform. Only Indian Python Developer Required. Key Details: - Purpose: The primary purpose of this script is to extract numbers from the social media platform. - Complexity: The data to be scraped is relatively straightforward. It's all about extracting numbers and not complexly nested or paginated. - Source: The numbers are scattered across various parts of the social media platform. Ideal Skills and Experience: - Proficiency in Python: A strong background in Python scripting is essential. - Web Scraping: Experience in web scraping will be crucial for this project. - Social Media Data Extraction: Prior experience in extracting data from social media platforms is a significant advantage....

...with demonstrated experience in lead scraping to compile three comprehensive CSV lists of leads. Each list will pertain to one of the following sectors: funeral homes, dental practices, and law firms. For each lead, we require the following information to be accurately sourced and documented: Phone Number Email Address Website URL The project will encompass a total of 450 leads, distributed evenly across the three sectors with 150 leads each. The data must be current, verifiable, and neatly organized in CSV format for seamless integration into our CRM system. We prioritize accuracy and are looking for someone who can guarantee the correctness of the provided data. The chosen freelancer should have a proven track record in lead generation and scraping techn...

THIRD time posting this, it seems people do not read the requirements and conditions. I need a fully bilingual professional (I will interview in English) to do some tasks for my agency, such as: PR Outreach Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Basic Wordpress And others You must be a fast learner, attentive, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes. This job will start part-time as a test period, after that it will be full-time. Payment for part-time during trial period: Fee: 250 USD Performance bonus: 50 USD Results bonus: 50 USD If your work complies with my quality requirements and you ...

...Australian horse racing, greyhounds, and harness matches, I'm in dire need of a specialist who can construct a web application that accurately exposes true odds and positive expected value (EV). This tool will be specifically made to analyze selected Australian races. The ideal applicant should have excellent knowledge of: - Web scraping, to gather necessary information - Machine Learning, to ensure the tool's precision and adaptability - Discord bot and automation, to streamline the application's operations and real-time info delivery Having experience with Google Sheets API and databases is advantageous, though not a requirement. Expertise in these tech fields will make the application’s data gathering and management process consider...