Web Scraping Jobs

I have a data processing script crafted in NodeJs that requires conversion to Python. The main reason for the conversion is to speed up the application process and optimize the use of space and resources. The complexity level of the script is medium. The finalized script should be command line only, no need for an interactive interface. Ideal Skills: - Solid understanding of both NodeJs and Python languages - Experience in converting scripts between different languages - Familiarity with command line operations - Background in data processing scripts - Ability to optimize scripts for resource usage and speed

I need an expert to help me gather a database of products from a select Aliexpress suppliers. I am only interested in suppliers with a short delivery time in Europe, up to a maximum of 7 days, so they must be suppliers who ship from Aliexpress warehouses in Europe, preferably from an Aliexpress warehouse located in Poland. I need to synchronize the product database of this supplier with my store, so I need the supplier's number, its products (SKU / GETIN), quantity and current price. API or xml synchronization. I will make wholesale purchases for my warehouse, but access may be via the Alliexpress dropshipping platform. Ideal Skills: - API/database creation and handling - Aliexpress XML / Scrapping - E-commerce experience The database should gather the following data fiel...

I need a comprehensive spreadsheet created that will contain the match results and contestant statistics for the Survivor Greece television program episodes that aired in the years 2019, 2020, 2021, and 2022. (2020 is considered 2021 because only 4 episodes) Identify in the episodes the point at which these matches usually take place—typically ending at 10 wins—and record the pairs that play and who wins. I don't need any other information from each episode. The only thing I am interested in is the main matches between the two teams, blue and red. I am also sending you an Excel file in which you can see the way I would like the recording to be done. Please start your bid carefully, First open this link: Check if you can open the episodes and watch the videos to extra...

I require a specialist to gather, compile and organize important data regarding the 50+ age demographic for virus software. The perfect candidate will have considerable experience adhering to privacy regulations, with an intermediate level proficiency in data collection practices. Key Responsibilities: - Collect personal information, contact details, and DOB from the target demographic. - Determine if they have any active virus protection subscriptions. - Primarily target Windows users for data collection. Ideal Skills: - Have proficiency in handling data related to Windows users. - Strong understanding of data privacy laws and compliance. - Intermediate knowledge in data collection and management.

Please read completely before placing a bid ! Please bid only if you also plan to respond... Please someone who is interested in doing several projects Please make realistic offers and no fake offers where the price multiplies afterwards. Please keep in mind that changes can still be made during the testing phase ! Hello, I am looking for a programmer for regular collaboration, who can write an upload/download tool for usenet in the first step. Thank you! My Requirements are: -Combine the settings of the programs mentioned (ngPost, Nyuu, NewsUP, SabNZBd) -download functions like the program "sabNZBd" -for Windows (With a proper installation routine and as an .exe file!!) -Python -NNTP (Network News Transfer Protocol) -modern GUI and a nice logo :) -source code, commenting o...

As the project owner, I'm seeking an expert programmer to build a web scrapping tool that can effectively scrape specific data across 1000's of web pages. The specific websites for this web scrapping operation will be college and university athletic pages. Therefore, among the required skills is the versatility to adapt to different websites' structures and frameworks. In terms of data structure, the scraped data should be organized and stored in a Google Sheets according to categories. This approach allows for a more coherent and systematic pattern for data analysis and representation. The ideal professional for this task should possess: - Proficiency in web scrapping - Expertise in Python or other relevant programming language - Experience with Google Sheets and datab...

I'm in need of a console script that can scrape specific details from the dashboard page of a desktop game, focusing specifically on the game progress. The script should be able to fetch the required data and store it in a CSV format. Key Requirements: - The script should be able to scrape the game progress statistics from the desktop game dashboard. - The extracted data must be saved in a CSV format. Ideal Skills: - Proficiency in developing console scripts for data scraping. - Experience in handling game data and understanding game progression. - Capability to save the scraped data in a CSV format. Overall, I intend to use the scraped game progress data to monitor and adjust the game's difficulty, so it's essential that the script can reliably pull this information.

As a client, I'm looking for a skilled data scraping professional who can create a script or tool that would automate the process of extracting data from both Google Maps and Pappers The main goal would to : Extract companies based on filters on the pappers website. The issue is pappers do not give informations like website or phone number/email. So the goal would be to add more informations to the pappers scrapping with google maps. The issue here is it would take a lot of time to type the companies names found with pappers inside google to get the additonnal information. So there is, maybe, a way to "sychronize" the export (scrapping) of the two plateform and merge them into one excel table, or maybe to automatically enrich the pappers scrapping result with google ma...

I'll be giving you a list of entries, you will need to go and search basic details fetch basic data, and plug it into our website. Write the word 'Rate' after your 'Hi' in your bid so i know you have read the job description. It's a very basic task, but it's lengthy and needs to be right.

We need a data collector to collect information about some Australian public services (listed below) per templates are attached to this project. We are looking for 3 types of data: 1- General: More about the public service name, ABN, address etc. Often these information can be found through Googling or going to the public service related website. 2- Divisions: Divisions (or Business Units) information like name, contact etc. Business units can be found again through Googling or going to the public service related website. We know that not all business unit information are publicly available, only what that public service publicly provided are enough. 3- Locations: Some public services have locations (branches). We need information like branch name, address, latitude, longitude etc. Oft...

I am in need of an experienced data scraper who can handle a variety of data types as specifics have yet to be determined. I am looking for someone flexible, who can efficiently scrape text data, image data, and numeric data. Key responsibilities: - Scrape from a variety of undisclosed websites - Handle different types data (Text, Image, Numeric) Ideal Skills: - Previous experience in Data scraping - Detail-oriented - Efficient - Adaptability and flexibility Given the nature of this project, it's essential for the freelancer to remain flexible as the specifics of data types, websites, and data elements to scrape may change throughout the project's duration. Please provide examples of your past work in data scraping, preferably showcasing variety in data types handled and sourc...

I'm looking for a Python Developer to assist with a project. While the specifics are not laid out here, the skills you'll need are varied: - Web development - Data analysis - Automation scripting Experience with frameworks like Django or Flask, libraries like NumPy, and the ability to create web applications, analyze data for reports, and automate tasks is a significant plus. Please reach out with your relevant experience.

I'm requiring a data scrapping software quickly to extract text content from both websites and PDF documents. It's crucial that the scraped data is directed into Excel or Google Sheets format for my immediate use. Ideal skills for this job would be: - Proficiency in programming languages like Python that are often used for data scrapping. - Familiarity with web scraping libraries or frameworks, e.g., Beautiful Soup or Scrapy. - Experience using APIs to scrape data if necessary. - Previous work in pulling data from PDFs into readable formats in Excel or Google Sheet. - Ability to deliver the project ASAP. Your attention to these requirements will be much appreciated as I need this task done urgently. Please contact me if you need more detail about the project, and I look forwar...

I'm looking for a Python developer working with Selenium to develop two separate apps. These apps are required to automate the submission of URLs from Text file to two different directory websites. Both websites only accept one URL submission at a time, therefore I need a solution to streamline this task. The data to be submitted is URLs only, with no additional company, product, or service details to be included. Key tasks include: - Building a user-friendly application that can handle and submit multiple URLs to each respective website - Ensuring each app is configured to submit URLs in the specific format or template required by each directory website Ideal skills for this project: - Proficiency in Python and Selenium - Strong experience in web scraping and automation - Atten...

I'm looking for a freelancer who can help with research on the Top headlines news API. My primary goal is to build a news aggregation service specifically for Web application. Key Tasks: - Research the most relevant and suitable Top headlines news API for the project - Provide me with a list of the pros and cons of each API, as well as the potential costs involved - Recommend the best news API for the project, suitable for a news aggregation service designed for Web application - Ensure the API supports the delivery of Top headlines Skills and Experience: - Proficient in API research - Experience in building news aggregation services - Good understanding of the Web application environment - Strong analytical and decision-making skills in selecting the most suitable API - Good comm...

I'm looking for a Python programmer who can create custom code to extract text, numerical data and dates from an Excel spreadsheet and populate PDF fields using the PDFMiner library. You should be confident writing Python scripts and have experience manipulating Excel and PDF files. Familiarity with PDFMiner is a essential. - Must Haves: - Proven Python programming experience. - Familiarity with the PDFMiner library. - Ability to extract and manipulate data from Excel. - Experience in PDF field population.

I'm looking for a skilled developer to create an online interface which can upload a Word document and extract key pieces of information to populate a database. Key Requirements: - Extract multiple fields: The tool should be able to efficiently parse and extract a range of fields from the Word document, such as Title, Author, Date, Description, and Quantity. - Metadata Extraction: The primary focus of this project is to extract specific metadata from the document, specifically Date, Description, and Quantity. - Populate Database: The extracted data should then be used to populate a database. Ideal Skills and Experience: - Proficiency in programming languages and tools for working with Word documents. - Experience in developing data extraction and parsing tools. - Familiarity with...

I am seeking a proficient freelancer to transfer text content from various websites and compile them meticulously into a Word document. Key Responsibilities: - Navigate diverse websites to find specified text - Diligently copy and paste accurate information - Ensure the data is correctly formatted in the Word document Important Skills: - Proficient in Microsoft Word - Strong attention to detail - Excellent web navigation - Quick and accurate typing skills Experience in data entry, web scraping or similar tasks will be appreciated.

Looking for an innovative thinker to solve the challenge of automatically filling a single-page form on a local host, where .exe files cannot be run. The database to work with can be either online or local (not the local host of the form), and the database type may vary (MySQL, SQLite, PostgreSQL, etc). Key Responsibilities: - Conceptualize and suggest potential solutions for the auto-fill issue - Design and implement a solution that does not require .exe or batch files Ideal Skills & Experience: - Expertise in form automation - Understanding of various database types - Experience with local and online database handling - Problem-solving and innovative thinking capabilities are crucial. Write strawberry in your response so I know you have read all.

I have a project where I need proficient Python developers to join my team. The project involves two main aspects: Text to Speech and Speech to Text development: - fix existing code - API integrations - using elevenlabs and assemblyai - Integration of voice to text and text to voice features - Experience in developing RAG web applications Data Analysis: - Strong analytical skills and experience in handling data - Able to provide insights and make recommendations based on data - Proficient in Python data analysis libraries In particular, I need the voice to text and text to voice functionality to be focused on converting text to speech. Ideal candidates for this project should have: - Proficiency in Python, with a strong focus on web development and data analysis - Experience in creati...

I am looking for a skilled Python programmer to assist with various tasks. Experience with data analysis and visualization, web scraping and automation, as well as Python application development would be preferred. The purpose of this project is not specified, so a versatile skill set is required. Proficiency in Python, Django, and Flask would be advantageous.

I require a savvy data scraping professional who can efficiently collect specified details from retail giants Amazon, eBay, and Walmart. I'm interested in: - Extracting product details (name, price, description) This activity should be performed daily. The ideal candidate would have experience in data scraping, particularly from the mentioned websites. Proficiency in appropriate tools and a keen attention to detail is expected to ensure high-quality, timely, and consistent data harvesting.

I'm looking to hire a highly skilled freelancer to help me with a data scraping project. The focus here is on website content, specifically, text elements. As the nature of text content was not specified, I anticipate a variety of text types which might include news articles, blog posts, product descriptions, among others. Ideal Candidate: - Experienced in Data Scraping projects, specifically with website content - Proficient in working with different types of text - Detail-oriented and accurate in collecting required information - Ability to handle tasks within given time frame Please ensure that you are equipped with appropriate data scraping tools and techniques, and able to adhere to legal guidelines for data collection. Your responsibility will be collecting and organizing thi...

I have an online database searching service and I'm looking to upgrade its current features and introduce some new ones. Key Features to Add: - Advanced Search Options: I'm interested in building on my current search function to offer more refined search capabilities. - Scraping: I'm looking to add a data scraping capability to my service. This will involve extracting data from various websites and integrating it into my existing database. - AI Data Analysis: I'd like to incorporate AI data analysis functionality into my service. Specifically, I'm interested in pattern recognition and data clustering. Other Enhancements: - Batch Searching: I need to implement a batch search functionality. - Additional Database Integration: I'm interested in integrating ne...

Monitor specific HTML div elements on various web pages. (differnt flows) -Send Telegram notifications when new elements or changes are found, including a subject to indicate which monitoring flow detected the change and a hyperlink to the relevant web page. -Explain the configuration of new monitoring flows, enabling addition of new web pages and specific HTML elements. Provide a list of required dependencies and setting up and configuring the flow, including telegram bot integration so I can install/config them on my Raspberry Pi.

I'm in need of a Python developer to assist me with web scraping. The data I'm after is sourced from APIs and once extracted, it needs to be stored in a CSV file. Key Requirements: - Proficiency in Python - Experience with web scraping - Knowledge of working with APIs - Ability to store scrapped data in a CSV file Ideal Skills: - Familiarity with popular Python libraries for web scraping, like Beautiful Soup or Scrapy - Understanding of API integration and usage - Strong data handling and manipulation skills It's a straightforward task that needs attention to detail and adherence to best practices in web scraping. If you have the right experience and are keen to assist, I look forward to hearing from you.

- all history and Engineering , Economics , Physics , Earth Sciences, Mathematics , Computer Science All PDFs in these categories will be downloaded!

I am seeking to acquire a comprehensive list of 10,000 fake domains associated specifically Saudi Arabia with phishing scams. This list will primarily serve the purpose of security testing. The focus of this task will be on the accumulation of domains, with no requirement for a detailed description of each domain's potential threat level. The ideal freelancer for this job would have a strong background in cyber security and a profound understanding of Web Scraping, phishing scams.

I require a professional web scraper to collect both text (data points) and images from a long list of web pages about hotels and destinations. - The project involves saving the actual images of destinations/hotels —not just their URLs—from every webpage. - As for the text content, I'm particularly interested in several points - The extracted data and saved images should be meticulously organized in an Excel sheet for easy review and reference. Ideally, I'm seeking someone with an extensive background in web scraping and data extraction. Being proficient in Excel would be a significant plus. Accuracy, attention to details, and reliability are also crucial traits for this task.

I'm in need of a Python developer with specific skills in web scraping. The main task for this project is to fix bugs in existing web scraping scripts. Your role will be to primarily focus on this aspect, ensuring the scraping process runs smoothly, and is optimized for efficiency. If you perform well in this project, it will be a long term business opportunity. I have lots of projects in mind which need to start after this. New freelancers are welcome to bid.

I'm in need of a proficient website scraper to gather data from specific fashion retailers. You will scrape the data for a period of about 12 weeks. Starting mid June. We would target the 10 following fashion retailers: Guess, Tommy Hilfiger, Levis, GAP, Calvin Klein, Ralph Lauren, Desigual, Mango, River Island, Pepe Jeans. The data required is - Item characteristics (like audience [male/female/kids] and item type [pants/shorts/tshirt/shirt/...]) - Price points over time (and corresponding discounts) - Out-of-stock data over time (per item, not by size) The collected data should specifically focus on their clothing items (no accessories, shoes, underwear, home wear, gifts,...). The project start deadline is ASAP. A quick turnaround is essential. Ideal Skills and Experience: - ...

I need a Python expert to scrape tabular data from a series of PDFs and store it in a database. Ideal Skills and Experience: - Proficiency in Python. - Strong experience in web scraping with PDFs. - Familiarity with database management. The PDFs are consistent in format and all contain tables. The scraped data needs to be stored in a database.

I am seeking a proficient data analyst who can help pull up, organize, and visualize data from a specific website, daily. I am primarily concerned with both numeric and text data, therefore, the ideal freelancer should have: - Experience in data extraction from websites. - Proficiency in analyzing and visualizing both numeric and text data. - Capabilities to update and visualize data on a daily basis. - Knowledge of latest data analysis and visualization tools. Success for this project is ultimately based on your ability to turn a mass of mixed data into clear and informative visualizations. Regular and prompt communication will be key to the successful realization of this project. If you have these skills and can maintain a daily schedule, I'd love to work with you!

I am looking for an experienced Python developer to create a scraper for Lazada. The ideal candidate must be skilled in web scraping and should reverse engineer API from mobile app because lazada blocks and throws captcha on web website is lazada . The script should work like i enter something in search box and it should scrape all the products from that search query Key Responsibilities: - Extract the following information: product names, prices, descriptions, stock, images, seller information, and product URLs. This list encapsulates the attributes you need to pay the most attention to. - Organizing the scraped data: The data, once scraped, must be organized in a well-structured CSV file. Ideal Skills: - Strong experience with Python. - Proficiency in web scraping tools. - Attent...

Hi there, We are looking for someone who is: - Proficient in Python. - Experienced in automation and data scraping. Our budget is $3/hr for 20 hours on the initial project. This is a one-off task for now but could be ongoing work if successful. Please message with your CV/portfolio if interested

I require a unique search engine designed that can effortlessly comb through several car websites (, , , , , , , Facebook Market Place) and display the results in one convenient place. Key functionalities should include: - Advanced filtering options - Price range filtering - Location-based search Ideal expertise would entail experience in advanced web scraping and designing search algorithms, along with a deep understanding of diverse automobile databases and SEO. The candidate should be capable of verifying and testing the accuracy of the collected data as well. Efficiency in coding with an ability to manage site speed and response time is crucial, especially considering the breadth of services it will be searching. The final product should be a user-friendly platform that effectivel...

I need a skilled Bot Developer to create a multi-language web bot for me. - Tasks: The bot will mainly be responsible for web tasks like form filling, data scraping, and possibly social media automation. Unlike some bots, it won't interact with APIs or integrate with other web services. - Programming Languages: This is a multi-language project. I am open to using Python, JavaScript or PHP depending on what you think is best for this task. I need someone who is experienced in bot development and can create a reliable and efficient bot that performs these tasks seamlessly. Please have a look at the choices of programming languages I'm considering and let me know which one you think would best suit the goals of this project.

I need a lead generator extraordinaire to compile urgent, organized leads. The following specifics are must-haves: • Contact Information: Name, Phone, Email • Company Information: Name, Industry, Size • Industry-Specific Information: Relevance to Australian trade shows This is a draining task pulling resources from various databases and websites. Knowledge in research, data mining and excellent attention to detail are significant for this role. Previous experience in lead generation specifically for trade shows is a bonus. Understanding the nature and the dynamics of various industries in Australian trade shows would enable more efficient and accurate results. Since time is of the essence, I need someone with a quick turnaround without compromising the accuracy and qua...

I need help fetching influencer data from Instagram, YouTube, and TikTok. There are other platforms, and the influencers required here are trading influencers. 1 - Those who sell trading indicators. 2 - Who have special channels for trading.. 3 - Who have bots for automated trading Basic skills and experience required: - Deep understanding of Instagram, YouTube and TikTok – Experience in data mining or web scraping - Good at analyzing data - Flexible and adaptable working approach I will attach a file I created as an example of the requirements I want. If you see yourself as suitable for this job, create an example of the same file sent to you, but with different information, and send it to me

I need the names, addresses, and contact information from a specific web map extracted. The purpose of this project is to create a directory of locations from this data, and the information will need to be updated annually. The ideal freelancer for this job will have experience in web scraping and data extraction. Key requirements: - Web scraping experience - Proficient in data extraction techniques - Understanding of directory creation - Reliable and professional with an eye for detail.

I'm looking for a Python expert to help me build a simple yet effective project. I need a program that can scan barcodes of grocery items and then provide me with detailed information about these products. This information should include protein, calories, added sugar, and any other relevant nutritional facts. Key requirements: - The ability to scan barcodes effectively and quickly - Retrieving information about the scanned products from an online source - Displaying this information in an organized and easy to understand manner Ideal skills and experience: - Proficiency in Python - Experience in working with barcode scanning - Familiarity with web scraping for nutritional information - Ability to create a user-friendly interface

In order to effectively drive my ongoing project, I'm in need of someone skilled at gathering specific data and preparing it into a highly organized spreadsheet. The data needed include: - Name - Email - Job/Business - Phone number(Whats app) of (NRI) Non Resident Indians in UAE The ideal candidate for this task should demonstrate: - Proficiency in data collection, and data management. - High level of accuracy and attention to detail. - Proven experience in sourcing data and utilizing Excel or similar spreadsheet software. Looking forward to advancing my project with your expertise.

I need a program that can scrape for the addresses of homes listed and compile them into a CSV file. The program should include the duration each house has been listed on the site, and have it run every hour to capture new listings. Additionally, I would like duplicates to be automatically eliminated. Key Responsibilities: - Scrape for home addresses - Compile addresses in CSV format - Include the duration each house has been listed - Run the program every hour to capture new listings - Automatically eliminate any duplicate entrie - Run CSV file against another data base that has age and name of owner and contact info. Ideal Skills and Experience: - Experience in web scraping and data extraction - Proficiency in programming languages suitable for web scraping (e.g. Python, Scrapy) - K...

I'm looking for a skilled web scraper to handle challenging websites with advanced detection. The main data you will be required to scrape is text content. Here are the key project details: Ideal candidate should have: - Experience in web scraping, especially from challenging sites - Strong knowledge of web scraping tools and techniques - Proficiency in handling advanced automation detection - Excellent attention to detail to maintain a high level of data accuracy - Ability to deliver monthly updates in a timely manner Please include any relevant past experiences or examples of similar projects in your bid.

I'm in need of a web scraping wizard who can help me extract text data and profiles from Twitter website. Key Requirements: - The ability to scrape text data and profile information efficiently and accurately. - Experience in web scraping, with a strong portfolio showcasing past work in similar projects. - The time for scraping a post and profile must be less 3 seconds without using Twitter API. The final deliverable should be in a format that's easy for me to analyze, but I'm flexible on whether it's a CSV file, Excel spreadsheet or a database format. Please describe your past work examples with your application. Write "Blue" on the head of your bid if you are not a bot.

I'm about to get daily PDF forms and need them automatically dumped into a Google Sheets document. The project involves: - Extracting data from incoming PDFs and inputting them into corresponding fields on Google Sheets. - Ensuring that each form submission creates a new row in the Google Sheets document. It's essential that: - The data is accurately extracted with no errors. - The system can handle a normal volume of PDF submissions (no more than 150) Ideal qualifications: - Proficient in web scraping and data entry. - Experienced in working with Google Sheets and PDF manipulation. - Ability to create an automated system for seamless data transfer.

We need a verified database of 200+ Greenhouse Growers growing within large commercial Greenhouses in South Korea. This must include e-mail address, website address and contact info. To be provided within a timeframe of 2 weeks.

I'm in need of a professional who can develop a scraping tool that will track market announcements and releases on a financial website using specific keywords. - The tool should scrape this data on a daily basis. Accuracy and reliability are key. - the scraped data should be filtered for the current date, daily. - I need this table of data to be automatically filtered for keywords. -the filtered results to be emailed automatically to an email list. - the tool to run automatically on a website or server. I'm looking for someone who has a proven track record in web scraping with a focus on financial data. Experience in creating automated scraping tools, particularly those that operate on a daily basis, is a huge plus.

I'm in need of a Python Developer who is proficient in data analysis, visualization, and data science to work on an array of data types including financial, customer, social media, and pharma data. Key Tasks: - Data Analysis and Visualization: You will be given various sets of data which you will need to efficiently analyze and create meaningful visualizations. - Web Scraping and Automation: Knowledge in this area is desirable but not necessary. - Django Web Development: Again, not a necessity but would be considered a bonus. Objectives: - Efficiency Improvement: Assist in identifying areas of operational efficiency and suggest or implement changes accordingly. - Cost-Saving Opportunities: Use the analyzed data to identify potential areas for reducing costs. - Decision Making Insig...

I'm seeking a freelancer proficient in numeric data entry to handle a personal project. Key Responsibilities: - Enter accurate and up-to-date numeric data provided. Ideal Skills and Experience: - Proficient in data entry, particularly with numeric data. - Keen attention to detail and a commitment to accuracy. - Previous experience working with similar projects would be a considerable advantage. Please ensure you have the appropriate skill set before placing a bid on this project. Your precision and attention to detail will help ensure this project's success.