Best database for web scraping jobs

I am seeking an experienced developer to creat...which is capable of collecting various pieces of data. This savvy tool must be designed to extract from () site: - Text content - Images - Product information - Address - Contact details - Videos It is essential for the scraper to perform its task on a daily basis. Yet, there won't be a need for the gathered data to be automatically integrated into a database. Ideal Skills: - Web scraping - Developing scraping bots - Programming knowledge - Manual data mining expertise Please only apply for this job if you have significant experience in creating web scrapers. This project requires a quick turnaround, so the ability to work under time constraints is key. Let's converse abo...

I'm looking for a skilled graphic designer to create graphics and thumbnails for 10 videos on my YouTube channel (the channel is here: ) Your responsibilities will include: - Designing a banner image and channel art that have a cohesive and professional look. - Creating thumbnails for the videos that can impress and retain the attention of viewers. - Suggesting themes and color schemes for the channel graphics. Ideal skills and experience for this job: - Proficiency in graphic design, with prior experience in YouTube channel branding. - Creativity and strong visual design skills to create engaging and attention-grabbing visuals. - Ability to suggest and implement themes and color schemes that are appealing and suitable for the channel...

We are looking for a freelancer with strong web scraping experience for an exciting and challenging project. We need to gather specific data from multiple online sources and transform it into useful, structured information for analysis. Responsibilities: Utilize web scraping techniques to extract data from selected websites. Automate the extraction process to ensure accuracy and efficiency. Clean and structure the collected data into readable and usable formats. Integrate the extracted data into a database or spreadsheet as needed. Collaborate with our team to understand specific requirements and ensure the quality of the obtained data. Requirements: Demonstrable experience in web scraping using tools like Python (Bea...

I'm looking for a web scraper. Your application should include your experience in this field specifically. I'm interested in scraping the following data from a particular website: - Product details - Contact information - Pricing information Please only apply if you have solid experience in web scraping. We will have lots of different webscraping tasks in the following weeks.

I'm looking for a diligent professional who can implement an Internet price research mechanism for the electronic products listed within a .csv file. The deliverable I expect from this project is a separate report containing the price of each product, along with additional details such as a link to the retailer's page and the price history. Key Responsibilities: - Extracting and updating the price information of electronic products from the Internet, based on the .csv file provided. - Incorporating a detailed report that includes the prices, a link to the retailer's page, and the price history of each product. Skills and Experience: - Proficiency in data extraction, research, and analysis. - Experience with web scraping tools. - Strong organizat...

I'm seeking an individual who can create a one-time web scraper that can collect text, images, and tables from Website 1. The project involves: - Developing a tool to scrape text, images, and tables from the specified website. - Ensuring the tool can operate efficiently for a one-time scraping process. Key Skills: - Proficiency in web scraping tools and techniques. - Experience in scraping text, images, and tables. - Ability to create a custom scraper for a one-time scraping task.

I need a web scraper to extract specific data from various websites. The project will involve: - Identifying the necessary data to be scraped - Building a scraper to extract this data Ideal skills for this job include: - Proficiency in web scraping tools - Familiarity with web data extraction techniques - Ability to work with and extract data from various websites Please provide your quote for this project.

I'm in need of an experienced backend developer to create a mail parser with the following specifications: - **Email Protocol:** The mail parser should support SMTP, so proficiency in this area is a must. - **Primary Goal:** The primary function of this mail parser should be storing emails in a MySQL database. If you have experience with database integration, this would be a big plus. This project requires expertise in backend development, specifically with an understanding of how SMTP works. You should also be familiar with MySQL and have experience in integrating databases into applications. Please provide examples of similar projects you've worked on in your proposal. Thank you.

I'm looking for a skilled web scraper who can extract detailed information regarding the sellers on the Miravia website. Requirements: - Extracting Seller Data: The main purpose of this project is to gather information about the sellers on the Miravia platform (). This includes the shop_id shop_name Ivl1_cate_name product_number avg_price shipping_duration company_location phone_number email_address vat_number company_name shop_rating shipping_on_time % followers comments etc. I require 10,000 entries of data I require the data to be well-structured and organized into a CSV or Excel file for further analysis. Skills and Experience: - Proficiency in Web Scraping: The ideal candidate should have extensive experience in web scraping ...

I need a VA with Wix store experience, a keen eye for detail, and proficiency in spreadsheet management. You'll be tasked with: - Keyword Optimization: Adjust the product titles on my Wix store to ensure they are optimized for search engines. Experience with SEO would be beneficial for this. - Database Creation: Develop a comprehensive database for all my products. This will include attributes like Product names, Product prices, and Product URLs. - Formatting: The database should contain separate columns for each product attribute. Strong organizational skills and experience with data entry would be ideal. Ultimately, the goal is to streamline the management of my product listings for a smoother business operation. ...

I need help with scraping specific information from urls (we will provide). The key details I need are the company name and contact information. Website Phone Email Brand Country Of Origin Total Entries: 1704 No research required, you just need to copy paste information from the fields onto a google sheet.

I'm looking for a skilled individual who has a good understanding of Mechanical Engineering and Data Science to help me set up a database that records the live feed of on-board sensors in a car. Key Responsibilities: - Utilizing an On-Board Diagnostic Tool and an app to record the data - Implementing a database to store the collected sensor data - Analyzing the data primarily for predictive maintenance using statistical analysis Ideal Skills: - Mechanical Engineering background - Proficiency in working with On-Board Diagnostic Tools - Strong experience in statistical analysis - Knowledge of database management systems and data analysis tools - Experience in predictive maintenance is a plus This project requires attention to detail, analytical thi...

I am searching for a Product Analyst who can apply their knowledge towards data analysis, market research, and performance monitoring. Its a small assignment This assignment involves diving into a snowflake database to explore how customers behave. The goal is to find useful information that can help the Product team make decisions to make the business grow. After you uncover insights, you'll suggest changes to the product, like adding new features, making current features better, or even getting rid of features that aren't working well. You need to do the analysis, create graphs to show your findings, share all the code you used, and also come up with a plan for an A/B test to try out one of your suggested changes. Note: Its a short assignment, not spen...

I'm looking for an experienced server administrator to optimize my dedicated server running Almalinux 9.3 + Plesk. The server is currently performing poorly with slow website loading times and database slowdowns, which is unacceptable as I regularly have more than 500 concurrent visitors. The primary focus of this project will be optimizing the server's Plesk settings, Postgres and MariaDB databases, and PHP 8.2 configuration. Key tasks will include, but are not limited to: - Configuring Plesk for optimal performance, including adjusting server pool size - Identifying and implementing improvements to Postgres and MariaDB settings to reduce slowdowns - Tuning PHP 8.2 to enhance website speed and performance Ideal candidates for this project will ha...

I am looking for a professional who has experience in data scraping to extract email addresses of senior level employees in the Building Industry, specifically from the United Kingdom. This task involves collecting the email addresses of 100 senior level employees. Key Requirements: - I need the first name, job title, and email address of each employee. - All the email addresses should be from the United Kingdom. The ideal freelancer for this project should have: - Experience in data scrapping and data mining. - Proficiency in tools and techniques for extracting data from web sources. - Attention to detail to ensure the accuracy of the collected information. - Familiarity with the Building Industry and the job titles associated with senior level roles i...

...in Nodejs, nginx reverse proxy, and bash scripts for a personal project. This personal project is focused on web scraping. The successful candidate will be tasked with scraping product information, news articles, and social media data. Exemplary knowledge of proxifying requests through nginx and formatting bash scripts that interact with Nodejs applications is a requisite. Mandatory Skills and Experience: - Advanced proficiency in Nodejs - Extensive experience with nginx reverse proxy - Expertise in formatting bash scripts - Proven experience in web scraping, with emphasis on scraping product info, news articles, and social media data The ideal candidate must be able to present a portfolio demonstrating their competence in web...

I am seeking a detail-oriented freelancer who can expertly transfer text data from PDF files into a database. The ideal candidate should possess the following skills and experience: - Proficiency in working with PDF files - Expertise in data entry tasks - Experience in formatting and structuring databases - Excellent attention to detail Suitable candidates need to handle copious amounts of text data, accurately convert the text-containing PDF files into a structured and organized database. This includes careful validation to ensure no data is lost or misrepresented during the data entry process.

Hi Ashish, this is for the tasks I emailed about.

I have an urgent web scraping task that needs to be completed as soon as possible. This project involves: - Scraping specified data from a list of instagram accounts. The information includes phone number and email of account and also phone number and email of account tagged in the bio description The ideal freelancer for this job should have: - Proven experience in web scraping - Proficiency in handling different types of data (text, images, tables) - An excellent track record of delivering projects on time. Please apply if you have the expertise and availability to tackle an urgent project.

We have a website where the homepage currently loads slowly due to multiple API calls. Despite implementing asynchronous API calls, the page load time is still not meeting our target. We are looking for a skilled developer to optimize the homepage to load within 1 second. we need some one who can : Optimized homepage that loads within 1 second. Cron job implementation for fetching and updating api data of tokens price/5%/24%//etc basically - i want to load data everything from DB only , rather than multiple api calls. thakns

...need a Python developer with a strong skill set in web scraping, database management, and video manipulation to create a code which can easily download videos from personal websites, save them to local web storage, and subsequently update values in an sqlite database. Detailed requirements are as follows: - Download videos specifically from personal websites. - Save videos internally for archiving purposes. - Saved videos should be in AVI format to maintain consistency. - Program should have a functionality of updating an sqlite database with relevant video details upon successful download. Ideal candidate should have a deep understanding of AVI video format handling as well as extensive experience interacting with an sqlite dat...

I am looking for an expert Oracle DBA with experience in both Oracle RAC (Real Application Clusters) and standalone Oracle databases. The primary goal of this project is performance tuning. Ideal Skills and Experience: - Proven experience with Oracle RAC - Proven experience with standalone Oracle databases - Specialization in performance tuning - Familiarity with Oracle Database 19c Key Responsibilities: - Implementing performance tuning strategies - Monitoring and optimizing database performance - Troubleshooting issues related to performance - Ensuring the smooth operation of both RAC and standalone Oracle databases The ideal candidate should have a deep understanding of Oracle databases and be able to provide tailored solutions for enhancing performance on...

...skilled developer who can build a customized matchmaking database for my internal use. The database will primarily focus on matching investors to investment opportunities. Key Features: - Storing Match Preferences: The database should be able to store various match preferences including minimum/maximum investment, minimum/maximum funding amount, geographical preference, and the type of funding. - User Authentication: As this database will be for internal use only, the user authentication should be secure and limited to specific staff members. No external user authentication is required. - Search Criteria: The database should have search functionality based on the geographic location. Ideal Skills: - Proficiency in database...

I have an unfinished Flutter app that requires a skilled individual to handle its database connection. The app is designed and now, I need help connecting it to a MySQL database using an API. Key Responsibilities: - Complete the database connection for my Flutter app - Utilize MySQL to store the following data types: user profiles and authentication, transactional records, content and multimedia files Ideal candidate: - Proficient in Flutter and experienced in developing Flutter apps - Skilled in MySQL and API integration - Familiar with handling user data and transaction records securely - Strong background in data storage and retrieval for content and multimedia files This project is not for a business, but rather a personal venture. Your exp...

I need a freelancer to collect data from online. It is simple job of data search and collection from crowdsourcing website. Would provide spreadsheet with details, all you need to fill the details. We are into venture financing. Job Description: Name LinkedIn profile. contacts (if possible) Attached spreadsheet for your reference. Regards, R

I'm looking for an expert programmer proficient in Node, The bot was created to scrape coins from my Telegram group via API integration but currently, it isn't purchasing as expected. Specifically, I'd require someone who could: - Identify and fix the issues that prevent it from purchasing and selling the scraped coins. - Make sure the bot interacts properly with the Latoken cryptocurrency exchange. This task would suit someone with a strong background in bot programming, API operations, web scraping, and experience dealing with cryptocurrency exchanges, particularly Latoken. Knowledge of crypto trading bots' operational peculiarities would be a major plus. Your task would be to get it back to working condition, ensuring all functions operate as ...

I'm looking for an expert programmer proficient in Node, The bot was created to scrape coins from my Telegram group via API integration but currently, it isn't purchasing as expected. Specifically, I'd require someone who could: - Identify and fix the issues that prevent it from purchasing and selling the scraped coins. - Make sure the bot interacts properly with the Latoken cryptocurrency exchange. This task would suit someone with a strong background in bot programming, API operations, web scraping, and experience dealing with cryptocurrency exchanges, particularly Latoken. Knowledge of crypto trading bots' operational peculiarities would be a major plus. Your task would be to get it back to working condition, ensuring all functions operate as ...

I'm seeking a proficient individual for constructing an Access database for my project. The principal requirements include: - Experience with Access, as that's the selected database management system. - Expertise in data storage and retrieval is essential. - The database will be storing textual and numerical data. Experience in handling these types of data is crucial. Ideal skills would include an in-depth understanding of Access, database design, data storage/retrieval techniques and knowledge in handling both textual and numerical data. This should make for a streamlined and efficient process. I'm excited for us to kickstart this project together!

...will run the script(s) you created for me. The script(s) you create will save the Google search results in a .csv file. That is trivial and straightforward. The script(s) will also open the websites associated with the search results. That is also trivial and straightforward. The main challenge lies in locating and filling out contact forms on these websites with my first name, last name, email address, phone number, etc. Most search results will include a link to the company’s website. For example, when I search on Google for… Jake The Plumber Minneapolis, MN … I see a link to Jake The Plumber’s website. Your script(s) will not submit the forms; rather, I will review each form and then manually submit each myself. In other words, I wil...

...Organise and sort these findings for simple review - Identify and list any products filled with non-English language in the description, pictures or images - Compile lists of products that aren’t currently making top-seller lists - List any products can not be delivered in eight days or less. Please note that tractors and food vans may take up to two months to deliver. - List any products that are not suitable for industrial purposes/non-commercial products. Ensure that the products you are considering are meant for commercial use or business-to-business sales. All products should be able to withstand at least 300 uses per month without breaking down. Industrial-use products are usually more powerful than products designed for home use by a single perso...

I need an Excel 365 PowerQuery or VBA script that can fetch daily market data and handle potential data source interruptions or changes. Google Shhets example =INDEX(IMPORTXML("" & C31, "//span[@class='mod-ui-data-list__value']"), 1, 1). <Where C31 = Cell containing the Stock eg GB00B8XYYQ86..." & C31, "//span[@class='mod-ui-data-list__value']"), 1, 1). <Where C31 = Cell containing the Stock eg GB00B8XYYQ86, LU1033663649 or GB00B0CNH163 I need an identical function in MS365 Excel - either with PowerQuery OR VBA (preferable) Ideal skills: - Proficiency in Excel 365 and PowerQuery and VBA - Experience in web scraping and handling dynamic data sources. I am after a fixed quote for this project.

The database is on the National Environmental Agency's website, and it includes all of the applications submitted for environmental permits. Here is a link to the database: Please go over all of the records, and filter ones that match all criteria: 1. EIA Screening Application/Statement or EIA Scoping Application/Statement and 2. The application is for an activity in the sea Start a new spreadsheet, and for every such record, meeting the above criteria, add a row to the spreadsheet including: date of the record, screening/scoping, title of the application (translated to English), a url linking to the application on the NEA website. In addition, download the screening/scoping report document, translate it to English with Google translate

We would like to hire a freelancer expert in development of Postgres Database and Synchronization of Data from our Headquarter to our Multiple Area Office (10 No.) and to Multiple Local PC (Around 300 Nos.) locations available in Network.

We have attached the details we need to sync our data from Headquarter to Area Office and than to local PCs and back again. for RFID based application.

I am looking for someone experienced in web scraping and data collation. The project will involve scraping blog articles in HTML format and compiling desired information into an Excel file. Key Project Requirements: * The extraction will be from specified URLs, using their individual patterns for efficient and accurate scraping. * For each blog article, I need the title, the full text, and the publish date extracted. * This scraped data must be properly arranged in an Excel file for easy analysis. * List of articles is here: Ideal Candidate Expertise: * Proven experience in web scraping is a must, preferably with full understanding of HTML structures. * Proficiency in Excel and data organization. * Attention to detai...

i have a form created with HTML and PHP. user has to fill in information and when press submit, it should insert infos in database. But sometimes it doesn't it just clear or keep loading. maybe connection is not good everytime. So i need someone to adjust it to upload data in realtime. as soon as user finished typing in 1 field, it should store data. when uploading, it should show loading icon near input field. if succeed, green vink icon. if not, red cross icon. when user finish, user can click submit button which will echo all data stored in mysql database on same page in lightbox. image attached. Budget is $35. if you want more, please do NOT bid. budget is $35

I need a fully bilingual professional (I will interview in English) to do some tasks for my agency such as: PR Outreach Content editing or creating CRM management Email marketing Email scraping Researching Organizing data in spreadsheets Copywriting Wordpress And others You must be a fast learner, attentive, curious, with great writing skills. Looking for someone that pays attention and doesn’t keep making the same mistakes. This job will start part-time as a test period, after that it will be full-time. Payment for part-time during trial period: Fee: 250 USD Performance bonus: 50 USD Results bonus: 50 USD If your work complies with my quality requirements and you give more than asked, you’ll get performance and results bonuses each month...

I'm looking for a talented freelancer who can assist with scraping automobile ads from website. Key Requirements: - Scraping specific automobile ads. - Extracting ad titles, descriptions and prices. The ideal candidate should have: - Experience in web scraping. - A strong understanding of data collection from websites. - Attention to detail to ensure accurate extraction of data. Please note that the exact websites and the car details are not provided yet, so the freelancer should be able to work with changing parameters.

I want to scrape daily leads from LinkedIn Jobs, Indeed Jobs, , etc. The task involves extracting data from these job sites and exporting it to Excel sheets. It would be preferable to have some kind of automation that reduces human dependency in obtaining leads every day. If someone has already set up a similar process before, I would prefer that. Preference w...Indeed Jobs, , etc. The task involves extracting data from these job sites and exporting it to Excel sheets. It would be preferable to have some kind of automation that reduces human dependency in obtaining leads every day. If someone has already set up a similar process before, I would prefer that. Preference will be given to those who have previously performed lead extraction tasks for recruitment websites.

...extracted. Scraper Functions Function: list_category_tree Input: competitor_name(astro | sayurbox | segari), existing_csv (optional - CSV file to append to for continuing execution, if the scraper stopped or got IP blocked) Output: CSV of category tree with the following columns (scrape_date, URL, category name, position index, parent_category (null if top level)) Function: extract_sku Input: competitor_name, location (autocomplete place from google maps API), category (optional - extract SKUs from all categories if null), sub_category (optional - extract all SKUs from all subcategories if null), existing_csv (optional - CSV file to append to for continuing execution, if the scraper stopped or got IP blocked) Output: CSV of SKUs with the following columns (category, ...

About Us: We're a dynamic team operating in the healthcare sector, committed to leveraging data to enhance our services and support for medical professionals. Our focus is on identifying and connecting with newer medical professionals and travel nurses to offer them tailored opportunities and support. What We Need: We're seeking a talented web scraper who can help us gather specific data on medical professionals with new NPI numbers. Your task will involve targeting individuals in specific states and collecting their information accurately and efficiently. Your Responsibilities: Develop a web scraping solution capable of targeting specific states and names of medical professionals with new NPI numbers. Ensure the accuracy and reliability of the scra...

My WordPress site hosted on AWS is currently down due to a database connection issue. Key requirements: - **Database Connection Issue**: The site is throwing an 'Error establishing a database connection' message. I believe this is related to database connection details in the WordPress configuration file. If you are experienced with AWS and WordPress, this could be a quick fix. - **Backup Restoration**: I have a recent backup of the site. However, I'm not confident about the database connection details in the configuration file. Restoring the backup and ensuring the database connection works correctly is crucial. - **AWS and WordPress Expertise**: Ideal candidates should have experience with both AWS and WordPress. Familiarity wi...

The app is supposed to: - Search for specific product and add it in the cart with all needed information: delivery location, accessories, quantity. (Example: HP laptop with 14in size) - Compare the product price and service quality in the platforms and give results of the comparison. ( example: price in Amazon for the laptop is 1000$, delivery time is 3 days, the reviews are 4 star. Same for other platforms) - Direct the user to the selected platform to complete the purchase. (Example: to purchase the laptop from Amazon)

Please Sign Up or Login to see details.

I'm in need of an expert who can help in developing a relational database using SQL and Python. The project will primarily revolve around database management. Consequently, I would appreciate assistance in the following tasks: - Designing a new relational database, ensuring it's optimized for efficiency and performance. - Implementing data import and export capabilities for seamless data movement. - Developing queries to support the database's functionality and ease of use. The ideal candidate for this project should have a strong background in both SQL and Python, with a specific focus on database development. Experience with optimizing databases for performance and some knowledge of data import/export mechanisms wou...

I'm in need of an expert who can fix my corrupted .FIC file in my HFSQL database. Key Project Requirements: - The file is currently not opening and is producing errors, so the main goal is to restore it to its original state and ensure it can be opened without any issues. Please note that I can provide the corrupted .FIC file for analysis. Ideal Skills and Experience: - Proficient in HFSQL database management. - Proven track record in repairing and recovering corrupted database files. - Strong problem-solving skills to identify and rectify the issues within the file. If you're confident in your ability to handle this task efficiently, please provide details of your relevant experience and how you plan to approach this project in your bid.

About Us: We're a dynamic team operating in the healthcare sector, committed to leveraging data to enhance our services and support for medical professionals. Our focus is on identifying and connecting with newer medical professionals and travel nurses to offer them tailored opportunities and support. What We Need: We're seeking a talented web scraper who can help us gather specific data on medical professionals with new NPI numbers. Your task will involve targeting individuals in specific states and collecting their information accurately and efficiently. Your Responsibilities: Develop a web scraping solution capable of targeting specific states and names of medical professionals with new NPI numbers. Ensure the accuracy and reliability of the scra...

I’m looking for an experienced programmer who can create an automation script for a website. Key Requirements: - Automation Tasks: Your main job would be to automate various tasks on a website. This could involve anything from data entry to form submissions, and possibly content scraping. The specific tasks will be shared with you in detail. - Python Expertise: Given the nature of this task, your proficiency in Python is a must. If you have experience with automating websites using Python, that would be a huge plus. - Experience: Your application should showcase your relevant experiences and past projects. I’m looking for someone who has a proven track record in this field. Please include relevant examples of your past work in your application. Loo...

we need a Web Scraping expert for a long term. will give you 1 site a day. per site $15. It's all about scraping product data like product title, description, image link etc.

...Key Features: - Efficient data scraping: The tool should successfully extract rental prices, occupancy rates, and property descriptions from Airbnb and AirDna. - Localized scraping: The data scraping should be focused on a specific city, which will be revealed once the project commences. Use of Data: The scraped information will be primarily used for market analysis purposes. The data will be instrumental in helping me understand the dynamics of the rental market within the specific city. Skills & Experience Required: - Proven experience in data scraping, especially from websites like Airbnb and AirDna. - Brilliant understanding of how to work with different types of data, such as numerical and textual data. - Strong ability to tailor the tool to...