What is web scraping python jobs

...on a daily basis. When a specific string shows up on that type of pages, the scraping of the page that meets the criteria should switch to hourly and the changes on that string should be put in the app dashboard with date & time, link and a photo. Key Requirements: - The app should monitor and notify about updates specifically on product pages of the online store. - Notifications should be in-app, once updates are detected. Skills and Experience: - Proven experience in web scraping, particularly from e-commerce websites. - Proficiency in developing web applications, with focus on in-app notifications. - Prior experience in building apps that monitor and trigger on specific page updates is a plus. The aim is to have a responsive and effi...

Hello, I'm looking for someone who can improve code written in Python. The application downloads data from Telegram and enters into transactions by setting stop loss and take profit at a given level. I have a problem with the limit function and setting stop loss and take profit correctly. I'm looking for someone who could improve the application code.

...for a skilled professional to scrape our competitors' platforms and retrieve their lead database, with a specific focus on contact numbers. This project requires someone with expertise in web scraping and data extraction. The successful candidate will need to have experience in handling large volumes of data and possess excellent attention to detail. The main tasks will include accessing the target platform, collecting the required contact information, and organizing it into a structured database. Additionally, the ability to handle any potential obstacles, such as CAPTCHAs or IP blocking, is crucial. This is a medium-sized project with an estimated duration of a few days or weeks. We require an expert-level freelancer to ensure the highest quality resul...

I have a database that I need to extract specific textual information from, in a one-time extraction. The data needs to be structured in an Excel file. Key Requirements: - Extracting Textual Data: You'll need to retrieve text from t...extraction. The data needs to be structured in an Excel file. Key Requirements: - Extracting Textual Data: You'll need to retrieve text from the database. - Data Structuring: The extracted data should be organized and presented in an Excel format. Ideal Skills and Experience: - Database Scraping: Experience in extracting information from various types of databases. - Data Structuring: Proficiency in organizing and presenting data in Excel. - Attention to Detail: Ensuring that all relevant text is accurately extracted and include...

I am in need of a skilled Wordpress Developer to create a responsive website that has blogs about AI, chatGPT, eCommerce store. The site is also intended to display the latest news of AI. Key Requirements: - Wordpress Expertise: The website should be built on Wordpress, with all the necessary features for a blog, an e-commerce store and news page. - Logo: Generate a unique logo for the website. - Blog Page: The design should be engaging and attractive. - Blog posts - Write around 50 high quality blog posts about AI, chatGPT. - E-commerce Functionality: The website will also need to include an eCommerce page, integrated with payment gateways and user-friendly navigation. - Latest News Page: A separate page should be created to showcase the latest news, with a user-friendly and dy...

...can create a robust data processing and visualization program. This software will primarily process data from Excel files, making use of Excel for the data processing. Ideal skills for this project include: - Proficiency in Python, Java, and C++ - Previous experience in data processing and visualization - Expertise in Excel, and ideally familiar with Plotly or Key Responsibilities: - Develop a program that can effectively process data from Excel files - Implement data visualization features that can be easily understood and interacted with - Ensure the program is user-friendly and efficient The selected developer should be able to provide a clear timeline and communicate effectively throughout the project. A portfolio or previous projects related to data visualization ...

looking for a masterclass python dev who can scrape some products from a shop. start your bid with "grow002"

...Latin America or Eastern Europe. ✻ NO EXPERIENCE REQUIRED ✻ You do not need any experience whatsoever; however, you must be clever and eager to learn. No. I am *not* being charitable; rather, I am being practical. ✻ PAYING YOU TO LEARN ✻ No. You aren't dreaming. I value intelligence and problem-solving ability over experience. I'd prefer to work with someone who is clever and learns quickly rather than someone experienced but is not very intelligent and/or does not solve problems scientifically. Would I hire an Isaac Newton or an Albert Einstein even if he had no programming experience? Of course I would. ✻ TESTS ✻ You must pass several difficult logic tests to work with me. The first logic test you complete for me will be an unpaid logic test. In other w...

I need a python developer to fix some Jupyter notebooks that present time series data with a variety of analytic studies like correlation, time series analysis report and others. Probably 20 hourss work. More if yoiu know 'R'. Must have experience of time series data AND be familiar with pandas, statsmodels, matplotlib, pyplot and pylab. I have a sample notebook that returns the data in a Pandas dataframe. Must work on European/UK time and be available on WhatsApp or Skype when working. It is not a complex job. The successful bidder will needs to pass a simple knowledge test Experience in 'R' and Binder would be nice. If you have relevant work in your portfolio please tell me about it.

I am looking for a skilled Python engineer to create an engine which is capable of finding pre-defined Data Points (DP’s) within the PDF file. Objectives for the system: 1. It has to be completely offline (no online solutions will be accepted); 2. System has to be integrated with LLM (Llama or similar); 3. LLM must be capable on answering questions (via chatbot interface on GUI) on: a. DP’s; and b. Text it read while it was scanning the PDF and looking for DP’s; c. Previously read documents related to the same client. 4. DP’s are to be saved to SQL table; 5. We need a dashboard, to train the engine on finding DP’s in the document. Current problems: A. Large part of documents are scanned, but regardless if the document is scanned or not, ...

I'm in need of a seasoned programmer who specializes in bots and scripts. This project is for an existing business, specifically, to assist in booking appointments on the 'Mafiva Egypt' website. Ideal candidates should be proficient in using Python for bot development. The bot should automate the appointment booking process on the website and should do so rapidly. Furthermore, the bot should be versatile and not tied to a specific platform (cross-platform support). Key requirements include: - Proficiency in Python - Experience in bot development - Understanding of appointment booking processes - Efficient, fast-paced coding - Cross-platform compatibility If you have the necessary skills and experience, I would like to discuss this project further. Pl...

...camera data, rather than LIDAR. I have a GitHub repository and guide to provide as a basis, objective is to replace LIDAR data with camera data. Must use a simulation environment, preferably ROS with GAZEBO and RVIZ. Also I require documentation explaining how your implementation works as well. Key Requirements: - Development of an indoor mobile robot navigation system using DRL - Utilization of camera data for navigation, not LIDAR - Focused on path finding, obstacle avoidance and mapping are the primary goals. - Proficiency in Python is a must, as the project will be entirely implemented in this language - Proficiency in ROS, Linux are also important. - Experience with robotics and DRL is highly desirable The project will involve: - Configuration and impl...

...(Model:MR-J5W3-222G) to control the Linear Motor (SMJ LMU) + Hall Sensor connected to Linear Motor (US2881 Melexis) - Writing code for controlling the servo driver from the Raspberry Pi - Testing and debugging the system - Providing support for any issues that may arise during the project Previous experience with Raspberry Pi and Panasonic Servo Drivers is a must. Additionally, the ideal candidate will have a strong understanding of programming in Python, as well as a background in robotics or industrial automation. GUI in Raspberry Pi will have START button. When we click on start button: Step 1: Communicate with Start Panasonic Servo Driver 1 to rotate the Servo motor in Clockwise direction and stop and a fixed position. This position we have to confirm with testing...

I need a Python developer with experience working with the node SDK. The main goal is to develop Python scripts for automating tasks or processes using the SDK. The job includes: - Developing Python scripts using the node SDK - Automating tasks or processes Ideal candidates for this job should have: - Strong Python programming skills - Experience with the node SDK - Proven background in developing automation scripts - Understanding of software development best practices and coding standards - Good problem-solving skills Please bid if you have the required expertise.

I'm urgently seeking a proficient developer to establish a connection between Zerodha's Kite Connect API and Python for my project. Your responsibilities will include: 1. Setting Up Kite Connect API: The core task will be to competently set up and integrate Kite Connect API into my Python project. 2. Implement Diverse API Functions: I expect the integration to facilitate following functions: - Order placement and portfolio management. - Reception of real-time market data. Required Skills: - Aptitude in API setup and integration. - Profound experience with Python. - Familiarity with Kite Connect API from Zerodha. - Strong understanding of real-time market data and trading functions. Please provide your timeframe to complete this...

I'm in need of a Python developer to create a Telegram bot specifically for individual users. The key features that are crucial to this project include messaging automation, user notifications, and the ability to execute custom commands. Key Requirements: - Expertise in Python programming, particularly in the context of Telegram bot development. - Strong understanding of Telegram bot API. - Experience in crafting automation and user notification features. - Ability to create a flexible, user-friendly interface for executing custom commands. - Attention to detail in order to ensure a smooth user experience. Automated responses to user queries: The bot needs to be capable of responding to a series of predefined queries, providing quick and accurate information. - Broadc...

I'm looking for a skilled developer to create a URL endpoint in Python that removes background from images. The objective is to utilize a free tool like rembg or similar, and host this service on a free platform such as Hugging Face. Here are the key details: - The endpoint will be integrated with my server. When an image URL is posted to this endpoint, it should process the image and return it without its background. Key Requirements: - The endpoint should be implemented in Python, as per my preference. - It should support the common image formats like JPEG, PNG, WEBP etc. I will be positing images from my PHP server to this endpoint. - I require specific requirements for API authentication. A secure authentication method should be implemented to ensure...

scraping site: list scoreboards of a competition

...inventory using the OData/SOAP API. This project involves custom fields and if/else logic based on product categories/and other fields. Key requirements: - Utilize OData/SOAP API: Proficiency in working with SAP BYD API is essential. - Custom field handling: Ensure that the custom fields of the products are accurately uploaded. - Implementing Conditional Logic: You will need to design the system to upload products based on their category. The project can be based on Python, Node.JS or C# This project aims to: - Reduce the manual entry work: The primary goal of this automation is to minimize manual intervention in the product upload process, thereby saving time and increasing efficiency. Ideal skills for this project include: - Strong understanding of SAP Busin...

I'm looking for a skilled developer to create a Python scraper/parser to gather information about upcoming events. The scraper should find events on 10 websites. 3 of them definitely use WooCommerce as a backend. For 6 I am not sure and 1 definitely has a custom solution. None of the website uses Captchas. Information to be scraped includes: - company - title - date - duration - price - city - ID - URL - presence / online / hybrid - status (places available/booked out) - remaining spots - maximum spots and a few other things that I will explain. An important functionality will be to detect the remaining spots by adding participants to the shopping cart and trying how many can be added. The scraper should output relevant logging information. It should be restartable. (Random...

I'm seeking a skilled developer with proficiency in a varied set of languages, including HTML, CSS, C++, Python, C, Java, and JavaScript. The primary goal of this project is to create a desktop application with a focus on web development. Key Requirements: - Proficiency in HTML, CSS, C++, Python, C, Java, and JavaScript - Strong understanding and experience in developing desktop applications - Ability to implement web development principles into a desktop application Your main tasks will include: - Designing and developing a desktop application - Implementing elements of web development into the application, focusing on HTML, CSS, and JavaScript - Ensuring the application is efficient and functional across different platforms Ideal c...

...Freelancer, So we are a company based in Tunisia we have a website an old website called : he is on wordpress and basically our old website contain too much error because after 7 years working to add product one by one we made several error on SEO, Texte descriptions and tag ! We wanted to make a python script to add product or to correct the old web site but ! We found too much problems on recognizing the right structure of the website. So we decided to work on a new made website on wordpress and elementor and basically make another new website ! But for this time we want to make it correctly without any error ! SEO must be perfect ! Let me explain you what our website do ! So we are a repair company specialized on repair Smartphone, Tablette, Video...

My project is looking for a skilled Full Stack Developer with expertise in Python FastAPI. The key aspects of this project include: - **User Authentication**: I need the developer to implement secure user authentication for my web application. - **Database Integration**: This project requires integrating the web application backend with MySQL. - **REST API Endpoints**: The FastAPI should be set up to include all necessary REST API endpoints for smooth operation. Ideal skills for this project include: - Proficiency in Python and FastAPI - Strong understanding of web application backend development - Experience with MySQL and database integration - Knowledge of REST API development - Expertise in implementing secure user authentication in web...

I'm seeking a skilled professional to help in the scraping and generation of high-quality B2B leads specifically in the healthcare and other industry in Spain. Your primary task will be to extract verified email addresses useing tools as apollo. I need between 2000-5000 verified emails and phone number if its possibble. Key Responsibilities: - Utilize lead scraping tools and strategies to extract B2B leads in the healthcare sector. - Generate and verify email addresses for each lead Preferable skills and qualifications: - Proven experience with lead generation and email scraping in the B2B sector - Previous projects or expertise specifically within the healthcare industry is a significant advantage - Familiarity with data verification and the ability to ...

I'm looking for a skilled Python developer to assist me with a few tasks. Please bid i will share task in chat

Data Scraping from a website. I will explain in detail while hiring you.

I'm looking for a Python developer with experience in deep learning and specifically TensorFlow for a denoising project. Key Details: - The project involves implementing a denoising code using the noise2void method. - The noisy images are in PNG format. - The denoising code should be developed using Python and integrated with TensorFlow. Ideal Candidate: - Proficient in Python and deep learning with a focus on TensorFlow. - Experience in denoising algorithms is a plus. - Familiarity with image processing in Python.

We are in need of a highly skilled and experienced Python Developer who specializes in Large Language Models (LLM) and Retrieval Augmented Generation (RAG) tasks. Key Tasks: -Your main responsibility will be to create a custom AI Chatbot by combining LLM (Large Language Model) with RAG (Retrieval-Augmented Generation) using custom data. General Requirements: - Demonstrable proficiency in Python and understanding of LLM and RAG is a generally necessary. - Familiarity with Chatbot modeling, data analysis, model building, web scraping, data extraction, and task automation will be regarded as additional advantages. This project provides an excellent opportunity for individuals deeply interested in language models and augmented generation. Interested and qu...

Note: make millions after see results The AI Influencer Agency Bot would function as a middleman between businesses seeking to promote their products or services and influencers interested in collaboration. Here's how it would work: 1. **Business Search**: The bot would search for businesses looking to promote their products through influencer marketing. This could involve scanning social media platforms, websites, and other online channels for potential leads. 2. **Influencer Search**: Simultaneously, the bot would also search for suitable influencers who align with the business's target audience and marketing objectives. It could analyze factors such as follower demographics, engagement rates, and content relevance to identify the best matches. 3. **Initiating Contact**: O...

I am in need of a skilled Python developer to assist with compiling a Python project into an executable file for Windows. Key Responsibilities: - Compile a Python desktop application into an executable file that can be run on Windows. Ideal Skills and Experience: - Proficiency in Python programming. - Experience with compiling Python applications into executable files. - Knowledge of Windows development environments and tools. This is a straightforward task, but I require someone with experience in compiling Python programs for Windows, as I am keen on ensuring the final product is suitable for distribution and use on Windows operating systems.

1) bharatiya nyaya sanhita 2023 pdf: 2) bharatiya nyaya sanhita pdf: 3) bns: 4) bharatiya nyaya sanhita: All backlinks will be for home page (root domain). Target URL: I want weekly and monthly work and backlinks report.

I'm looking for a skilled developer who can ...attachment. Key requirements include: - Using Gmail as the email service provider. - The emails will be sent to multiple recipients with the same content. - The frequency of sending emails is irregular. The main responsibilities of the program are: - Extracting email addresses and any other necessary information from the spreadsheet. - Attaching a PDF to each email. - Sending out the emails. Ideal skills: - Proficiency in Python or similar programming language. - Experience in working with Gmail API. - Proven track record in developing email automation tools. Please note that while personalization is not currently required, the program should be built in a way that adding personalization features in the future wou...

I need a python programme to download historical prices on daily basis of a list of stocks from the BSE India (Bombay Stock Exchange) website. Data should be stored in csv or excel file. Retrieve data accurately and efficiently.

I'm looking for a skilled software developer with proficiency in Java, Python, and C# to create a mobile application. The main goal of this project is to design and develop a mobile application with a seamless user interface and user-friendly experience. Key functionalities that the application should have include: - Efficient product catalog and search system to allow users to easily find and browse through available products - Intuitive user registration and login features to ensure a personalized experience for users The ideal candidate for this project should have a proven track record of developing mobile applications, with a strong understanding of Java, Python, and C#. Experience in e-commerce development and a keen eye for user experience design would b...

I'm in need of someone to help me scrape a website daily, note down a list of traders and run some checks on them. Qualifications: - Knowing how to use a computer. Tasks Involved: - Visit the website daily, note down a list of traders, and run some checks on them. - This needs to be done by hand, as it cannot be automated due to Cloudflare.

...market analysis project. The objective is to gather and analyze housing data to compare rental market trends in specific regions. This will help inform business decisions and strategies. Responsibilities: Collect housing data from multiple sources, ensuring all data is accurately gathered in compliance with all applicable laws and website terms of service. Analyze data related to rental amounts, property types, locations, and amenities. Provide detailed reports comparing market trends, prices, and available amenities. Create visualizations that clearly illustrate market dynamics. Requirements: Proven experience in data collection and analysis, particularly in real estate or similar markets. Strong proficiency with data analytics tools (Excel, Python, R, etc.). Ab...

...DATABASE This is an interesting overview of the steps that might be involved in completing this project: 1. Develop a web scraping script using Python (e.g., BeautifulSoup, Scrapy) to extract data from relevant grant databases and websites (if possible, considering anti-scraping measures). Sites to be scraped: 2. Design a database schema to store the extracted data. 3. Write scripts to clean, transform, and load the data into the database. 4. Design a WordPress directory listing interface with search filters to display the grant information. 5. Develop a user interface to query and display the grant information based on customer criteria 6. Create a Python plugin for WordPress to automate the scraping work, using

As the owner of an advanced security level website, I am seeking professional hacking services to conduct thorough penetration testing. The key focus areas would be:...areas would be: - User Authentication Process: Probe for any weak links in our login and authentication systems. - Data Encryption: Assess the robustness of our data encryption protocols. - Server Security: Evaluate potential weaknesses in our server security. Ideal applicants would have significant experience with Python-based hacking tools and a proven track record in cybersecurity. Knowledge of advanced security measures and the ability to recommend improvements after testing is highly desirable. Please provide evidence of your skills and previous work in your application. Make sure your proposals are comp...

... - While I'm not looking for a full suite of features, ensuring that the tool can provide a comprehensive SERP analysis is crucial. - The tool should be user-friendly, intuitive, and capable of generating clear and concise reports based on the analysis conducted. Given the nature of the project, expertise in web scraping and data analysis would be highly beneficial. Familiarity with Google's search algorithms and ranking factors would also be advantageous. Budget for this project is in parts and long term. The first stage it to get a platform to launch with. Then we will add more tools. We LOVE the project and look to offer something similar. IT is easy to use and easy to create a project (website) Add keywords and track how the keyw...

I'm a beginner looking for a tutor to help me learn and understand Git and Python, with a focus on branching, version control, Python syntax and functions, as well as building Machine Learning (ML) and Artificial Intelligence (AI) models. My preferred learning style is through hands-on projects. The ideal candidate should have the following skills and experience: - Proficiency in Git and Python - Experience with version control, branching and merging - Strong understanding of Python syntax and functions - Background in building ML and AI models - Ability to teach through hands-on projects.

I'm in need of a freelancer who can help me parse my VCF file and convert it to a different format. The main goal of this task is to extract the genotype information from the file. input will be VCF file (from ONT whole genome run) and csv file with columns containing rsID, chromosome number, position. output will be same as input csv file, with extra column showing genotype from VCF at the given position can run on Mac shell so either perl or python would be fine. Ideal Skills & Experience: - Proficient in parsing VCF files and understanding genotype data - Experience in converting files to various formats like CSV, TXT, and XLS - Attention to detail to ensure accurate extraction of the data - Knowledge of any data validation methods would be a plus. should be a s...

Please Sign Up or Login to see details.

I'm looking for a proficient web scraper who can extract text content from a specific website on a daily basis. The scraped data should be compiled and delivered in a spreadsheet. Key requirements include: - Daily scraping of text content from the designated website - Compilation and formatting of this data into a spreadsheet Your experience in web scraping, data compiling, and spreadsheet management will be greatly valued for this project. Accuracy, timeliness, and consistent daily delivery are crucial aspects of this job. Understanding of automation tools for data scraping would be a big plus. I am looking to collate some data from this website and need an ongoing scrape of this website to set up an ever-updating excel spreadsheet with the fie...

...of a Python GUI software to automate sending messages through Google Voice. The software should be able to perform the following functions: - Send messages to individual contacts on Google Voice - Support precise date and time scheduling for these messages -Automated Sending with customized message example: message example {name} and {adsress} -Custom delay settings for each message -Multiple Profile Sender (custom threads) with multiple Proxy support (enable/disable proxy) -Auto login accounts - Auto Skip Terminated Accounts -License system for users -Sending reports Ideal Skills and Experience: - Proficient in Python programming - Experience in developing GUI applications - Familiarity with Google Voice API is a definite plus - Strong understanding of message s...

I'm seeking a dependable freelancer for a weekly web data extraction task. The primary purpose of this extraction is for market research analysis. Key Responsibilities: - Conduct weekly web data extraction for market research purposes - Deliver the extracted data in an Excel spreadsheet format Ideal Skills and Experience: - Proficiency in web scraping and data extraction - Previous experience with market research data - Strong attention to detail and reliable turnaround time

I'm seeking an experienced professional in the field of Electrode Impedance Tomography to work on a project with a focus on analyzing tissue conductivity. Key Requirements: - Ability to conduct Electrode Impedance Tomography with a focus on tissue conductivity - Experience in interpreting and analyzing the collected data - Strong background in medical imaging and/or related fields P...Impedance Tomography to work on a project with a focus on analyzing tissue conductivity. Key Requirements: - Ability to conduct Electrode Impedance Tomography with a focus on tissue conductivity - Experience in interpreting and analyzing the collected data - Strong background in medical imaging and/or related fields Proven experience with Electrode Impedance Tomography using EIDORS (Matlab) or pyEIT ...

I'm in need of a Python Jupyter expert who can support me in the development of a machine learning model. Here are the specifics: - **Task**: The primary task revolves around machine learning, specifically model development. - **Current Project Stage**: The project is currently focused on model development, so we've already completed the data collection phase. - **Model Type**: The model type we're focusing on is classification. Ideal candidates should have solid experience in machine learning, particularly in classification models. Expertise with Python and Jupyter is also a must. If you have a good handle on data analysis and statistics, that would be a huge plus.

...Requirements: - Aggregating Business Ratings: The system should specifically focus on collecting the business ratings of security installation services available on Google. Data Points: The key data points that need to be collected include each business's overall rating and star reviews listed on Google SERPs. for Ideal Candidate: - Proficient in Web Scraping: Experience extracting and aggregating data from websites is essential. - Familiar with Google API: Knowledge of Google's API for harvesting ratings and review stars would be a plus. - Data Analytics Skills: Ability to process and analyze large amounts of data efficiently. - Rich Results and Schema Markup Please provide examples of similar projects you've worked on, and a brief explanation o...

I am in need of a web application developer with a proven track record in UI/UX design. The ultimate goal of this project is to design a user-friendly interface for an emotional chatbot web app. The chatbot acts as a source of comfort and information, offering responses to users' questions based on their emotional state. Design: - Designing the user interface for the chatbot web application. - Implementing UI component libraries to enhance user experience Functionalities: - Add a blue rectangle around my face which continous moves along with my face and above that there will be text showing my emotion. - Add AI voice (right now im using google voice which is robotic) - Use chatgpt api for conversation with the chatbot (leave blank for api keys, ...

I'm looking for a skilled professional to scrape and collect specific sports-related statistics from Website A. The template is made, its really jsut a copy and paste exercise. Code is already written. Key Responsibilities: - Extract sports statistics from Website A. Your Skills and Qualifications: - Proficiency in web scraping and data extraction. - Previous experience with similar projects. - Understanding of sports statistics is a plus. This is a one-time project with the potential for future work if successful. I look forward to discussing the project further with you.