Python web scraping to csv jobs

Hello I am looking for a python code to scrape a large number pages and save them as html. In order to get to the page to save, you must click a radio button, submit, and then enter a string of numbers, then submit and then save the html. If the string entered provides an error then you must skip to the next iteration. There is no human verification. I already have a version I made myself that works with Selenium, however I need to increase the speed, so I am looking for someone to see if its possible to do this without even opening a browser and possibly using direct call methods (get, request, cURL, response, JSON?). It should be a simply project for someone who knows how to do this. Please enter the result of 3+2 for ...

...project, you are given the flexibility to choose between Python, JavaScript and Ruby, based on your expertise and the bot's needs. 2. Required Functionality: I'm not certain about all the functionalities needed yet. Hence, I expect you to suggest essential attributes during development, keeping in mind a bot that can handle referrals efficiently and incorporate an earning system. 3. Bot Purpose: The primary purpose of this bot is to encourage users to refer and earn rewards. It must be able to streamline this process, making it user-friendly and effective. Ideal skills and experience: - Past experience in coding telegram bots - Proficiency in Python, JavaScript or Ruby - Excellent understanding of referral functions and im...

I'm looking for a skilled Python programmer to improve the functionality of my code which automates downloading and generating reports from a specific website. Key requirements include: - Deep understanding of Python and proficiency in code repair and maintenance. - Experience with highly efficient report generation. The goal is to improve quality of code and reduce the time it takes to generate and download these reports. - The ability to critically analyze existing scripts and identify potential optimizations. The task will be considered successful when our report generation process is noticeably faster and more efficient. Having experience in similar projects is a plus.

A tool using equations and generating a graph & excel report showing how variations in some of the variables change the value of a model.

I have a backend code for a pre-existing fully function website and mobile app. The backend code is currently all written in php. I need someone to convert this existing php code into fully functional python code which I can deploy.

I'm on the lookout for a specialist who brings proficien...for a specialist who brings proficiency in both ASHLAR and MIST to the table. Your main objective will be: - Create a small demo App using VB.NET to illustrate implementation of both Ashlar and Microscopy Image Stitching Tool. You're free to employ placeholder images or your own sample images. It's essential that you're adept at using ASHLAR and MIST for seamless task execution. Your bid should evidence your understanding and experience in these software along with VB.NET. Ready to use explanation are available on various sites : Purpose is to understand and learn these two techniques, in VB.NET.

...description below. We will consider only freelancer who will provide a scraping sample (2-3 lines) aligned with the instructions below. Scrape data from this website: Filters to be used: - "CAR": 203 and 16348 - "Anno di Concessione": 2020, 2021, 2022, 2023, 2024 - "Importo": select "Compreso fra 100000 e 200000", "Compreso fra 200000 e 500000" and "Maggiore di 500000" We need to scrape the results from all the possible combinations of the above filters. The outcome table should contain all the columns of the initial table AND all the data contained inside each result (you can access in it by clicking on the magnifiying lens). To be clear: - identificativo di riferimento - numero di riferimen...

I'm looking for an experienced freelancer to install Python on my cPanel shared hosting account and run several cron jobs daily using a ready-made Python script. Budget is $20.

...sourced from CSV files. The chosen candidate: - Should first start with cleaning and preprocessing the data to create a reliable foundation for analysis. - Should then interpret and present that same data through meaningful visuals to explore its intricate properties and characteristics. - Should additionally facilitate statistical analysis to derive patterns and trends otherwise invisible to the naked eye. The hoped-for end-product of this project is not just predictive analytics but insight and data-driven recommendations that will inform future decision-making. Proficient use of Python or R for these tasks is essential, as is familiarity with data cleaning and visualization libraries and tools. To thrive in this role, you must be a h...

I'm looking for a skilled data scraping professional to assist me with a project. I had a working script in Python using an API, but the company implemented a Cloudflare protection that is always blocking me. You would need to find a solution how this could be circumvented (e.g. proxies) and large amounts of data be scraped. If you are interested, I am happy to provide more details privately.

...should be done through scheduled sync and is expected to be seamless and error-free. Key Points: - I use Quickbooks for my accounting activities and need it to be in sync with my other tools - The integration should be scheduled, with the ability to set the frequency of the sync - It should be able to handle a large amount of data and ensure that all transactions are accurately reflected in Quickbooks - Python integration is created for Booqable, but needs adjustment The ideal candidate for this project should have: - Proven experience in integrating Quickbooks with other software, ideally Booqable, Shogo, and Lightspeed - Proficiency in working with APIs and ensuring scheduled syncs are set up correctly - Strong attention to detail to...

We're searching for an experienced Full Stack Developer to assist with an undisclosed project. While the specific programming languages and frameworks have not been indicated, a comprehensive understanding of JavaScript, Python, and Ruby on Rails is usually desired in this role. The purpose of the project is unknown at this moment; however, a versatile developer who can adapt to various situation would serve our goals best. Skills and Experience: - Proficiency in JavaScript, Python, Ruby on Rails - Experience in creating a website, developing a mobile application, building a web application - Ability to adapt and learn quickly - Proven track record in full-stack development - Excellent problem-solving skills

I'm looking for a skilled developer who is proficient in both Android and Python development to create an app centered around social media analytics. The primary goal of this project is the development of a functional app that is capable of analyzing data across multiple platforms namely Facebook, Instagram, and Twitter. IDEAL CANDIDATE: - Solid experience in Android and Python app development - Proven track record in creating apps related to social media analytics - Understanding of API integrations for Facebook, Instagram, and Twitter is a must TASKS: - Design and develop an Android app using Python - Incorporate capabilities to analyze social media activity and data from Facebook, Instagram, and Twitter - Ensure reliable interpretation a...

...experienced web developer who can create a high-quality mockup generator website tailored for e-commerce companies. example website Key Aspects: - The main audience for this website is website developers, so the interface and functionalities have to align with their needs. Ideal Skills and Experiences: - Proficiency in either Python Django, JavaScript React, or Ruby on Rails. The choice of technology should be based on what guarantees the perfect performance and optimum results for this project. - Extensive experience in developing mockup generators or similar tools. - Deep understanding of the needs and preferences of website developers. - Strong knowledge of e-commerce businesses and their design needs will be an advantage. The goal is to creat...

We are seeking an expert in algorithmic trading or financial engineering to assist with completing the code for our High-Frequency Trading (HFT) Bot. The ideal candidate will have a deep understanding of algorithmic trading strategies, market data analysis, and the ability to optimize trading systems for high-speed execution. This project involves refining and enhancing the existing codebase to improve performance and profitability. Required skills: - Proficiency in algorithmic trading and financial engineering - Experience with HFT strategies and market data analysis - Strong programming skills in languages such as Python or C++ - Knowledge of trading platforms and APIs - Ability to optimize trading systems for high-speed execution

I'm in need of a Python programmer to write a piece of code for me in Python, and then compile a detailed report about it. The job essentially involves writing a code in Python, and then the creation of a detailed report about the code, its structure, design, and implementation. Key Requirements: - Proficiency in Python programming - Strong understanding of coding best practices - Experience in technical report writing - Ability to explain complex concepts in a clear and concise manner - Familiarity with creating and structuring PDF documents. Ideal deliverables: - A well-structured Python code - A detailed, structured, and easy to understand report in PDF format. If you're confident in your Python programmin...

I need to create an AWS Lambda function for user creation in DynamoDB. For Endpoint creation - API Gateway For User auth - JWT

I'm seeking a Python developer with experience in Playwright to complete my existing code. Key tasks include: - Reviewing the existing codebase. - Identifying and fixing bugs. - Completing partial functionalities if any. Ideal candidate should have: - Prior experience with Python (Playwright). - A strong understanding of web scraping and UI automation. Please provide examples of your past work in Python (Playwright) along with your bid.

I am seeking a proficient developer to create a tool for read data. the following information daily prices and another data That I would explain later. Ideal skills for this project consist of: - Extensive experience, particularly with this task - Proficiency in data formatting. - StormProxies - PHP - Python - RocketSoruce API - Amazon Web Services - Server Management The output format should be compatible with Magento 2 API. This project demands a high level of accuracy to ensure the data is both comprehensive and precise. Please bid only if you can fulfill these requirements.

Must be able to meet via Microsoft Teams I'm looking for a Python developer who can provide me with hands-on assistance in my project development within VS Code. Key Tasks: - Code Debugging: I require assistance in debugging my Python code. The ideal freelancer will be able to analyze and troubleshoot my code to identify and fix any issues. - Package Installation: I'm using Django, Flask, and NumPy in my project, and I need help installing these packages correctly within my development environment. - API Integration: As part of my project, I need to integrate several APIs into my Python code. The successful freelancer will be able to guide me on how to implement these integrations effectively. Python Version...

PLEASE READ ALL DESCRIPTIONS!!! I...! I am in need of a comprehensive full stack developer who is proficient in JavaScript and Python, and ideally has experience with React, Angular, and Django. Successful completion of this project will require a developer with strong problem-solving skills, experience in building similar applications, and a keen eye for security. Ultimately, I am looking for a professional who can deliver a high-quality, functional, and scalable application that meets all the requirements. Please schedule a meeting for discussing about opportunity using this link. If you read the full job description, just write: " I READ ALL DESCRIPTION. I SCHEDULED. HOPE TO TALK WITH YOU SOON. " I am looking forward your proposal!

To integrate ChatGPT into the Pepper robot : User spoken question>prompt text to ChatGPT>GPT answer>text-to-speech voice +hand gestures. You need to be familiar with Pepper's main programming software Choreographe 2.5.5 , Pepper SDK, ChatGPT API, and maybe if necessary, Android Studio will help at the last milestone. So the task is fully described above, please do not ask me again and again what to do. I will give you access to the Choreographe on my laptop that is connected to the Pepper robot staying in my room. Please do not disturb me if you have not clue of what is the task about or even Python coding.

I'm in need of a skilled programmer to assist me in automating daily pricing updates from a specific website. The script should pull the pricing information and update it into our system. Key Requirements: - Develop a script that can extract data from a website and automate the pricing update process - The script should be able to run daily, without manual intervention - Ensure the script is robust and can handle occasional changes in the website's layout without breaking Ideal Skills and Experience: - Proficient in web scraping and data extraction - Experienced in script automation, particularly on a daily basis - Familiarity with handling data within a business context - Ability to create a reliable and sustainable solution, accommodating f...

I require a professional data scraper to scrape multiple websites. Key tasks include: - No limitation on type of data scraped as this was not specified. - Scraping must be done across multiple websites, specifics will be provided upon project commencement. - All data should be delivered in Excel spreadsheet format. Ideal skills and experience: - Prior experience in web scraping across multiple diverse websites. - Proficient in using different scraping tools. - Strong understanding of Excel and data parsing. - Attention to detail and commitment to high quality, error-free work.

I'm a beginner with Raspberry Pi. I need programming help to create a video looper. Key requirements: - Experienced in Raspberry Pi programming - Proficient in Python or relevant languages - Able to troubleshoot and debug Your task will be to guide me through the process, helping me write code and understand the logic behind it. Your assistance will be instrumental in achieving my goal of creating a video looper with my Raspberry Pi.

The idea is to experiment and listen to the frames of the modbus master and slave (Any RS485 modbus slave), you can simulate the HMI with Weintek, for example, with a camera to capture images of the HMI and using OCR (artificial vision) in Python Windows to match the variables found with the memory table that is running, you can virtualize com ports. you can simulate the communication of any process

I'm seeking a skilled developer to create an API that can recognize specific objects or logos in images, and provide real-time alerts based on this recognition. To accomplish this, you should be proficient in Python, Artificial Intelligence (AI), and the Azure Vision API. Key Requirements: - Develop an API for image recognition that specifically identifies objects or logos - Enable real-time alerts triggered by the API's recognition capabilities Ideal Experience: - Proficiency in Python is a must - Previous experience with AI and machine learning for image recognition - Familiarity with Azure Vision API is highly desirable - Strong understanding of real-time alerting systems This project will be pivotal in enhancing our monitoring and alerting capa...

We are in search of an experienced Web Scraper to uncover price points across multiple websites and categories for us. Key Requirements: * Compile pricing information from the following platforms: Amazon, , , , , , , , , , nykaaman.com. * The scraping project should cater to several products and categories rather than specific ones. * Implement scraped data directly into the backend of our website using PHP. Ideal Skills: * Proficiency in web scraping scripts and tools * Deep knowledge and experience in PHP programming * Familiarity with the aforementioned websites' structures and processes * Ability to handle data scraping projects from a wide range of product categories

data collection as per sample web scraping fro

As an experienced Python programmer with a focus on OCR and deep learning, I'm looking for a savvy Python developer who can help develop an OCR Model using machine learning or deep learning. The model will be used specifically for complex math equations. The details are as follows: - Dataset: Unfortunately, I currently do not have a dataset available. This will need to be sourced or created, so previous experience in this area would be highly beneficial. - Accuracy Level: The intended target for accuracy is a moderate level, between 80-95%. A capability to improve this rate in the future would be seen as a significant plus. My ideal candidate will have experience with: - OCR and ML/DL model development - Sourcing or creating datasets - Achieving opti...

I need to outsource the API connection to various e-commerce platforms to retrieve data for reporting, using Python. Here is the list of platforms I need to connect to: 1/ Shopee 2/ Lazada 3/ Google Ads 4/ TikTok 5/ Tokopedia Requirement: a demo of a project you have previously connected that is on the list You can choose one or all platforms to outsource.

I'm in need of a proficient developer who can code a typin...development - A deep understanding of Windows OS The program should possess an essential feature which is a correct word-breaking routine. Furthermore, it should empower users to define their own word-breaking rules. Prior experience programming in languages compatible with Windows OS is vital. Preferred skills for the job would include: - Programming languages, C++, Java, Python - Windows application development - Ability to work with language processing algorithms This project requires someone who understands the intricacies of typing programs and the Thai language, someone who can create a software catering specifically to the users' needs. It's a challenging yet rewarding project ...

We're seeking Python developers to build an OCR model with machine learning/deep learning capabilities integrated into a web interface. The project involves converting screenshots of complex mathematical equations into editable LaTeX code, Word, or text/markdown formats. Responsibilities: - Develop an OCR model using Python and relevant machine learning/deep learning libraries. - Integrate the OCR model into a user-friendly web interface for easy upload and conversion of screenshots. - Implement preprocessing techniques to enhance image quality and improve OCR accuracy. - Handle complex mathematical symbols and equations during text conversion. - Conduct testing and debugging to ensure the functionality and accuracy of the OCR system....

I need a professional to help me extract contact details from the Australian Institute of Architects website. Their website address is: There are 566 architect contacts for Sydney, NSW, Australia within 100km. I requirements: - Extracting: I require the following contact information to be extracted: Business Name, Email, Phone number, Full address separated by suburb, postcode and state. - Formatting: All extracted data should be structured and organized into an Excel spreadsheet. Ideal Skills: - Web Scraping: Proficiency in web scraping tools and techniques is essential. - Data Entry: Experience with data entry and extraction. - Attention to Detail: Accuracy in capturing and organizing contact details is crucial. - Excel Proficien...

Hello, I have a simple WordPress plugin with 300 lines of code, which scrapes a website. Problem: The website has activated cloudflare and since then the plugin no longer extracts the data. If you can tell me your budget and we will start working immediately. I'll send you the Zip so you can modify it and return it to me, I'll test it and if everything works we'll finish the project. URL of the website that I scrapped:

I need a wide range of details about accommodations on , downloaded for analytical purpos...for analytical purposes. This data should include room availability, pricing, customer reviews, accommodation rate variances, photos, addresses, and phone numbers. - Essential Skills and Experience: 1. A strong understanding of web scraping tactics and data extraction. 2. Proficiency with 's platform and data structures. 3. Data organizing skills to deliver finalized data in CSV format. The outcome I envision is a well-organized CSV file that can further my research and analysis goals. A successful delivery will require attention to detail to ensure all requested information is included. Please bring forward your innovative solutions ...

I'm in need of an experienced Python developer to assist with the development of critical web security tools. While specific tools aren't outlined below - Subdomain Enumeration: Subdomains to be listed and categorized. - Directory Enumeration - Sensitive Parameter Detection - XSS Testing - SQL Testing

I'm actively seeking an experienced Python/Flask developer. Detailed specifications for the project were not provided, so a willingness to work collaboratively to clarify project requirements will be crucial in this role. Ideal Skills: • Python/Flask programming prowess • Experience with user authentication processes • Knowledge on data storage and retrieval • Proficiency with integrating external APIs Given that the design preference and platform compatibility weren't specified, a flexible mindset toward these aspects would be appreciated. Please be prepared to adapt to different styles and multiple device functionalities. Your input and expertise will be invaluable to shaping this project's success.

...multiple bots for the private game servers in a game called Ragnarok These bots are expected to carry out a myriad of tasks which include, but aren’t limited to; • Advanced character leveling • Detailed item farming • Skill automation Additional features essential for these bots to possess are: • Auto potion consumption: The bot should be able to intelligently consume potions whenever required • Mob detection and avoidance: Bots must have the ability to detect and evade mobs automatically • Chat filter: It should be able to interact with other users by filtering out specific keywords or phrases There is versatility in the choice of code we are willing to accommodate for this initiative. Whether...

Please Sign Up or Login to see details.

I'm looking for a skilled developer to assist in the creation of a python code frame finite element analysis. It is crucial that the tool is developed in Python and allows for Finite Element Analysis to show stiffness matrix, displacement vector and reaction vector. - Required Skills: Python, Finite Element Analysis, Web Development - Experience: Prior experience in developing web-based interfaces for engineering applications would be highly advantageous. A background in frame finite element analysis is a significant plus. Your understanding of Python and its application in this context is essential.

Good I am making a script for a client in python, where I am building a program where the program will generate me 100 weekly emails at most, these emails must have a phone number associated with each of them a number, ie emails have to be valid, the customer wants to receive and send mails, I am looking for creation of server to receive and send mails with emails created by the python app. emails are created randomly and just like passwords with a custom domain. I speak a little English so if you know Spanish we would understand each other better.

I need a proficient developer to create a Firefox add-on that can scrape specific data from multiple websites.

...full-stack developer to create a bespoke quote system for our company, ensuring robustness and security in web development practices. The successful candidate will have the following credentials: - Proficiency in HTML, CSS, JavaScript, and PHP or Python for comprehensive full-stack development. - Experience with relational databases such as MySQL or PostgreSQL, to effectively manage and integrate the quote system database. - Expertise in API integrations, especially with implementing BankID for secure electronic signature functionality. - A deep understanding of secure authentication methods and strict adherence to GDPR compliance. Key Responsibilities: - Design, develop, and integrate a custom quote system that aligns with our existing operations. -...

I'm loo...an experienced Python programmer to help me build a custom script for data extraction. - Data Extraction: The script will be primarily focused on extracting information from articles and publications. Specifically, I'm interested in acquiring author information, publication date, title, and URL. The extraction needs to be driven by SEO searches. - Usage: The data that is extracted will be used for content creation purposes. Therefore, I need the script to be able to provide a clean and easy-to-use output that can be utilized in this context. Please include examples of your past work in your application. The ideal freelancer for this job will be proficient in Python, have experience in data extraction, and be able ...

...Interactive Brokers platform. The goal here is to design an algorithm that will execute trades according to a set of custom rules I've established. Key requirements and expectations for this project include: - The algorithm needs to be developed in Python - Trades should execute on Interactive Brokers and plot custom rules on TradingView. - Custom rules are provided by the client and not based on common indicators like Moving Average Crossover or RSI. - No manual intervention required; trades solely based on custom rules. - Experience in optimizing entry and exit orders for large orders or low liquidity scenarios required. - Trading signals, such as support and resistance lines and entry/exit markers, to be plotted on TradingView. - Alerts to...

I have an existing Python script that needs to be ported to a console app. Key Requirements: - Porting of the existing Python script to a user-friendly console app in Python 3.x - Implementation of input/output handling to ensure the app is interactive and easy to use Ideally, the developer should have: - Proficiency in Python programming and understanding of Python 3.x features - Experience with developing console apps - Strong skills in implementing user-friendly interfaces - A good understanding of input/output handling in Python As the original script has already been developed, the focus here is on the user interface and experience. If you have a good understanding of Python, experience in build...

I'm looking for a command line tool that can lock .pcm files, similar to a specific example that will be provided. Key Requirements: - File Locking: The tool should be able to lock .pcm files in a way that's identical to a specific example I will provide. The locking mechanism should be secure and reliable. - Command Line Inputs: Users should be able to interact with the tool solely through command line inputs. There's no need for a GUI or web interface. - Batch Processing: The tool should also support batch processing of multiple files at once. This is a crucial requirement for me. - It will run on windows Ideal Qualifications: - Experience with file locking mechanisms and encryption. - Proficient in developing command line tools. - Pr...

I am looking for an experienced individual to help me create an interactive web platform that will serve as a guide to various types of machine learning algorithms. The purpose of this guide is to cater to beginners and intermediate level practitioners who have a basic understanding of programming concepts. The ideal candidate for this job would have: - A strong understanding of machine learning algorithms and their practical applications - Experience in creating interactive web platforms - The ability to simplify complex concepts for a beginner audience - Good programming skills, as some technical programming knowledge will be required for creating the interactive elements Key requirements for the interactive web platform i...

I'm looking for a proficient Python developer who specialises in Machine Learning. The chosen individual will be responsible for the selection and training of models, as well as predictive analysis. The ideal candidate possesses: - Mastery in Python programming. - Extensive understanding of Decision Trees for analysis. - Ability to effectively perform model selection and training. - Proven experience with predictive analysis. Please reference prior similar projects in your application. Serious, dedicated professionals only.