Python scraper scrapy jobs

I'm looking for a professional who can develop a standalone web scraper for Envato Requirements as provided here - Looking for someone who can begin immediately and finish this within 24 hours. Please only bid, if you're able to finish this in 24 hours

I'm in need of a skilled High-Frequency Trading (HFT) Developer with mid-level experience (3-5 years). Key requirements: - Proficiency in Python and C++ programming languages is essential. - Must have a deep understanding of HFT strategies, specifically Market Making and Momentum Trading. Prospective freelancers should have applicable experience and be ready to showcase relevant past projects. This role requires precise code writing and fast problem-solving skills. A strong understanding of financial markets is also preferable.

...rates. Responsibilities: Optimize existing web scraping scripts for speed and efficiency. Deploy and manage web scraping scripts on platforms such as Scrapy Cloud, Apify, AWS Lambda, or Azure. Implement techniques to ensure high-speed data extraction (e.g., parallel processing, distributed crawling, efficient request handling). Monitor and troubleshoot scraping processes to ensure uninterrupted operation. Collaborate with our team to understand project requirements and adjust scraping strategies as needed. Requirements: Proven experience with web scraping using platforms like Scrapy Cloud, Apify, AWS Lambda, or Azure. Proficiency in Python only relevant programming commonly used for web scraping. Strong understanding of web scraping techniques, including but not...

I'm in need of an experienced data scraper that can help me in extracting data from Yellowpages of Malaysia, Thailand, Japan, and Indonesia. Key Details: - I require a full listing of all businesses from various sectors within the mentioned countries. This includes but not limited to Restaurants, Hotels, Clinics, and Retail Stores. - The extracted data should be well-organized, including data such as business names, contact information, and addresses. Skills/Experience: - Proven track record in web scraping with a focus on Yellowpages. - Familiarity with the Yellowpages platforms of Malaysia, Thailand, Japan, and Indonesia. - Capability to handle large data sets and deliver the information in an easily usable format. - A high level of accuracy in data extraction to ensure no ...

We have a list of products. We need to check everyday, if those products have strikethrough price appear on them. All the products that need to be checked are from the same website. The following are the steps:- a) Excel file containing Product url list of about 300 products, all from the same website b) We should be able to run a ma...appear, then it should highlight that G) If the MSRP is appearing for variation, then it should fetch and enter that number. It is very easy and simple work. Bid only if you can do within next 24 hours. See the attached excel file for the sample of what I need For end solution, i should be able to carry it within excel file. The people performing this task, will not be able to execute separate python commands as they will have very limited tech ...

I'm looking for a professional who can develop a standalone web scraper for Envato Requirements as provided here - Looking for someone who can begin immediately and finish this within 24 hours. Please only bid, if you're able to finish this in 24 hours

Data Entry Project - I am looking for a freelancer who can assist me with typing work. - The project involves entering data into a spreadsheet or a database. - The ideal candidate should have excellent typing skills and attention to detail. - There is no specific software preference for data cleaning, so the freelancer can use Excel, Python, or any other tool they are comfortable with. - The dataset contains 100-500 records or entries. - The project requires accuracy and efficiency in data entry. - Experience in data analysis would be a plus, but not mandatory. - The freelancer should be able to complete the task within the specified timeframe. - Good communication skills and the ability to follow instructions are important. - This is a one-time project with the potential for futur...

I'm urgently looking for a skilled Python developer to assist me with a project involving data analysis, web scraping, and potentially machine learning. Your role will be crucial in helping me to derive insights from a large dataset and extract specific information from the web. Key Responsibilities: - Conducting in-depth data analysis using Python - Implementing web scraping scripts to collect relevant data - Potentially developing machine learning models (based on your expertise) While the client did not specify the exact libraries, the ideal candidate should be well-versed in Python programming, particularly with libraries such as Pandas and NumPy. Familiarity with Django, although not mentioned, could be a plus if the project expands to web application deve...

I am seeking a beginner level Python developer with a knack for web development, data analysis, and scripting. The ideal candidate should have a good understanding and practical knowledge in: - Web development: Tasked with the development of usable, meaningful applications that will enhance user interactions and overall user experience. - Data analysis: The successful candidate is expected to leverage Python's capabilities in order to provide solutions to complex data problems. - Scripting: Equally, candidates should be adroit in writing, testing, and debugging codes—including modification of existing scripts. In terms of essential Python frameworks, knowledge and expertise encompassing Django and Flask is non-negotiable, as these will form the crux of most proje...

I am in need of a professional web scraper with Python expertise, who can scrape data from a website(with filter Options) and convert it into Excel format. Key Requirements: - Expertise in web scraping with Python, including dealing with website search filters. - Proficiency in data extraction and manipulation. - Experience in converting extracted data into Excel format. Please note that the specific website and the type of data to be extracted has not been provided as it was skipped by me. The project can be detailed further with the selected freelancer. If you have the skills and experience in this area, please do apply.

I'm in need of a Python expert to assist primarily with automation tasks. The specific task at hand involves generating HTML reports using Python. These reports should primarily include test steps. Your role will involve scripting Python-driven test steps and converting them into a comprehensive HTML report. Ideal Skills: - Strong experience with Python programming and automation. - Proficiency in generating HTML reports using Python. - Familiarity with Quality Assurance and translating test steps. Join me in streamlining my reporting process with your Python expertise!

I'm in need of a Python expert to assist primarily with automation tasks. The specific task at hand involves generating HTML reports using Python. These reports should primarily include test steps. Your role will involve scripting Python-driven test steps and converting them into a comprehensive HTML report. Ideal Skills: - Strong experience with Python programming and automation. - Proficiency in generating HTML reports using Python. - Familiarity with Quality Assurance and translating test steps. Join me in streamlining my reporting process with your Python expertise!

...design. Key Features: - Collaboration Tools: Implementing robust collaboration tools to enhance team productivity. - Knowledge Base: Integration of a comprehensive knowledge base to support users in utilizing llmRAG efficiently. Programming Languages: - Python and JavaScript: The software should support these two languages effectively. Design Requirement: - Professional and Corporate: The design of the llmRAG interface should reflect a top-notch professional and corporate look. Ideal skills for this project include proficiency in Python and JavaScript, experience in developing collaboration tools, and a strong understanding of creating a professional and corporate design aesthetic. Your ability to work with cloud-based IDEs and incorporating a knowledge base will be ad...

I'm looking for a talented individual who can help me scrape 500 - 1000 quality leads. I need the below criteria to be met The must be located in Melbourne Australia The must have a Google My Business Profile They must only have a few reviews if at all They must have an Australian mobile phone number 0407 464 674 Ideally a first name is provided Ideal candidates should: - Have prior experience in lead generation and scraping and have access to the right tools - Be able to deliver high-quality, accurate leads - Be proficient in data mining and have the necessary tools for the task

Data Entry Project - I am looking for a freelancer who can assist me with typing work. - The project involves entering data into a spreadsheet or a database. - The ideal candidate should have excellent typing skills and attention to detail. - There is no specific software preference for data cleaning, so the freelancer can use Excel, Python, or any other tool they are comfortable with. - The dataset contains 100-500 records or entries. - The project requires accuracy and efficiency in data entry. - Experience in data analysis would be a plus, but not mandatory. - The freelancer should be able to complete the task within the specified timeframe. - Good communication skills and the ability to follow instructions are important. - This is a one-time project with the potential for futur...

...Data Engineer/Data Scientist to help me with the creation of a Data Extraction Pipeline. The pipeline will be responsible for extracting data from documents in PDF/Image format, primarily for the purpose of data cleaning and preprocessing. Key responsibilities include: - Building a robust data extraction pipeline using Python - Implementing data cleaning and preprocessing techniques effectively Ideal candidates for this role should possess the following: - Proficiency in Python, with a strong understanding of data extraction and cleaning - Need to have experience with paid tools and clear understanding among different paid tools. - Can develop a Entire Data pipeline/Extarction system from scratch that can accomodate 50k users with less latency. - Experience in building d...

I'm in need of a specialist to develop an automated interface for managing 1 Cisco switch. The purpose of this interface is primarily for configuration management. Critical features of this interface should entail: - A few ability to automatically apply configuration changes on friendly interface - Need only 5 configurations - Using Python Programming - Capacity to perform regular configuration backups saved locally A solid understanding of Cisco switch architecture and prior experience with automated interface design are required for this project. Knowledge of configuration management practices would certainly set you apart in this space. Efficiency and reliability are key here, so your ability to develop an automated solution that can streamline these processes will be indi...

I'm in need of a Excel setup algo that can execute orders on Zerodha from excel file. I require the following features: - One click button: The system should be able to place and execute my selected orders from excel...excel file. I require the following features: - One click button: The system should be able to place and execute my selected orders from excel with one click button. - Customizable Order Parameters: I need to be able to set my own order parameters, including the stock, quantity, price, and other variables. The ideal freelancer for this project should have experience in: - Developing python algo application with excel. - Integrating with Zerodha API. - Implementing automated trading systems. - Creating user-friendly interfaces, with some level of...

I have 2 Python Scripts they do same things but 1st script use functions for one platform 2 script use different functions for second platform, both script do its same just used different functions, i need someone to re made it Scripter number 1 to use functions from script number 2 - The functionality of the first script needs to be well understood to ensure a successful replication. - The project is time-sensitive, so the work should be completed as soon as possible. Ideal freelancer: - Experience in Python development, particularly in replicating scripts for various platforms. - Proficient in understanding and working with pre-existing Python scripts. - Able to deliver quality work under strict time constraints.

Velocity alert analysis and provide actionable insights. Key requirements include: - Proficient in analyzing velocity alerts using SQL or SPL or Python - Capable of translating data from a word file into actionable insights - Experienced in the field of identity analytics, risk engine, authentication channel for the digital banking platforms - Understanding of Account Takeover (ATO) or digital identity compromise - Leverage known data as it relates to the digital customer identity and risk decisioning. - Analyze data logs from customer authentication channels and digital banking applications for malicious use and bad actors. - Create long-term solutions and automation to processes that can be improved when digital member identity is being utilized. Refer to attached document for b...

I'm in need of a Full-Stack Developer who is well-versed in ReactJS, NodeJS, CSS, and Python. The project will require both front-end and back-end development. In detailed, we're developing a web workflow application and I'm looking for an experienced developer for a task of about 2-3 weeks to create an interactive workflow with React front-end and Python backend (see the 3 attachments to this post with the main job description is in the file MTQ - Upwork - Interactive Front Panel - and the other attachments are supporting documents). SUMMARY: Tabbed ReactJS forms with a Python backend that can interact with each other. The front-end can have a few input fields and a few interactive subcomponents in the form of either tables or images (with possibly ov...

Please Sign Up or Login to see details.

Please Sign Up or Login to see details.

...that it is either repetitive or there is no reply at all. I need to identify the cause of these repetitions and non-responses. Please provide detailed instructions on how the erroneous parts of the code should be modified. I'm seeking a Python developer to assist me in fixing logic errors in my existing Telegram bot code. The bot's main functionality is to automate certain tasks. Key responsibilities include: - Identifying current logic errors in the code - Fixing the code to ensure proper functioning The ideal candidate will have: - Proficient in Python and Telegram bot development - Experience in identifying and fixing logic errors - Strong problem-solving skills Your task does not involve generating reports, sending emails, or updating database records...

NOTE : this is for futures .. max budget is $300 *** please submit, only if you have worked on BOT projects for crypto exchange*** I'm seeking a skilled developer to create an automated trading system that can...require seamless integration with the MEXC platform. Skills and Experience Required: - Strong knowledge of algorithmic trading and cryptocurrency markets - Proficiency in building automated trading systems, particularly on the MEXC platform - Experience in developing and implementing trading strategies - Understanding of real-time market data analysis - Proficiency in coding languages such as Python, Java, or C++ Please only apply if you have a proven track record in building similar systems and are able to deliver a reliable and effective trading bot for the MEXC ...

I'm in search of talented coders with a passion, education (may be self or collage etc.) with expertise in Python, Java, and C++ to help me develop a new software application for Windows. Key Project Details: - Programming Languages: Proficiency in Python, Java, and HTML is essential for this role. Your role will involve: - Working on the software development process from conception to final testing and deployment. - Ensuring that the application is optimized for all users and clients, considering the specific requirements and features of this platform. Ideal Skills and Experience: - Strong programming skills in Python, Java, and C++. - Proficiency in developing software applications for Windows. - Experience in creating software from scratch. Looking forward ...

I'm seeking a Python Jupyter expert with a specialization in data visualization. Specifically, I'm looking for someone to help me build interactive charts for my data. The ideal candidate should be familiar with the Pandas library and proficient in using Dash for creating interactive visualizations. Key Requirements: - Proficient in Python and Jupyter - Experience with Pandas for data manipulation - Strong knowledge in data visualization principles - Skilled in creating interactive visualizations using Dash Your tasks will include: - Understanding the data I provide you - Building interactive charts that represent the data accurately - Ensuring the visualizations are user-friendly and interactive Ideal Skills: - Python - Jupyter - Pandas - Dash - Data Vis...

I'm seeking a proficient software engineer adept at Java, Python, and C++, who will assist me in website development. The core assignment entails creating a program specifically for WordPress, my preferred CMS. Ideal Skills and Experience: - Comprehensive Java, Python, and C++ knowledge - Previous experience with website development - Proficiency in WordPress CMS Your role will focus on developing a program tailored to my needs, emphasizing functionality and integration within the WordPress platform. It's essential to have a hands-on approach, be detail-oriented, and dedication to creating high-quality, reliable software. Applicants should show a portfolio or examples of previous related work. This will aid in understanding your process, style and skills that can ...

upload text file into site and extract his content

I am in need of a Python expert to create a program that will handle multiple tasks concurrently via workers (multi process) I already wrote a task manager using threading and async, I just want to make sure I have no race conditions, avoid deadlocks and improve logic and preformance.

I am seeking a Python expert to deploy and debug a web application from my Github repository. Requirements: - Experienced with Python for web development. - Has expertise in deploying Python web applications. - Must be knowledgeable in debugging Python code and fixing potential issues. - Familiarity with Python web frameworks like Django, Flask, or Pyramid (actual framework used will be confirmed during the kick-off meeting). Your role will specifically involve deploying and debugging my Python web application to run locally. Experience with data analysis and machine learning will be beneficial. A background in similar roles/projects will be highly regarded.

I'm urgently seeking a Django expert to develop a backend application for my project. This application requires: - User authentication and authorization, roles: Global Administrator: - Access to everything Application Administrator: - Access...Company provider creation/update- method POST 6. Company provider service category creation/update- method POST 7. Service creation/update- method POST Models: Use attached data model as a base, not mandatory to reproduce AS IS. What is expected: 1. Django application 2. DB performance enhancement scripts. i.e. indexes. The ideal freelancer for this project should display strong proficiency in Python, Django, and experience in API integration. Given the urgency of the project, I would prioritize candidates that can deliver high-quality...

...autonomous driving systems by effectively monitoring and tracking objects. Key Responsibilities: - Implementing object tracking in lidar point cloud data - Utilizing provided JSON files for object detections - Developing a visual representation of the tracked objects - Ensuring the tracking system is optimized for the specific needs of autonomous driving Ideal Skills and Experience: - Proficient in Python, with experience in relevant libraries like NumPy or Open3D - Prior experience with object tracking in lidar point clouds - Understanding of the requirements and challenges of autonomous driving technology - Ability to create visual representations of the tracked objects - Strong problem-solving skills and attention to detail This project is crucial for enhancing the safety a...

For my project, I'm using Twitter's API version 2.0 along with Python for analyzing tweets. However, I've encountered a "403 Forbidden" error, pertaining to the Tweepy library that I need resolved. - Ideal Skills:Experience with Twitter's API, especially version 2.0, is critical. The freelancer should also be proficient in Python programming and have specific knowledge about the Tweepy library. - Other Information: Please note that, aside from Tweepy, no other libraries or frameworks have been employed for this project.

...Spreadsheet used for my car rental business. Each tab in the spreadsheet represents a specific car. The app should allow employees to: Select a car category (corresponding to a tab in the spreadsheet). Select a rental date. Input various amounts (e.g., rental income, expenses). Automatically update the corresponding tab in the Google Sheet with the provided data. Requirements: Experience with Python and Google Sheets API. Ability to create a user-friendly interface. Strong understanding of gspread and oauth2client libraries. Good communication skills and responsiveness. Deliverables: A functional app that performs the required operations. Documentation on how to set up and use the app. Support for initial setup and troubleshooting. Budget: [Your Budget] Deadline: [Your Deadli...

...list of processes. 5. Detailed view of specific process information. 6. Temporary storage of uploaded files in the browser. 7. Functionality to delete data being processed and start a new analysis. 8. Automatic process to delete old records from the database. 9. Recording of deletions for audit and regulatory compliance purposes. Technical Requirements: - Development in Java, NodeJs, or Python languages. - Implementation of API for file processing and database access. - Data storage in a database. - Data security and encryption. Expected Deliverables: - Complete development of the Colombia Rama Judicial file analysis system. - Implementation of user interface and specified functionalities. - Exhaustive testing to ensure the quality and accuracy of the system. ...

I need a Python script that can scrape ALL images uploaded on Stackexchange posts related to LaTeX, especially those tagged with tikz/pgfplot. The primary goal for collecting these images is to create a personal database of the best illustrations asked and made by users. Key Requirements: - Ability to scrape Stackexchange posts specifically related to LaTeX - Must be able to identify and download all images in the posts - Organize the images with their corresponding posts Ideal Skills and Experience: - Proficiency in Python - Experience with web scraping and data extraction - Familiarity with Stackexchange's layout and data structure - Ability to handle and download images from web sources Please submit detailed project proposals outlining your approach to achieving t...

I'm in need of a developer who can create a web scraper for the marketplace. Your main task will be to scrape both card details and bids, based on specific filters such as rarity or card type. Key Requirements: - Extracting card details (name, stars, price, last sale price) and bids (price, quantity, time) - Applying filters based on card attributes like rarity Ideally, I would like the data to be updated on a daily basis. This means you will have to set up the scraper to periodically check for new information and update the existing dataset accordingly. Skills and Experience: - Proficient in web scraping - Experience with scraping marketplaces or similar platforms - Familiarity with filtering and updating scraped data - Ability to work with large datasets and hand...

... or if the source was unavailable. 5. Executor Function: There should be a function that executes all the sources that were queried and returns a PDF file as in Annex 1. Technical Requirements: • Experience in the development of automated query systems and data processing from external sources. • Knowledge in APIs, web scraping, and web page reengineering processes. Must use Java, NodeJs, or Python. • Ability to structure data efficiently and accurately. • Ability to generate detailed logs of queries and results. • The solution must include the necessary files and documentation to deploy each connector or integrator separately as AWS Lambda functions, Docker containers, or any Serverless service in AWS or GCP. Expected Deliverables: • Complete de...

I'm looking for a geotechnical expert to perform a thorough analysis using abaqus on the requirements for a tieback wall in my project. Modeling with abaqus Python is preferred to link with abaqus Knowledge in UMAT is preferred Writing drafts Be organized

I'm seeking a highly skilled Python developer to implement an automated stock trading algo strategy with top-of-the-line features. Here's what you would need to handle: - Implement automation of the trading execution. This includes suggesting suitable algo methodology and developing programs to automate trade orders, modification, and cancellation. - Integration with the Shoonya trading platform. Understanding of APIs is crucial. - Managing a high frequency of trades, on a tick by tick basis; real-time is absolutely essential. Therefore, previous experience and proven ability to implement such processes is vital. The ideal candidate would have a deep understanding of Python and experience in algo trading, particularly automated trading execution. Proficiency worki...

...deploy serverless applications including API Gateway, Lambda functions, DynamoDB, and IAM roles. 2. Develop a wrapper in CDK to orchestrate the deployment of the serverless components by calling the construct to create a CDK stack. 3. Ensure that the deployed stack includes all necessary resources for the API functionality. Tools: 1. Infrastructure: AWS CDK with TypeScript. 2. AWS Lambda: Node.js, Python, or other supported languages. Considerations: 1. Implement least privilege access for IAM roles to follow security best practices. 2. Secure the API endpoints to protect the data and ensure confidentiality and integrity. Submission Deadline: Please submit a link to your code repository on GitHub by noon the day prior to your interview. The code should include your CDK constru...

I am in s...tasks may vary from website development to application development and data analysis. I need a versatile individual who can adapt to different project requirements and deliver high-quality results. The key functionalities and features required for these tasks may include user authentication, database integration, and payment processing. Ideal candidates should possess: - Strong coding skills in Python, Java, and JavaScript - Experience in website development, application development, and data analysis - Proficiency in user authentication, database integration, and payment processing - Ability to deliver high-quality results within the stipulated timeframes If you are a professional coder with the required skills and experience, I'd be happy to discuss further de...

I am seeking a skilled programmer who can create an intelligent BOT that's able to traverse my google spreadsheet and scrutinize incoming leads based on their EPC status. The main functionalities requir...simultaneously check their EPC statuses. - Highlighting Matches: In case a lead matches the EPC status I am in search for, the BOT should distinctly highlight the respective row in the spreadsheet. - Segregating Non-Matches: The BOT should be capable of moving the leads that do not match the desired EPC status to a separate section in the spreadsheet. Ideal skills for this job would be advanced Python or Java programming capabilities, extensive experience with google spreadsheets, and familiarity with EPC checks. A structured and methodical approach to problem-solving is ...

...of a proficient Python coder who can develop a robust object recognition system for me. The key tasks for this project are as follows: - Create a Python code able to recognize and detect people and vehicles. - The code not only needs to detect these objects but also provide specific information about them, including flagging any instances of jumping signals via license plate detection. - Additionally, it should be able to identify instances of multiple riders on two-wheelers, whether the riders are Indian or foreign, again using license plate detection. Algorithm 4 different Deep learning Algorithm and tell the best * Yolo * other than Yolo any 3 Deep learning network model The ideal freelancer for this project should demonstrate previous experience in P...

I'm looking for an artificial intelligence expert to help me incorporate AI into my websites. The AI should be able to perform the following tasks: - Natural language processing for chatbots: It is essential that the AI can effectively proce...tailoring the website experience to individual users. Key Responsibilities: - Incorporating AI technologies in the website for the above-mentioned functionalities - Ensuring the AI is seamlessly integrated and functions optimally - Delivering the project within a month Ideal candidate: - Has experience working with AI technologies, particularly in the context of website development - Proficient in Python and/or JavaScript - Adept at natural language processing and user behavior analysis - Able to deliver high-quality work within the req...

I require a proficient developer who can code a stock checker bot for Lowe's. The bot will need to be compatible with Discord, as we'll be using commands there to pull product ID and zip code data. Key details include: - It must be coded in Python. - The bot should track stock availability at Lowe's for a specified zip code, in real-time. Requirements: - Competency in Python is a must. - Previous experience in developing bots compatible with Discord. - Understanding of real-time data tracking. - Knowledge of Lowe's system or similar would be advantageous. The final deliverable should enable users on Discord to run a command with the product ID and zip code to get real-time results on product availability and price.

As a major part of my project, I'm looking for a specialist well-versed in both sentiment analysis and named entity recognition. You'd be perfect for this project if: - You have substantial experience in Python programming. - You have worked with the Natural Language Toolkit (NLTK). - You have demonstrated skills in sentiment analysis and named entity recognition. Your role would primarily involve working with the NLP tasks, using Python and NLTK. You would play a key role in executing sentiment analysis and named entity recognition for the data. An understanding of these processes, and the ability to work with them efficiently, will be key to the successful completion of this project.

I'm urgently seeking a Django expert to develop a backend application for my project. This application requires: - User authentication and authorization, roles: Global Administrator: - Access to everything Application Administrator: - Access...Company provider creation/update- method POST 6. Company provider service category creation/update- method POST 7. Service creation/update- method POST Models: Use attached data model as a base, not mandatory to reproduce AS IS. What is expected: 1. Django application 2. DB performance enhancement scripts. i.e. indexes. The ideal freelancer for this project should display strong proficiency in Python, Django, and experience in API integration. Given the urgency of the project, I would prioritize candidates that can deliver high-quality...

I have developed a model in Python and now I'm looking for a skilled individual who can enhance the model with semantics, particularly in the area of Natural Language Processing (NLP). Additionally, I need the model tested on different datasets to ensure it performs well in a variety of scenarios. Key responsibilities include: - Enhancing the existing model with NLP features - Testing the model on various datasets - Ensuring the model performs well across different scenarios The ideal freelancer for this project should have: - Proficiency in Python, with a strong grasp of NLP techniques - Experience in enhancing existing models with semantics - A track record of testing and optimizing models on diverse datasets. I'm open to discussing the specific datasets on w...