scrapping + web browser automation PhantomJS Scrappy Python / Javascript

iread. Hi, I'm an expert in web scraping and I have knowledge and resources for avoiding being banned. let me know what you want to automate with browser emulation so I'll update my bid accordingly.

Hi Dear, Hope you are doing well !! I have gone through your project description. I can understand that you are looking for web scrapping and browser automation to complete certain browser tasks therefore I am looking forward to discuss and move ahead. placed bid cost is not the final one and to be negotiable. Looking forward for your response. Thanks Abhi

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

iread. Hi, I would like to know more details about this project. Does the project need to be developed from scratch or is already stared? You say "handle couple of million scrapping requests" so, we need to setup a cluster for web scraping? Can you share few sites that we need to scrawl? Thx, waiting for details.

iread Hello, I am a freelance expert developer and have specialized in bot, scraper and chrome extension development. I have developed many such programs before. So I can make a better software than others by using my past experiences.

iread Hello! I'm web scraping expert. I use python scrapy framework. My scripts can run on windows or linux, but linux is preferably. I can schedule scripts on your server if it is required I can scrape secured and protected sites, my crawlers can enter into login form, emulate ajax requests etc. If site block IP i can use proxy or TOR. I can try avoid captha on site in avtomatic or manual mode. I can export data into xml, csv (excel), mysql, mongodb, mssql, postgres. I have a lot of finish projects (google scraping, facebook scraping, yellow pages, webshops and other sites with lists of any items). Time to scrape one site: 2- 5 days (depend on the different site). I am ready do for you free test file that contain 1000 rows for verify of quality my scripts.

Предложение еще не подано

iread Hello, I am a very experienced web automation and scraping specialist. I have written many scrapers and web automation tools using phantomjs, selenium, python scrapy both using rotating proxy mechanism and tor. I can help you on this and write a pluggable interface for adding websites on the fly. The toughest scrapers I worked on were those that required the reverse engineering of javascript heavy webpages when i had no choice but using the requests library from python. The websites that required that were a deal aggregator for ~10 daily deal websites. Cheers, Artur

A proposal has not yet been provided

iread Hi. .... Lets Start.......... 100% job satisfaction.....payment after work.. Would you like to discuss more?

iread Hi, I have extensive knowledge in web scraping with Ruby. I recently scraped YellowPages, Amazon, Clickbank and Yell. I use proxies,switching user agents and timeouts. I havent used Selenium and PhantomJS much but i'm familiar with Watir which is another web driver. Let me know if you are interested. Thanks

iread. I have good experience of making browser automation applications. You can see my profile reviews for verification. I have completed browser automation for various websites like US Taxes govt RTO website which require various inputs in 4 to 5 steps and then application should see and fetch data from browser, Apart from that I have also done similar task fro Indian govt EPFO service website, Pakistan govt state education board result website etc. Please share the website and I used to develop these automation application using C#.net. Please share any website that you want to do automation on and also share the steps to perform. I will prepare and share a sample POC for this work and if you like it we can continue further. Thanks

Hi, I am Lenin and I have the 5+ years of work experience in Java&J2EE technologies. I am currently the working software professional in one of the leading IT services company. I went through the post and I am sure that I can able to do that as I am having the hands on experience. Please find the below projects which are I have delivered successfully in the past using Java and related technologies. 1. Project ID: 8267223 - Find the faces from the image and return coordinates of the found faces using the Java, OpenCV 2. Project ID: 7942147 - Captured the image from WebCam, Cropped the captured image as a passport size and sent the image to Print using the Java, OpenCV 3. Project ID: 7952131 - Automated the Web browser to scrape the data from Google Maps as per the keywords specified by in the input file 4. Project ID: 7633555 - Automated the Web browser to click on the Google Adsense Ads for all the specified websites using the different proxies 5. Generated the PDF files using the image files provided as a input 6. Automated the Web browser to scrape the data from Real estate websites like Quikr and 99 Acres Please hire me for this work and I will deliver the good quality work for you sure as I did in the past. Expecting for your quick favorable reply. Please feel free to initiate a chat to discuss more about the project. Best Regards, Lenin

iread I have good experience in developing scrapers using browser automation such as PhantomJS, Gecko etc. and as well using sockets. I have developed scrapers for classifieds, yellowpages and social media sites. Please contact to discuss the requirement in detail Thanks & Regards Charles

iread I've got quite a lot of scraping projects in the past which involved static and dynamic pages. To answer your question, there are some sites (previous work in forex site) that is really difficult to scrap, even selenium didn't work, I end up doing it in python and using a different library instead. Some of the issue was, those hidden element cannot be selected when using selenium, it will throw an error, I also tried manipulating the element via javascript call but it did'nt work, the element is controlled by css which is controlled by javascript which is buried deep inside someone else api. As mentioned in the job description, these are browser tasks, there are some tasks that can be done without using headless browser, e.g. sending ajax request, logging into website, fething jason response and etc. As you are aware headless browser tends to load slower. I can do this tasks using python but i advise to use java as it supports multithreading unlike python which has limitations when it comes to mulithreading. Java can open several links in parallel and thus works faster. Let me know if you have questions.

iread - Hello, I'm a veteran so to speak of web scraping projects on here. I've done quite a few already, the most complicated being a scrape of zulutrade, with hundreds of thousands of rows of info to scrape, and ip/blocking and captchas to deal with. I have worked with php , python and ruby for accomplishing these things, php being by far the slowest and most cumbersome to use. Python has the best libraries out there for scraping and I am able to code quickly with it. If needed you can also run python from php and have a nice web interface to run the program from.

iread. Hy, I own a company specialized in data scraping from all around the web. We do data scraping for various clients around the globe. We can gather anything from simple data, like website metadata, website keywords etc, to more complicated results like pagerank, alexa rank, archive rank and even google and bing search results. We use tens of servers that we own (we have our own data room), and our own IP address block, that we can use to scrape data for our clients. We also have full SSDs setups, so that we can work with milions of results very easily. Our largest project (which will be launched this fall), will consist of storing 2 billion links from around 1500 fashion websites, for a client of ours to search on for various brands. If you would like to talk more, let me know. Thanks, Peter

I have written code in python selenium for web automation,can you specify about your requirement, ping me

I could handle millions of requests for any website concurrently and i can extract the data required from there website.

My profession is python and I totally dominated the Selenium Module and PhantomJS Browser. Please contact me on Skype or this site for more details. Skype: kadiremreoto