I am an experienced freelance software developer with over 8 years experience providing web scraping and data extraction services. I write custom code to crawl and extract different types of data from numerous sources including real-time data, websites requiring authentication, business listings, real-estate, etc.
My expertise lies in automated web scraping of extremely difficult to obtain data, websites with bare bones structures and complex to parse, large scale websites, websites using obfuscated protocols and authentication, including those using 'scraping protection' services and sites that simply put - no-one else can scrape. I use a variety of methods for getting the data and aim to obtain the data as quickly, accurately and efficiently as possible.
I work most effectively given well-defined specifications including website urls, keywords, search terms, preferred output format and update frequency. Data output formats are usually chosen by you, the client, and include further post-processing of crawled data according to bespoke requirements.
Please contact me if you have any available work. Thanks!