Website Scanning Script

$30-250 USD

In Progress

Posted

about 2 years ago

$30-250 USD

Paid on delivery

I have an excel file with around 30k websites, some of which are no longer active. Would like a script created that can scan the entire list & detect which are inactive. Scenarios may include: — error / dns message — 404 not found — 'this site can’t be reached' — redirect to domain registar — domain is for sale page In some cases the redirect can be a new company url, so it would be helpful if we captured redirects as output where I could then review afterwards. This script should be something that I can run more than once, ideally hosted in the cloud with a platform such as digital ocean… but I’m open to suggestions. thank you

Scripting

Web Crawling

Project ID: 33580079

About the project

8 proposals

Remote project

Active 2 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@diegodewloper

Hello I can help you perfectly than other freelancer. I have 7 years of experience and if you build this project you have to use requests httpx. So I can help you and will deliver it soon. Please contact me and let's start. Regards.

$100 USD in 1 day

0.0

(0 reviews)

0.0

8 freelancers are bidding on average $112 USD for this job

@ScotttPassmore

Hi I have 8+years work experience in .NET,FLASH,C#,Linux,Visual Studio2010,Joomla,ASP,Javascript,Java,Angular,Laravel,PHP,Python,Prestashop, MS access,SQL,Shell script,XML,moodle,AJAX,CMS,HTML,Drupal,SEO,CSS,wordpress,Bootstrap,Photoshop,Oscommerce, CSS,Paypal API technologies here. I am a web and tech savvy person.I have satisfied more clients successfully in short duration.I will give you very good quality and high level of Accuracy for this position.I can accept your payment terms and method here,Keep me posted. Thank you

$140 USD in 3 days

0.0

(0 reviews)

0.0

@nikosl1

Hello Sir, I am graduated Computer Engineer with deep knowledge in Python Scripting and Web Scraping using Selenium and other techniques. I will implement a threading version for your problem in order to reduce as much as we can the execution time of time of the script. I have experience to do that. I have implemented something similar a while ago. Please contact me to discuss what you need in detail. Thank you very much.

$95 USD in 1 day

0.0

(0 reviews)

0.0

@Noman4077

I have experience and good grip on python ,automation bot and web scraping .I can do your task quickly and in smart budget. Also i can show you my some previous work contact me Thank you !

$30 USD in 1 day

0.0

(0 reviews)

0.0

@aaowal

Hello Sir, I will make an web application for you there you upload an csv file, and application will collect necessary information and insert into database. You will finally can show a report of all scraped urls with return data. You can also export the result as csv. You can run the application as you need. Looking forward to chat for more details. Thanks

$140 USD in 7 days