Write a website scraping script

$250-750 AUD

Completed

Posted

about 8 years ago

$250-750 AUD

Paid on delivery

We have a CSV file with 65,000 domain names that we want to scrape their website and check if they have a Facebook URL, Twitter URL or Instagram URL. There are two deliverables from this work. 1. We want a CSV returned with the following new populated fields: - Facebook URL - Twitter URL - Instagram URL *Each of these columns should include the domains actual Social Media URL, for example: Domain | Facebook URL | Twitter URL | Instagram URL [login to view URL] | [login to view URL] | [login to view URL] | [login to view URL] 2. We want a copy of the PHP script which you've written so that we can re-use ourselves later. CSV file will be supplied to winning freelancer.

Project ID: 10280222

About the project

26 proposals

Remote project

Active 8 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@sonarkaushik

I am well versed in this kind of jobs and can do your project as per requirement. I have over 8 years of experiences. I am very much able to work on this. ***I am ready to start Waiting to hear from you. with thanks and regards

$500 AUD in 4 days

4.6

(93 reviews)

6.3

26 freelancers are bidding on average $466 AUD for this job

@mhmhz

Hi I can provide a Multi-threading desktop application in C# that will crawl each domain and get the required URL.. Thanks

$1,666 AUD in 3 days

5.0

(136 reviews)

7.6

@jubair7

Experienced FREELANCER HERE to work for your project. Is it OK if I do it using Python? Let's discuss more and finalize the project and cost. Feel free to ask me questions, if any. I look forward to work with you. You can also contact me through Skype. Have a good day and stay fine :-) Sincere regards, Jubair

$600 AUD in 20 days

4.9

(227 reviews)

7.6

@DanielVizcaya91

Hi there. I would be glad to help you out with this project. I am a professional scraper, with experience creating easy to use scripts to extract bulk data from the web. I can create a sample file for you to check my work. Also, I will properly document the code, so you will be able to use it in the future as per your needs. Hope to hear back from you soon. thanks, Daniel

$368 AUD in 3 days

4.7

(126 reviews)

7.1

@mananraja

Hi there, I have read the project & would like to discuss.. I have good web scraping skills in Python & can make web scraping scripts in Python.. Hope to hear from you..

$250 AUD in 2 days

5.0

(150 reviews)

6.3

@Verz1Lka

Hello! I'm web scraping expert and i can done your project. I use python language and scrapy framework. My scripts works on windows, mac or linux, but linux is preferably. I can schedule scripts on server if it is required. I have more 200 finished projects (google scraping, facebook scraping, yellow pages, linkedinIn, amazon, webshops and other sites with lists of any items). I can scrape secured and protected sites, ii site block IP i can use proxy or TOR, also i can try avoid captcha. I can export data into json, xml, csv (excel), or any database (mysql, mongodb, mssql, etc). Message me, if you have any questions!

$299 AUD in 3 days

4.8

(108 reviews)

6.6

@wbslivera

Hello, I am Oracle certified professional java programmer and have Bsc,IT, I am ready to help you, I can do java program or php for this,thanks

$250 AUD in 3 days

5.0

(131 reviews)

5.9

@freelance4hire80

hi I've scraped social media URL from business website before. I'll deliver both csv data and perl/php script for this project. I've time and ready to start this project

$388 AUD in 5 days

5.0

(46 reviews)

6.1

@RRajeshR

Hi, I am interested to work on your project. I can write a script to check for the social links in each URL provided and generate the result csv file. There are some URL that might not be able to fetch the links automatically using script. Those cases I will fill manually and provide you the quality list. Please share me a sample list of URLs to have better understanding of the requirement. Regards, Rajesh

$300 AUD in 10 days

5.0

(40 reviews)

6.0

@jawadakr

Hi I am Jawad . I am working from last 5 years. I have a team of developers/designers who will deliver the task within your budget and in time according to your requirements. let's talk and discuss the details of the project here. Please give us a chance. looking forward to work with you. Thanks

$473 AUD in 15 days

5.0

(85 reviews)

6.2

@dabing1205

Good at scrapy/python, and have many scrapy projects done. Please contact me to discuss more detailed requirement, Thanks

$444 AUD in 10 days

5.0

(32 reviews)

5.4

@proauthor

Dear employer, I've very good experience in web scraping. I've done numerous web scraping projects. I usually write custom scripts using java language. I did similar project to visit individual domains and scrape the content from them. I can proceed with your project to scrape the social media links from the sites. Please send in more details to proceed with the project. I'm ready to start working on the project. Looking forward to working with you. Awaiting a positive reply from you. Thanking you Shaik Allabakash.

$250 AUD in 5 days

5.0

(64 reviews)

5.6

@Madaky01

Hello, i can build an exe app that will open the specific csv file, download homepage from the desired domain, check all urls if any of them are facebook, twitter or instagram and write complete the specirfic rows. Also it can be multi threading, so you can run as many instances as your computer can handle. Is not a php code but will do the same job working just in windows. If you're intrested i'm waiting your pm.

$250 AUD in 1 day

5.0

(54 reviews)

5.4

@durorey

Hi sir, I can complete it fast , I have 7+ years of experience. I created similar work before. I can send you demo today. I look forward to work for you and I will do my best. Thank you.

$277 AUD in 3 days

4.9

(17 reviews)

5.0

@jinigo23

I've excellent knowledge and experience in this kind of work(Over 5+ years). So I can easily understand your project. I've added some of my previous project in the portfolio. I'm ready to start the project immediately. I'll complete your project within the time stated. I'll do my best.

$300 AUD in 10 days

4.9

(11 reviews)

5.0

@basrimy

hi, we will use web scraper with jquery capability in order to make it faster. Basri .

$388 AUD in 5 days

4.9

(27 reviews)

4.5

@Flowzone

Dear Sir, PHP is definitely not the right language for your project. I will use a much faster and better language for the script, and provide it to you at the end. Cheers, Flowzone

$955 AUD in 10 days

5.0

(10 reviews)

3.9

@danielnewhard

Hi, I was going to write this script in Python, because it has the Twisted library which allows for many different concurrent connections. It'll be much faster when making multiple connections to different sites at once, instead of only making one connection, scraping, and then doing another connection. I can do this task, but one thing I want to know is whether you want only to scrape the index page or view all pages on the site for a Facebook / Twitter / Instagram URL. If it's only the index page, my bid will not change as that is what I have based my bid on, but it may be more if you want to scrape the entire site. Thank you for the opportunity, please contact me if you have any questions.

$270 AUD in 2 days

5.0

(5 reviews)

4.0

@AccuPro

Hello, I can deliver the project in two days. Can you send me the input file to take a look in the meanwhile? Best regards, AccuPro - Providing simple solutions to complex problems.

$250 AUD in 2 days

5.0

(9 reviews)

3.9

@engkelber

Hello, I have more than 20 years experience on programming languages like C, C++, PHP, ASP, etc. Please give me a chance to try to have your job done. Thanks

$277 AUD in 10 days