Find Jobs
Hire Freelancers

Search external download link within millions of static files if external link is not alive remove static file

$30-250 USD

Completed
Posted over 6 years ago

$30-250 USD

Paid on delivery
I WILL NOT CHOICE YOU IF * you didn't read my description and understand my needs * you are company not individual * you have less than 5 feedback * you have no any skills written php script or perl script. SUMMARY: Search external download link within millions of static files in local folder if external link is not alive remove static file Please download [login to view URL] file has 10 static file (not all of them download page) PROJECT DETAILS: We have millions of static download pages in a folder, each download page has external download link e.g [login to view URL] time to time download link expires for various reason, therefore you will need to write a php script that system will run everyday. Once your script finds url is not alive it will delete static file. You have 2 options to follow Php script depends your written schema for me it is okay which way you want to go. OPTIONS 1 A) There is million static files in 1 folder not all static files contain "download page" in [login to view URL] for example only few of them download page hence you will have to create a list should contains only download pages file name not any other pages(in this [login to view URL] there is 10 static pages not all pages is download page). You could name as [login to view URL] this file will contain all static files name to be checked. you have to search this string wihtin files to get external URL search this in file <font size="1" color="#216415"><strong>Source : </strong></font> after this external link will start e.g <font size="1" color="#216415"><strong>Source : </strong></font>[login to view URL]</p> external URL here is [login to view URL] B) Once we get all download static page file name and download external urls to be checked, script will check each external url exe, if link still alive or not. If url is not alive static file name will be added to ([login to view URL]) file C) Once ([login to view URL]) file ready. You can run this file to delete all static files links not alive. We will do this after all search finishes or we can do cronjob work once a day D) It is very important that, you as a programmer debugging purpose, we have to have log how many we have listed to be deleted. How many of them deleted and what files exactly. and date. Current status OPTIONS 2 A. read next download static file in a folder B. find file to check and get static file name B. check External download URL of static file <font size="1" color="#216415"><strong>Source : </strong></font> C. if is not alive, remove static file D. add to log whats happening with date E. go to A and repeat This URL will help you how to check file on a URL [login to view URL] there is 10 static files attached we will have millions static file hence you will have to implement something we can monitor also you might need give us option how many treat at the same time we gonna run, it might be so long wait if one treat will check every file. It is because there is millions of static pages you would need to think about it too. I HAVE TEST WEBSITE IF YOU DON'T HAVE WEBSITE I CAN GIVE YOU FTP DETAILS IF YOU HAVE WEBSITE I WILL JUST GIVE YOU 1000 STATIC FILE TO TEST.
Project ID: 15267085

About the project

10 proposals
Remote project
Active 7 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hello, my bid is for 1 million files. Not sure how many files you have, I will create php script to complete this task. Relevant Skills and Experience scraping is my best Proposed Milestones $250 USD - upon completion
$250 USD in 2 days
5.0 (580 reviews)
8.0
8.0
10 freelancers are bidding on average $293 USD for this job
User Avatar
Build a script which check externer URL and either leave as it is or remove Relevant Skills and Experience HI Friend I build your script in perl and let me explain how i will do, i will build a suck like 10 or 100 request running parallel in same second and do all in batch processing, so will not take time Proposed Milestones $277 USD - Total Cost i can use your account as well as my server no problem. let me know so we can do in personal chat.
$277 USD in 3 days
5.0 (8 reviews)
3.7
3.7
User Avatar
We are happy to bid on this project. ***** We provides dedicate developers and Development and design services as well. ***** We are having a great team of Web developers with 7-8 years of experie Relevant Skills and Experience Javascript,Perl,PHP, Proposed Milestones $277 USD - Complete project
$277 USD in 3 days
5.0 (1 review)
1.9
1.9

About the client

Flag of AUSTRALIA
Sydney, Australia
5.0
96
Payment method verified
Member since Dec 1, 2010

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.