Find Jobs
Hire Freelancers

Development of WebCrawler / bot for job offers

$750-1500 USD

Closed
Posted almost 15 years ago

$750-1500 USD

Paid on delivery
The outcome of the development project hast o be a WebCrawler for websites (mainly company sites) containing job offers which allows the extraction of content and stores it in a database. Extraction of content The content of the websites containing the job offers (job description) has to be extracted in a text format and exported in a mysql database whereas the format should be “onlinedate, offlinedate, id, category, url, jobtitle, jobdescription, e-mail (if existing), phone (if existing), contactperson (if existing)”. The software also has to be able to crawl job portals like [login to view URL], [login to view URL], [login to view URL],... Example Pages: [login to view URL]://[login to view URL]://[login to view URL] [login to view URL] [login to view URL] Note: It has to be considered that on some of the company websites you need a search engine in order to get to the jobs. Validity of jobs The software also has to verify if jobs are taken offline by a company and are not online anymore. The jobs than has to be marked offline in the database with the corresponding date the job has been taken offline (date of crawling process where the software has identified that the job is not online anymore). Definition / Configuration of URLs The configuration of the software must allow, that the URLs of the websites which have to crawled including SUB-URLs can be defined. The URLs are mainly company webpages whereas the software has to identify on which pages job offers are published. Please do not bid on the project if you are not familiar with the technology of web crawlers. Configuration of Keywords Besides the URLs also keywords can be defined whereas a website will only be extracted if predefined keywords are on the site. Keywords can be grouped in a category so that a job which has been found can be put in a certain job category (e.g. consulting, banking,…). Progress and statistics A small progress and statistic module of the software always has to show the progress of a crawling process as well as the result (websites crawled, new jobs found, jobs updated, jobs taken offline, websites a job was found). The data has to be provided for each new crawling process. Error Messages In order to identify problems with a crawling process an error log has to be written which allows the identification of the problems which have occurred during a crawling process. Dublicate Check The software has to identify if job offers are posted on different sites. For example on a company home page as well as on a job portal. This information has to be stored in the database. Performance The WebCrawler must ensure a fast crawling process. Documentation The software has to be documented in a proper way (functions, methos, etc.) so that a third party is able to understand it. Payment The payment amount will be put in an escrow agreement. After the software has been finished, delivered and quality assured the escrow payment will be released.
Project ID: 437267

About the project

16 proposals
Remote project
Active 15 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
16 freelancers are bidding on average $1,172 USD for this job
User Avatar
Dear friend please kind view PMB for more details thanks
$1,000 USD in 15 days
5.0 (54 reviews)
6.1
6.1
User Avatar
fake bid for PMB
$750 USD in 1 day
4.9 (25 reviews)
4.9
4.9
User Avatar
Hi, Greeting from Astinsoftech.!!! We are ISO 9001:2000 Certified Software Development Company I have studied your requirements in detail and based on our assessment I am very confident that we will execute the project over and above you expectations. I am very confident that the return on investment (ROI) will be over 100% with complete transparent plan of action. We are very confident that we can execute this project with great degree of success. For further details and our expertise please read PMB. Regards, Ravi (usiness Development) Astin Softech Pvt Ltd-Noida.
$1,100 USD in 15 days
5.0 (3 reviews)
4.4
4.4
User Avatar
We are twelve team members who have professionally mastered the skills of Web Design and Development. We have provided excellent quality service within our clients’ budget to their utmost satisfaction. We offers an outstanding value added professional services with high degree of quality at very competitive prices. We have creative designers, experienced programmers and systems analysts to give cutting edge to your business.
$750 USD in 35 days
5.0 (2 reviews)
3.5
3.5
User Avatar
We possess extensive experience of developing numerous high-end websites and are highly organized and adept at meeting tight deadlines that are so common in this industry. Please see PMB for more details.
$1,500 USD in 30 days
4.0 (1 review)
3.7
3.7
User Avatar
Please, check PMB
$1,500 USD in 0 day
5.0 (2 reviews)
2.9
2.9
User Avatar
In your project i have to work on java for better security purpose of database so i bidding $ 1050.
$1,050 USD in 15 days
0.0 (1 review)
0.0
0.0
User Avatar
Hi, I am system analyst and have 5+ years of experience in .NET technology. I worked on Windows application, Windows service and Web application. I also worked on WCF and WF. I am really intrested in this. I hope, will get a chance to work with you.
$1,000 USD in 30 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Please check PMB
$751 USD in 30 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Plz check your PMB for further details..
$1,250 USD in 25 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi,Please check PM. Thanks.
$1,200 USD in 30 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, I have experience of working on WebCrawler bot. I have been working for a WebCrawer boot which download data from hundreds of site. Please see my PM. Thanks, Thuc
$1,500 USD in 20 days
0.0 (0 reviews)
0.0
0.0
User Avatar
HI,Check PM please.
$1,200 USD in 20 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, We are Software Development Company from India provides IT services, having a great experience in development and designing of complex solutions. We have well trained and fully experienced developers and programmers specialized in different technologies for the better accomplishment of the clients needs, want and desires globally. Please find PMB. Thank you, QualSoft Services
$1,500 USD in 35 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of GERMANY
Hamburg, Germany
4.8
4
Member since May 19, 2007

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.