In Progress

DATA-SCRAPING SEARCH ENGINE - data scraping expert needed

This is my website: [url removed, login to view] which was build by a [url removed, login to view] member who has since been BANNED for being a scammer.

[url removed, login to view] is a SEARCH ENGINE which scrapes data from a list of 150-200 websites selling watches.

I need a data scraping expert to complete the search engine - which scrapes data from over 150-200 websites. These things are incomplete:

a. DATA is not fetched from all 150-200 websites

b. existing websites scraped is not consistently fetched data

c. email alert function is not working

d. email alert function admin panel to approve signups

e. social media interface incomplete

These are the comments from a data-scraping expert, which u need to fix:

" Current setup is not flexible, we have to add a scrapping script for each of the URL we need to scrap for data, even if they are similar and just a pagination of the same website. So 2 scrips for

[url removed, login to view] and [url removed, login to view]

This needs to improve so it can autoscrap the other pages of the same URL, even if they do not exist now but will be added later

There are about 35 files suppose to be executed to scrap all of the URL you have in the list. Have not confirmed if they have covered all of the URL as need to match them in each of the file. It is difficult to execute all of these 35 files manually and/or as cron jobs. It should be just one process which should scrap all of the pages.

Database details are being defined in each of these files, and need to be updated in each of them in case later on you decide to change the password or want to setup on different host. Tiring :)

Current setup is not suitable to run as cron jobs, as they are scrapping over 20 web pages within the single script, failure of one of them, will result failure of all.

Current setup of scrapping is very slow, as it is done sequentially. So the next webpage can only be scrapped once the previous one completes successfully.

Not all of the scrapping scripts are complete, as I can see for some Web URL they have incomplete codes inside. This means you are currently not getting the data from these web pages. For ex. [url removed, login to view]

Jobs are being executed manually on browser, with a fixed page refresh limit. This is causing the pages to reload after the specified time and start from the start again. Due to that, the pages schedule to be scrapped down the page might not be executed in case the one above take longer then the reload time."

If you wish to be hired, you must

a. PROVE THAT you can make this website 100% functional


c ANTICIPATE client needs well. DO NOT only WAIT TO BE TOLD.

d. be PROFESSIONAL and do what is needed to get the search engine up and running

e. advise what hosting requirements are needed. this is the current plan: VPS 1180 [url removed, login to view]

f. you must be the TECHNICAL PERSON - I DO NOT wish to speak to the BUSINESS DEVELOPMENT PERSON.

g. Advise how FUTURE WEBSITES can be uploaded and data fetched from them.

Thank you.

Dateline: 20 days

If you completion rate is less than 90%, please do not bid for this project.

Skills: node.js, PHP

See more: www freelancer hk 3, www freelancer de 3, www freelancer com browser, what should i need to add design my webpage, what needs for graphic design jobs, what jobs can you get with graphic design, what is freelancer means, what is a virtual function, what do you need to start a graphic design business, what do i need to start a graphic design business, websites search engine, websites search development, websites for graphic design jobs, website needed jobs graphic web design, website for scrap data, web search the social web, web search engine design, web scraping solution, web scraping process, web page scrapping, webpage design jobs, webpage design codes, web freelancer in hk, web freelancer hk, web development freelancer jobs

About the Employer:
( 4 reviews ) Hong Kong, Hong Kong

Project ID: #6279553

Awarded to:


Hi Shing, I am Sandeep. We spoke about your website on Skype. We have checked your requirements and we will surely be able to complete these tasks for you. We have done some research prior to sending this proposal to y More

$421 USD in 21 days
(2 Reviews)

19 freelancers are bidding on average $736 for this job


Hi I have gone through the details of your project and we find it well within our capabilities. I offer a wide range of services, including Web design, PHP/MySQL web application development, Open sources like Joo More

$670 USD in 20 days
(270 Reviews)

Hello, First of all, I am available for your project to start immediately. I am good in data scraping form other web pages. I can complete this task within 20 days for sure. I have experience of developing huge site More

$833 USD in 20 days
(89 Reviews)

I am an expert in delivering custom scripts and willing to discuss further about the project details/

$736 USD in 10 days
(102 Reviews)

Hi, Thanks for the opportunity to bid. I have gone through your project description & understood very well. I at smashing interactive having core expertise in Web design and Web development. I have covered various pro More

$705 USD in 30 days
(30 Reviews)

Hi, I have done a similar assignment before and would anticipate this would take me around 8 hours to complete. Im an EXPERT in scraping. Please send me a message if interested. Thank you.

$736 USD in 0 days
(39 Reviews)

Hi, Thanks for alerting me for this project. We can handle it. Don't be worried. If you need more clarifications. Please be online on the Skype and let us have a chat too. we are also looking for more jobs from you. More

$631 USD in 20 days
(15 Reviews)

Hi, I wish to be hired, I am qualified according to your points (a,b,c,,,g) As a PROFESSIONAL . i need to calculate all bugs and problems to give you a good estimation may be budget less than that or more than More

$421 USD in 10 days
(23 Reviews)

Hello i have done a very similar project for another satisfied client which can be recalled here The project was simila More

$2222 USD in 20 days
(7 Reviews)

Hi, I (Myself a senior PHP, ASP.NET programmer using C# and VB) have a team having experience of more than 10 years in developing web and mobile applications. I have a team of expert programmers who write robust and bu More

$789 USD in 20 days
(14 Reviews)

Hello, Greetings from geniuskline webtech solutions pvt ltd. Following are our past work, have a look. [url removed, login to view] [url removed, login to view] [url removed, login to view] [url removed, login to view] ht More

$700 USD in 15 days
(14 Reviews)

Hi Thank you for the opportunity to submit a proposal. We are interested in possibly building a relationship with your organization and, we are a team of 60 designers and developers and all are well experienced in More

$670 USD in 5 days
(6 Reviews)

Hi, I am a node.js developer. I can do this in Node.Js I have done several web scrapping projects before. I have developed my own web scrapping library '[url removed, login to view]' . my github id is More

$722 USD in 20 days
(4 Reviews)

Hi, I have 5+ years of experience in Web scrapping. I have made 500+ scraping tools before. I am able to scrap data from any website within 10 hours. Please watch all my real demos at: [url removed, login to view] More

$555 USD in 10 days
(2 Reviews)

I've expertise in web-scraping as my regular expression skills is quite high especially when working with PHP, i can do all the task with preg_match or preg_match_all to fetch all necessary data.

$500 USD in 10 days
(4 Reviews)

A proposal has not yet been provided

$500 USD in 10 days
(3 Reviews)

Hi, Thanks for your interests. Well, I will try my best to do the website functional as much as possible, hope to do 100%. I am able to do maximum automation via programming. I have good English spoken and listen More

$720 USD in 15 days
(0 Reviews)

Hello, I am a new programmer here. I need some job examples, so it is the best I can offer - cheap price and nice quality. Waiting for your approvement and can't stand to start the job! I have an experience in data More

$488 USD in 5 days
(0 Reviews)

Hi I had worked on similar project called Hotel Channel Manager,where our site was posting & receiving data from different hotel booking portals like [url removed, login to view] ,expedia etc.. & I had faced same kind of issue in p More

$666 USD in 20 days
(0 Reviews)

Hi Shing Chow, I expertise in PHP,HTML,CSS, Wordpress,Graphic design,Web Designing, your work will be done very beautifully once you select me and I will give you the quality [url removed, login to view] can check quality of my work fro More

$722 USD in 15 days
(0 Reviews)