Closed

Blocking Bots in Mediawiki (but not Google)

I have a large Mediawiki site (the open source software behind Wikipedia) that's getting killed by data mining bots. The bots are eating up all my server resources. Mediawiki has lots of extensions that kill spam bots, but none that I can find that kill data mining bots. I need the following:

1. I need a script that blocks data mining bots by creating a bot trap. All bots that go to the trap need to be blacklisted from the site (unless their on the whitelist)

2. The script to have a whitelist that allows the major search engine bots (google, yahoo, bing,etc).

3. The script to be written as an extension to the Mediawiki software so I can still update the software Mediawiki (in other words not a hack that changes the fundamental code and locks up the ability for easy updates).

Basically I'm looking for something similar to:[url removed, login to view] But once a bot goes to a trap it's blocked from the entire website forever.

Skills: PHP, Software Architecture

See more: open source data mining, architecture search engine, search engine script google, script bing, server blacklisted, open source search engine software, killed, mediawiki search, software bots, yahoo bing google, bing search script, http bot source, mining website script, blocking script, google extensions, easy wikipedia, script mining, hack spam words, bing search engine script, data mining php code

About the Employer:
( 3 reviews ) tustin, United States

Project ID: #4654142

4 freelancers are bidding on average $499 for this job

farhaoui

Hi, we are a team of programmers and designers with expertise and experience in PHP, Mysql, jQuery and Ajax. We have coded and designed websites for various types of businesses very successfully. We have developed many More

$515 USD in 3 days
(47 Reviews)
4.9
extreamcode

HI, Have gone through the requirements, can make this project as [login to view URL] you have any questions please feel free to ask.

$515 USD in 3 days
(6 Reviews)
4.9
chsztsl

Please check the PMB.

$500 USD in 1 day
(33 Reviews)
4.6
prosysadmin

I am a Sr. Linux System Administrator for a very large hosting company and actually work monitoring servers. I deal with these bothersome bots on a daily basis (manually blocking them unfortunately), and it would be my More

$315 USD in 5 days
(7 Reviews)
3.7
mozat

I have experience with your project requirements , check pm.

$250 USD in 15 days
(4 Reviews)
3.1
wildcoder91

hi sir, please check pm

$497 USD in 4 days
(1 Review)
1.1
Dragonnize

Hello,yes, i'm ready for this project.

$666 USD in 3 days
(0 Reviews)
0.0