Do you run your own website.... - SaltwaterCentral.Com

Post new topic   Reply to topic
 

Capt_Dave
Posts: 12331
Location: Cape Fear, NC
Reply with quote
Tue Dec 18, 2007 7:09 am
Take this and drop in into a file called ".htaccess" or add it to the one that is already present. IF you do not see it in your file list....try -la before you upload....(htaccess files do not show in most ftp clients)

Code:
#Bad Bots
RewriteCond %{QUERY_STRING} \.ru
RewriteCond %{HTTP_USER_AGENT} ^Java [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^LWP [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^lwp-trivial [OR]
RewriteCond %{HTTP_USER_AGENT} ^libwww-perl [OR]
RewriteCond %{HTTP_USER_AGENT} ^NaverBot [OR]
RewriteCond %{HTTP_USER_AGENT} ^Twiceler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Yeti [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^BlackWidow [OR]
RewriteCond %{HTTP_USER_AGENT} ^Bot\ mailto:craftbot@yahoo.com [OR]
RewriteCond %{HTTP_USER_AGENT} ^ChinaClaw [OR]
RewriteCond %{HTTP_USER_AGENT} ^Custo [OR]
RewriteCond %{HTTP_USER_AGENT} ^DISCo [OR]
RewriteCond %{HTTP_USER_AGENT} ^Download\ Demon [OR]
RewriteCond %{HTTP_USER_AGENT} ^eCatch [OR]
RewriteCond %{HTTP_USER_AGENT} ^EirGrabber [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailSiphon [OR]
RewriteCond %{HTTP_USER_AGENT} ^EmailWolf [OR]
RewriteCond %{HTTP_USER_AGENT} ^Express\ WebPictures [OR]
RewriteCond %{HTTP_USER_AGENT} ^ExtractorPro [OR]
RewriteCond %{HTTP_USER_AGENT} ^EyeNetIE [OR]
RewriteCond %{HTTP_USER_AGENT} ^FlashGet [OR]
RewriteCond %{HTTP_USER_AGENT} ^GetRight [OR]
RewriteCond %{HTTP_USER_AGENT} ^GetWeb! [OR]
RewriteCond %{HTTP_USER_AGENT} ^Go!Zilla [OR]
RewriteCond %{HTTP_USER_AGENT} ^Go-Ahead-Got-It [OR]
RewriteCond %{HTTP_USER_AGENT} ^GrabNet [OR]
RewriteCond %{HTTP_USER_AGENT} ^Grafula [OR]
RewriteCond %{HTTP_USER_AGENT} ^HMView [OR]
RewriteCond %{HTTP_USER_AGENT} HTTrack [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^Image\ Stripper [OR]
RewriteCond %{HTTP_USER_AGENT} ^Image\ Sucker [OR]
RewriteCond %{HTTP_USER_AGENT} Indy\ Library [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ^InterGET [OR]
RewriteCond %{HTTP_USER_AGENT} ^Internet\ Ninja [OR]
RewriteCond %{HTTP_USER_AGENT} ^JetCar [OR]
RewriteCond %{HTTP_USER_AGENT} ^JOC\ Web\ Spider [OR]
RewriteCond %{HTTP_USER_AGENT} ^larbin [OR]
RewriteCond %{HTTP_USER_AGENT} ^LeechFTP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mass\ Downloader [OR]
RewriteCond %{HTTP_USER_AGENT} ^MIDown\ tool [OR]
RewriteCond %{HTTP_USER_AGENT} ^Mister\ PiX [OR]
RewriteCond %{HTTP_USER_AGENT} ^Navroad [OR]
RewriteCond %{HTTP_USER_AGENT} ^NearSite [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetAnts [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetSpider [OR]
RewriteCond %{HTTP_USER_AGENT} ^Net\ Vampire [OR]
RewriteCond %{HTTP_USER_AGENT} ^NetZIP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Octopus [OR]
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Explorer [OR]
RewriteCond %{HTTP_USER_AGENT} ^Offline\ Navigator [OR]
RewriteCond %{HTTP_USER_AGENT} ^PageGrabber [OR]
RewriteCond %{HTTP_USER_AGENT} ^Papa\ Foto [OR]
RewriteCond %{HTTP_USER_AGENT} ^pavuk [OR]
RewriteCond %{HTTP_USER_AGENT} ^pcBrowser [OR]
RewriteCond %{HTTP_USER_AGENT} ^RealDownload [OR]
RewriteCond %{HTTP_USER_AGENT} ^ReGet [OR]
RewriteCond %{HTTP_USER_AGENT} ^SiteSnagger [OR]
RewriteCond %{HTTP_USER_AGENT} ^SmartDownload [OR]
RewriteCond %{HTTP_USER_AGENT} ^SuperBot [OR]
RewriteCond %{HTTP_USER_AGENT} ^SuperHTTP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Surfbot [OR]
RewriteCond %{HTTP_USER_AGENT} ^tAkeOut [OR]
RewriteCond %{HTTP_USER_AGENT} ^Teleport\ Pro [OR]
RewriteCond %{HTTP_USER_AGENT} ^VoidEYE [OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\ Image\ Collector [OR]
RewriteCond %{HTTP_USER_AGENT} ^Web\ Sucker [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebAuto [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebCopier [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebFetch [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebGo\ IS [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebLeacher [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebReaper [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebSauger [OR]
RewriteCond %{HTTP_USER_AGENT} ^Website\ eXtractor [OR]
RewriteCond %{HTTP_USER_AGENT} ^Website\ Quester [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebStripper [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebWhacker [OR]
RewriteCond %{HTTP_USER_AGENT} ^WebZIP [OR]
RewriteCond %{HTTP_USER_AGENT} ^Wget [OR]
RewriteCond %{HTTP_USER_AGENT} ^Widow [OR]
RewriteCond %{HTTP_USER_AGENT} ^WWWOFFLE [OR]
RewriteCond %{HTTP_USER_AGENT} ^Xaldon\ WebSpider [OR]
RewriteCond %{HTTP_USER_AGENT} ^Zeus

_________________
Captain Dave Tilley
910-264-3973

Let\'s go kill something!
Carolina Beach Fishing Charters
  
View user's profile Send private message Send e-mail

Capt_Brent
Posts: 349
Location: Wilmington, NC
Reply with quote
Tue Dec 18, 2007 1:44 pm
what does it do Dave???
_________________
Capt. Brent Stanley
\'09 East Cape Vantage, 90HP Honda 4-stroke
  
View user's profile Send private message Send e-mail

Capt_Dave
Posts: 12331
Location: Cape Fear, NC
Reply with quote
Tue Dec 18, 2007 2:26 pm
Capt_Brent,

It blocks the BOTS listed from spidering your site. It also blocks referrers from the domain ru

The bots listed there....you don't want them on your site....they are for harvesting e-mail addresses, stealing content and other things that are not desired.

Dave
_________________
Captain Dave Tilley
910-264-3973

Let\'s go kill something!
Carolina Beach Fishing Charters
  
View user's profile Send private message Send e-mail

HOTSPOT
Posts: 136
Location: Bradenton, FL
Reply with quote
Thu Jul 24, 2008 7:26 am
Thanks for the code Capt Dave. Adding it to all my sites.

You mind posting the code to disable hot linking of images?
  
View user's profile Send private message

Capt_Dave
Posts: 12331
Location: Cape Fear, NC
Reply with quote
Thu Jul 24, 2008 8:12 am
I use several methods. Which one do you want? htaccess in the image DIR is the best IMHO.

That way you can allow or disallow who ever you want.

Dave
_________________
Captain Dave Tilley
910-264-3973

Let\'s go kill something!
Carolina Beach Fishing Charters
  
View user's profile Send private message Send e-mail

Capt_Dave
Posts: 12331
Location: Cape Fear, NC
Reply with quote
Thu Jul 24, 2008 8:17 am
This is what I use....place it in an htaccess file in the image DIR

Code:
Options -Indexes
RewriteEngine on
RewriteCond %{HTTP_REFERER} !^$
RewriteCond %{HTTP_REFERER} !^http://(www\.)?fryingpantower.com(/)?.*$     [NC]
RewriteCond %{HTTP_REFERER} !^http://(www\.)?kurebeachfishingpier.com(/)?.*$     [NC]
RewriteCond %{HTTP_REFERER} !^http://(www\.)?continentalshelf.com(/)?.*$     [NC]
RewriteCond %{HTTP_REFERER} !^http://(www\.)?militaryappreciationday.org(/)?.*$     [NC]
RewriteRule .*\.(gif|jpg|jpeg|bmp|pdf|zip|doc|tif|tiff|xls|wmv|txt)$ http://www.fryingpantower.com [R,NC]



You add any site you want to allow to the list. Only sites listed are allowed to use the files in that DIR.

Dave
_________________
Captain Dave Tilley
910-264-3973

Let\'s go kill something!
Carolina Beach Fishing Charters
  
View user's profile Send private message Send e-mail

Post new topic   Reply to topic


Jump to:   

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You cannot download files in this forum

Do you run your own website.... - SaltwaterCentral.Com