| |
Deny From User-Agent |
| |
Kinetic (12:00 30/8/2002)
andypoole (20:46 3/9/2002)
Kinetic (20:54 3/9/2002)
andypoole (21:18 3/9/2002)
Phlamethrower (09:32 4/9/2002)
rich (15:39 4/9/2002)
rich (09:32 4/9/2002)
|
| |
|
Andrew Duffell |
Message #19103, posted by ad at 12:00, 30/8/2002 |
Posts: 3262
|
I was just wondering why Knox denys from non specified user-agents? It does get quite annoying  |
| |
 [ Log in to reply ] |
| |
|
Andrew Poole |
Message #19124, posted by andypoole at 20:46, 3/9/2002, in reply to message #19103 |
Posts: 5558
|
I was just wondering why Knox denys from non specified user-agents? It does get quite annoying Oh come on, how often is it that a browser doesn't send a user-agent..
(apart from netsurf, which is very developmental...) |
| |
[ Log in to reply ] |
| |
|
Andrew Duffell |
Message #19125, posted by ad at 20:54, 3/9/2002, in reply to message #19124 |
Posts: 3262
|
That isn't the point. I was just wondering why it does it? |
| |
[ Log in to reply ] |
| |
|
Andrew Poole |
Message #19127, posted by andypoole at 21:18, 3/9/2002, in reply to message #19125 |
Posts: 5558
|
That isn't the point. I was just wondering why it does it? probably to stop bots from getting at the pages. |
| |
[ Log in to reply ] |
| |
|
Richard Goodwin |
Message #19136, posted by rich at 09:32, 4/9/2002, in reply to message #19103 |
 Dictator for life
Posts: 6828
|
I was just wondering why Knox denys from non specified user-agents? It does get quite annoying So don't use anything that doesn't use a proper user agent.
Knox blocks a number of user agents to try and cut down on the massive amounts of spam we get, which, by cunning use of hidden meta tags, I know is being sent to addresses harvested from web pages.
________
 Cheers,
Rich.
|
| |
[ Log in to reply ] |
| |
|
Jeffrey Lee |
Message #19137, posted by Phlamethrower at 09:32, 4/9/2002, in reply to message #19127 |
 Hot Hot Hot Hot Hot Hot Hot Hot Hot Hot Hot Hot Hot stuff
Posts: 15100
|
even though a smart bot could realise that and then send a false user agent 
I suppose it stops some of them though. |
| |
[ Log in to reply ] |
| |
|
Richard Goodwin |
Message #19150, posted by rich at 15:39, 4/9/2002, in reply to message #19137 |
Dictator for life
Posts: 6828
|
even though a smart bot could realise that and then send a false user agent
I suppose it stops some of them though. There's no way to stop people who are faking nice, standard Mozilla/MIE/Windows type user agents with proper referrer data - hell, I do it myself whenever I use Perl and LWP to screen-scrape data for viewing on my PDA - but then to go back to the original problem they wouldn't be null user agents would they, so even they have a bit of sense  So no, it's not an ideal solution, but better than nothing. There are other tricks to use to ban IPs though, like faking your entries in robots.txt and seeing who tries to fetch those faked directories, and getting 404 report emails that tell you someone's just tried to fetch /cgi-bin/formmail.pl from contacts.htm (as the referal page is bogus because we all use .html and .php extensions, and formmail.pl is a spammer relay trick).
Incidentally, wget is one of the agents banned because there's a bot that fakes this, but I'm assured that it's dead easy to change in the real wget so you all can do some work figuring it out to earn the free data 
________
Cheers,
Rich.
|
| |
[ Log in to reply ] |
| |
|
