Hi All. We're considering trying to improve server performance by filtering out bots that hit the site. We have a list of bots already. Is there a best practice in how to do this most effectively? We obviously want some spiders (e.g. google) to be able to index the content. For example, with regards to documents linked to web pages, would it make sense to block bots from clicking those links? Same with form buttons. Any feedback is greatly appreciated.

Just before you do anything. Any reason to believe traffic from bots is actually doing any harm? Exactly how much traffic are they causing?

@Adam Cameron Good question. We saw a bunch of these weird requests hanging for a long time in fusion reactor, seeming to cause performance issues on the server. It has been suggested that if we do a better job locking down our bindings in IIS, that might do the trick. I'm looking into that now.