Google spider me too much!

[jpratt]

I have something that starts to look like a problem. I run a small forum with something like 10-20 topics per day. We have about 5,000 topics in total. Google eat almost 80% of my bandwidth meaning about 6Gb per month. I am using a robots.txt file but it does not seem to do the trick. I want Google to spider but not the whole site every hour. Anyone here who have solved this problem?

What I would like to do is to ask Googlebot to visit only one time per day...

[cromartie]

At Google Webmaster you can configure the amount of visits from the bot if I am not mistaken. It's maybe also a good idea to do a review on your site structure.