Comment Google is creating a bandwidth shortage on MY site (Score 1) 287
Google consumes between 50-60% of the bandwidth every month on our Absolute Michigan site*.
Their spider visits hundreds of times each day despite the fact that our site is only updated a day**. Interesting (at least to me) is how poorly our massive "All Michigan, All the Time" site does on the general search for "Michigan" on Google. Way, way after a totally defunct Michigan alternative news site. I assume that most database generated sites experience the same thing.
*Google is also the largest referrer, so it's not as if they are all bad!
**Yes, I am aware of the "changefreq" variable in Robots.txt and Google sitemaps. Most people certainly are not and even aware of these options, let alone using them.
Their spider visits hundreds of times each day despite the fact that our site is only updated a day**. Interesting (at least to me) is how poorly our massive "All Michigan, All the Time" site does on the general search for "Michigan" on Google. Way, way after a totally defunct Michigan alternative news site. I assume that most database generated sites experience the same thing.
*Google is also the largest referrer, so it's not as if they are all bad!
**Yes, I am aware of the "changefreq" variable in Robots.txt and Google sitemaps. Most people certainly are not and even aware of these options, let alone using them.