Google bot surfing the forums?

Forum support questions and discussion.

Moderator: Moderator Team

Post Reply
akueck
Pitcher (300 posts)
Posts: 301
Joined: Mon Mar 12, 2007 6:31 pm
Location: Oakland, CA
Google bot surfing the forums?

Post by akueck » Thu May 22, 2008 5:16 pm

Silly question...

At the bottom of the index page it lists folks who are active on the forum. Google, MSN, and Yahoo bots are all listed. What exactly are they doing?

User avatar
drewbage
Pitcher (300 posts)
Posts: 300
Joined: Wed Mar 09, 2005 3:08 pm
Location: Los Angeles, CA
Contact:
Re: Google bot surfing the forums?

Post by drewbage » Thu May 22, 2008 5:33 pm

Indexing the conversations for searching off their sites.

User avatar
Roger456
Addict (5000 posts)
Posts: 5963
Joined: Fri Jun 24, 2005 2:19 pm
Location: California
Contact:
Re: Google bot surfing the forums?

Post by Roger456 » Fri May 23, 2008 8:58 am

I, for one, welcome our new search engine bot overlords.

User avatar
BeerPal
Addict (5000 posts)
Posts: 5111
Joined: Mon Feb 23, 2004 11:18 pm
Location: Martinez, CA
Contact:
Re: Google bot surfing the forums?

Post by BeerPal » Fri May 23, 2008 9:08 am

Roger456 wrote:I, for one, welcome our new search engine bot overlords.


Resistance is futile.
"Make beer not war"

Currently fermenting: Nothing
Conditioning: Firestone Walker Pale 31 clone
On draught: Nothing

Watch episodes of BYOB TV: http://www.kofytv.com/byob-tv/archive/

User avatar
alewife
Barrel (1000 posts)
Posts: 1698
Joined: Sun Jan 09, 2005 11:28 am
Location: Northern California
Re: Google bot surfing the forums?

Post by alewife » Fri May 23, 2008 6:26 pm

Yeah, I found my own post quoted in a Google search already..... talk about Big Brother....
On Deck: Irish Heavy, Mother Bunch's Holiday Porter, Dobby's Magic (like Mad Elf)

In primary:

Conditioning:

Ready to drink:

Cellared: Hardly Cider (2016)

User avatar
gfoster
Site Admin
Posts: 6119
Joined: Tue Aug 09, 2005 6:14 pm
Location: Clyde, CA
Contact:
Re: Google bot surfing the forums?

Post by gfoster » Fri May 23, 2008 9:24 pm

Google has indexed this site for as long as I can remember. I used to use google to search the site before we upgraded because the old search function on the old software was so bad, google could find things for me more quickly.

The difference is that with the old software the spiderbots would connect as regular guest user. With this software, I can put them in a specific class and assign access roles to them and limit the impact they have on the performance of the forum to make them behave more nicely.

-- Gary F.
Primary: empty
Tap 1: California Creamin'
Tap 2: empty

All my recipes: Buen Perro Brewing

User avatar
JP
Moderator
Posts: 4146
Joined: Tue Feb 10, 2004 6:55 pm
Location: Concord, CA
Contact:
Re: Google bot surfing the forums?

Post by JP » Wed Jun 25, 2008 12:02 pm

Would that have anything to do with how often they crawl our main site, since they are on the same server?
Cheers!
JP

User avatar
gfoster
Site Admin
Posts: 6119
Joined: Tue Aug 09, 2005 6:14 pm
Location: Clyde, CA
Contact:
Re: Google bot surfing the forums?

Post by gfoster » Wed Jun 25, 2008 5:32 pm

Nope.

-- Gary F.
Primary: empty
Tap 1: California Creamin'
Tap 2: empty

All my recipes: Buen Perro Brewing


Post Reply