Jump to content
LOTROCommunity
Saelanna

Is Google watching us?

Recommended Posts

I've noticed, on more than a few occasions, that "Google" is listed on the list of active users looking at this site. You can't click on the name, unlike the other listed active users, and (I don't know why) it feels a bit sinister! Shall I get my tin foil hat now? :$

Share this post


Link to post
Share on other sites

I have seen this on another board, I don't think it is anything sinister and more to do with admin.

I could be utterly wrong there though :P

Share this post


Link to post
Share on other sites

Google uses spiders (Bots) to search & index every webpage that they find, that's what you are seeing. It is possible to block them but that means no Google ranking and not being found in searches.

Share this post


Link to post
Share on other sites

Which is nice, since I didn't even submit the site to Yahoo.

Share this post


Link to post
Share on other sites

Are there slayer deeds for these spiders and crawlers? :Y)

Share this post


Link to post
Share on other sites

If you manage to kill Googlebot, you'll get the title "World Renowned", a special cosmetic outfit, a cozy room in a hotel near you (bars in front of window included) and a brand new serial number!

Share this post


Link to post
Share on other sites

It's probably a good thing that they are watching us because we'll get more people to visit us too!

Share this post


Link to post
Share on other sites

I must admit that it is impressive what those sites can accomplish. It will indeed mean more visitors for us :P

Share this post


Link to post
Share on other sites

I used to run admin for a forum, and, while it's relatively harmless on the surface, it's a bit of good-and-bad overall. The crawlers feed the search engines, which help those outside the site quickly locate topics here (as well as the site itself), but, on the other hand, it's somewhat creepy to have the companies that run the engines prowling about without a say-so from the administrator. Poor manners, really, especially MueR hadn't submitted the site yet.

Share this post


Link to post
Share on other sites

If they would only start crawling a site when the owner approves, they would be useless. Three quarters of the internet would not be found if that were the case. Any site administrator knows (or should know) that it is easy to block a search engine by means of a robots.txt file.

Share this post


Link to post
Share on other sites

If they would only start crawling a site when the owner approves, they would be useless. Three quarters of the internet would not be found if that were the case. Any site administrator knows (or should know) that it is easy to block a search engine by means of a robots.txt file.

Throw in a few meta tags on specific pages and search engine access can be fine-tuned to the nth degree.

Share this post


Link to post
Share on other sites

Just seen Facebook here as well. This site's already having the big players looking in. :D

(not to mention the boost in user numbers... German part, in relation, seems just as busy as on the CM forum, hah)

How come they show up as "users"? Do they use a special crawler that identifies itself, or does the forum software recognize them?

Share this post


Link to post
Share on other sites

The forum software can recognise them. Google (and any decent spider) will identify itself by using a custom User Agent string. That usually also contains an URL detailing what they do and how to get rid of them ;)

Share this post


Link to post
Share on other sites

Example of how it looks on the serverside:

66.220.156.250 - - [08/May/2011:02:21:54 +0200] "GET /forum/topic/32-show-us-your-favourite-cosmetic-outfit/ HTTP/1.1" 200 17677 "-" "facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)"

That's the IP they connect from, the time they connected, the 'resource' they were asking for, the response code (200 means 'OK'), the size of the response (17677 bytes), the referrer ('-' means empty) and last but not least their identification string, indicating there's more info to be found at http://www.facebook.com/externalhit_uatext.php :)

Share this post


Link to post
Share on other sites

Facebook groups like they existed before are being discontinued by FB.

"FB group" is now ment for small gathering of people, if one expects high number of participants/wants to promote their site, organisation or company, making a page is recommended.

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...

×
×
  • Create New...