Docskillz

The Good Stuff => SMF Forum Help => Topic started by: limitzero on September 12, 2012, 08:33:00 PM

Title: Spiders / Bots
Post by: limitzero on September 12, 2012, 08:33:00 PM
Hey

So I was wondering if it is a built in feature or additional mod we have to install to show the Spiders / Bots who are 'online'  I have noticed on some forums like Logooff that it would say 'Google Adsense' or 'Baidu' on the Users Online list. Any info regarding this will be helpful.

Thanks
Title: Re: Spiders / Bots
Post by: Skhilled on September 13, 2012, 07:58:03 AM
It's easy. Go to Admin -> Core Features and enable "Search Engine Tracking". Then go to Admin -> Members -> Search Engines -> Settings. There you can set how you want to see and log the them. You will only see the Search Engine menu if you enable it first.

The other menu items will give you stats and logs on what you have chosen. This is what I have here and what Rock has at logooff. You can also have it show to admin only like I have it here.
Title: Re: Spiders / Bots
Post by: limitzero on September 13, 2012, 03:49:28 PM
Thanks! I couldn't find this on SMF 1.1.x , but have found it on a dummy 2.x I have installed, great feature.
Title: Re: Spiders / Bots
Post by: Skhilled on September 13, 2012, 08:53:47 PM
Ah! I forget that you have SMF 1.1.x. That is only on SMF 2.x versions.
Title: Re: Spiders / Bots
Post by: beast on September 14, 2012, 08:23:25 AM


  Is there any speacil reason for wanting to see them?

:dontknow:
Title: Re: Spiders / Bots
Post by: Skhilled on September 14, 2012, 08:34:51 AM
to learn how they are crawling your site. You will want them to see the important things about your site. But there may be things that you do not want them to see and you can block it or allow it via a robots.txt file or a .htaccess file.

This way when you look up your site in a search engine the things you want people to see will be seen and the things you don't will not.