What to disallow in robots.txt

Hi all,

 

Just wondering which are the basic folders I should disallow in my robots.txt.  I have the following folders:

disallow.jpg

 

Thanks for the advice!

disallow.JPG · 18.8K · 115 views
Quote · 20 Mar 2011

i have so far done this not sure what is best practice for dolphin sites

the calenders because they work as a robot trap and the admin folder i have blocked so far

Disallow: /m/news/calendar/
Disallow: /admin/
Disallow: /m/events/calendar/
Allow: /
Disallow: /calendar.php/
Disallow: /m/videos/calendar/
Disallow: /m/articles/calendar/
Disallow: /m/photos/calendar/
Disallow: /administration/
Disallow: /categories.php?action=calendar/
Disallow: /calendar/

happy thoughts
Quote · 20 Mar 2011

A shame no one else is about to help, especially because I'm sure the majority went through this.

Quote · 26 Mar 2011
 
 
Below is the legacy version of the Boonex site, maintained for Dolphin.Pro 7.x support.
The new Dolphin solution is powered by UNA Community Management System.