Tim Krause - PhD

By default, Joomla provides this robots.txt file at the root level of your site. It tells search engines how to index your site. You'll notice that, for the most part, this is useful because it hides a number of administrative folders from search.

Depending upon the nature of your site, however, you might want to delete the images and media folders. If you don't that content won't be indexed by Joomla.

User-agent: *

Disallow: /administrator/
Disallow: /cache/
Disallow: /components/
Disallow: /images/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/
Disallow: /xmlrpc/