← Back to branch summary

~ubuntu-branches/ubuntu/karmic/drupal5/karmic-security

« back to all changes in this revision

Viewing changes to robots.txt

  • Committer: Bazaar Package Importer
  • Author(s): Bhavani Shankar
  • Date: 2009-01-09 21:55:33 UTC
  • mfrom: (3.1.4 sid)
  • Revision ID: james.westby@ubuntu.com-20090109215533-jiz659l0jmilexoo
Tags: 5.14-1ubuntu1
https://launchpad.net/bugs/315544
* Merge from debian unstable, remaining changes: LP: #315544
  + debian/patches/02_htaccess:
    - Add RewriteBase /drupal5
  + debian/control:
    - Replace exim4 with postfix in Depends.
    - Add Homepage field.
  + Fix for debian/watch.
    - Bump version from 2 to 3

Show diffs side-by-side

added added

removed removed

Lines of Context:
robots.txt
1
 
# $Id: robots.txt,v 1.7.2.2 2008/02/25 02:18:25 drumm Exp $
 
1
# $Id: robots.txt,v 1.7.2.3 2008/12/10 20:24:38 drumm Exp $
2
2
#
3
3
# robots.txt
4
4
#
20
20
User-agent: *
21
21
Crawl-delay: 10
22
22
# Directories
23
 
Disallow: /database/
24
23
Disallow: /includes/
25
24
Disallow: /misc/
26
25
Disallow: /modules/
 
26
Disallow: /profiles/
 
27
Disallow: /scripts/
27
28
Disallow: /sites/
28
29
Disallow: /themes/
29
 
Disallow: /scripts/
30
 
Disallow: /updates/
31
 
Disallow: /profiles/
32
30
# Files
33
 
Disallow: /xmlrpc.php
 
31
Disallow: /CHANGELOG.txt
34
32
Disallow: /cron.php
35
 
Disallow: /update.php
 
33
Disallow: /INSTALL.mysql.txt
 
34
Disallow: /INSTALL.pgsql.txt
36
35
Disallow: /install.php
37
36
Disallow: /INSTALL.txt
38
 
Disallow: /INSTALL.mysql.txt
39
 
Disallow: /INSTALL.pgsql.txt
40
 
Disallow: /CHANGELOG.txt
 
37
Disallow: /LICENSE.txt
41
38
Disallow: /MAINTAINERS.txt
42
 
Disallow: /LICENSE.txt
 
39
Disallow: /update.php
43
40
Disallow: /UPGRADE.txt
 
41
Disallow: /xmlrpc.php
44
42
# Paths (clean URLs)
45
43
Disallow: /admin/
46
44
Disallow: /comment/reply/