# robots.txt zu http://inkunabeln.ub.uni-koeln.de/ User-agent: * Disallow: /vdib-cgi/ Disallow: /cgi-bin/ Disallow: /database/ Disallow: /incomming/ Disallow: /incomming2/ Disallow: /server/ Disallow: /inkunabeln/ Disallow: /process/ Disallow: vdib/css/ Disallow: vdib/buttons/ Disallow: vdib/scripts/ Allow: vdib/dokumentation/ # verhindert, dass Spider Webseite nach E-Mailadressen durchsucht: User-agent: EmailCollector Disallow: /