Cleanup robots.txt

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
This commit is contained in:
Sebastiaan van Stijn 2020-07-02 23:16:16 +02:00
parent 2b4833a355
commit 36d0938bb2
No known key found for this signature in database
GPG Key ID: 76698F39D527CE8C
1 changed files with 2 additions and 14 deletions

View File

@ -20,20 +20,8 @@ Disallow: /v18.03/
Disallow: /v18.09/
# Docker Datacenter archives
Disallow: /datacenter/dtr/2.0
Disallow: /datacenter/dtr/2.1
Disallow: /datacenter/dtr/2.2
Disallow: /datacenter/dtr/2.3
Disallow: /datacenter/dtr/2.4
Disallow: /datacenter/dtr/2.5
Disallow: /datacenter/dtr/2.6
Disallow: /datacenter/ucp/3.1
Disallow: /datacenter/ucp/3.0
Disallow: /datacenter/ucp/2.2
Disallow: /datacenter/ucp/2.1
Disallow: /datacenter/ucp/2.0
Disallow: /datacenter/ucp/1.1
Disallow: /datacenter/
Disallow: /ee/
Disallow: /apidocs/v*