Commit Graph

51590 Commits

Author SHA1 Message Date
Maria Bermudez adeba07213
Merge pull request #8421 from ssewell/patch-1
Fixed minor typo
2019-03-08 09:35:19 -08:00
paigehargrave 27d211b81a
Merge pull request #8384 from bermudezmt/dtr-nfs-updates
Addresses 8370
2019-03-08 09:33:27 -08:00
Maria Bermudez faf1e52357 Incorporated technical feedback
Update based on session with Ada and Ryan

Discourage use of NFS storage URL flag

Additional section on storage backend switch

Discourage NFS storage URL option for now

Polish on necessary storage backend updates

Final technical edits

Fix crud on DTR release notes page

Update note on storage links
2019-03-08 09:29:51 -08:00
Maria Bermudez c32fc64258
Merge pull request #8420 from thaJeztah/dockerfile_fixes
Dockerfile follow-up fixes and improvements
2019-03-08 08:52:53 -08:00
Maria Bermudez 2ee6341348
Merge pull request #8419 from thaJeztah/fix_liquid_warnings_on_dtr
Fix liquid warnings on DTR troubleshooting page
2019-03-07 10:07:28 -08:00
Shane Sewell 6a6fc45959
Fixed minor typo 2019-03-07 11:08:18 -06:00
Sebastiaan van Stijn 573af666e4
Move fetching "library samples" to a separate stage
Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2019-03-07 16:27:20 +01:00
Sebastiaan van Stijn 7868538ad7
Fix liquid warnings on DTR troubleshooting page
Fix a warning during build of the documentation:

```
Liquid Warning: Liquid syntax error (line 64): [:dot, "."] is not a valid expression in "{{.Name}}" in datacenter/dtr/2.5/guides/admin/monitor-and-troubleshoot/troubleshoot-dtr.md
Liquid Warning: Liquid syntax error (line 64): [:dot, "."] is not a valid expression in "{{.Name}}" in ee/dtr/admin/monitor-and-troubleshoot/troubleshoot-dtr.md
```

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2019-03-07 15:34:16 +01:00
Sebastiaan van Stijn d2504d31dc
Reorder fetching of upstream-resources
Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2019-03-07 15:31:51 +01:00
Sebastiaan van Stijn f297c554b6
Remove remaining "edge" docs
Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2019-03-07 15:29:06 +01:00
Sebastiaan van Stijn 0785a8513e
Make wget less noisy when fetching upstream resources
Add a `--quiet` flag to suppress progress output;

```
--2019-03-07 14:02:43--  https://raw.githubusercontent.com/docker/docker-ce/17.12/components/engine/api/swagger.yaml
Resolving raw.githubusercontent.com... 151.101.0.133, 151.101.64.133, 151.101.128.133, ...
Connecting to raw.githubusercontent.com|151.101.0.133|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 343126 (335K) [text/plain]
Saving to: './engine/api/v1.35/swagger.yaml'

     0K .......... .......... .......... .......... .......... 14% 2.97M 0s
    50K .......... .......... .......... .......... .......... 29% 6.10M 0s
   100K .......... .......... .......... .......... .......... 44% 6.22M 0s
   150K .......... .......... .......... .......... .......... 59% 6.32M 0s
   200K .......... .......... .......... .......... .......... 74% 6.15M 0s
   250K .......... .......... .......... .......... .......... 89% 6.11M 0s
   300K .......... .......... .......... .....                100% 6.82M=0.06s

2019-03-07 14:02:44 (5.37 MB/s) - './engine/api/v1.35/swagger.yaml' saved [343126/343126]
```

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2019-03-07 15:27:06 +01:00
Sebastiaan van Stijn c7b9a54df9
Dockerfile: fix missing "boilerplate.txt" in build-stage
Although the docs still rendered ok, some pieces were missing
when generating the "samples", which resulted in warnings during
build:

```
Adding front-matter to ./_samples/library/rethinkdb/README.md ...
cat: can't open './_samples/boilerplate.txt': No such file or directory
Adding front-matter to ./_samples/library/tomcat/README.md ...
cat: can't open './_samples/boilerplate.txt': No such file or directory
```

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2019-03-07 15:15:13 +01:00
Maria Bermudez 5d111f85dc
Merge pull request #8413 from thaJeztah/optimize_dockerfile
Dockerfile: optimize for caching
2019-03-06 20:19:56 -08:00
Maria Bermudez 6479270f39 Revert "Update restore-from-backup.md"
This reverts commit ef8f6af3bb.
2019-03-06 15:09:16 -08:00
Maria Bermudez ef8f6af3bb
Update restore-from-backup.md 2019-03-06 14:53:00 -08:00
L-Hudson 2ed35707f7
Merge pull request #8408 from thaJeztah/add_missing_stub_for_builder_prune
Add missing stubs for docker builder subcommands
2019-03-06 17:08:55 -05:00
Maria Bermudez a6aa08dde9
Merge pull request #8411 from thaJeztah/improve_compose_install_docs
Clarify that compose installation is for stable release
2019-03-06 10:12:59 -08:00
Maria Bermudez 1e513418ca
Capitalize product name 2019-03-06 10:10:38 -08:00
Sebastiaan van Stijn 7729a83889
Dockerfile: optimize for caching
The implementation of the Dockerfile first copied the current
version of the documentation, to be followed by fetching upstream
resources, and adding the archived documentation.

As a result, the build-cache was "busted" on every change that was
made locally, causing a full rebuild of both "fetching upstream resources",
building the reference documentation, and generating the archived
versions of the documentation.

With the changes made to the "fetch-upstream-resources.sh" script,
it's now possible to build those docs in advance (in a separate build-
stage), and append the pre-built docs _after_ the current version
of the documentation was built.

This patch updates the Dockerfile to build reference-docs and
archived docs in separate build-stages, optimizing the build for
caching (wich the assumption that no changes are made in upstream
resources between builds). Not only caused this builds to take longer
than needed, but each rebuild also caused new "dangling" images to
be created (in case of the "classic" builder), or new build-caches
to be created (when using BuildKit).

Note that when _deploying_ the documentation, no caching should be
used (to enforce a full rebuild of the documentation, and guarantee
that reference-docs are "fresh").

Before this change, rebuilding the documentation (after a previous
build, so with cache present) took ~185 seconds;

```
docker build -t docs .

[+] Building 184.7s (26/26) FINISHED

 => [builder 2/5] COPY . md_source                                                                                                                                                                                                    2.8s
 => [builder 3/5] RUN bash ./md_source/_scripts/fetch-upstream-resources.sh md_source                                                                                                                                                52.7s
 => [builder 4/5] RUN jekyll build -s md_source -d /usr/share/nginx/html --config md_source/_config.yml                                                                                                                             113.0s
 => [builder 5/5] RUN find /usr/share/nginx/html -type f -name '*.html' | grep -vE "v[0-9]+\." | while read i; do sed -i 's#href="https://docs.docker.com/#href="/#g' "$i"; done                                                      4.4s
 => CACHED [stage-1 2/8] COPY --from=docs/docker.github.io:nginx-onbuild /etc/nginx/conf.d/default.conf /etc/nginx/conf.d/default.conf                                                                                                0.0s
 => CACHED [stage-1 3/8] COPY --from=docs/docker.github.io:v17.03 /usr/share/nginx/html /usr/share/nginx/html                                                                                                                         0.0s
 => CACHED [stage-1 4/8] COPY --from=docs/docker.github.io:v17.06 /usr/share/nginx/html /usr/share/nginx/html                                                                                                                         0.0s
 => CACHED [stage-1 5/8] COPY --from=docs/docker.github.io:v17.09 /usr/share/nginx/html /usr/share/nginx/html                                                                                                                         0.0s
 => CACHED [stage-1 6/8] COPY --from=docs/docker.github.io:v17.12 /usr/share/nginx/html /usr/share/nginx/html                                                                                                                         0.0s
 => CACHED [stage-1 7/8] COPY --from=docs/docker.github.io:v18.03 /usr/share/nginx/html /usr/share/nginx/html                                                                                                                         0.0s
 => [stage-1 8/8] COPY --from=builder /usr/share/nginx/html /usr/share/nginx/html                                                                                                                                                     3.7s
 => exporting to image                                                                                                                                                                                                                5.1s
 => => exporting layers                                                                                                                                                                                                               5.1s
 => => writing image sha256:70f77631001bd0271455f893b87dd75a1fd6f5db84a00feb8afe5ddf5a697d7d                                                                                                                                          0.0s
 => => naming to docker.io/library/docs                                                                                                                                                                                               0.0s
```

After this change, archives and reference-docs are using the build-cache,
and building was reduced to ~126 seconds (most of that taken by Jekyll to
generate the static HTML);

```
docker build -t docs .

+] Building 126.4s (30/30) FINISHED
...
 => CACHED [upstream-resources 1/4] COPY ./_scripts/fetch-upstream-resources.sh ./_scripts/                                                                                                                                           0.0s
 => CACHED [upstream-resources 2/4] COPY ./_config.yml .                                                                                                                                                                              0.0s
 => CACHED [upstream-resources 3/4] COPY ./_data/toc.yaml ./_data/                                                                                                                                                                    0.0s
 => CACHED [upstream-resources 4/4] RUN bash ./_scripts/fetch-upstream-resources.sh .                                                                                                                                                 0.0s
 => [current 2/4] COPY --from=upstream-resources /usr/src/app/md_source/. ./                                                                                                                                                          1.5s
 => [current 3/4] RUN jekyll build -d /usr/share/nginx/html                                                                                                                                                                         108.9s
 => [current 4/4] RUN find /usr/share/nginx/html -type f -name '*.html' | grep -vE "v[0-9]+\." | while read i; do sed -i 's#href="https://docs.docker.com/#href="/#g' "$i"; done                                                      4.8s
 => CACHED [deploybase 2/2] COPY --from=docs/docker.github.io:nginx-onbuild /etc/nginx/conf.d/default.conf /etc/nginx/conf.d/default.conf                                                                                             0.0s
 => CACHED [archives 1/5] COPY --from=docs/docker.github.io:v17.03 /usr/share/nginx/html /usr/share/nginx/html                                                                                                                        0.0s
 => CACHED [archives 2/5] COPY --from=docs/docker.github.io:v17.06 /usr/share/nginx/html /usr/share/nginx/html                                                                                                                        0.0s
 => CACHED [archives 3/5] COPY --from=docs/docker.github.io:v17.09 /usr/share/nginx/html /usr/share/nginx/html                                                                                                                        0.0s
 => CACHED [archives 4/5] COPY --from=docs/docker.github.io:v17.12 /usr/share/nginx/html /usr/share/nginx/html                                                                                                                        0.0s
 => CACHED [archives 5/5] COPY --from=docs/docker.github.io:v18.03 /usr/share/nginx/html /usr/share/nginx/html                                                                                                                        0.0s
 => [deploy 1/1] COPY --from=current /usr/share/nginx/html /usr/share/nginx/html                                                                                                                                                      4.1s
 => exporting to image                                                                                                                                                                                                                1.9s
 => => exporting layers                                                                                                                                                                                                               1.9s
 => => writing image sha256:e76359b937fb4d956fb17e889a7333687929d4c9ae093909fe5630a8f3e4de64                                                                                                                                          0.0s
 => => naming to docker.io/library/docs                                                                                                                                                                                               0.0s
```

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2019-03-06 16:38:38 +01:00
Sebastiaan van Stijn f98576eaa2
Dockerfile: use ARG to configure engine and distribution branches
Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2019-03-06 15:15:14 +01:00
Sebastiaan van Stijn 5d8ce076f7
Dockerfile: remove use of $SOURCE env-var
This variable is no longer needed, as the scripts are
always executed relative to the current directory (`.`).

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2019-03-06 15:10:07 +01:00
Sebastiaan van Stijn d386c4cd2c
Dockerfile: use WORKDIR to simplify steps
Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2019-03-06 15:02:29 +01:00
Sebastiaan van Stijn 3f165c6d32
fetch-upstream-resources: use wget --directory-prefix
When using Gnu Wget, the `--directory-prefix` option automatically
creates the specified path if it doesn't exist.

Note that this does not work when using the busybox version
of Wget (but we're not using that in our Dockerfile).

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2019-03-06 14:46:20 +01:00
Sebastiaan van Stijn f3feee5375
fetch-upstream-resources: fix invalid exit-code
Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2019-03-06 14:36:59 +01:00
Sebastiaan van Stijn f6ed1b7725
Clarify that compose installation is for stable release
This patch updates the compose installation instruction to
be more clear about the default instructions installing
the current stable release.

Inline nodes about installing different versions has been
reduced, and the "Master builds" section has been renamed
to "Install pre-release builds", to capture installing either
"master" builds, or pre-releases (release-candidates) from
GitHub.

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2019-03-06 13:21:54 +01:00
Sebastiaan van Stijn 8a1b16e8e0
Merge pull request #8407 from thaJeztah/cleanup_overlay_instructions
Clean up some old setup information for overlayFS
2019-03-06 11:04:20 +01:00
paigehargrave 75be5b662f
Merge pull request #8385 from docker/kubelet-storage
Kubelet storage requirements for UCP 3.1
2019-03-05 11:50:11 -05:00
L-Hudson 2ad4167f4a
Merge pull request #8391 from plygrnd/patch-1
Update running_ssh_service.md
2019-03-05 08:19:08 -05:00
Sebastiaan van Stijn 1452039cb3
Add missing stubs for docker builder subcommands
Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2019-03-05 13:51:20 +01:00
Sebastiaan van Stijn ec7e716c54
Clean up some old setup information for overlayFS
This removes the additional steps for old versions of Docker EE 17.06.
Current versions of Docker EE 17.06 no longer need these additional
steps.

Signed-off-by: Sebastiaan van Stijn <github@gone.nl>
2019-03-05 13:41:55 +01:00
paigehargrave 5d76dbc595
Merge pull request #8405 from gtardif/release_notes_2.0.3.0_mac
Release notes for 2.0.3.0 mac (Edge)
2019-03-05 05:48:58 -05:00
paigehargrave 4eda670bd7
Update edge-release-notes.md 2019-03-05 05:48:45 -05:00
paigehargrave 402711ab33
Merge pull request #8406 from gtardif/release_notes_2.0.3.0_win
Release notes for 2.0.3.0 win (Edge)
2019-03-05 05:47:55 -05:00
paigehargrave dcf37d5d09
Update edge-release-notes.md 2019-03-05 05:47:32 -05:00
Jenkins-pr-release-docs 88aab44de1 Docker for win edge relnotes 2.0.3.0
Signed-off-by: Jenkins-pr-release-docs <guillaume.tardif@docker.com>
2019-03-05 10:10:01 +00:00
Jenkins-pr-release-docs f6fc431544 Docker for mac edge relnotes 2.0.3.0
Signed-off-by: Jenkins-pr-release-docs <guillaume.tardif@docker.com>
2019-03-05 10:04:15 +00:00
L-Hudson 71bda4770f
Merge pull request #8401 from ekitagawa/patch-19
Adding "Known Issues" section
2019-03-04 13:22:49 -05:00
Eiichi Kitagawa b6c6fb2a70
Adding "Known Issues" section
There is a known issue, and getting this fixed will have to wait for the Microsoft team.  It's good idea to mention the workaround in the mean time.
2019-03-04 10:10:35 -08:00
L-Hudson cf669f0701
Merge pull request #8395 from xinfengliu/patch-3
Add HideInfoHeaders in interlock configuration
2019-03-04 08:02:51 -05:00
Xinfeng Liu 752f3087af
Add HideInfoHeaders in interlock configuration
UCP Interlock now supports HideInfoHeaders configuration. See internal https://github.com/docker/orca/issues/15403
2019-03-02 15:08:30 +08:00
Maria Bermudez 46f2c21231
Merge pull request #8386 from docker/macos-client-binaries
Macos client binaries
2019-03-01 15:59:44 -08:00
Sebastiaan van Stijn c36b01067e
Merge pull request #8130 from excieve/patch-1
Fixes Docker Hub repository tag env var name
2019-03-01 21:26:00 +01:00
Dan Urson a9f88ed3e3
Update running_ssh_service.md
Fixes #8390
2019-03-01 14:05:44 -05:00
L-Hudson 3948dcc901
Merge pull request #8253 from russellballestrini/patch-2
Create local.md
2019-03-01 08:32:16 -05:00
paigehargrave 6b4f030aa8
Add relative links 2019-03-01 08:29:15 -05:00
paigehargrave 4ba4c88061
Update binaries.md 2019-03-01 08:27:32 -05:00
paigehargrave 99f653ae00
Update system-requirements.md 2019-03-01 07:12:09 -05:00
paigehargrave b67774bd65
Update system-requirements.md 2019-03-01 07:11:33 -05:00
paigehargrave 41bdcdef2d
Merge pull request #8382 from docker/ucp-audit-logs
Ucp audit logs
2019-02-28 20:27:53 -05:00
Maria Bermudez 2766b82053
Update enable-audit-logging.md 2019-02-28 17:02:33 -08:00