--- title: Secure Gateways (File Mount) description: Expose a service outside of the service mesh over TLS or mTLS using file-mounted certificates. weight: 20 aliases: - /docs/tasks/traffic-management/secure-ingress/mount/ keywords: [traffic-management,ingress,file-mount-credentials] --- The [Control Ingress Traffic task](/docs/tasks/traffic-management/ingress) describes how to configure an ingress gateway to expose an HTTP service to external traffic. This task shows how to expose a secure HTTPS service using either simple or mutual TLS. The TLS required private key, server certificate, and root certificate, are configured using a file mount based approach. ## Before you begin 1. Perform the steps in the [Before you begin](/docs/tasks/traffic-management/ingress/ingress-control#before-you-begin) and [Determining the ingress IP and ports](/docs/tasks/traffic-management/ingress/ingress-control/#determining-the-ingress-ip-and-ports) sections of the [Control Ingress Traffic](/docs/tasks/traffic-management/ingress) task. After performing those steps you should have Istio and the [httpbin]({{< github_tree >}}/samples/httpbin) service deployed, and the environment variables `INGRESS_HOST` and `SECURE_INGRESS_PORT` set. 1. For macOS users, verify that you use _curl_ compiled with the [LibreSSL](http://www.libressl.org) library: {{< text bash >}} $ curl --version | grep LibreSSL curl 7.54.0 (x86_64-apple-darwin17.0) libcurl/7.54.0 LibreSSL/2.0.20 zlib/1.2.11 nghttp2/1.24.0 {{< /text >}} If a version of _LibreSSL_ is printed as in the output above, your _curl_ should work correctly with the instructions in this task. Otherwise, try another installation of _curl_, for example on a Linux machine. ## Generate server certificate and private key For this task you can use your favorite tool to generate certificates and keys. The commands below use [openssl](https://man.openbsd.org/openssl.1) 1. Create a root certificate and private key to sign the certificate for your services: {{< text bash >}} $ openssl req -x509 -sha256 -nodes -days 365 -newkey rsa:2048 -subj '/O=example Inc./CN=example.com' -keyout example.com.key -out example.com.crt {{< /text >}} 1. Create a certificate and a private key for `httpbin.example.com`: {{< text bash >}} $ openssl req -out httpbin.example.com.csr -newkey rsa:2048 -nodes -keyout httpbin.example.com.key -subj "/CN=httpbin.example.com/O=httpbin organization" $ openssl x509 -req -days 365 -CA example.com.crt -CAkey example.com.key -set_serial 0 -in httpbin.example.com.csr -out httpbin.example.com.crt {{< /text >}} ## Configure a TLS ingress gateway with a file mount-based approach In this section you configure an ingress gateway with port 443 to handle HTTPS traffic. You first create a secret with a certificate and a private key. The secret is mounted to a file on the `/etc/istio/ingressgateway-certs` path. You can then create a gateway definition that configures a server on port 443. 1. Create a Kubernetes secret to hold the server's certificate and private key. Use `kubectl` to create the secret `istio-ingressgateway-certs` in namespace `istio-system` . The Istio gateway will load the secret automatically. {{< warning >}} The secret **must** be named `istio-ingressgateway-certs` in the `istio-system` namespace to align with the configuration of the Istio default ingress gateway used in this task. {{< /warning >}} {{< text bash >}} $ kubectl create -n istio-system secret tls istio-ingressgateway-certs --key httpbin.example.com.key --cert httpbin.example.com.crt secret "istio-ingressgateway-certs" created {{< /text >}} Note that by default all the pods in the `istio-system` namespace can mount this secret and access the private key. You may want to deploy the ingress gateway in a separate namespace and create the secret there, so that only the ingress gateway pod will be able to mount it. Verify that `tls.crt` and `tls.key` have been mounted in the ingress gateway pod: {{< text bash >}} $ kubectl exec -it -n istio-system $(kubectl -n istio-system get pods -l istio=ingressgateway -o jsonpath='{.items[0].metadata.name}') -- ls -al /etc/istio/ingressgateway-certs {{< /text >}} 1. Define a `Gateway` with a `server` section for port 443. {{< warning >}} The location of the certificate and the private key **must** be `/etc/istio/ingressgateway-certs`, or the gateway will fail to load them. {{< /warning >}} {{< text bash >}} $ kubectl apply -f - <}} 1. Configure routes for traffic entering via the `Gateway`. Define the same `VirtualService` as in the [Control Ingress Traffic](/docs/tasks/traffic-management/ingress/ingress-control/#configuring-ingress-using-an-istio-gateway) task: {{< text bash >}} $ kubectl apply -f - <}} 1. Access the `httpbin` service with HTTPS by sending an `https` request using _curl_ to `SECURE_INGRESS_PORT`. The `--resolve` flag instructs _curl_ to supply the [SNI](https://en.wikipedia.org/wiki/Server_Name_Indication) value `httpbin.example.com` when accessing the gateway IP over TLS. The `--cacert` option instructs _curl_ to use your generated certificate to verify the server. {{< tip >}} The `-HHost:httpbin.example.com` flag is included but only really needed if `SECURE_INGRESS_PORT` is different from the actual gateway port (443), for example, if you are accessing the server via a mapped `NodePort`. {{< /tip >}} By sending the request to the `/status/418` URL path, you get a nice visual clue that your `httpbin` service was indeed accessed. The `httpbin` service will return the [418 I'm a Teapot](https://tools.ietf.org/html/rfc7168#section-2.3.3) code. {{< text bash >}} $ curl -v -HHost:httpbin.example.com --resolve httpbin.example.com:$SECURE_INGRESS_PORT:$INGRESS_HOST --cacert example.com.crt https://httpbin.example.com:$SECURE_INGRESS_PORT/status/418 ... Server certificate: subject: CN=httpbin.example.com; O=httpbin organization start date: Oct 27 19:32:48 2019 GMT expire date: Oct 26 19:32:48 2020 GMT common name: httpbin.example.com (matched) issuer: O=example Inc.; CN=example.com SSL certificate verify ok. SSL certificate verify ok. ... HTTP/2 418 ... -=[ teapot ]=- _...._ .' _ _ `. | ."` ^ `". _, \_;`"---"`|// | ;/ \_ _/ `"""` {{< /text >}} {{< tip >}} It might take time for the gateway definition to propagate so you might get the following error: `Failed to connect to httpbin.example.com port : Connection refused`. Wait for a minute and then retry the _curl_ call. {{< /tip >}} Look for the _Server certificate_ section in the _curl_ output and specifically a line with the matched _common name_: `common name: httpbin.example.com (matched)`. The line `SSL certificate verify ok` in the output indicates that the server's certificate was verified successfully. If all went well, you should also see a returned status of 418 along with a nice drawing of a teapot. ## Configure a mutual TLS ingress gateway In this section you extend your gateway's definition from the previous section to support [mutual TLS](https://en.wikipedia.org/wiki/Mutual_authentication) between external clients and the gateway. 1. Create a Kubernetes `Secret` to hold the [CA](https://en.wikipedia.org/wiki/Certificate_authority) certificate that the server will use to verify its clients. Create the secret `istio-ingressgateway-ca-certs` in namespace `istio-system` using `kubectl`. The Istio gateway will automatically load the secret. {{< warning >}} The secret **must** be named `istio-ingressgateway-ca-certs` in the `istio-system` namespace to align with the configuration of the Istio default ingress gateway used in this task. {{< /warning >}} {{< text bash >}} $ kubectl create -n istio-system secret generic istio-ingressgateway-ca-certs --from-file=example.com.crt secret "istio-ingressgateway-ca-certs" created {{< /text >}} 1. Redefine your previous `Gateway` to change the TLS mode to `MUTUAL` and to specify `caCertificates`: {{< warning >}} The location of the certificate **must** be `/etc/istio/ingressgateway-ca-certs`, or the gateway will fail to load them. The file (short) name of the certificate must be identical to the one you created the secret from, in this case `example.com.crt`. {{< /warning >}} {{< text bash >}} $ kubectl apply -f - <}} 1. Access the `httpbin` service by HTTPS as in the previous section: {{< text bash >}} $ curl -HHost:httpbin.example.com --resolve httpbin.example.com:$SECURE_INGRESS_PORT:$INGRESS_HOST --cacert example.com.crt https://httpbin.example.com:$SECURE_INGRESS_PORT/status/418 curl: (35) error:14094410:SSL routines:SSL3_READ_BYTES:sslv3 alert handshake failure {{< /text >}} {{< warning >}} It might take time for the gateway definition to propagate so you might still get _418_. Wait for a minute and then retry the _curl_ call. {{< /warning >}} This time you will get an error since the server refuses to accept unauthenticated requests. You need to pass _curl_ a client certificate and your private key for signing the request. 1. Create a client certificate for the `httpbin.example.com` service. You can designate the client by the `httpbin-client.example.com` URI, or use any other URI. {{< text bash >}} $ openssl req -out httpbin-client.example.com.csr -newkey rsa:2048 -nodes -keyout httpbin-client.example.com.key -subj "/CN=httpbin-client.example.com/O=httpbin's client organization" $ openssl x509 -req -days 365 -CA example.com.crt -CAkey example.com.key -set_serial 0 -in httpbin-client.example.com.csr -out httpbin-client.example.com.crt {{< /text >}} 1. Resend the previous request by _curl_, this time passing as parameters your client certificate (additional `--cert` option) and your private key (the `--key` option): {{< text bash >}} $ curl -HHost:httpbin.example.com --resolve httpbin.example.com:$SECURE_INGRESS_PORT:$INGRESS_HOST --cacert example.com.crt --cert httpbin-client.example.com.crt --key httpbin-client.example.com.key https://httpbin.example.com:$SECURE_INGRESS_PORT/status/418 -=[ teapot ]=- _...._ .' _ _ `. | ."` ^ `". _, \_;`"---"`|// | ;/ \_ _/ `"""` {{< /text >}} This time the server performed client authentication successfully and you received the pretty teapot drawing again. ## Configure a TLS ingress gateway for multiple hosts In this section you will configure an ingress gateway for multiple hosts, `httpbin.example.com` and `bookinfo.com`. The ingress gateway will present to clients a unique certificate corresponding to each requested server. Unlike the previous sections, the Istio default ingress gateway will not work out of the box because it is only preconfigured to support one secure host. You'll need to first configure and redeploy the ingress gateway server with another secret, before you can use it to handle a second host. ### Create a server certificate and private key for `bookinfo.com` {{< text bash >}} $ openssl req -out bookinfo.com.csr -newkey rsa:2048 -nodes -keyout bookinfo.com.key -subj "/CN=bookinfo.com/O=bookinfo organization" $ openssl x509 -req -days 365 -CA example.com.crt -CAkey example.com.key -set_serial 0 -in bookinfo.com.csr -out bookinfo.com.crt {{< /text >}} ### Redeploy `istio-ingressgateway` with the new certificate 1. Create a new secret to hold the certificate for `bookinfo.com`: {{< text bash >}} $ kubectl create -n istio-system secret tls istio-ingressgateway-bookinfo-certs --key bookinfo.com.key --cert bookinfo.com.crt secret "istio-ingressgateway-bookinfo-certs" created {{< /text >}} 1. To include a volume mounted from the new created secret, update the `istio-ingressgateway` deployment. To patch the `istio-ingressgateway` deployment, create the following `gateway-patch.json` file: {{< text bash >}} $ cat > gateway-patch.json <}} 1. Apply `istio-ingressgateway` deployment patch with the following command: {{< text bash >}} $ kubectl -n istio-system patch --type=json deploy istio-ingressgateway -p "$(cat gateway-patch.json)" {{< /text >}} 1. Verify that the key and certificate have been successfully loaded in the `istio-ingressgateway` pod: {{< text bash >}} $ kubectl exec -it -n istio-system $(kubectl -n istio-system get pods -l istio=ingressgateway -o jsonpath='{.items[0].metadata.name}') -- ls -al /etc/istio/ingressgateway-bookinfo-certs {{< /text >}} `tls.crt` and `tls.key` should appear in the directory contents. ### Configure traffic for the `bookinfo.com` host 1. Deploy the [Bookinfo sample application](/docs/examples/bookinfo/), without a gateway: {{< text bash >}} $ kubectl apply -f @samples/bookinfo/platform/kube/bookinfo.yaml@ {{< /text >}} 1. Define a gateway for `bookinfo.com`: {{< text bash >}} $ kubectl apply -f - <}} 1. Configure the routes for `bookinfo.com`. Define a `VirtualService` like the one in [`samples/bookinfo/networking/bookinfo-gateway.yaml`]({{< github_file >}}/samples/bookinfo/networking/bookinfo-gateway.yaml): {{< text bash >}} $ kubectl apply -f - <}} 1. Send a request to the _Bookinfo_ `productpage`: {{< text bash >}} $ curl -o /dev/null -s -v -w "%{http_code}\n" -HHost:bookinfo.com --resolve bookinfo.com:$SECURE_INGRESS_PORT:$INGRESS_HOST --cacert example.com.crt -HHost:bookinfo.com https://bookinfo.com:$SECURE_INGRESS_PORT/productpage ... Server certificate: subject: CN=bookinfo.com; O=bookinfo organization start date: Oct 27 20:08:32 2019 GMT expire date: Oct 26 20:08:32 2020 GMT common name: bookinfo.com (matched) issuer: O=example Inc.; CN=example.com SSL certificate verify ok. ... 200 {{< /text >}} 1. Verify that `httbin.example.com` is accessible as previously. Send a request to it and see again the teapot you should already love: {{< text bash >}} $ curl -HHost:httpbin.example.com --resolve httpbin.example.com:$SECURE_INGRESS_PORT:$INGRESS_HOST --cacert example.com.crt --cert httpbin-client.example.com.crt --key httpbin-client.example.com.key https://httpbin.example.com:$SECURE_INGRESS_PORT/status/418 ... -=[ teapot ]=- _...._ .' _ _ `. | ."` ^ `". _, \_;`"---"`|// | ;/ \_ _/ `"""` {{< /text >}} ## Troubleshooting * Inspect the values of the `INGRESS_HOST` and `SECURE_INGRESS_PORT` environment variables. Make sure they have valid values, according to the output of the following commands: {{< text bash >}} $ kubectl get svc -n istio-system $ echo INGRESS_HOST=$INGRESS_HOST, SECURE_INGRESS_PORT=$SECURE_INGRESS_PORT {{< /text >}} * Verify that the key and the certificate are successfully loaded in the `istio-ingressgateway` pod: {{< text bash >}} $ kubectl exec -it -n istio-system $(kubectl -n istio-system get pods -l istio=ingressgateway -o jsonpath='{.items[0].metadata.name}') -- ls -al /etc/istio/ingressgateway-certs {{< /text >}} `tls.crt` and `tls.key` should exist in the directory contents. * If you created the `istio-ingressgateway-certs` secret, but the key and the certificate are not loaded, delete the ingress gateway pod and force the ingress gateway pod to restart and reload key and certificate. {{< text bash >}} $ kubectl delete pod -n istio-system -l istio=ingressgateway {{< /text >}} * Verify that the `Subject` is correct in the certificate of the ingress gateway: {{< text bash >}} $ kubectl exec -i -n istio-system $(kubectl get pod -l istio=ingressgateway -n istio-system -o jsonpath='{.items[0].metadata.name}') -- cat /etc/istio/ingressgateway-certs/tls.crt | openssl x509 -text -noout | grep 'Subject:' Subject: CN=httpbin.example.com, O=httpbin organization {{< /text >}} * Verify that the proxy of the ingress gateway is aware of the certificates: {{< text bash >}} $ kubectl exec -ti $(kubectl get po -l istio=ingressgateway -n istio-system -o jsonpath='{.items[0].metadata.name}') -n istio-system -- pilot-agent request GET certs { "ca_cert": "", "cert_chain": "Certificate Path: /etc/istio/ingressgateway-certs/tls.crt, Serial Number: 100212, Days until Expiration: 370" } {{< /text >}} * Check the log of `istio-ingressgateway` for error messages: {{< text bash >}} $ kubectl logs -n istio-system -l istio=ingressgateway {{< /text >}} * For macOS users, verify that you use `curl` compiled with the [LibreSSL](http://www.libressl.org) library, as described in the [Before you begin](#before-you-begin) section. ### Troubleshooting for mutual TLS In addition to the steps in the previous section, perform the following: * Verify that the CA certificate is loaded in the `istio-ingressgateway` pod: {{< text bash >}} $ kubectl exec -it -n istio-system $(kubectl -n istio-system get pods -l istio=ingressgateway -o jsonpath='{.items[0].metadata.name}') -- ls -al /etc/istio/ingressgateway-ca-certs {{< /text >}} `example.com.crt` should exist in the directory contents. * If you created the `istio-ingressgateway-ca-certs` secret, but the CA certificate is not loaded, delete the ingress gateway pod and force it to reload the certificate: {{< text bash >}} $ kubectl delete pod -n istio-system -l istio=ingressgateway {{< /text >}} * Verify that the `Subject` is correct in the CA certificate of the ingress gateway: {{< text bash >}} $ kubectl exec -i -n istio-system $(kubectl get pod -l istio=ingressgateway -n istio-system -o jsonpath='{.items[0].metadata.name}') -- cat /etc/istio/ingressgateway-ca-certs/example.com.crt | openssl x509 -text -noout | grep 'Subject:' Subject: O=example Inc., CN=example.com {{< /text >}} ## Cleanup 1. Delete the `Gateway` configuration, the `VirtualService`, and the secrets: {{< text bash >}} $ kubectl delete gateway --ignore-not-found=true httpbin-gateway bookinfo-gateway $ kubectl delete virtualservice httpbin $ kubectl delete --ignore-not-found=true -n istio-system secret istio-ingressgateway-certs istio-ingressgateway-ca-certs $ kubectl delete --ignore-not-found=true virtualservice bookinfo {{< /text >}} 1. Delete the directories of the certificates and the repository used to generate them: {{< text bash >}} $ rm -rf example.com.crt example.com.key httpbin.example.com.crt httpbin.example.com.key httpbin.example.com.csr httpbin-client.example.com.crt httpbin-client.example.com.key httpbin-client.example.com.csr bookinfo.com.crt bookinfo.com.key bookinfo.com.csr {{< /text >}} 1. Remove the patch file you used for redeployment of `istio-ingressgateway`: {{< text bash >}} $ rm -f gateway-patch.json {{< /text >}} 1. Shutdown the [httpbin]({{< github_tree >}}/samples/httpbin) service: {{< text bash >}} $ kubectl delete --ignore-not-found=true -f @samples/httpbin/httpbin.yaml@ {{< /text >}}