15 KiB
title | description | weight | keywords | owner | test | ||||
---|---|---|---|---|---|---|---|---|---|
Virtual Machine Installation | Deploy Istio and connect a workload running within a virtual machine to it. | 60 |
|
istio/wg-environments-maintainers | yes |
Follow this guide to deploy Istio and connect a virtual machine to it.
Prerequisites
- Download the Istio release
- Perform any necessary platform-specific setup
- Check the requirements for Pods and Services
- Virtual machines must have IP connectivity to the ingress gateway in the connecting mesh, and optionally every pod in the mesh via L3 networking if enhanced performance is desired.
- Learn about Virtual Machine Architecture to gain an understanding of the high level architecture of Istio's virtual machine integration.
Prepare the guide environment
-
Create a virtual machine
-
Set the environment variables
VM_APP
,WORK_DIR
,VM_NAMESPACE
, andSERVICE_ACCOUNT
on your machine that you're using to set up the cluster. (e.g.,WORK_DIR="${HOME}/vmintegration"
):{{< tabset category-name="network-mode" >}}
{{< tab name="Single-Network" category-value="single" >}}
{{< text bash >}} $ VM_APP="" $ VM_NAMESPACE="" $ WORK_DIR="" $ SERVICE_ACCOUNT="" $ CLUSTER_NETWORK="" $ VM_NETWORK="" $ CLUSTER="Kubernetes" {{< /text >}}
{{< /tab >}}
{{< tab name="Multi-Network" category-value="multiple" >}}
{{< text bash >}} $ VM_APP="" $ VM_NAMESPACE="" $ WORK_DIR="" $ SERVICE_ACCOUNT="" $ # Customize values for multi-cluster/multi-network as needed $ CLUSTER_NETWORK="kube-network" $ VM_NETWORK="vm-network" $ CLUSTER="cluster1" {{< /text >}}
{{< /tab >}}
{{< /tabset >}}
-
Create the working directory on your machine that you're using to set up the cluster:
{{< text syntax=bash snip_id=setup_wd >}}
mkdir -p "
{WORK_DIR}" {{< /text >}}
Install the Istio control plane
If your cluster already has an Istio control plane, you can skip the installation steps, but will still need to expose the control plane for virtual machine access.
Install Istio and expose the control plane on cluster so that your virtual machine can access it.
-
Create the
IstioOperator
spec for installation.{{< text syntax="bash yaml" snip_id=setup_iop >}} $ cat < ./vm-cluster.yaml apiVersion: install.istio.io/v1alpha1 kind: IstioOperator metadata: name: istio spec: values: global: meshID: mesh1 multiCluster: clusterName: "${CLUSTER}" network: "${CLUSTER_NETWORK}" EOF {{< /text >}}
-
Install Istio.
{{< tabset category-name="registration-mode" >}}
{{< tab name="Default" category-value="default" >}}
{{< text bash >}} $ istioctl install -f vm-cluster.yaml {{< /text >}}
{{< /tab >}}
{{< tab name="Automated WorkloadEntry Creation" category-value="autoreg" >}}
{{< boilerplate experimental >}}
{{< text syntax=bash snip_id=install_istio >}} $ istioctl install -f vm-cluster.yaml --set values.pilot.env.PILOT_ENABLE_WORKLOAD_ENTRY_AUTOREGISTRATION=true --set values.pilot.env.PILOT_ENABLE_WORKLOAD_ENTRY_HEALTHCHECKS=true {{< /text >}}
{{< /tab >}}
{{< /tabset >}}
-
Deploy the east-west gateway:
{{< warning >}} If the control-plane was installed with a revision, add the
--revision rev
flag to thegen-eastwest-gateway.sh
command. {{< /warning >}}{{< tabset category-name="network-mode" >}}
{{< tab name="Single-Network" category-value="single" >}}
{{< text syntax=bash snip_id=install_eastwest >}} $ @samples/multicluster/gen-eastwest-gateway.sh@ --single-cluster | istioctl install -y -f - {{< /text >}}
{{< /tab >}}
{{< tab name="Multi-Network" category-value="multiple" >}}
{{< text bash >}} $ @samples/multicluster/gen-eastwest-gateway.sh@
--network "${CLUSTER_NETWORK}" |
istioctl install -y -f - {{< /text >}}{{< /tab >}}
{{< /tabset >}}
-
Expose services inside the cluster via the east-west gateway:
{{< tabset category-name="network-mode" >}}
{{< tab name="Single-Network" category-value="single" >}}
Expose the control plane:
{{< text syntax=bash snip_id=expose_istio >}} $ kubectl apply -n istio-system -f @samples/multicluster/expose-istiod.yaml@ {{< /text >}}
{{< /tab >}}
{{< tab name="Multi-Network" category-value="multiple" >}}
Expose the control plane:
{{< text bash >}} $ kubectl apply -n istio-system -f @samples/multicluster/expose-istiod.yaml@ {{< /text >}}
Expose cluster services:
{{< text bash >}} $ kubectl apply -n istio-system -f @samples/multicluster/expose-services.yaml@ {{< /text >}}
Ensure to label the istio-system namespace with the defined cluster network:
{{< text bash >}}
kubectl label namespace istio-system topology.istio.io/network="
{CLUSTER_NETWORK}" {{< /text >}}{{< /tab >}}
{{< /tabset >}}
Configure the VM namespace
-
Create the namespace that will host the virtual machine:
{{< text syntax=bash snip_id=install_namespace >}}
kubectl create namespace "
{VM_NAMESPACE}" {{< /text >}} -
Create a serviceaccount for the virtual machine:
{{< text syntax=bash snip_id=install_sa >}}
kubectl create serviceaccount "
{SERVICE_ACCOUNT}" -n "${VM_NAMESPACE}" {{< /text >}}
Create files to transfer to the virtual machine
{{< tabset category-name="registration-mode" >}}
{{< tab name="Default" category-value="default" >}}
First, create a template WorkloadGroup
for the VM(s):
{{< text bash >}} $ cat < workloadgroup.yaml apiVersion: networking.istio.io/v1 kind: WorkloadGroup metadata: name: "${VM_APP}" namespace: "${VM_NAMESPACE}" spec: metadata: labels: app: "${VM_APP}" template: serviceAccount: "${SERVICE_ACCOUNT}" network: "${VM_NETWORK}" EOF {{< /text >}}
{{< /tab >}}
{{< tab name="Automated WorkloadEntry Creation" category-value="autoreg" >}}
First, create a template WorkloadGroup
for the VM(s):
{{< boilerplate experimental >}}
{{< text syntax=bash snip_id=create_wg >}} $ cat < workloadgroup.yaml apiVersion: networking.istio.io/v1 kind: WorkloadGroup metadata: name: "${VM_APP}" namespace: "${VM_NAMESPACE}" spec: metadata: labels: app: "${VM_APP}" template: serviceAccount: "${SERVICE_ACCOUNT}" network: "${VM_NETWORK}" EOF {{< /text >}}
Then, to allow automated WorkloadEntry
creation, push the WorkloadGroup
to the cluster:
{{< text syntax=bash snip_id=apply_wg >}}
kubectl --namespace "
{VM_NAMESPACE}" apply -f workloadgroup.yaml
{{< /text >}}
Using the Automated WorkloadEntry
Creation feature, application health checks are also available. These share the same API and behavior as Kubernetes Readiness Probes.
For example, to configure a probe on the /ready
endpoint of your application:
{{< text bash >}} $ cat < workloadgroup.yaml apiVersion: networking.istio.io/v1 kind: WorkloadGroup metadata: name: "${VM_APP}" namespace: "${VM_NAMESPACE}" spec: metadata: labels: app: "${VM_APP}" template: serviceAccount: "${SERVICE_ACCOUNT}" network: "${NETWORK}" probe: periodSeconds: 5 initialDelaySeconds: 1 httpGet: port: 8080 path: /ready EOF {{< /text >}}
With this configuration, the automatically generated WorkloadEntry
will not be marked "Ready" until the probe succeeds.
{{< /tab >}}
{{< /tabset >}}
{{< warning >}}
Before proceeding to generate the istio-token
, as part of istioctl x workload entry
, you should verify third party tokens are enabled in your cluster by following the steps describe here.
If third party tokens are not enabled, you should add the option --set values.global.jwtPolicy=first-party-jwt
to the Istio install commands.
{{< /warning >}}
Next, use the istioctl x workload entry
command to generate:
cluster.env
: Contains metadata that identifies what namespace, service account, network CIDR and (optionally) what inbound ports to capture.istio-token
: A Kubernetes token used to get certs from the CA.mesh.yaml
: ProvidesProxyConfig
to configurediscoveryAddress
, health-checking probes, and some authentication options.root-cert.pem
: The root certificate used to authenticate.hosts
: An addendum to/etc/hosts
that the proxy will use to reach istiod for xDS.*
{{< idea >}} A sophisticated option involves configuring DNS within the virtual machine to reference an external DNS server. This option is beyond the scope of this guide. {{< /idea >}}
{{< tabset category-name="registration-mode" >}}
{{< tab name="Default" category-value="default" >}}
{{< text bash >}}
istioctl x workload entry configure -f workloadgroup.yaml -o "
{WORK_DIR}" --clusterID "${CLUSTER}"
{{< /text >}}
{{< /tab >}}
{{< tab name="Automated WorkloadEntry Creation" category-value="autoreg" >}}
{{< boilerplate experimental >}}
{{< text syntax=bash snip_id=configure_wg >}}
istioctl x workload entry configure -f workloadgroup.yaml -o "
{WORK_DIR}" --clusterID "${CLUSTER}" --autoregister
{{< /text >}}
{{< /tab >}}
{{< /tabset >}}
Configure the virtual machine
Run the following commands on the virtual machine you want to add to the Istio mesh:
-
Securely transfer the files from
"${WORK_DIR}"
to the virtual machine. How you choose to securely transfer those files should be done with consideration for your information security policies. For convenience in this guide, transfer all of the required files to"${HOME}"
in the virtual machine. -
Install the root certificate at
/etc/certs
:{{< text bash >}} $ sudo mkdir -p /etc/certs
sudo cp "
{HOME}"/root-cert.pem /etc/certs/root-cert.pem {{< /text >}} -
Install the token at
/var/run/secrets/tokens
:{{< text bash >}} $ sudo mkdir -p /var/run/secrets/tokens
sudo cp "
{HOME}"/istio-token /var/run/secrets/tokens/istio-token {{< /text >}} -
Install the package containing the Istio virtual machine integration runtime:
{{< tabset category-name="vm-os" >}}
{{< tab name="Debian" category-value="debian" >}}
{{< text syntax=bash snip_id=none >}} $ curl -LO https://storage.googleapis.com/istio-release/releases/{{< istio_full_version >}}/deb/istio-sidecar.deb $ sudo dpkg -i istio-sidecar.deb {{< /text >}}
{{< /tab >}}
{{< tab name="CentOS" category-value="centos" >}}
Note: only CentOS 8 is currently supported.
{{< text syntax=bash snip_id=none >}} $ curl -LO https://storage.googleapis.com/istio-release/releases/{{< istio_full_version >}}/rpm/istio-sidecar.rpm $ sudo rpm -i istio-sidecar.rpm {{< /text >}}
{{< /tab >}}
{{< /tabset >}}
-
Install
cluster.env
within the directory/var/lib/istio/envoy/
:{{< text bash >}}
sudo cp "
{HOME}"/cluster.env /var/lib/istio/envoy/cluster.env {{< /text >}} -
Install the Mesh Config to
/etc/istio/config/mesh
:{{< text bash >}}
sudo cp "
{HOME}"/mesh.yaml /etc/istio/config/mesh {{< /text >}} -
Add the istiod host to
/etc/hosts
:{{< text bash >}}
sudo sh -c 'cat
(eval echo ~$SUDO_USER)/hosts >> /etc/hosts' {{< /text >}} -
Transfer ownership of the files in
/etc/certs/
and/var/lib/istio/envoy/
to the Istio proxy:{{< text bash >}} $ sudo mkdir -p /etc/istio/proxy $ sudo chown -R istio-proxy /var/lib/istio /etc/certs /etc/istio/proxy /etc/istio/config /var/run/secrets /etc/certs/root-cert.pem {{< /text >}}
Start Istio within the virtual machine
-
Start the Istio agent:
{{< text bash >}} $ sudo systemctl start istio {{< /text >}}
Verify Istio Works Successfully
-
Check the log in
/var/log/istio/istio.log
. You should see entries similar to the following:{{< text bash >}} $ 2020-08-21T01:32:17.748413Z info sds resource:default pushed key/cert pair to proxy $ 2020-08-21T01:32:20.270073Z info sds resource:ROOTCA new connection $ 2020-08-21T01:32:20.270142Z info sds Skipping waiting for gateway secret $ 2020-08-21T01:32:20.270279Z info cache adding watcher for file ./etc/certs/root-cert.pem $ 2020-08-21T01:32:20.270347Z info cache GenerateSecret from file ROOTCA $ 2020-08-21T01:32:20.270494Z info sds resource:ROOTCA pushed root cert to proxy $ 2020-08-21T01:32:20.270734Z info sds resource:default new connection $ 2020-08-21T01:32:20.270763Z info sds Skipping waiting for gateway secret $ 2020-08-21T01:32:20.695478Z info cache GenerateSecret default $ 2020-08-21T01:32:20.695595Z info sds resource:default pushed key/cert pair to proxy {{< /text >}}
-
Create a Namespace to deploy a Pod-based Service:
{{< text bash >}} $ kubectl create namespace sample $ kubectl label namespace sample istio-injection=enabled {{< /text >}}
-
Deploy the
HelloWorld
Service:{{< text bash >}} $ kubectl apply -n sample -f @samples/helloworld/helloworld.yaml@ {{< /text >}}
-
Send requests from your Virtual Machine to the Service:
{{< text bash >}} $ curl helloworld.sample.svc:5000/hello Hello version: v1, instance: helloworld-v1-578dd69f69-fxwwk {{< /text >}}
Next Steps
For more information about virtual machines:
- Debugging Virtual Machines to troubleshoot issues with virtual machines.
- Bookinfo with a Virtual Machine to set up an example deployment of virtual machines.
Uninstall
Stop Istio on the virtual machine:
{{< text bash >}} $ sudo systemctl stop istio {{< /text >}}
Then, remove the Istio-sidecar package:
{{< tabset category-name="vm-os" >}}
{{< tab name="Debian" category-value="debian" >}}
{{< text bash >}} $ sudo dpkg -r istio-sidecar $ dpkg -s istio-sidecar {{< /text >}}
{{< /tab >}}
{{< tab name="CentOS" category-value="centos" >}}
{{< text bash >}} $ sudo rpm -e istio-sidecar {{< /text >}}
{{< /tab >}}
{{< /tabset >}}
To uninstall Istio, run the following command:
{{< text bash >}} $ kubectl delete -n istio-system -f @samples/multicluster/expose-istiod.yaml@ $ istioctl uninstall -y --purge {{< /text >}}
The control plane namespace (e.g., istio-system
) is not removed by default.
If no longer needed, use the following command to remove it:
{{< text bash >}} $ kubectl delete namespace istio-system {{< /text >}}