1669 lines
66 KiB
Markdown
1669 lines
66 KiB
Markdown
---
|
||
title: 运行 ZooKeeper，一个分布式协调系统
|
||
content_type: tutorial
|
||
weight: 40
|
||
---
|
||
<!--
|
||
reviewers:
|
||
- bprashanth
|
||
- enisoc
|
||
- erictune
|
||
- foxish
|
||
- janetkuo
|
||
- kow3ns
|
||
- smarterclayton
|
||
title: Running ZooKeeper, A Distributed System Coordinator
|
||
content_type: tutorial
|
||
weight: 40
|
||
-->
|
||
|
||
<!-- overview -->
|
||
|
||
<!--
|
||
This tutorial demonstrates running [Apache Zookeeper](https://zookeeper.apache.org) on
|
||
Kubernetes using [StatefulSets](/docs/concepts/workloads/controllers/statefulset/),
|
||
[PodDisruptionBudgets](/docs/concepts/workloads/pods/disruptions/#pod-disruption-budget),
|
||
and [PodAntiAffinity](/docs/concepts/scheduling-eviction/assign-pod-node/#affinity-and-anti-affinity).
|
||
-->
|
||
本教程展示了在 Kubernetes 上使用
|
||
[StatefulSet](/zh/docs/concepts/workloads/controllers/statefulset/)，
|
||
[PodDisruptionBudget](/zh/docs/concepts/workloads/pods/disruptions/#pod-disruption-budget) 和
|
||
[PodAntiAffinity](/zh/docs/concepts/scheduling-eviction/assign-pod-node/#亲和与反亲和)
|
||
特性运行 [Apache Zookeeper](https://zookeeper.apache.org)。
|
||
|
||
## {{% heading "prerequisites" %}}
|
||
|
||
<!--
|
||
Before starting this tutorial, you should be familiar with the following
|
||
Kubernetes concepts.
|
||
-->
|
||
在开始本教程前，你应该熟悉以下 Kubernetes 概念。
|
||
|
||
- [Pods](/zh/docs/concepts/workloads/pods/)
|
||
- [集群 DNS](/zh/docs/concepts/services-networking/dns-pod-service/)
|
||
- [无头服务（Headless Service）](/zh/docs/concepts/services-networking/service/#headless-services)
|
||
- [PersistentVolumes](/zh/docs/concepts/storage/persistent-volumes/)
|
||
- [PersistentVolume 制备](https://github.com/kubernetes/examples/tree/{{< param "githubbranch" >}}/staging/persistent-volume-provisioning/)
|
||
- [StatefulSet](/zh/docs/concepts/workloads/controllers/statefulset/)
|
||
- [PodDisruptionBudget](/zh/docs/concepts/workloads/pods/disruptions/#pod-disruption-budget)
|
||
- [PodAntiAffinity](/zh/docs/concepts/scheduling-eviction/assign-pod-node/#亲和与反亲和)
|
||
- [kubectl CLI](/zh/docs/reference/kubectl/kubectl/)
|
||
|
||
<!--
|
||
You must have a cluster with at least four nodes, and each node requires at least 2 CPUs and 4 GiB of memory. In this tutorial you will cordon and drain the cluster's nodes. **This means that the cluster will terminate and evict all Pods on its nodes, and the nodes will temporarily become unschedulable.** You should use a dedicated cluster for this tutorial, or you should ensure that the disruption you cause will not interfere with other tenants.
|
||
-->
|
||
你需要一个至少包含四个节点的集群，每个节点至少 2 CPUs 和 4 GiB 内存。
|
||
在本教程中你将会隔离（Cordon）和腾空（Drain ）集群的节点。
|
||
**这意味着集群节点上所有的 Pods 将会被终止并移除。这些节点也会暂时变为不可调度**。
|
||
在本教程中你应该使用一个独占的集群，或者保证你造成的干扰不会影响其它租户。
|
||
|
||
<!--
|
||
This tutorial assumes that you have configured your cluster to dynamically provision
|
||
PersistentVolumes. If your cluster is not configured to do so, you
|
||
will have to manually provision three 20 GiB volumes before starting this
|
||
tutorial.
|
||
-->
|
||
本教程假设你的集群配置为动态的提供 PersistentVolumes。
|
||
如果你的集群没有配置成这样，在开始本教程前，你需要手动准备三个 20 GiB 的卷。
|
||
|
||
## {{% heading "objectives" %}}
|
||
|
||
<!--
|
||
After this tutorial, you will know the following.
|
||
|
||
- How to deploy a ZooKeeper ensemble using StatefulSet.
|
||
- How to consistently configure the ensemble.
|
||
- How to spread the deployment of ZooKeeper servers in the ensemble.
|
||
- How to use PodDisruptionBudgets to ensure service availability during planned maintenance.
|
||
-->
|
||
在学习本教程后，你将熟悉下列内容。
|
||
|
||
* 如何使用 StatefulSet 部署一个 ZooKeeper ensemble。
|
||
* 如何一致性配置 ensemble。
|
||
* 如何在 ensemble 中 分布 ZooKeeper 服务器的部署。
|
||
* 如何在计划维护中使用 PodDisruptionBudgets 确保服务可用性。
|
||
|
||
<!-- lessoncontent -->
|
||
|
||
<!--
|
||
### ZooKeeper
|
||
|
||
[Apache ZooKeeper](https://zookeeper.apache.org/doc/current/) is a
|
||
distributed, open-source coordination service for distributed applications.
|
||
ZooKeeper allows you to read, write, and observe updates to data. Data are
|
||
organized in a file system like hierarchy and replicated to all ZooKeeper
|
||
servers in the ensemble (a set of ZooKeeper servers). All operations on data
|
||
are atomic and sequentially consistent. ZooKeeper ensures this by using the
|
||
[Zab](https://pdfs.semanticscholar.org/b02c/6b00bd5dbdbd951fddb00b906c82fa80f0b3.pdf)
|
||
consensus protocol to replicate a state machine across all servers in the ensemble.
|
||
-->
|
||
### ZooKeeper {#zookeeper-basics}
|
||
|
||
[Apache ZooKeeper](https://zookeeper.apache.org/doc/current/)
|
||
是一个分布式的开源协调服务，用于分布式系统。
|
||
ZooKeeper 允许你读取、写入数据和发现数据更新。
|
||
数据按层次结构组织在文件系统中，并复制到 ensemble（一个 ZooKeeper 服务器的集合）
|
||
中所有的 ZooKeeper 服务器。对数据的所有操作都是原子的和顺序一致的。
|
||
ZooKeeper 通过
|
||
[Zab](https://pdfs.semanticscholar.org/b02c/6b00bd5dbdbd951fddb00b906c82fa80f0b3.pdf)
|
||
一致性协议在 ensemble 的所有服务器之间复制一个状态机来确保这个特性。
|
||
|
||
<!--
|
||
The ensemble uses the Zab protocol to elect a leader, and the ensemble cannot write data until that election is complete. Once complete, the ensemble uses Zab to ensure that it replicates all writes to a quorum before it acknowledges and makes them visible to clients. Without respect to weighted quorums, a quorum is a majority component of the ensemble containing the current leader. For instance, if the ensemble has three servers, a component that contains the leader and one other server constitutes a quorum. If the ensemble can not achieve a quorum, the ensemble cannot write data.
|
||
-->
|
||
Ensemble 使用 Zab 协议选举一个领导者，在选举出领导者前不能写入数据。
|
||
一旦选举出了领导者，ensemble 使用 Zab 保证所有写入被复制到一个 quorum，
|
||
然后这些写入操作才会被确认并对客户端可用。
|
||
如果没有遵照加权 quorums，一个 quorum 表示包含当前领导者的 ensemble 的多数成员。
|
||
例如，如果 ensemble 有 3 个服务器，一个包含领导者的成员和另一个服务器就组成了一个
|
||
quorum。
|
||
如果 ensemble 不能达成一个 quorum，数据将不能被写入。
|
||
|
||
<!--
|
||
ZooKeeper servers keep their entire state machine in memory, and write every mutation to a durable WAL (Write Ahead Log) on storage media. When a server crashes, it can recover its previous state by replaying the WAL. To prevent the WAL from growing without bound, ZooKeeper servers will periodically snapshot them in memory state to storage media. These snapshots can be loaded directly into memory, and all WAL entries that preceded the snapshot may be discarded.
|
||
-->
|
||
ZooKeeper 在内存中保存它们的整个状态机，但是每个改变都被写入一个在存储介质上的
|
||
持久 WAL（Write Ahead Log）。
|
||
当一个服务器出现故障时，它能够通过回放 WAL 恢复之前的状态。
|
||
为了防止 WAL 无限制的增长，ZooKeeper 服务器会定期的将内存状态快照保存到存储介质。
|
||
这些快照能够直接加载到内存中，所有在这个快照之前的 WAL 条目都可以被安全的丢弃。
|
||
|
||
<!--
|
||
## Creating a ZooKeeper Ensemble
|
||
|
||
The manifest below contains a
|
||
[Headless Service](/docs/concepts/services-networking/service/#headless-services),
|
||
a [Service](/docs/concepts/services-networking/service/),
|
||
a [PodDisruptionBudget](/docs/concepts/workloads/pods/disruptions/#pod-disruption-budgets),
|
||
and a [StatefulSet](/docs/concepts/workloads/controllers/statefulset/).
|
||
-->
|
||
## 创建一个 ZooKeeper Ensemble
|
||
|
||
下面的清单包含一个
|
||
[无头服务](/zh/docs/concepts/services-networking/service/#headless-services)，
|
||
一个 [Service](/zh/docs/concepts/services-networking/service/)，
|
||
一个 [PodDisruptionBudget](/zh/docs/concepts/workloads/pods/disruptions/#specifying-a-poddisruptionbudget)，
|
||
和一个 [StatefulSet](/zh/docs/concepts/workloads/controllers/statefulset/)。
|
||
|
||
{{< codenew file="application/zookeeper/zookeeper.yaml" >}}
|
||
|
||
<!--
|
||
Open a terminal, and use the
|
||
[`kubectl apply`](/docs/reference/generated/kubectl/kubectl-commands/#apply) command to create the
|
||
manifest.
|
||
-->
|
||
打开一个命令行终端，使用命令
|
||
[`kubectl apply`](/docs/reference/generated/kubectl/kubectl-commands/#apply)
|
||
创建这个清单。
|
||
|
||
```shell
|
||
kubectl apply -f https://k8s.io/examples/application/zookeeper/zookeeper.yaml
|
||
```
|
||
|
||
<!--
|
||
This creates the `zk-hs` Headless Service, the `zk-cs` Service,
|
||
the `zk-pdb` PodDisruptionBudget, and the `zk` StatefulSet.
|
||
-->
|
||
这个操作创建了 `zk-hs` 无头服务、`zk-cs` 服务、`zk-pdb` PodDisruptionBudget
|
||
和 `zk` StatefulSet。
|
||
|
||
```
|
||
service/zk-hs created
|
||
service/zk-cs created
|
||
poddisruptionbudget.policy/zk-pdb created
|
||
statefulset.apps/zk created
|
||
```
|
||
|
||
<!--
|
||
Use [`kubectl get`](/docs/reference/generated/kubectl/kubectl-commands/#get) to watch the
|
||
StatefulSet controller create the StatefulSet's Pods.
|
||
-->
|
||
使用命令
|
||
[`kubectl get`](/docs/reference/generated/kubectl/kubectl-commands/#get)
|
||
查看 StatefulSet 控制器创建的 Pods。
|
||
|
||
```shell
|
||
kubectl get pods -w -l app=zk
|
||
```
|
||
|
||
<!--
|
||
Once the `zk-2` Pod is Running and Ready, use `CTRL-C` to terminate kubectl.
|
||
-->
|
||
一旦 `zk-2` Pod 变成 Running 和 Ready 状态，使用 `CRTL-C` 结束 kubectl。
|
||
|
||
```
|
||
NAME READY STATUS RESTARTS AGE
|
||
zk-0 0/1 Pending 0 0s
|
||
zk-0 0/1 Pending 0 0s
|
||
zk-0 0/1 ContainerCreating 0 0s
|
||
zk-0 0/1 Running 0 19s
|
||
zk-0 1/1 Running 0 40s
|
||
zk-1 0/1 Pending 0 0s
|
||
zk-1 0/1 Pending 0 0s
|
||
zk-1 0/1 ContainerCreating 0 0s
|
||
zk-1 0/1 Running 0 18s
|
||
zk-1 1/1 Running 0 40s
|
||
zk-2 0/1 Pending 0 0s
|
||
zk-2 0/1 Pending 0 0s
|
||
zk-2 0/1 ContainerCreating 0 0s
|
||
zk-2 0/1 Running 0 19s
|
||
zk-2 1/1 Running 0 40s
|
||
```
|
||
|
||
<!--
|
||
The StatefulSet controller creates three Pods, and each Pod has a container with
|
||
a [ZooKeeper](https://www-us.apache.org/dist/zookeeper/stable/) server.
|
||
-->
|
||
StatefulSet 控制器创建 3 个 Pods，每个 Pod 包含一个
|
||
[ZooKeeper](https://www-us.apache.org/dist/zookeeper/stable/) 服务容器。
|
||
|
||
<!--
|
||
### Facilitating Leader Election
|
||
|
||
Because there is no terminating algorithm for electing a leader in an anonymous network, Zab requires explicit membership configuration to perform leader election. Each server in the ensemble needs to have a unique identifier, all servers need to know the global set of identifiers, and each identifier needs to be associated with a network address.
|
||
|
||
Use [`kubectl exec`](/docs/reference/generated/kubectl/kubectl-commands/#exec) to get the hostnames
|
||
of the Pods in the `zk` StatefulSet.
|
||
-->
|
||
### 促成 Leader 选举 {#facilitating-leader-election}
|
||
|
||
由于在匿名网络中没有用于选举 leader 的终止算法，Zab 要求显式的进行成员关系配置，
|
||
以执行 leader 选举。Ensemble 中的每个服务器都需要具有一个独一无二的标识符，
|
||
所有的服务器均需要知道标识符的全集，并且每个标识符都需要和一个网络地址相关联。
|
||
|
||
使用命令
|
||
[`kubectl exec`](/docs/reference/generated/kubectl/kubectl-commands/#exec)
|
||
获取 `zk` StatefulSet 中 Pods 的主机名。
|
||
|
||
```shell
|
||
for i in 0 1 2; do kubectl exec zk-$i -- hostname; done
|
||
```
|
||
|
||
<!--
|
||
The StatefulSet controller provides each Pod with a unique hostname based on its ordinal index. The hostnames take the form of `<statefulset name>-<ordinal index>`. Because the `replicas` field of the `zk` StatefulSet is set to `3`, the Set's controller creates three Pods with their hostnames set to `zk-0`, `zk-1`, and
|
||
`zk-2`.
|
||
-->
|
||
StatefulSet 控制器基于每个 Pod 的序号索引为它们各自提供一个唯一的主机名。
|
||
主机名采用 `<statefulset 名称>-<序数索引>` 的形式。
|
||
由于 `zk` StatefulSet 的 `replicas` 字段设置为 3，这个集合的控制器将创建
|
||
3 个 Pods，主机名为：`zk-0`、`zk-1` 和 `zk-2`。
|
||
|
||
```
|
||
zk-0
|
||
zk-1
|
||
zk-2
|
||
```
|
||
|
||
<!--
|
||
The servers in a ZooKeeper ensemble use natural numbers as unique identifiers, and store each server's identifier in a file called `myid` in the server's data directory.
|
||
|
||
To examine the contents of the `myid` file for each server use the following command.
|
||
-->
|
||
ZooKeeper ensemble 中的服务器使用自然数作为唯一标识符，
|
||
每个服务器的标识符都保存在服务器的数据目录中一个名为 `myid` 的文件里。
|
||
|
||
检查每个服务器的 `myid` 文件的内容。
|
||
|
||
```shell
|
||
for i in 0 1 2; do echo "myid zk-$i";kubectl exec zk-$i -- cat /var/lib/zookeeper/data/myid; done
|
||
```
|
||
|
||
<!--
|
||
Because the identifiers are natural numbers and the ordinal indices are non-negative integers, you can generate an identifier by adding 1 to the ordinal.
|
||
-->
|
||
由于标识符为自然数并且序号索引是非负整数，你可以在序号上加 1 来生成一个标识符。
|
||
|
||
```
|
||
myid zk-0
|
||
1
|
||
myid zk-1
|
||
2
|
||
myid zk-2
|
||
3
|
||
```
|
||
|
||
<!--
|
||
To get the Fully Qualified Domain Name (FQDN) of each Pod in the `zk` StatefulSet use the following command.
|
||
-->
|
||
获取 `zk` StatefulSet 中每个 Pod 的全限定域名（Fully Qualified Domain Name，FQDN）。
|
||
|
||
```shell
|
||
for i in 0 1 2; do kubectl exec zk-$i -- hostname -f; done
|
||
```
|
||
|
||
<!--
|
||
The `zk-hs` Service creates a domain for all of the Pods,
|
||
`zk-hs.default.svc.cluster.local`.
|
||
-->
|
||
`zk-hs` Service 为所有 Pods 创建了一个域：`zk-hs.default.svc.cluster.local`。
|
||
|
||
```
|
||
zk-0.zk-hs.default.svc.cluster.local
|
||
zk-1.zk-hs.default.svc.cluster.local
|
||
zk-2.zk-hs.default.svc.cluster.local
|
||
```
|
||
|
||
<!--
|
||
The A records in [Kubernetes DNS](/docs/concepts/services-networking/dns-pod-service/) resolve the FQDNs to the Pods' IP addresses. If Kubernetes reschedules the Pods, it will update the A records with the Pods' new IP addresses, but the A records names will not change.
|
||
|
||
ZooKeeper stores its application configuration in a file named `zoo.cfg`. Use `kubectl exec` to view the contents of the `zoo.cfg` file in the `zk-0` Pod.
|
||
-->
|
||
[Kubernetes DNS](/zh/docs/concepts/services-networking/dns-pod-service/)
|
||
中的 A 记录将 FQDNs 解析成为 Pods 的 IP 地址。
|
||
如果 Pods 被调度，这个 A 记录将会使用 Pods 的新 IP 地址完成更新，
|
||
但 A 记录的名称不会改变。
|
||
|
||
ZooKeeper 在一个名为 `zoo.cfg` 的文件中保存它的应用配置。
|
||
使用 `kubectl exec` 在 `zk-0` Pod 中查看 `zoo.cfg` 文件的内容。
|
||
|
||
```shell
|
||
kubectl exec zk-0 -- cat /opt/zookeeper/conf/zoo.cfg
|
||
```
|
||
|
||
<!--
|
||
In the `server.1`, `server.2`, and `server.3` properties at the bottom of
|
||
the file, the `1`, `2`, and `3` correspond to the identifiers in the
|
||
ZooKeeper servers' `myid` files. They are set to the FQDNs for the Pods in
|
||
the `zk` StatefulSet.
|
||
-->
|
||
文件底部为 `server.1`、`server.2` 和 `server.3`，其中的 `1`、`2` 和 `3`
|
||
分别对应 ZooKeeper 服务器的 `myid` 文件中的标识符。
|
||
它们被设置为 `zk` StatefulSet 中的 Pods 的 FQDNs。
|
||
|
||
```
|
||
clientPort=2181
|
||
dataDir=/var/lib/zookeeper/data
|
||
dataLogDir=/var/lib/zookeeper/log
|
||
tickTime=2000
|
||
initLimit=10
|
||
syncLimit=2000
|
||
maxClientCnxns=60
|
||
minSessionTimeout= 4000
|
||
maxSessionTimeout= 40000
|
||
autopurge.snapRetainCount=3
|
||
autopurge.purgeInterval=0
|
||
server.1=zk-0.zk-hs.default.svc.cluster.local:2888:3888
|
||
server.2=zk-1.zk-hs.default.svc.cluster.local:2888:3888
|
||
server.3=zk-2.zk-hs.default.svc.cluster.local:2888:3888
|
||
```
|
||
|
||
<!--
|
||
### Achieving consensus
|
||
|
||
Consensus protocols require that the identifiers of each participant be unique. No two participants in the Zab protocol should claim the same unique identifier. This is necessary to allow the processes in the system to agree on which processes have committed which data. If two Pods are launched with the same ordinal, two ZooKeeper servers would both identify themselves as the same server.
|
||
-->
|
||
### 达成共识 {#achieving-consensus}
|
||
|
||
一致性协议要求每个参与者的标识符唯一。
|
||
在 Zab 协议里任何两个参与者都不应该声明相同的唯一标识符。
|
||
对于让系统中的进程协商哪些进程已经提交了哪些数据而言，这是必须的。
|
||
如果有两个 Pods 使用相同的序号启动，这两个 ZooKeeper 服务器
|
||
会将自己识别为相同的服务器。
|
||
|
||
```shell
|
||
kubectl get pods -w -l app=zk
|
||
```
|
||
|
||
```
|
||
NAME READY STATUS RESTARTS AGE
|
||
zk-0 0/1 Pending 0 0s
|
||
zk-0 0/1 Pending 0 0s
|
||
zk-0 0/1 ContainerCreating 0 0s
|
||
zk-0 0/1 Running 0 19s
|
||
zk-0 1/1 Running 0 40s
|
||
zk-1 0/1 Pending 0 0s
|
||
zk-1 0/1 Pending 0 0s
|
||
zk-1 0/1 ContainerCreating 0 0s
|
||
zk-1 0/1 Running 0 18s
|
||
zk-1 1/1 Running 0 40s
|
||
zk-2 0/1 Pending 0 0s
|
||
zk-2 0/1 Pending 0 0s
|
||
zk-2 0/1 ContainerCreating 0 0s
|
||
zk-2 0/1 Running 0 19s
|
||
zk-2 1/1 Running 0 40s
|
||
```
|
||
|
||
<!--
|
||
The A records for each Pod are entered when the Pod becomes Ready. Therefore,
|
||
the FQDNs of the ZooKeeper servers will resolve to a single endpoint, and that
|
||
endpoint will be the unique ZooKeeper server claiming the identity configured
|
||
in its `myid` file.
|
||
-->
|
||
每个 Pod 的 A 记录仅在 Pod 变成 Ready状态时被录入。
|
||
因此，ZooKeeper 服务器的 FQDNs 只会解析到一个端点，而那个端点将会是
|
||
一个唯一的 ZooKeeper 服务器，这个服务器声明了配置在它的 `myid`
|
||
文件中的标识符。
|
||
|
||
```
|
||
zk-0.zk-hs.default.svc.cluster.local
|
||
zk-1.zk-hs.default.svc.cluster.local
|
||
zk-2.zk-hs.default.svc.cluster.local
|
||
```
|
||
|
||
<!--
|
||
This ensures that the `servers` properties in the ZooKeepers' `zoo.cfg` files
|
||
represents a correctly configured ensemble.
|
||
-->
|
||
|
||
这保证了 ZooKeepers 的 `zoo.cfg` 文件中的 `servers` 属性代表了
|
||
一个正确配置的 ensemble。
|
||
|
||
```
|
||
server.1=zk-0.zk-hs.default.svc.cluster.local:2888:3888
|
||
server.2=zk-1.zk-hs.default.svc.cluster.local:2888:3888
|
||
server.3=zk-2.zk-hs.default.svc.cluster.local:2888:3888
|
||
```
|
||
|
||
<!--
|
||
When the servers use the Zab protocol to attempt to commit a value, they will either achieve consensus and commit the value (if leader election has succeeded and at least two of the Pods are Running and Ready), or they will fail to do so (if either of the conditions are not met). No state will arise where one server acknowledges a write on behalf of another.
|
||
-->
|
||
当服务器使用 Zab 协议尝试提交一个值的时候，它们会达成一致并成功提交这个值
|
||
（如果领导者选举成功并且至少有两个 Pods 处于 Running 和 Ready状态），
|
||
或者将会失败（如果没有满足上述条件中的任意一条）。
|
||
当一个服务器承认另一个服务器的代写时不会有状态产生。
|
||
|
||
<!--
|
||
### Sanity Testing the Ensemble
|
||
|
||
The most basic sanity test is to write data to one ZooKeeper server and
|
||
to read the data from another.
|
||
|
||
The command below executes the `zkCli.sh` script to write `world` to the path `/hello` on the `zk-0` Pod in the ensemble.
|
||
-->
|
||
### Ensemble 健康检查
|
||
|
||
最基本的健康检查是向一个 ZooKeeper 服务器写入一些数据，然后从
|
||
另一个服务器读取这些数据。
|
||
|
||
使用 `zkCli.sh` 脚本在 `zk-0` Pod 上写入 `world` 到路径 `/hello`。
|
||
|
||
```shell
|
||
kubectl exec zk-0 zkCli.sh create /hello world
|
||
```
|
||
```
|
||
WATCHER::
|
||
|
||
WatchedEvent state:SyncConnected type:None path:null
|
||
Created /hello
|
||
```
|
||
|
||
<!--
|
||
To get the data from the `zk-1` Pod use the following command.
|
||
-->
|
||
使用下面的命令从 `zk-1` Pod 获取数据。
|
||
|
||
```shell
|
||
kubectl exec zk-1 zkCli.sh get /hello
|
||
```
|
||
|
||
<!--
|
||
The data that you created on `zk-0` is available on all the servers in the
|
||
ensemble.
|
||
-->
|
||
你在 `zk-0` 上创建的数据在 ensemble 中所有的服务器上都是可用的。
|
||
|
||
```
|
||
WATCHER::
|
||
|
||
WatchedEvent state:SyncConnected type:None path:null
|
||
world
|
||
cZxid = 0x100000002
|
||
ctime = Thu Dec 08 15:13:30 UTC 2016
|
||
mZxid = 0x100000002
|
||
mtime = Thu Dec 08 15:13:30 UTC 2016
|
||
pZxid = 0x100000002
|
||
cversion = 0
|
||
dataVersion = 0
|
||
aclVersion = 0
|
||
ephemeralOwner = 0x0
|
||
dataLength = 5
|
||
numChildren = 0
|
||
```
|
||
|
||
<!--
|
||
### Providing Durable Storage
|
||
|
||
As mentioned in the [ZooKeeper Basics](#zookeeper-basics) section,
|
||
ZooKeeper commits all entries to a durable WAL, and periodically writes snapshots
|
||
in memory state, to storage media. Using WALs to provide durability is a common
|
||
technique for applications that use consensus protocols to achieve a replicated
|
||
state machine.
|
||
|
||
Use the [`kubectl delete`](/docs/reference/generated/kubectl/kubectl-commands/#delete) command to delete the
|
||
`zk` StatefulSet.
|
||
-->
|
||
### 提供持久存储
|
||
|
||
如同在 [ZooKeeper](#zookeeper-basics) 一节所提到的，ZooKeeper 提交
|
||
所有的条目到一个持久 WAL，并周期性的将内存快照写入存储介质。
|
||
对于使用一致性协议实现一个复制状态机的应用来说，使用 WALs 提供持久化
|
||
是一种常用的技术，对于普通的存储应用也是如此。
|
||
|
||
使用 [`kubectl delete`](/docs/reference/generated/kubectl/kubectl-commands/#delete)
|
||
删除 `zk` StatefulSet。
|
||
|
||
```shell
|
||
kubectl delete statefulset zk
|
||
```
|
||
|
||
```
|
||
statefulset.apps "zk" deleted
|
||
```
|
||
|
||
<!--
|
||
Watch the termination of the Pods in the StatefulSet.
|
||
-->
|
||
观察 StatefulSet 中的 Pods 变为终止状态。
|
||
|
||
```shell
|
||
kubectl get pods -w -l app=zk
|
||
```
|
||
|
||
<!--
|
||
When `zk-0` if fully terminated, use `CTRL-C` to terminate kubectl.
|
||
-->
|
||
当 `zk-0` 完全终止时，使用 `CRTL-C` 结束 kubectl。
|
||
|
||
```
|
||
zk-2 1/1 Terminating 0 9m
|
||
zk-0 1/1 Terminating 0 11m
|
||
zk-1 1/1 Terminating 0 10m
|
||
zk-2 0/1 Terminating 0 9m
|
||
zk-2 0/1 Terminating 0 9m
|
||
zk-2 0/1 Terminating 0 9m
|
||
zk-1 0/1 Terminating 0 10m
|
||
zk-1 0/1 Terminating 0 10m
|
||
zk-1 0/1 Terminating 0 10m
|
||
zk-0 0/1 Terminating 0 11m
|
||
zk-0 0/1 Terminating 0 11m
|
||
zk-0 0/1 Terminating 0 11m
|
||
```
|
||
|
||
<!--
|
||
Reapply the manifest in `zookeeper.yaml`.
|
||
-->
|
||
重新应用 `zookeeper.yaml` 中的清单。
|
||
|
||
```shell
|
||
kubectl apply -f https://k8s.io/examples/application/zookeeper/zookeeper.yaml
|
||
```
|
||
|
||
<!--
|
||
This creates the `zk` StatefulSet object, but the other API objects in the manifest are not modified because they already exist.
|
||
|
||
Watch the StatefulSet controller recreate the StatefulSet's Pods.
|
||
-->
|
||
`zk` StatefulSet 将会被创建。由于清单中的其他 API 对象已经存在，所以它们不会被修改。
|
||
|
||
观察 StatefulSet 控制器重建 StatefulSet 的 Pods。
|
||
|
||
```shell
|
||
kubectl get pods -w -l app=zk
|
||
```
|
||
|
||
<!--
|
||
Once the `zk-2` Pod is Running and Ready, use `CTRL-C` to terminate kubectl.
|
||
-->
|
||
一旦 `zk-2` Pod 处于 Running 和 Ready 状态，使用 `CRTL-C` 停止 kubectl命令。
|
||
|
||
```
|
||
NAME READY STATUS RESTARTS AGE
|
||
zk-0 0/1 Pending 0 0s
|
||
zk-0 0/1 Pending 0 0s
|
||
zk-0 0/1 ContainerCreating 0 0s
|
||
zk-0 0/1 Running 0 19s
|
||
zk-0 1/1 Running 0 40s
|
||
zk-1 0/1 Pending 0 0s
|
||
zk-1 0/1 Pending 0 0s
|
||
zk-1 0/1 ContainerCreating 0 0s
|
||
zk-1 0/1 Running 0 18s
|
||
zk-1 1/1 Running 0 40s
|
||
zk-2 0/1 Pending 0 0s
|
||
zk-2 0/1 Pending 0 0s
|
||
zk-2 0/1 ContainerCreating 0 0s
|
||
zk-2 0/1 Running 0 19s
|
||
zk-2 1/1 Running 0 40s
|
||
```
|
||
|
||
<!--
|
||
Use the command below to get the value you entered during the [sanity test](#sanity-testing-the-ensemble),
|
||
from the `zk-2` Pod.
|
||
-->
|
||
从 `zk-2` Pod 中获取你在[健康检查](#Ensemble-健康检查)中输入的值。
|
||
|
||
```shell
|
||
kubectl exec zk-2 zkCli.sh get /hello
|
||
```
|
||
|
||
<!--
|
||
Even though you terminated and recreated all of the Pods in the `zk` StatefulSet, the ensemble still serves the original value.
|
||
-->
|
||
尽管 `zk` StatefulSet 中所有的 Pods 都已经被终止并重建过，ensemble
|
||
仍然使用原来的数值提供服务。
|
||
|
||
```
|
||
WATCHER::
|
||
|
||
WatchedEvent state:SyncConnected type:None path:null
|
||
world
|
||
cZxid = 0x100000002
|
||
ctime = Thu Dec 08 15:13:30 UTC 2016
|
||
mZxid = 0x100000002
|
||
mtime = Thu Dec 08 15:13:30 UTC 2016
|
||
pZxid = 0x100000002
|
||
cversion = 0
|
||
dataVersion = 0
|
||
aclVersion = 0
|
||
ephemeralOwner = 0x0
|
||
dataLength = 5
|
||
numChildren = 0
|
||
```
|
||
|
||
<!--
|
||
The `volumeClaimTemplates` field of the `zk` StatefulSet's `spec` specifies a PersistentVolume provisioned for each Pod.
|
||
-->
|
||
`zk` StatefulSet 的 `spec` 中的 `volumeClaimTemplates` 字段标识了
|
||
将要为每个 Pod 准备的 PersistentVolume。
|
||
|
||
```yaml
|
||
volumeClaimTemplates:
|
||
- metadata:
|
||
name: datadir
|
||
annotations:
|
||
volume.alpha.kubernetes.io/storage-class: anything
|
||
spec:
|
||
accessModes: [ "ReadWriteOnce" ]
|
||
resources:
|
||
requests:
|
||
storage: 20Gi
|
||
```
|
||
|
||
<!--
|
||
The `StatefulSet` controller generates a `PersistentVolumeClaim` for each Pod in
|
||
the `StatefulSet`.
|
||
|
||
Use the following command to get the `StatefulSet`'s `PersistentVolumeClaims`.
|
||
-->
|
||
`StatefulSet` 控制器为 `StatefulSet` 中的每个 Pod 生成一个 `PersistentVolumeClaim`。
|
||
|
||
获取 `StatefulSet` 的 `PersistentVolumeClaim`。
|
||
|
||
```shell
|
||
kubectl get pvc -l app=zk
|
||
```
|
||
|
||
<!--
|
||
When the `StatefulSet` recreated its Pods, it remounts the Pods' PersistentVolumes.
|
||
-->
|
||
当 `StatefulSet` 重新创建它的 Pods 时，Pods 的 PersistentVolumes 会被重新挂载。
|
||
|
||
```
|
||
NAME STATUS VOLUME CAPACITY ACCESSMODES AGE
|
||
datadir-zk-0 Bound pvc-bed742cd-bcb1-11e6-994f-42010a800002 20Gi RWO 1h
|
||
datadir-zk-1 Bound pvc-bedd27d2-bcb1-11e6-994f-42010a800002 20Gi RWO 1h
|
||
datadir-zk-2 Bound pvc-bee0817e-bcb1-11e6-994f-42010a800002 20Gi RWO 1h
|
||
```
|
||
|
||
<!--
|
||
The `volumeMounts` section of the `StatefulSet`'s container `template` mounts the PersistentVolumes in the ZooKeeper servers' data directories.
|
||
-->
|
||
StatefulSet 的容器 `template` 中的 `volumeMounts` 一节使得
|
||
PersistentVolumes 被挂载到 ZooKeeper 服务器的数据目录。
|
||
|
||
```yaml
|
||
volumeMounts:
|
||
- name: datadir
|
||
mountPath: /var/lib/zookeeper
|
||
```
|
||
|
||
<!--
|
||
When a Pod in the `zk` `StatefulSet` is (re)scheduled, it will always have the
|
||
same `PersistentVolume` mounted to the ZooKeeper server's data directory.
|
||
Even when the Pods are rescheduled, all the writes made to the ZooKeeper
|
||
servers' WALs, and all their snapshots, remain durable.
|
||
-->
|
||
当 `zk` `StatefulSet` 中的一个 Pod 被（重新）调度时，它总是拥有相同的 PersistentVolume，
|
||
挂载到 ZooKeeper 服务器的数据目录。
|
||
即使在 Pods 被重新调度时，所有对 ZooKeeper 服务器的 WALs 的写入和它们的
|
||
全部快照都仍然是持久的。
|
||
|
||
<!--
|
||
## Ensuring consistent configuration
|
||
|
||
As noted in the [Facilitating Leader Election](#facilitating-leader-election) and
|
||
[Achieving Consensus](#achieving-consensus) sections, the servers in a
|
||
ZooKeeper ensemble require consistent configuration to elect a leader
|
||
and form a quorum. They also require consistent configuration of the Zab protocol
|
||
in order for the protocol to work correctly over a network. In our example we
|
||
achieve consistent configuration by embedding the configuration directly into
|
||
the manifest.
|
||
|
||
Get the `zk` StatefulSet.
|
||
-->
|
||
## 确保一致性配置
|
||
|
||
如同在[促成领导者选举](#facilitating-leader-election) 和[达成一致](#achieving-consensus)
|
||
小节中提到的，ZooKeeper ensemble 中的服务器需要一致性的配置来选举一个领导者并形成一个
|
||
quorum。它们还需要 Zab 协议的一致性配置来保证这个协议在网络中正确的工作。
|
||
在这次的示例中，我们通过直接将配置写入代码清单中来达到该目的。
|
||
|
||
获取 `zk` StatefulSet。
|
||
|
||
```shell
|
||
kubectl get sts zk -o yaml
|
||
```
|
||
```
|
||
...
|
||
command:
|
||
- sh
|
||
- -c
|
||
- "start-zookeeper \
|
||
--servers=3 \
|
||
--data_dir=/var/lib/zookeeper/data \
|
||
--data_log_dir=/var/lib/zookeeper/data/log \
|
||
--conf_dir=/opt/zookeeper/conf \
|
||
--client_port=2181 \
|
||
--election_port=3888 \
|
||
--server_port=2888 \
|
||
--tick_time=2000 \
|
||
--init_limit=10 \
|
||
--sync_limit=5 \
|
||
--heap=512M \
|
||
--max_client_cnxns=60 \
|
||
--snap_retain_count=3 \
|
||
--purge_interval=12 \
|
||
--max_session_timeout=40000 \
|
||
--min_session_timeout=4000 \
|
||
--log_level=INFO"
|
||
...
|
||
```
|
||
|
||
<!--
|
||
The command used to start the ZooKeeper servers passed the configuration as command line parameter. You can also use environment variables to pass configuration to the ensemble.
|
||
-->
|
||
用于启动 ZooKeeper 服务器的命令将这些配置作为命令行参数传给了 ensemble。
|
||
你也可以通过环境变量来传入这些配置。
|
||
|
||
<!--
|
||
### Configuring Logging
|
||
|
||
One of the files generated by the `zkGenConfig.sh` script controls ZooKeeper's logging.
|
||
ZooKeeper uses [Log4j](https://logging.apache.org/log4j/2.x/), and, by default,
|
||
it uses a time and size based rolling file appender for its logging configuration.
|
||
|
||
Use the command below to get the logging configuration from one of Pods in the `zk` `StatefulSet`.
|
||
-->
|
||
### 配置日志 {#configuring-logging}
|
||
|
||
`zkGenConfig.sh` 脚本产生的一个文件控制了 ZooKeeper 的日志行为。
|
||
ZooKeeper 使用了 [Log4j](http://logging.apache.org/log4j/2.x/) 并默认使用
|
||
基于文件大小和时间的滚动文件追加器作为日志配置。
|
||
|
||
从 `zk` StatefulSet 的一个 Pod 中获取日志配置。
|
||
|
||
```shell
|
||
kubectl exec zk-0 cat /usr/etc/zookeeper/log4j.properties
|
||
```
|
||
|
||
<!--
|
||
The logging configuration below will cause the ZooKeeper process to write all
|
||
of its logs to the standard output file stream.
|
||
-->
|
||
下面的日志配置会使 ZooKeeper 进程将其所有的日志写入标志输出文件流中。
|
||
|
||
```
|
||
zookeeper.root.logger=CONSOLE
|
||
zookeeper.console.threshold=INFO
|
||
log4j.rootLogger=${zookeeper.root.logger}
|
||
log4j.appender.CONSOLE=org.apache.log4j.ConsoleAppender
|
||
log4j.appender.CONSOLE.Threshold=${zookeeper.console.threshold}
|
||
log4j.appender.CONSOLE.layout=org.apache.log4j.PatternLayout
|
||
log4j.appender.CONSOLE.layout.ConversionPattern=%d{ISO8601} [myid:%X{myid}] - %-5p [%t:%C{1}@%L] - %m%n
|
||
```
|
||
|
||
<!--
|
||
This is the simplest possible way to safely log inside the container.
|
||
Because the applications write logs to standard out, Kubernetes will handle log rotation for you.
|
||
Kubernetes also implements a sane retention policy that ensures application logs written to
|
||
standard out and standard error do not exhaust local storage media.
|
||
|
||
Use [`kubectl logs`](/docs/reference/generated/kubectl/kubectl-commands/#logs) to retrieve the last 20 log lines from one of the Pods.
|
||
-->
|
||
这是在容器里安全记录日志的最简单的方法。
|
||
由于应用的日志被写入标准输出，Kubernetes 将会为你处理日志轮转。
|
||
Kubernetes 还实现了一个智能保存策略，保证写入标准输出和标准错误流
|
||
的应用日志不会耗尽本地存储媒介。
|
||
|
||
使用命令 [`kubectl logs`](/docs/reference/generated/kubectl/kubectl-commands/#logs)
|
||
从一个 Pod 中取回最后 20 行日志。
|
||
|
||
```shell
|
||
kubectl logs zk-0 --tail 20
|
||
```
|
||
|
||
<!--
|
||
You can view application logs written to standard out or standard error using `kubectl logs` and from the Kubernetes Dashboard.
|
||
-->
|
||
使用 `kubectl logs` 或者从 Kubernetes Dashboard 可以查看写入到标准输出和标准错误流中的应用日志。
|
||
|
||
```
|
||
2016-12-06 19:34:16,236 [myid:1] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@827] - Processing ruok command from /127.0.0.1:52740
|
||
2016-12-06 19:34:16,237 [myid:1] - INFO [Thread-1136:NIOServerCnxn@1008] - Closed socket connection for client /127.0.0.1:52740 (no session established for client)
|
||
2016-12-06 19:34:26,155 [myid:1] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:52749
|
||
2016-12-06 19:34:26,155 [myid:1] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@827] - Processing ruok command from /127.0.0.1:52749
|
||
2016-12-06 19:34:26,156 [myid:1] - INFO [Thread-1137:NIOServerCnxn@1008] - Closed socket connection for client /127.0.0.1:52749 (no session established for client)
|
||
2016-12-06 19:34:26,222 [myid:1] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:52750
|
||
2016-12-06 19:34:26,222 [myid:1] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@827] - Processing ruok command from /127.0.0.1:52750
|
||
2016-12-06 19:34:26,226 [myid:1] - INFO [Thread-1138:NIOServerCnxn@1008] - Closed socket connection for client /127.0.0.1:52750 (no session established for client)
|
||
2016-12-06 19:34:36,151 [myid:1] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:52760
|
||
2016-12-06 19:34:36,152 [myid:1] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@827] - Processing ruok command from /127.0.0.1:52760
|
||
2016-12-06 19:34:36,152 [myid:1] - INFO [Thread-1139:NIOServerCnxn@1008] - Closed socket connection for client /127.0.0.1:52760 (no session established for client)
|
||
2016-12-06 19:34:36,230 [myid:1] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:52761
|
||
2016-12-06 19:34:36,231 [myid:1] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@827] - Processing ruok command from /127.0.0.1:52761
|
||
2016-12-06 19:34:36,231 [myid:1] - INFO [Thread-1140:NIOServerCnxn@1008] - Closed socket connection for client /127.0.0.1:52761 (no session established for client)
|
||
2016-12-06 19:34:46,149 [myid:1] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:52767
|
||
2016-12-06 19:34:46,149 [myid:1] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@827] - Processing ruok command from /127.0.0.1:52767
|
||
2016-12-06 19:34:46,149 [myid:1] - INFO [Thread-1141:NIOServerCnxn@1008] - Closed socket connection for client /127.0.0.1:52767 (no session established for client)
|
||
2016-12-06 19:34:46,230 [myid:1] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@192] - Accepted socket connection from /127.0.0.1:52768
|
||
2016-12-06 19:34:46,230 [myid:1] - INFO [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@827] - Processing ruok command from /127.0.0.1:52768
|
||
2016-12-06 19:34:46,230 [myid:1] - INFO [Thread-1142:NIOServerCnxn@1008] - Closed socket connection for client /127.0.0.1:52768 (no session established for client)
|
||
```
|
||
|
||
<!--
|
||
Kubernetes integrates with many logging solutions. You can choose a logging solution
|
||
that best fits your cluster and applications. For cluster-level logging and aggregation,
|
||
consider deploying a [sidecar container](/docs/concepts/cluster-administration/logging#sidecar-container-with-logging-agent) to rotate and ship your logs.
|
||
-->
|
||
Kubernetes 支持与多种日志方案集成。你可以选择一个最适合你的集群和应用
|
||
的日志解决方案。对于集群级别的日志输出与整合，可以考虑部署一个
|
||
[边车容器](/zh/docs/concepts/cluster-administration/logging#sidecar-container-with-logging-agent)
|
||
来轮转和提供日志数据。
|
||
|
||
<!--
|
||
### Configuring a non-privileged user
|
||
|
||
The best practices to allow an application to run as a privileged
|
||
user inside of a container are a matter of debate. If your organization requires
|
||
that applications run as a non-privileged user you can use a
|
||
[SecurityContext](/docs/tasks/configure-pod-container/security-context/) to control the user that
|
||
the entry point runs as.
|
||
|
||
The `zk` `StatefulSet`'s Pod `template` contains a `SecurityContext`.
|
||
-->
|
||
### 配置非特权用户
|
||
|
||
在容器中允许应用以特权用户运行这条最佳实践是值得商讨的。
|
||
如果你的组织要求应用以非特权用户运行，你可以使用
|
||
[SecurityContext](/zh/docs/tasks/configure-pod-container/security-context/)
|
||
控制运行容器入口点所使用的用户。
|
||
|
||
`zk` StatefulSet 的 Pod 的 `template` 包含了一个 `SecurityContext`。
|
||
|
||
```yaml
|
||
securityContext:
|
||
runAsUser: 1000
|
||
fsGroup: 1000
|
||
```
|
||
|
||
<!--
|
||
In the Pods' containers, UID 1000 corresponds to the zookeeper user and GID 1000
|
||
corresponds to the zookeeper group.
|
||
|
||
Get the ZooKeeper process information from the `zk-0` Pod.
|
||
-->
|
||
在 Pods 的容器内部，UID 1000 对应用户 zookeeper，GID 1000 对应用户组 zookeeper。
|
||
|
||
从 `zk-0` Pod 获取 ZooKeeper 进程信息。
|
||
|
||
```shell
|
||
kubectl exec zk-0 -- ps -elf
|
||
```
|
||
|
||
<!--
|
||
As the `runAsUser` field of the `securityContext` object is set to 1000,
|
||
instead of running as root, the ZooKeeper process runs as the zookeeper user.
|
||
-->
|
||
由于 `securityContext` 对象的 `runAsUser` 字段被设置为 1000 而不是 root，
|
||
ZooKeeper 进程将以 zookeeper 用户运行。
|
||
|
||
```
|
||
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
|
||
4 S zookeep+ 1 0 0 80 0 - 1127 - 20:46 ? 00:00:00 sh -c zkGenConfig.sh && zkServer.sh start-foreground
|
||
0 S zookeep+ 27 1 0 80 0 - 1155556 - 20:46 ? 00:00:19 /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Dzookeeper.log.dir=/var/log/zookeeper -Dzookeeper.root.logger=INFO,CONSOLE -cp /usr/bin/../build/classes:/usr/bin/../build/lib/*.jar:/usr/bin/../share/zookeeper/zookeeper-3.4.9.jar:/usr/bin/../share/zookeeper/slf4j-log4j12-1.6.1.jar:/usr/bin/../share/zookeeper/slf4j-api-1.6.1.jar:/usr/bin/../share/zookeeper/netty-3.10.5.Final.jar:/usr/bin/../share/zookeeper/log4j-1.2.16.jar:/usr/bin/../share/zookeeper/jline-0.9.94.jar:/usr/bin/../src/java/lib/*.jar:/usr/bin/../etc/zookeeper: -Xmx2G -Xms2G -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.local.only=false org.apache.zookeeper.server.quorum.QuorumPeerMain /usr/bin/../etc/zookeeper/zoo.cfg
|
||
```
|
||
|
||
<!--
|
||
By default, when the Pod's PersistentVolumes is mounted to the ZooKeeper server's data directory, it is only accessible by the root user. This configuration prevents the ZooKeeper process from writing to its WAL and storing its snapshots.
|
||
|
||
Use the command below to get the file permissions of the ZooKeeper data directory on the `zk-0` Pod.
|
||
-->
|
||
默认情况下，当 Pod 的 PersistentVolume 被挂载到 ZooKeeper 服务器的数据目录时，
|
||
它只能被 root 用户访问。这个配置将阻止 ZooKeeper 进程写入它的 WAL 及保存快照。
|
||
|
||
在 `zk-0` Pod 上获取 ZooKeeper 数据目录的文件权限。
|
||
|
||
```shell
|
||
kubectl exec -ti zk-0 -- ls -ld /var/lib/zookeeper/data
|
||
```
|
||
|
||
<!--
|
||
Because the `fsGroup` field of the `securityContext` object is set to 1000, the ownership of the Pods' PersistentVolumes is set to the zookeeper group, and the ZooKeeper process is able to read and write its data.
|
||
-->
|
||
由于 `securityContext` 对象的 `fsGroup` 字段设置为 1000，Pods 的
|
||
PersistentVolumes 的所有权属于 zookeeper 用户组，因而 ZooKeeper
|
||
进程能够成功地读写数据。
|
||
|
||
```
|
||
drwxr-sr-x 3 zookeeper zookeeper 4096 Dec 5 20:45 /var/lib/zookeeper/data
|
||
```
|
||
|
||
<!--
|
||
## Managing the ZooKeeper Process
|
||
|
||
The [ZooKeeper documentation](https://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_supervision)
|
||
mentions that "You will want to have a supervisory process that
|
||
manages each of your ZooKeeper server processes (JVM)." Utilizing a watchdog
|
||
(supervisory process) to restart failed processes in a distributed system is a
|
||
common pattern. When deploying an application in Kubernetes, rather than using
|
||
an external utility as a supervisory process, you should use Kubernetes as the
|
||
watchdog for your application.
|
||
-->
|
||
## 管理 ZooKeeper 进程
|
||
|
||
[ZooKeeper 文档](https://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_supervision)
|
||
指出“你将需要一个监管程序用于管理每个 ZooKeeper 服务进程（JVM）”。
|
||
在分布式系统中，使用一个看门狗（监管程序）来重启故障进程是一种常用的模式。
|
||
|
||
<!--
|
||
### Updating the ensemble
|
||
|
||
The `zk` `StatefulSet` is configured to use the `RollingUpdate` update strategy.
|
||
|
||
You can use `kubectl patch` to update the number of `cpus` allocated to the servers.
|
||
-->
|
||
### 更新 Ensemble
|
||
|
||
`zk` `StatefulSet` 的更新策略被设置为了 `RollingUpdate`。
|
||
|
||
你可以使用 `kubectl patch` 更新分配给每个服务器的 `cpus` 的数量。
|
||
|
||
```shell
|
||
kubectl patch sts zk --type='json' -p='[{"op": "replace", "path": "/spec/template/spec/containers/0/resources/requests/cpu", "value":"0.3"}]'
|
||
```
|
||
|
||
```
|
||
statefulset.apps/zk patched
|
||
```
|
||
|
||
<!--
|
||
Use `kubectl rollout status` to watch the status of the update.
|
||
-->
|
||
使用 `kubectl rollout status` 观测更新状态。
|
||
|
||
```shell
|
||
kubectl rollout status sts/zk
|
||
```
|
||
|
||
```
|
||
waiting for statefulset rolling update to complete 0 pods at revision zk-5db4499664...
|
||
Waiting for 1 pods to be ready...
|
||
Waiting for 1 pods to be ready...
|
||
waiting for statefulset rolling update to complete 1 pods at revision zk-5db4499664...
|
||
Waiting for 1 pods to be ready...
|
||
Waiting for 1 pods to be ready...
|
||
waiting for statefulset rolling update to complete 2 pods at revision zk-5db4499664...
|
||
Waiting for 1 pods to be ready...
|
||
Waiting for 1 pods to be ready...
|
||
statefulset rolling update complete 3 pods at revision zk-5db4499664...
|
||
```
|
||
|
||
<!--
|
||
This terminates the Pods, one at a time, in reverse ordinal order, and recreates them with the new configuration. This ensures that quorum is maintained during a rolling update.
|
||
|
||
Use the `kubectl rollout history` command to view a history or previous configurations.
|
||
-->
|
||
这项操作会逆序地依次终止每一个 Pod，并用新的配置重新创建。
|
||
这样做确保了在滚动更新的过程中 quorum 依旧保持工作。
|
||
|
||
使用 `kubectl rollout history` 命令查看历史或先前的配置。
|
||
|
||
```shell
|
||
kubectl rollout history sts/zk
|
||
```
|
||
|
||
```
|
||
statefulsets "zk"
|
||
REVISION
|
||
1
|
||
2
|
||
```
|
||
|
||
<!--
|
||
Use the `kubectl rollout undo` command to roll back the modification.
|
||
-->
|
||
使用 `kubectl rollout undo` 命令撤销这次的改动。
|
||
|
||
```shell
|
||
kubectl rollout undo sts/zk
|
||
```
|
||
|
||
```
|
||
statefulset.apps/zk rolled back
|
||
```
|
||
|
||
<!--
|
||
### Handling process failure
|
||
|
||
[Restart Policies](/docs/concepts/workloads/pods/pod-lifecycle/#restart-policy) control how
|
||
Kubernetes handles process failures for the entry point of the container in a Pod.
|
||
For Pods in a `StatefulSet`, the only appropriate `RestartPolicy` is Always, and this
|
||
is the default value. For stateful applications you should **never** override
|
||
the default policy.
|
||
|
||
Use the following command to examine the process tree for the ZooKeeper server running in the `zk-0` Pod.
|
||
-->
|
||
### 处理进程故障
|
||
|
||
[重启策略](/zh/docs/concepts/workloads/pods/pod-lifecycle/#restart-policy)
|
||
控制 Kubernetes 如何处理一个 Pod 中容器入口点的进程故障。
|
||
对于 StatefulSet 中的 Pods 来说，Always 是唯一合适的 RestartPolicy，也是默认值。
|
||
你应该**绝不**覆盖有状态应用的默认策略。
|
||
|
||
检查 `zk-0` Pod 中运行的 ZooKeeper 服务器的进程树。
|
||
|
||
```shell
|
||
kubectl exec zk-0 -- ps -ef
|
||
```
|
||
|
||
<!--
|
||
The command used as the container's entry point has PID 1, and
|
||
the ZooKeeper process, a child of the entry point, has PID 27.
|
||
-->
|
||
作为容器入口点的命令的 PID 为 1，Zookeeper 进程是入口点的子进程，
|
||
PID 为 27。
|
||
|
||
```
|
||
UID PID PPID C STIME TTY TIME CMD
|
||
zookeep+ 1 0 0 15:03 ? 00:00:00 sh -c zkGenConfig.sh && zkServer.sh start-foreground
|
||
zookeep+ 27 1 0 15:03 ? 00:00:03 /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Dzookeeper.log.dir=/var/log/zookeeper -Dzookeeper.root.logger=INFO,CONSOLE -cp /usr/bin/../build/classes:/usr/bin/../build/lib/*.jar:/usr/bin/../share/zookeeper/zookeeper-3.4.9.jar:/usr/bin/../share/zookeeper/slf4j-log4j12-1.6.1.jar:/usr/bin/../share/zookeeper/slf4j-api-1.6.1.jar:/usr/bin/../share/zookeeper/netty-3.10.5.Final.jar:/usr/bin/../share/zookeeper/log4j-1.2.16.jar:/usr/bin/../share/zookeeper/jline-0.9.94.jar:/usr/bin/../src/java/lib/*.jar:/usr/bin/../etc/zookeeper: -Xmx2G -Xms2G -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.local.only=false org.apache.zookeeper.server.quorum.QuorumPeerMain /usr/bin/../etc/zookeeper/zoo.cfg
|
||
```
|
||
|
||
<!--
|
||
In another terminal watch the Pods in the `zk` `StatefulSet` with the following command.
|
||
-->
|
||
在一个终端观察 `zk` `StatefulSet` 中的 Pods。
|
||
|
||
```shell
|
||
kubectl get pod -w -l app=zk
|
||
```
|
||
|
||
<!--
|
||
In another terminal, terminate the ZooKeeper process in Pod `zk-0` with the following command.
|
||
-->
|
||
在另一个终端杀掉 Pod `zk-0` 中的 ZooKeeper 进程。
|
||
|
||
```shell
|
||
kubectl exec zk-0 -- pkill java
|
||
```
|
||
|
||
<!--
|
||
The termination of the ZooKeeper process caused its parent process to terminate. Because the `RestartPolicy` of the container is Always, it restarted the parent process.
|
||
-->
|
||
ZooKeeper 进程的终结导致了它父进程的终止。由于容器的 `RestartPolicy`
|
||
是 Always，父进程被重启。
|
||
|
||
```
|
||
NAME READY STATUS RESTARTS AGE
|
||
zk-0 1/1 Running 0 21m
|
||
zk-1 1/1 Running 0 20m
|
||
zk-2 1/1 Running 0 19m
|
||
NAME READY STATUS RESTARTS AGE
|
||
zk-0 0/1 Error 0 29m
|
||
zk-0 0/1 Running 1 29m
|
||
zk-0 1/1 Running 1 29m
|
||
```
|
||
|
||
<!--
|
||
If your application uses a script (such as `zkServer.sh`) to launch the process
|
||
that implements the application's business logic, the script must terminate with the
|
||
child process. This ensures that Kubernetes will restart the application's
|
||
container when the process implementing the application's business logic fails.
|
||
-->
|
||
如果你的应用使用一个脚本（例如 `zkServer.sh`）来启动一个实现了应用业务逻辑的进程，
|
||
这个脚本必须和子进程一起结束。这保证了当实现应用业务逻辑的进程故障时，
|
||
Kubernetes 会重启这个应用的容器。
|
||
|
||
<!--
|
||
### Testing for liveness
|
||
|
||
Configuring your application to restart failed processes is not enough to
|
||
keep a distributed system healthy. There are scenarios where
|
||
a system's processes can be both alive and unresponsive, or otherwise
|
||
unhealthy. You should use liveness probes to notify Kubernetes
|
||
that your application's processes are unhealthy and it should restart them.
|
||
|
||
The Pod `template` for the `zk` `StatefulSet` specifies a liveness probe.
|
||
-->
|
||
### 存活性测试
|
||
|
||
你的应用配置为自动重启故障进程，但这对于保持一个分布式系统的健康来说是不够的。
|
||
许多场景下，一个系统进程可以是活动状态但不响应请求，或者是不健康状态。
|
||
你应该使用存活性探针来通知 Kubernetes 你的应用进程处于不健康状态，需要被重启。
|
||
|
||
`zk` `StatefulSet` 的 Pod 的 `template` 一节指定了一个存活探针。
|
||
|
||
```yaml
|
||
livenessProbe:
|
||
exec:
|
||
command:
|
||
- sh
|
||
- -c
|
||
- "zookeeper-ready 2181"
|
||
initialDelaySeconds: 15
|
||
timeoutSeconds: 5
|
||
```
|
||
|
||
<!--
|
||
The probe calls a bash script that uses the ZooKeeper `ruok` four letter
|
||
word to test the server's health.
|
||
-->
|
||
这个探针调用一个简单的 Bash 脚本，使用 ZooKeeper 的四字缩写 `ruok`
|
||
来测试服务器的健康状态。
|
||
|
||
```
|
||
OK=$(echo ruok | nc 127.0.0.1 $1)
|
||
if [ "$OK" == "imok" ]; then
|
||
exit 0
|
||
else
|
||
exit 1
|
||
fi
|
||
```
|
||
|
||
<!--
|
||
In one terminal window, use the following command to watch the Pods in the `zk` StatefulSet.
|
||
-->
|
||
在一个终端窗口中使用下面的命令观察 `zk` StatefulSet 中的 Pods。
|
||
|
||
```shell
|
||
kubectl get pod -w -l app=zk
|
||
```
|
||
|
||
<!--
|
||
In another window, using the following command to delete the `zookeeper-ready` script from the file system of Pod `zk-0`.
|
||
-->
|
||
在另一个窗口中，从 Pod `zk-0` 的文件系统中删除 `zookeeper-ready` 脚本。
|
||
|
||
```shell
|
||
kubectl exec zk-0 -- rm /usr/bin/zookeeper-ready
|
||
```
|
||
|
||
<!--
|
||
When the liveness probe for the ZooKeeper process fails, Kubernetes will
|
||
automatically restart the process for you, ensuring that unhealthy processes in
|
||
the ensemble are restarted.
|
||
-->
|
||
当 ZooKeeper 进程的存活探针探测失败时，Kubernetes 将会为你自动重启这个进程，
|
||
从而保证 ensemble 中不健康状态的进程都被重启。
|
||
|
||
```shell
|
||
kubectl get pod -w -l app=zk
|
||
```
|
||
|
||
```
|
||
NAME READY STATUS RESTARTS AGE
|
||
zk-0 1/1 Running 0 1h
|
||
zk-1 1/1 Running 0 1h
|
||
zk-2 1/1 Running 0 1h
|
||
NAME READY STATUS RESTARTS AGE
|
||
zk-0 0/1 Running 0 1h
|
||
zk-0 0/1 Running 1 1h
|
||
zk-0 1/1 Running 1 1h
|
||
```
|
||
|
||
<!--
|
||
### Testing for readiness
|
||
|
||
Readiness is not the same as liveness. If a process is alive, it is scheduled
|
||
and healthy. If a process is ready, it is able to process input. Liveness is
|
||
a necessary, but not sufficient, condition for readiness. There are cases,
|
||
particularly during initialization and termination, when a process can be
|
||
alive but not ready.
|
||
-->
|
||
### 就绪性测试
|
||
|
||
就绪不同于存活。如果一个进程是存活的，它是可调度和健康的。
|
||
如果一个进程是就绪的，它应该能够处理输入。存活是就绪的必要非充分条件。
|
||
在许多场景下，特别是初始化和终止过程中，一个进程可以是存活但没有就绪的。
|
||
|
||
<!--
|
||
If you specify a readiness probe, Kubernetes will ensure that your application's
|
||
processes will not receive network traffic until their readiness checks pass.
|
||
|
||
For a ZooKeeper server, liveness implies readiness. Therefore, the readiness
|
||
probe from the `zookeeper.yaml` manifest is identical to the liveness probe.
|
||
-->
|
||
如果你指定了一个就绪探针，Kubernetes 将保证在就绪检查通过之前，
|
||
你的应用不会接收到网络流量。
|
||
|
||
对于一个 ZooKeeper 服务器来说，存活即就绪。
|
||
因此 `zookeeper.yaml` 清单中的就绪探针和存活探针完全相同。
|
||
|
||
```yaml
|
||
readinessProbe:
|
||
exec:
|
||
command:
|
||
- sh
|
||
- -c
|
||
- "zookeeper-ready 2181"
|
||
initialDelaySeconds: 15
|
||
timeoutSeconds: 5
|
||
```
|
||
|
||
<!--
|
||
Even though the liveness and readiness probes are identical, it is important
|
||
to specify both. This ensures that only healthy servers in the ZooKeeper
|
||
ensemble receive network traffic.
|
||
-->
|
||
虽然存活探针和就绪探针是相同的，但同时指定它们两者仍然重要。
|
||
这保证了 ZooKeeper ensemble 中只有健康的服务器能接收网络流量。
|
||
|
||
<!--
|
||
## Tolerating node failure
|
||
|
||
ZooKeeper needs a quorum of servers to successfully commit mutations
|
||
to data. For a three server ensemble, two servers must be healthy for
|
||
writes to succeed. In quorum based systems, members are deployed across failure
|
||
domains to ensure availability. To avoid an outage, due to the loss of an
|
||
individual machine, best practices preclude co-locating multiple instances of the
|
||
application on the same machine.
|
||
-->
|
||
## 容忍节点故障
|
||
|
||
ZooKeeper 需要一个 quorum 来提交数据变动。对于一个拥有 3 个服务器的 ensemble 来说，
|
||
必须有两个服务器是健康的，写入才能成功。
|
||
在基于 quorum 的系统里，成员被部署在多个故障域中以保证可用性。
|
||
为了防止由于某台机器断连引起服务中断，最佳实践是防止应用的多个实例在相同的机器上共存。
|
||
|
||
<!--
|
||
By default, Kubernetes may co-locate Pods in a `StatefulSet` on the same node.
|
||
For the three server ensemble you created, if two servers are on the same node, and that node fails,
|
||
the clients of your ZooKeeper service will experience an outage until at least one of the Pods can be rescheduled.
|
||
-->
|
||
默认情况下，Kubernetes 可以把 `StatefulSet` 的 Pods 部署在相同节点上。
|
||
对于你创建的 3 个服务器的 ensemble 来说，如果有两个服务器并存于
|
||
相同的节点上并且该节点发生故障时，ZooKeeper 服务将中断，
|
||
直至至少一个 Pods 被重新调度。
|
||
|
||
<!--
|
||
You should always provision additional capacity to allow the processes of critical
|
||
systems to be rescheduled in the event of node failures. If you do so, then the
|
||
outage will only last until the Kubernetes scheduler reschedules one of the ZooKeeper
|
||
servers. However, if you want your service to tolerate node failures with no downtime,
|
||
you should set `podAntiAffinity`.
|
||
|
||
Use the command below to get the nodes for Pods in the `zk` `StatefulSet`.
|
||
-->
|
||
你应该总是提供多余的容量以允许关键系统进程在节点故障时能够被重新调度。
|
||
如果你这样做了，服务故障就只会持续到 Kubernetes 调度器重新调度某个
|
||
ZooKeeper 服务器为止。
|
||
但是，如果希望你的服务在容忍节点故障时无停服时间，你应该设置 `podAntiAffinity`。
|
||
|
||
使用下面的命令获取 `zk` `StatefulSet` 中的 Pods 的节点。
|
||
|
||
```shell
|
||
for i in 0 1 2; do kubectl get pod zk-$i --template {{.spec.nodeName}}; echo ""; done
|
||
```
|
||
|
||
<!--
|
||
All of the Pods in the `zk` `StatefulSet` are deployed on different nodes.
|
||
-->
|
||
`zk` `StatefulSet` 中所有的 Pods 都被部署在不同的节点。
|
||
|
||
```
|
||
kubernetes-node-cxpk
|
||
kubernetes-node-a5aq
|
||
kubernetes-node-2g2d
|
||
```
|
||
|
||
<!--
|
||
This is because the Pods in the `zk` `StatefulSet` have a `PodAntiAffinity` specified.
|
||
-->
|
||
|
||
这是因为 `zk` `StatefulSet` 中的 Pods 指定了 `PodAntiAffinity`。
|
||
|
||
```yaml
|
||
affinity:
|
||
podAntiAffinity:
|
||
requiredDuringSchedulingIgnoredDuringExecution:
|
||
- labelSelector:
|
||
matchExpressions:
|
||
- key: "app"
|
||
operator: In
|
||
values:
|
||
- zk
|
||
topologyKey: "kubernetes.io/hostname"
|
||
```
|
||
|
||
<!--
|
||
The `requiredDuringSchedulingIgnoredDuringExecution` field tells the
|
||
Kubernetes Scheduler that it should never co-locate two Pods which have `app` label
|
||
as `zk` in the domain defined by the `topologyKey`. The `topologyKey`
|
||
`kubernetes.io/hostname` indicates that the domain is an individual node. Using
|
||
different rules, labels, and selectors, you can extend this technique to spread
|
||
your ensemble across physical, network, and power failure domains.
|
||
-->
|
||
`requiredDuringSchedulingIgnoredDuringExecution` 告诉 Kubernetes 调度器，
|
||
在以 `topologyKey` 指定的域中，绝对不要把带有键为 `app`、值为 `zk` 的标签
|
||
的两个 Pods 调度到相同的节点。`topologyKey` `kubernetes.io/hostname` 表示
|
||
这个域是一个单独的节点。
|
||
使用不同的规则、标签和选择算符，你能够通过这种技术把你的 ensemble 分布
|
||
在不同的物理、网络和电力故障域之间。
|
||
|
||
<!--
|
||
## Surviving maintenance
|
||
|
||
**In this section you will cordon and drain nodes. If you are using this tutorial
|
||
on a shared cluster, be sure that this will not adversely affect other tenants.**
|
||
|
||
The previous section showed you how to spread your Pods across nodes to survive
|
||
unplanned node failures, but you also need to plan for temporary node failures
|
||
that occur due to planned maintenance.
|
||
|
||
Use this command to get the nodes in your cluster.
|
||
-->
|
||
## 节点维护期间保持应用可用
|
||
|
||
**在本节中你将会隔离（Cordon）和腾空（Drain）节点。
|
||
如果你是在一个共享的集群里使用本教程，请保证不会影响到其他租户。**
|
||
|
||
上一小节展示了如何在节点之间分散 Pods 以在计划外的节点故障时保证服务存活。
|
||
但是你也需要为计划内维护引起的临时节点故障做准备。
|
||
|
||
使用此命令获取你的集群中的节点。
|
||
|
||
```shell
|
||
kubectl get nodes
|
||
```
|
||
|
||
<!--
|
||
Use [`kubectl cordon`](/docs/reference/generated/kubectl/kubectl-commands/#cordon) to
|
||
cordon all but four of the nodes in your cluster.
|
||
-->
|
||
|
||
使用 [`kubectl cordon`](/docs/reference/generated/kubectl/kubectl-commands/#cordon)
|
||
隔离你的集群中除 4 个节点以外的所有节点。
|
||
|
||
```shell
|
||
kubectl cordon <node-name>
|
||
```
|
||
|
||
<!--
|
||
Use this command to get the `zk-pdb` `PodDisruptionBudget`.
|
||
-->
|
||
使用下面的命令获取 `zk-pdb` `PodDisruptionBudget`。
|
||
|
||
```shell
|
||
kubectl get pdb zk-pdb
|
||
```
|
||
|
||
<!--
|
||
The `max-unavailable` field indicates to Kubernetes that at most one Pod from
|
||
`zk` `StatefulSet` can be unavailable at any time.
|
||
-->
|
||
`max-unavailable` 字段指示 Kubernetes 在任何时候，`zk` `StatefulSet`
|
||
至多有一个 Pod 是不可用的。
|
||
|
||
```
|
||
NAME MIN-AVAILABLE MAX-UNAVAILABLE ALLOWED-DISRUPTIONS AGE
|
||
zk-pdb N/A 1 1
|
||
```
|
||
|
||
<!--
|
||
In one terminal, use this command to watch the Pods in the `zk` `StatefulSet`.
|
||
-->
|
||
在一个终端中，使用下面的命令观察 `zk` `StatefulSet` 中的 Pods。
|
||
|
||
```shell
|
||
kubectl get pods -w -l app=zk
|
||
```
|
||
|
||
<!--
|
||
In another terminal, use this command to get the nodes that the Pods are currently scheduled on.
|
||
-->
|
||
|
||
在另一个终端中，使用下面的命令获取 Pods 当前调度的节点。
|
||
|
||
```shell
|
||
for i in 0 1 2; do kubectl get pod zk-$i --template {{.spec.nodeName}}; echo ""; done
|
||
```
|
||
|
||
```
|
||
kubernetes-node-pb41
|
||
kubernetes-node-ixsl
|
||
kubernetes-node-i4c4
|
||
```
|
||
|
||
<!--
|
||
Use [`kubectl drain`](/docs/reference/generated/kubectl/kubectl-commands/#drain) to cordon and
|
||
drain the node on which the `zk-0` Pod is scheduled.
|
||
-->
|
||
|
||
使用 [`kubectl drain`](/docs/reference/generated/kubectl/kubectl-commands/#drain)
|
||
来隔离和腾空 `zk-0` Pod 调度所在的节点。
|
||
|
||
```shell
|
||
kubectl drain $(kubectl get pod zk-0 --template {{.spec.nodeName}}) --ignore-daemonsets --force --delete-emptydir-data
|
||
```
|
||
|
||
```
|
||
node "kubernetes-node-pb41" cordoned
|
||
|
||
WARNING: Deleting pods not managed by ReplicationController, ReplicaSet, Job, or DaemonSet: fluentd-cloud-logging-kubernetes-node-pb41, kube-proxy-kubernetes-node-pb41; Ignoring DaemonSet-managed pods: node-problem-detector-v0.1-o5elz
|
||
pod "zk-0" deleted
|
||
node "kubernetes-node-pb41" drained
|
||
```
|
||
|
||
<!--
|
||
As there are four nodes in your cluster, `kubectl drain`, succeeds and the
|
||
`zk-0` is rescheduled to another node.
|
||
-->
|
||
由于你的集群中有 4 个节点, `kubectl drain` 执行成功，`zk-0` 被调度到其它节点。
|
||
|
||
```
|
||
NAME READY STATUS RESTARTS AGE
|
||
zk-0 1/1 Running 2 1h
|
||
zk-1 1/1 Running 0 1h
|
||
zk-2 1/1 Running 0 1h
|
||
NAME READY STATUS RESTARTS AGE
|
||
zk-0 1/1 Terminating 2 2h
|
||
zk-0 0/1 Terminating 2 2h
|
||
zk-0 0/1 Terminating 2 2h
|
||
zk-0 0/1 Terminating 2 2h
|
||
zk-0 0/1 Pending 0 0s
|
||
zk-0 0/1 Pending 0 0s
|
||
zk-0 0/1 ContainerCreating 0 0s
|
||
zk-0 0/1 Running 0 51s
|
||
zk-0 1/1 Running 0 1m
|
||
```
|
||
|
||
<!--
|
||
Keep watching the `StatefulSet`'s Pods in the first terminal and drain the node on which
|
||
`zk-1` is scheduled.
|
||
-->
|
||
在第一个终端中持续观察 `StatefulSet` 的 Pods 并腾空 `zk-1` 调度所在的节点。
|
||
|
||
```shell
|
||
kubectl drain $(kubectl get pod zk-1 --template {{.spec.nodeName}}) --ignore-daemonsets --force -delete-emptydir-data "kubernetes-node-ixsl" cordoned
|
||
```
|
||
|
||
```
|
||
WARNING: Deleting pods not managed by ReplicationController, ReplicaSet, Job, or DaemonSet: fluentd-cloud-logging-kubernetes-node-ixsl, kube-proxy-kubernetes-node-ixsl; Ignoring DaemonSet-managed pods: node-problem-detector-v0.1-voc74
|
||
pod "zk-1" deleted
|
||
node "kubernetes-node-ixsl" drained
|
||
```
|
||
|
||
<!--
|
||
The `zk-1` Pod cannot be scheduled because the `zk` `StatefulSet` contains a `PodAntiAffinity` rule preventing
|
||
co-location of the Pods, and as only two nodes are schedulable, the Pod will remain in a Pending state.
|
||
-->
|
||
`zk-1` Pod 不能被调度，这是因为 `zk` `StatefulSet` 包含了一个防止 Pods
|
||
共存的 `PodAntiAffinity` 规则，而且只有两个节点可用于调度，
|
||
这个 Pod 将保持在 Pending 状态。
|
||
|
||
```shell
|
||
kubectl get pods -w -l app=zk
|
||
```
|
||
|
||
```
|
||
NAME READY STATUS RESTARTS AGE
|
||
zk-0 1/1 Running 2 1h
|
||
zk-1 1/1 Running 0 1h
|
||
zk-2 1/1 Running 0 1h
|
||
NAME READY STATUS RESTARTS AGE
|
||
zk-0 1/1 Terminating 2 2h
|
||
zk-0 0/1 Terminating 2 2h
|
||
zk-0 0/1 Terminating 2 2h
|
||
zk-0 0/1 Terminating 2 2h
|
||
zk-0 0/1 Pending 0 0s
|
||
zk-0 0/1 Pending 0 0s
|
||
zk-0 0/1 ContainerCreating 0 0s
|
||
zk-0 0/1 Running 0 51s
|
||
zk-0 1/1 Running 0 1m
|
||
zk-1 1/1 Terminating 0 2h
|
||
zk-1 0/1 Terminating 0 2h
|
||
zk-1 0/1 Terminating 0 2h
|
||
zk-1 0/1 Terminating 0 2h
|
||
zk-1 0/1 Pending 0 0s
|
||
zk-1 0/1 Pending 0 0s
|
||
```
|
||
|
||
<!--
|
||
Continue to watch the Pods of the StatefulSet, and drain the node on which
|
||
`zk-2` is scheduled.
|
||
-->
|
||
继续观察 StatefulSet 中的 Pods 并腾空 `zk-2` 调度所在的节点。
|
||
|
||
```shell
|
||
kubectl drain $(kubectl get pod zk-2 --template {{.spec.nodeName}}) --ignore-daemonsets --force --delete-emptydir-data
|
||
```
|
||
```
|
||
node "kubernetes-node-i4c4" cordoned
|
||
|
||
WARNING: Deleting pods not managed by ReplicationController, ReplicaSet, Job, or DaemonSet: fluentd-cloud-logging-kubernetes-node-i4c4, kube-proxy-kubernetes-node-i4c4; Ignoring DaemonSet-managed pods: node-problem-detector-v0.1-dyrog
|
||
WARNING: Ignoring DaemonSet-managed pods: node-problem-detector-v0.1-dyrog; Deleting pods not managed by ReplicationController, ReplicaSet, Job, or DaemonSet: fluentd-cloud-logging-kubernetes-node-i4c4, kube-proxy-kubernetes-node-i4c4
|
||
There are pending pods when an error occurred: Cannot evict pod as it would violate the pod's disruption budget.
|
||
pod/zk-2
|
||
```
|
||
|
||
<!--
|
||
Use `CTRL-C` to terminate to kubectl.
|
||
|
||
You cannot drain the third node because evicting `zk-2` would violate `zk-budget`. However, the node will remain cordoned.
|
||
|
||
Use `zkCli.sh` to retrieve the value you entered during the sanity test from `zk-0`.
|
||
-->
|
||
使用 `CTRL-C` 终止 kubectl。
|
||
|
||
你不能腾空第三个节点，因为驱逐 `zk-2` 将和 `zk-budget` 冲突。
|
||
然而这个节点仍然处于隔离状态（Cordoned）。
|
||
|
||
使用 `zkCli.sh` 从 `zk-0` 取回你的健康检查中输入的数值。
|
||
|
||
```shell
|
||
kubectl exec zk-0 zkCli.sh get /hello
|
||
```
|
||
|
||
<!--
|
||
The service is still available because its `PodDisruptionBudget` is respected.
|
||
-->
|
||
由于遵守了 `PodDisruptionBudget`，服务仍然可用。
|
||
|
||
```
|
||
WatchedEvent state:SyncConnected type:None path:null
|
||
world
|
||
cZxid = 0x200000002
|
||
ctime = Wed Dec 07 00:08:59 UTC 2016
|
||
mZxid = 0x200000002
|
||
mtime = Wed Dec 07 00:08:59 UTC 2016
|
||
pZxid = 0x200000002
|
||
cversion = 0
|
||
dataVersion = 0
|
||
aclVersion = 0
|
||
ephemeralOwner = 0x0
|
||
dataLength = 5
|
||
numChildren = 0
|
||
```
|
||
|
||
<!--
|
||
Use [`kubectl uncordon`](/docs/reference/generated/kubectl/kubectl-commands/#uncordon) to uncordon the first node.
|
||
-->
|
||
使用 [`kubectl uncordon`](/docs/reference/generated/kubectl/kubectl-commands/#uncordon)
|
||
来取消对第一个节点的隔离。
|
||
|
||
```shell
|
||
kubectl uncordon kubernetes-node-pb41
|
||
```
|
||
|
||
```
|
||
node "kubernetes-node-pb41" uncordoned
|
||
```
|
||
|
||
<!--
|
||
`zk-1` is rescheduled on this node. Wait until `zk-1` is Running and Ready.
|
||
-->
|
||
`zk-1` 被重新调度到了这个节点。等待 `zk-1` 变为 Running 和 Ready 状态。
|
||
|
||
```shell
|
||
kubectl get pods -w -l app=zk
|
||
```
|
||
|
||
```
|
||
NAME READY STATUS RESTARTS AGE
|
||
zk-0 1/1 Running 2 1h
|
||
zk-1 1/1 Running 0 1h
|
||
zk-2 1/1 Running 0 1h
|
||
NAME READY STATUS RESTARTS AGE
|
||
zk-0 1/1 Terminating 2 2h
|
||
zk-0 0/1 Terminating 2 2h
|
||
zk-0 0/1 Terminating 2 2h
|
||
zk-0 0/1 Terminating 2 2h
|
||
zk-0 0/1 Pending 0 0s
|
||
zk-0 0/1 Pending 0 0s
|
||
zk-0 0/1 ContainerCreating 0 0s
|
||
zk-0 0/1 Running 0 51s
|
||
zk-0 1/1 Running 0 1m
|
||
zk-1 1/1 Terminating 0 2h
|
||
zk-1 0/1 Terminating 0 2h
|
||
zk-1 0/1 Terminating 0 2h
|
||
zk-1 0/1 Terminating 0 2h
|
||
zk-1 0/1 Pending 0 0s
|
||
zk-1 0/1 Pending 0 0s
|
||
zk-1 0/1 Pending 0 12m
|
||
zk-1 0/1 ContainerCreating 0 12m
|
||
zk-1 0/1 Running 0 13m
|
||
zk-1 1/1 Running 0 13m
|
||
```
|
||
|
||
<!--
|
||
Attempt to drain the node on which `zk-2` is scheduled.
|
||
-->
|
||
尝试腾空 `zk-2` 调度所在的节点。
|
||
|
||
```shell
|
||
kubectl drain $(kubectl get pod zk-2 --template {{.spec.nodeName}}) --ignore-daemonsets --force --delete-emptydir-data
|
||
```
|
||
|
||
<!--
|
||
The output:
|
||
-->
|
||
输出：
|
||
|
||
```
|
||
node "kubernetes-node-i4c4" already cordoned
|
||
WARNING: Deleting pods not managed by ReplicationController, ReplicaSet, Job, or DaemonSet: fluentd-cloud-logging-kubernetes-node-i4c4, kube-proxy-kubernetes-node-i4c4; Ignoring DaemonSet-managed pods: node-problem-detector-v0.1-dyrog
|
||
pod "heapster-v1.2.0-2604621511-wht1r" deleted
|
||
pod "zk-2" deleted
|
||
node "kubernetes-node-i4c4" drained
|
||
```
|
||
|
||
<!--
|
||
This time `kubectl drain` succeeds.
|
||
|
||
Uncordon the second node to allow `zk-2` to be rescheduled.
|
||
-->
|
||
这次 `kubectl drain` 执行成功。
|
||
|
||
取消第二个节点的隔离，以允许 `zk-2` 被重新调度。
|
||
|
||
```shell
|
||
kubectl uncordon kubernetes-node-ixsl
|
||
```
|
||
|
||
```
|
||
node "kubernetes-node-ixsl" uncordoned
|
||
```
|
||
|
||
<!--
|
||
You can use `kubectl drain` in conjunction with `PodDisruptionBudgets` to ensure that your services remain available during maintenance.
|
||
If drain is used to cordon nodes and evict pods prior to taking the node offline for maintenance,
|
||
services that express a disruption budget will have that budget respected.
|
||
You should always allocate additional capacity for critical services so that their Pods can be immediately rescheduled.
|
||
-->
|
||
你可以同时使用 `kubectl drain` 和 `PodDisruptionBudgets` 来保证你的服务
|
||
在维护过程中仍然可用。如果使用了腾空操作来隔离节点并在节点离线之前驱逐了 pods，
|
||
那么设置了干扰预算的服务将会遵守该预算。
|
||
你应该总是为关键服务分配额外容量，这样它们的 Pods 就能够迅速的重新调度。
|
||
|
||
## {{% heading "cleanup" %}}
|
||
|
||
<!--
|
||
- Use `kubectl uncordon` to uncordon all the nodes in your cluster.
|
||
- You must delete the persistent storage media for the PersistentVolumes used in this tutorial.
|
||
Follow the necessary steps, based on your environment, storage configuration,
|
||
and provisioning method, to ensure that all storage is reclaimed.
|
||
-->
|
||
* 使用 `kubectl uncordon` 解除你集群中所有节点的隔离。
|
||
* 你需要删除在本教程中使用的 PersistentVolumes 的持久存储媒介。
|
||
请遵循必须的步骤，基于你的环境、存储配置和制备方法，保证回收所有的存储。
|
||
|