1556 lines
71 KiB
Markdown
1556 lines
71 KiB
Markdown
---
|
||
title: 为 Pod 和容器管理资源
|
||
content_type: concept
|
||
weight: 40
|
||
feature:
|
||
title: 自动装箱
|
||
description: >
|
||
根据资源需求和其他限制自动放置容器，同时避免影响可用性。
|
||
将关键性的和尽力而为性质的工作负载进行混合放置，以提高资源利用率并节省更多资源。
|
||
---
|
||
<!--
|
||
title: Resource Management for Pods and Containers
|
||
content_type: concept
|
||
weight: 40
|
||
feature:
|
||
title: Automatic bin packing
|
||
description: >
|
||
Automatically places containers based on their resource requirements and other constraints, while not sacrificing availability.
|
||
Mix critical and best-effort workloads in order to drive up utilization and save even more resources.
|
||
-->
|
||
|
||
<!-- overview -->
|
||
|
||
<!--
|
||
When you specify a {{< glossary_tooltip term_id="pod" >}}, you can optionally specify how much of each resource a
|
||
{{< glossary_tooltip text="container" term_id="container" >}} needs. The most common resources to specify are CPU and memory
|
||
(RAM); there are others.
|
||
|
||
When you specify the resource _request_ for containers in a Pod, the
|
||
{{< glossary_tooltip text="kube-scheduler" term_id="kube-scheduler" >}} uses this information to decide which node to place the Pod on.
|
||
When you specify a resource _limit_ for a container, the {{< glossary_tooltip text="kubelet" term_id="kubelet" >}} enforces those
|
||
limits so that the running container is not allowed to use more of that resource
|
||
than the limit you set. The kubelet also reserves at least the _request_ amount of
|
||
that system resource specifically for that container to use.
|
||
-->
|
||
当你定义 {{< glossary_tooltip text="Pod" term_id="pod" >}}
|
||
时可以选择性地为每个{{< glossary_tooltip text="容器" term_id="container" >}}设定所需要的资源数量。
|
||
最常见的可设定资源是 CPU 和内存（RAM）大小；此外还有其他类型的资源。
|
||
|
||
当你为 Pod 中的 Container 指定了资源 **request（请求）** 时，
|
||
{{< glossary_tooltip text="kube-scheduler" term_id="kube-scheduler" >}}
|
||
就利用该信息决定将 Pod 调度到哪个节点上。
|
||
当你为 Container 指定了资源 **limit（限制）** 时，{{< glossary_tooltip text="kubelet" term_id="kubelet" >}}
|
||
就可以确保运行的容器不会使用超出所设限制的资源。
|
||
kubelet 还会为容器预留所 **request（请求）** 数量的系统资源，供其使用。
|
||
|
||
<!-- body -->
|
||
|
||
<!--
|
||
## Requests and limits
|
||
|
||
If the node where a Pod is running has enough of a resource available, it's possible (and
|
||
allowed) for a container to use more resource than its `request` for that resource specifies.
|
||
|
||
For example, if you set a `memory` request of 256 MiB for a container, and that container is in
|
||
a Pod scheduled to a Node with 8GiB of memory and no other Pods, then the container can try to use
|
||
more RAM.
|
||
-->
|
||
## 请求和限制 {#requests-and-limits}
|
||
|
||
如果 Pod 运行所在的节点具有足够的可用资源，容器可能（且可以）使用超出对应资源
|
||
`request` 属性所设置的资源量。
|
||
|
||
例如，如果你将容器的 `memory` 的请求量设置为 256 MiB，而该容器所处的 Pod
|
||
被调度到一个具有 8 GiB 内存的节点上，并且该节点上没有其他 Pod
|
||
运行，那么该容器就可以尝试使用更多的内存。
|
||
|
||
<!--
|
||
Limits are a different story. Both `cpu` and `memory` limits are applied by the kubelet (and
|
||
{{< glossary_tooltip text="container runtime" term_id="container-runtime" >}}),
|
||
and are ultimately enforced by the kernel. On Linux nodes, the Linux kernel
|
||
enforces limits with
|
||
{{< glossary_tooltip text="cgroups" term_id="cgroup" >}}.
|
||
The behavior of `cpu` and `memory` limit enforcement is slightly different.
|
||
-->
|
||
限制是另一个话题。`cpu` 限制和 `memory` 限制都由 kubelet
|
||
（以及 {{< glossary_tooltip text="容器运行时" term_id="container-runtime" >}}）来应用，
|
||
最终由内核强制执行。在 Linux 节点上，Linux 内核通过
|
||
{{< glossary_tooltip text="CGroup" term_id="cgroup" >}} 来强制执行限制。
|
||
`cpu` 限制和 `memory` 限制的执行行为略有不同。
|
||
|
||
<!--
|
||
`cpu` limits are enforced by CPU throttling. When a container approaches
|
||
its `cpu` limit, the kernel will restrict access to the CPU corresponding to the
|
||
container's limit. Thus, a `cpu` limit is a hard limit the kernel enforces.
|
||
Containers may not use more CPU than is specified in their `cpu` limit.
|
||
-->
|
||
`cpu` 限制通过 CPU 节流机制来强制执行。
|
||
当某容器接近其 `cpu` 限制值时，内核会基于容器的限制值来限制其对 CPU 的访问。
|
||
因此，`cpu` 限制是内核强制执行的一个硬性限制。容器不得使用超出其 `cpu` 限制所指定的 CPU 核数。
|
||
|
||
<!--
|
||
`memory` limits are enforced by the kernel with out of memory (OOM) kills. When
|
||
a container uses more than its `memory` limit, the kernel may terminate it. However,
|
||
terminations only happen when the kernel detects memory pressure. Thus, a
|
||
container that over allocates memory may not be immediately killed. This means
|
||
`memory` limits are enforced reactively. A container may use more memory than
|
||
its `memory` limit, but if it does, it may get killed.
|
||
-->
|
||
`memory` 限制由内核使用 OOM（内存溢出）终止机制来强制执行。
|
||
当某容器使用的内存超过其 `memory` 限制时，内核可以终止此容器。
|
||
然而，终止只会在内核检测到内存压力时才会发生。
|
||
因此，超配内存的容器可能不会被立即终止。
|
||
这意味着 `memory` 限制是被动执行的。
|
||
某容器可以使用超过其 `memory` 限制的内存，但如果这样做，此容器可能会被终止。
|
||
|
||
{{< note >}}
|
||
<!--
|
||
There is an alpha feature `MemoryQoS` which attempts to add more preemptive
|
||
limit enforcement for memory (as opposed to reactive enforcement by the OOM
|
||
killer). However, this effort is
|
||
[stalled](https://github.com/kubernetes/enhancements/tree/a47155b340/keps/sig-node/2570-memory-qos#latest-update-stalled)
|
||
due to a potential livelock situation a memory hungry can cause.
|
||
-->
|
||
你可以使用一个 Alpha 特性 `MemoryQoS` 来尝试为内存添加执行更多的抢占限制
|
||
（这与 OOM Killer 的被动执行相反）。然而，由于可能会因内存饥饿造成活锁情形，
|
||
所以这种尝试操作会被[卡滞](https://github.com/kubernetes/enhancements/tree/a47155b340/keps/sig-node/2570-memory-qos#latest-update-stalled)。
|
||
{{< /note >}}
|
||
|
||
{{< note >}}
|
||
<!--
|
||
If you specify a limit for a resource, but do not specify any request, and no admission-time
|
||
mechanism has applied a default request for that resource, then Kubernetes copies the limit
|
||
you specified and uses it as the requested value for the resource.
|
||
-->
|
||
如果你为某个资源指定了限制，但不指定请求，
|
||
并且没有应用准入时机制为该资源设置默认请求，
|
||
然后 Kubernetes 复制你所指定的限制值，将其用作资源的请求值。
|
||
{{< /note >}}
|
||
|
||
<!--
|
||
## Resource types
|
||
|
||
*CPU* and *memory* are each a *resource type*. A resource type has a base unit.
|
||
CPU represents compute processing and is specified in units of [Kubernetes CPUs](#meaning-of-cpu).
|
||
Memory is specified in units of bytes.
|
||
For Linux workloads, you can specify _huge page_ resources.
|
||
Huge pages are a Linux-specific feature where the node kernel allocates blocks of memory
|
||
that are much larger than the default page size.
|
||
|
||
For example, on a system where the default page size is 4KiB, you could specify a limit,
|
||
`hugepages-2Mi: 80Mi`. If the container tries allocating over 40 2MiB huge pages (a
|
||
total of 80 MiB), that allocation fails.
|
||
-->
|
||
## 资源类型 {#resource-types}
|
||
|
||
**CPU** 和 **内存** 都是 **资源类型**。每种资源类型具有其基本单位。
|
||
CPU 表达的是计算处理能力，其单位是 [Kubernetes CPU](#meaning-of-cpu)。
|
||
内存的单位是字节。
|
||
对于 Linux 负载，则可以指定巨页（Huge Page）资源。
|
||
巨页是 Linux 特有的功能，节点内核在其中分配的内存块比默认页大小大得多。
|
||
|
||
例如，在默认页面大小为 4KiB 的系统上，你可以指定限制 `hugepages-2Mi: 80Mi`。
|
||
如果容器尝试分配 40 个 2MiB 大小的巨页（总共 80 MiB ），则分配请求会失败。
|
||
|
||
{{< note >}}
|
||
<!--
|
||
You cannot overcommit `hugepages-*` resources.
|
||
This is different from the `memory` and `cpu` resources.
|
||
-->
|
||
你不能过量使用 `hugepages- *` 资源。
|
||
这与 `memory` 和 `cpu` 资源不同。
|
||
{{< /note >}}
|
||
|
||
<!--
|
||
CPU and memory are collectively referred to as *compute resources*, or *resources*. Compute
|
||
resources are measurable quantities that can be requested, allocated, and
|
||
consumed. They are distinct from
|
||
[API resources](/docs/concepts/overview/kubernetes-api/). API resources, such as Pods and
|
||
[Services](/docs/concepts/services-networking/service/) are objects that can be read and modified
|
||
through the Kubernetes API server.
|
||
-->
|
||
CPU 和内存统称为 **计算资源**，或简称为 **资源**。
|
||
计算资源的数量是可测量的，可以被请求、被分配、被消耗。
|
||
它们与 [API 资源](/zh-cn/docs/concepts/overview/kubernetes-api/)不同。
|
||
API 资源（如 Pod 和 [Service](/zh-cn/docs/concepts/services-networking/service/)）是可通过
|
||
Kubernetes API 服务器读取和修改的对象。
|
||
|
||
<!--
|
||
## Resource requests and limits of Pod and container
|
||
|
||
For each container, you can specify resource limits and requests,
|
||
including the following:
|
||
-->
|
||
## Pod 和容器的资源请求和限制 {#resource-requests-and-limits-of-pod-and-container}
|
||
|
||
针对每个容器，你都可以指定其资源限制和请求，包括如下选项：
|
||
|
||
* `spec.containers[].resources.limits.cpu`
|
||
* `spec.containers[].resources.limits.memory`
|
||
* `spec.containers[].resources.limits.hugepages-<size>`
|
||
* `spec.containers[].resources.requests.cpu`
|
||
* `spec.containers[].resources.requests.memory`
|
||
* `spec.containers[].resources.requests.hugepages-<size>`
|
||
|
||
<!--
|
||
Although you can only specify requests and limits for individual containers,
|
||
it is also useful to think about the overall resource requests and limits for
|
||
a Pod.
|
||
For a particular resource, a *Pod resource request/limit* is the sum of the
|
||
resource requests/limits of that type for each container in the Pod.
|
||
-->
|
||
尽管你只能逐个容器地指定请求和限制值，但考虑 Pod 的总体资源请求和限制也是有用的。
|
||
对特定资源而言，**Pod 的资源请求/限制** 是 Pod 中各容器对该类型资源的请求/限制的总和。
|
||
|
||
<!--
|
||
## Resource units in Kubernetes
|
||
|
||
### CPU resource units {#meaning-of-cpu}
|
||
|
||
Limits and requests for CPU resources are measured in *cpu* units.
|
||
In Kubernetes, 1 CPU unit is equivalent to **1 physical CPU core**,
|
||
or **1 virtual core**, depending on whether the node is a physical host
|
||
or a virtual machine running inside a physical machine.
|
||
-->
|
||
## Kubernetes 中的资源单位 {#resource-units-in-kubernetes}
|
||
|
||
### CPU 资源单位 {#meaning-of-cpu}
|
||
|
||
CPU 资源的限制和请求以 **cpu** 为单位。
|
||
在 Kubernetes 中，一个 CPU 等于 **1 个物理 CPU 核** 或者 **1 个虚拟核**，
|
||
取决于节点是一台物理主机还是运行在某物理主机上的虚拟机。
|
||
|
||
<!--
|
||
Fractional requests are allowed. When you define a container with
|
||
`spec.containers[].resources.requests.cpu` set to `0.5`, you are requesting half
|
||
as much CPU time compared to if you asked for `1.0` CPU.
|
||
For CPU resource units, the [quantity](/docs/reference/kubernetes-api/common-definitions/quantity/) expression `0.1` is equivalent to the
|
||
expression `100m`, which can be read as "one hundred millicpu". Some people say
|
||
"one hundred millicores", and this is understood to mean the same thing.
|
||
-->
|
||
你也可以表达带小数 CPU 的请求。
|
||
当你定义一个容器，将其 `spec.containers[].resources.requests.cpu` 设置为 `0.5` 时，
|
||
你所请求的 CPU 是你请求 `1.0` CPU 时的一半。对于 CPU 资源单位，
|
||
[数量](/zh-cn/docs/reference/kubernetes-api/common-definitions/quantity/)表达式 `0.1`
|
||
等价于表达式 `100m`，可以看作 “100 millicpu”。
|
||
有些人说成是“一百毫核”，其实说的是同样的事情。
|
||
|
||
<!--
|
||
CPU resource is always specified as an absolute amount of resource, never as a relative amount. For example,
|
||
`500m` CPU represents the roughly same amount of computing power whether that container
|
||
runs on a single-core, dual-core, or 48-core machine.
|
||
-->
|
||
CPU 资源总是设置为资源的绝对数量而非相对数量值。
|
||
例如，无论容器运行在单核、双核或者 48 核的机器上，`500m` CPU 表示的是大约相同的算力。
|
||
|
||
{{< note >}}
|
||
<!--
|
||
Kubernetes doesn't allow you to specify CPU resources with a precision finer than
|
||
`1m` or `0.001` CPU. To avoid accidentally using an invalid CPU quantity, it's useful to specify CPU units using the milliCPU form
|
||
instead of the decimal form when using less than 1 CPU unit.
|
||
|
||
For example, you have a Pod that uses `5m` or `0.005` CPU and would like to decrease
|
||
its CPU resources. By using the decimal form, it's harder to spot that `0.0005` CPU
|
||
is an invalid value, while by using the milliCPU form, it's easier to spot that
|
||
`0.5m` is an invalid value.
|
||
-->
|
||
Kubernetes 不允许设置精度小于 `1m` 或 `0.001` 的 CPU 资源。
|
||
为了避免意外使用无效的 CPU 数量，当使用少于 1 个 CPU 单元时，使用
|
||
milliCPU 形式而不是十进制形式指定 CPU 单元非常有用。
|
||
|
||
例如，你有一个使用 `5m` 或 `0.005` 核 CPU 的 Pod，并且希望减少其 CPU 资源。
|
||
通过使用十进制形式，更难发现 `0.0005` CPU 是无效值，而通过使用 milliCPU 形式，
|
||
更容易发现 `0.5m` 是无效值。
|
||
{{< /note >}}
|
||
|
||
<!--
|
||
### Memory resource units {#meaning-of-memory}
|
||
|
||
Limits and requests for `memory` are measured in bytes. You can express memory as
|
||
a plain integer or as a fixed-point number using one of these
|
||
[quantity](/docs/reference/kubernetes-api/common-definitions/quantity/) suffixes:
|
||
E, P, T, G, M, k. You can also use the power-of-two equivalents: Ei, Pi, Ti, Gi,
|
||
Mi, Ki. For example, the following represent roughly the same value:
|
||
-->
|
||
## 内存资源单位 {#meaning-of-memory}
|
||
|
||
`memory` 的限制和请求以字节为单位。
|
||
你可以使用普通的整数，或者带有以下
|
||
[数量](/zh-cn/docs/reference/kubernetes-api/common-definitions/quantity/)后缀
|
||
的定点数字来表示内存：E、P、T、G、M、k。
|
||
你也可以使用对应的 2 的幂数：Ei、Pi、Ti、Gi、Mi、Ki。
|
||
例如，以下表达式所代表的是大致相同的值：
|
||
|
||
```shell
|
||
128974848、129e6、129M、128974848000m、123Mi
|
||
```
|
||
|
||
<!--
|
||
Pay attention to the case of the suffixes. If you request `400m` of memory, this is a request
|
||
for 0.4 bytes. Someone who types that probably meant to ask for 400 mebibytes (`400Mi`)
|
||
or 400 megabytes (`400M`).
|
||
-->
|
||
请注意后缀的大小写。如果你请求 `400m` 临时存储，实际上所请求的是 0.4 字节。
|
||
如果有人这样设定资源请求或限制，可能他的实际想法是申请 400Mi 字节（`400Mi`）
|
||
或者 400M 字节。
|
||
|
||
<!--
|
||
## Container resources example {#example-1}
|
||
|
||
The following Pod has two containers. Both containers are defined with a request for
|
||
0.25 CPU
|
||
and 64MiB (2<sup>26</sup> bytes) of memory. Each container has a limit of 0.5
|
||
CPU and 128MiB of memory. You can say the Pod has a request of 0.5 CPU and 128
|
||
MiB of memory, and a limit of 1 CPU and 256MiB of memory.
|
||
-->
|
||
## 容器资源示例 {#example-1}
|
||
|
||
以下 Pod 有两个容器。每个容器的请求为 0.25 CPU 和 64MiB（2<sup>26</sup> 字节）内存，
|
||
每个容器的资源限制为 0.5 CPU 和 128MiB 内存。
|
||
你可以认为该 Pod 的资源请求为 0.5 CPU 和 128 MiB 内存，资源限制为 1 CPU 和 256MiB 内存。
|
||
|
||
```yaml
|
||
---
|
||
apiVersion: v1
|
||
kind: Pod
|
||
metadata:
|
||
name: frontend
|
||
spec:
|
||
containers:
|
||
- name: app
|
||
image: images.my-company.example/app:v4
|
||
resources:
|
||
requests:
|
||
memory: "64Mi"
|
||
cpu: "250m"
|
||
limits:
|
||
memory: "128Mi"
|
||
cpu: "500m"
|
||
- name: log-aggregator
|
||
image: images.my-company.example/log-aggregator:v6
|
||
resources:
|
||
requests:
|
||
memory: "64Mi"
|
||
cpu: "250m"
|
||
limits:
|
||
memory: "128Mi"
|
||
cpu: "500m"
|
||
```
|
||
|
||
<!--
|
||
## How Pods with resource requests are scheduled
|
||
|
||
When you create a Pod, the Kubernetes scheduler selects a node for the Pod to
|
||
run on. Each node has a maximum capacity for each of the resource types: the
|
||
amount of CPU and memory it can provide for Pods. The scheduler ensures that,
|
||
for each resource type, the sum of the resource requests of the scheduled
|
||
containers is less than the capacity of the node.
|
||
Note that although actual memory
|
||
or CPU resource usage on nodes is very low, the scheduler still refuses to place
|
||
a Pod on a node if the capacity check fails. This protects against a resource
|
||
shortage on a node when resource usage later increases, for example, during a
|
||
daily peak in request rate.
|
||
-->
|
||
## 带资源请求的 Pod 如何调度 {#how-pods-with-resource-limits-are-run}
|
||
|
||
当你创建一个 Pod 时，Kubernetes 调度程序将为 Pod 选择一个节点。
|
||
每个节点对每种资源类型都有一个容量上限：可为 Pod 提供的 CPU 和内存量。
|
||
调度程序确保对于每种资源类型，所调度的容器的资源请求的总和小于节点的容量。
|
||
请注意，尽管节点上的实际内存或 CPU 资源使用量非常低，如果容量检查失败，
|
||
调度程序仍会拒绝在该节点上放置 Pod。
|
||
当稍后节点上资源用量增加，例如到达请求率的每日峰值区间时，节点上也不会出现资源不足的问题。
|
||
|
||
<!--
|
||
## How Kubernetes applies resource requests and limits {#how-pods-with-resource-limits-are-run}
|
||
|
||
When the kubelet starts a container as part of a Pod, the kubelet passes that container's
|
||
requests and limits for memory and CPU to the container runtime.
|
||
|
||
On Linux, the container runtime typically configures
|
||
kernel {{< glossary_tooltip text="cgroups" term_id="cgroup" >}} that apply and enforce the
|
||
limits you defined.
|
||
-->
|
||
## Kubernetes 应用资源请求与限制的方式 {#how-pods-with-resource-limits-are-run}
|
||
|
||
当 kubelet 将容器作为 Pod 的一部分启动时，它会将容器的 CPU 和内存请求与限制信息传递给容器运行时。
|
||
|
||
在 Linux 系统上，容器运行时通常会配置内核
|
||
{{< glossary_tooltip text="CGroup" term_id="cgroup" >}}，负责应用并实施所定义的请求。
|
||
|
||
<!--
|
||
- The CPU limit defines a hard ceiling on how much CPU time the container can use.
|
||
During each scheduling interval (time slice), the Linux kernel checks to see if this
|
||
limit is exceeded; if so, the kernel waits before allowing that cgroup to resume execution.
|
||
-->
|
||
- CPU 限制定义的是容器可使用的 CPU 时间的硬性上限。
|
||
在每个调度周期（时间片）期间，Linux 内核检查是否已经超出该限制；
|
||
内核会在允许该 CGroup 恢复执行之前会等待。
|
||
<!--
|
||
- The CPU request typically defines a weighting. If several different containers (cgroups)
|
||
want to run on a contended system, workloads with larger CPU requests are allocated more
|
||
CPU time than workloads with small requests.
|
||
-->
|
||
- CPU 请求值定义的是一个权重值。如果若干不同的容器（CGroup）需要在一个共享的系统上竞争运行，
|
||
CPU 请求值大的负载会获得比请求值小的负载更多的 CPU 时间。
|
||
<!--
|
||
- The memory request is mainly used during (Kubernetes) Pod scheduling. On a node that uses
|
||
cgroups v2, the container runtime might use the memory request as a hint to set
|
||
`memory.min` and `memory.low`.
|
||
-->
|
||
- 内存请求值主要用于（Kubernetes）Pod 调度期间。在一个启用了 CGroup v2 的节点上，
|
||
容器运行时可能会使用内存请求值作为设置 `memory.min` 和 `memory.low` 的提示值。
|
||
<!--
|
||
- The memory limit defines a memory limit for that cgroup. If the container tries to
|
||
allocate more memory than this limit, the Linux kernel out-of-memory subsystem activates
|
||
and, typically, intervenes by stopping one of the processes in the container that tried
|
||
to allocate memory. If that process is the container's PID 1, and the container is marked
|
||
as restartable, Kubernetes restarts the container.
|
||
-->
|
||
- 内存限制定义的是 CGroup 的内存限制。如果容器尝试分配的内存量超出限制，
|
||
则 Linux 内核的内存不足处理子系统会被激活，并停止尝试分配内存的容器中的某个进程。
|
||
如果该进程在容器中 PID 为 1，而容器被标记为可重新启动，则 Kubernetes
|
||
会重新启动该容器。
|
||
<!--
|
||
- The memory limit for the Pod or container can also apply to pages in memory backed
|
||
volumes, such as an `emptyDir`. The kubelet tracks `tmpfs` emptyDir volumes as container
|
||
memory use, rather than as local ephemeral storage. When using memory backed `emptyDir`,
|
||
be sure to check the notes [below](#memory-backed-emptydir).
|
||
-->
|
||
- Pod 或容器的内存限制也适用于通过内存作为介质的卷，例如 `emptyDir` 卷。
|
||
kubelet 会跟踪 `tmpfs` 形式的 emptyDir 卷用量，将其作为容器的内存用量，
|
||
而不是临时存储用量。当使用内存作为介质的 `emptyDir` 时，
|
||
请务必查看[下面](#memory-backed-emptydir)的注意事项。
|
||
|
||
<!--
|
||
If a container exceeds its memory request and the node that it runs on becomes short of
|
||
memory overall, it is likely that the Pod the container belongs to will be
|
||
{{< glossary_tooltip text="evicted" term_id="eviction" >}}.
|
||
|
||
A container might or might not be allowed to exceed its CPU limit for extended periods of time.
|
||
However, container runtimes don't terminate Pods or containers for excessive CPU usage.
|
||
|
||
To determine whether a container cannot be scheduled or is being killed due to resource limits,
|
||
see the [Troubleshooting](#troubleshooting) section.
|
||
-->
|
||
如果某容器内存用量超过其内存请求值并且所在节点内存不足时，容器所处的 Pod
|
||
可能被{{< glossary_tooltip text="逐出" term_id="eviction" >}}。
|
||
|
||
每个容器可能被允许也可能不被允许使用超过其 CPU 限制的处理时间。
|
||
但是，容器运行时不会由于 CPU 使用率过高而杀死 Pod 或容器。
|
||
|
||
要确定某容器是否会由于资源限制而无法调度或被杀死，请参阅[疑难解答](#troubleshooting)节。
|
||
|
||
<!--
|
||
### Monitoring compute & memory resource usage
|
||
|
||
The kubelet reports the resource usage of a Pod as part of the Pod
|
||
[`status`](/docs/concepts/overview/working-with-objects/#object-spec-and-status).
|
||
|
||
If optional [tools for monitoring](/docs/tasks/debug/debug-cluster/resource-usage-monitoring/)
|
||
are available in your cluster, then Pod resource usage can be retrieved either
|
||
from the [Metrics API](/docs/tasks/debug/debug-cluster/resource-metrics-pipeline/#metrics-api)
|
||
directly or from your monitoring tools.
|
||
-->
|
||
### 监控计算和内存资源用量 {#monitoring-compute-memory-resource-usage}
|
||
|
||
kubelet 会将 Pod 的资源使用情况作为 Pod
|
||
[`status`](/zh-cn/docs/concepts/overview/working-with-objects/#object-spec-and-status)
|
||
的一部分来报告的。
|
||
|
||
如果为集群配置了可选的[监控工具](/zh-cn/docs/tasks/debug/debug-cluster/resource-usage-monitoring/)，
|
||
则可以直接从[指标 API](/zh-cn/docs/tasks/debug/debug-cluster/resource-metrics-pipeline/#metrics-api)
|
||
或者监控工具获得 Pod 的资源使用情况。
|
||
|
||
<!--
|
||
### Considerations for memory backed `emptyDir` volumes {#memory-backed-emptydir}
|
||
-->
|
||
### 使用内存作为介质的 `emptyDir` 卷的注意事项 {#memory-backed-emptydir}
|
||
|
||
{{< caution >}}
|
||
<!--
|
||
If you do not specify a `sizeLimit` for an `emptyDir` volume, that volume may
|
||
consume up to that pod's memory limit (`Pod.spec.containers[].resources.limits.memory`).
|
||
If you do not set a memory limit, the pod has no upper bound on memory consumption,
|
||
and can consume all available memory on the node. Kubernetes schedules pods based
|
||
on resource requests (`Pod.spec.containers[].resources.requests`) and will not
|
||
consider memory usage above the request when deciding if another pod can fit on
|
||
a given node. This can result in a denial of service and cause the OS to do
|
||
out-of-memory (OOM) handling. It is possible to create any number of `emptyDir`s
|
||
that could potentially consume all available memory on the node, making OOM
|
||
more likely.
|
||
-->
|
||
如果你没有为 `emptyDir` 卷指定 `sizeLimit`，该卷就会消耗 Pod 的内存，
|
||
卷的用量上限为 Pod 的内存限制（`Pod.spec.containers[].resources.limits.memory`）。
|
||
如果你没有设置内存限制，Pod 的内存消耗将没有上限，并且可能会用掉节点上的所有可用内存。
|
||
Kubernetes 基于资源请求（`Pod.spec.containers[].resources.requests`）调度 Pod，
|
||
并且在决定另一个 Pod 是否适合调度到某个给定的节点上时，不会考虑超出请求的内存用量。
|
||
这可能导致拒绝服务，并使操作系统出现需要处理内存不足（OOM）的情况。
|
||
用户可以创建任意数量的 `emptyDir`，可能会消耗节点上的所有可用内存，使得 OOM 更有可能发生。
|
||
{{< /caution >}}
|
||
|
||
<!--
|
||
From the perspective of memory management, there are some similarities between
|
||
when a process uses memory as a work area and when using memory-backed
|
||
`emptyDir`. But when using memory as a volume, like memory-backed `emptyDir`,
|
||
there are additional points below that you should be careful of:
|
||
-->
|
||
从内存管理的角度来看，进程使用内存作为工作区与使用内存作为 `emptyDir` 的介质有一些相似之处。
|
||
但当将内存用作存储卷（例如内存为介质的 `emptyDir` 卷）时，你需要额外注意以下几点：
|
||
|
||
<!--
|
||
* Files stored on a memory-backed volume are almost entirely managed by the
|
||
user application. Unlike when used as a work area for a process, you can not
|
||
rely on things like language-level garbage collection.
|
||
* The purpose of writing files to a volume is to save data or pass it between
|
||
applications. Neither Kubernetes nor the OS may automatically delete files
|
||
from a volume, so memory used by those files can not be reclaimed when the
|
||
system or the pod are under memory pressure.
|
||
* A memory-backed `emptyDir` is useful because of its performance, but memory
|
||
is generally much smaller in size and much higher in cost than other storage
|
||
media, such as disks or SSDs. Using large amounts of memory for `emptyDir`
|
||
volumes may affect the normal operation of your pod or of the whole node,
|
||
so should be used carefully.
|
||
-->
|
||
* 存储在内存为介质的卷上的文件几乎完全由用户应用所管理。
|
||
与用作进程工作区的用法不同，你无法依赖语言级别垃圾回收这类机制。
|
||
* 将文件写入某个卷的目的是保存数据或在应用之间传递数据。
|
||
Kubernetes 或操作系统都不会自动从卷中删除文件，
|
||
因此当系统或 Pod 面临内存压力时，将无法回收这些文件所使用的内存。
|
||
* 以内存为介质的 `emptyDir` 因性能较好而很有用，但内存通常比其他存储介质（如磁盘或 SSD）小得多且成本更高。
|
||
为 `emptyDir` 卷使用大量内存可能会影响 Pod 或整个节点的正常运行，因此你应谨慎使用。
|
||
|
||
<!--
|
||
If you are administering a cluster or namespace, you can also set
|
||
[ResourceQuota](/docs/concepts/policy/resource-quotas/) that limits memory use;
|
||
you may also want to define a [LimitRange](/docs/concepts/policy/limit-range/)
|
||
for additional enforcement.
|
||
If you specify a `spec.containers[].resources.limits.memory` for each Pod,
|
||
then the maximum size of an `emptyDir` volume will be the pod's memory limit.
|
||
-->
|
||
如果你在管理集群或命名空间，还可以设置限制内存使用的
|
||
[ResourceQuota](/zh-cn/docs/concepts/policy/resource-quotas/)；
|
||
你可能还希望定义一个 [LimitRange](/zh-cn/docs/concepts/policy/limit-range/)
|
||
以施加额外的限制。如果为每个 Pod 指定 `spec.containers[].resources.limits.memory`，
|
||
那么 `emptyDir` 卷的最大尺寸将是 Pod 的内存限制。
|
||
|
||
<!--
|
||
As an alternative, a cluster administrator can enforce size limits for
|
||
`emptyDir` volumes in new Pods using a policy mechanism such as
|
||
[ValidationAdmissionPolicy](/docs/reference/access-authn-authz/validating-admission-policy).
|
||
-->
|
||
作为一种替代方案，集群管理员可以使用诸如
|
||
[ValidationAdmissionPolicy](/zh-cn/docs/reference/access-authn-authz/validating-admission-policy)
|
||
之类的策略机制来强制对新 Pod 的 `emptyDir` 卷进行大小限制。
|
||
|
||
<!--
|
||
## Local ephemeral storage
|
||
|
||
Nodes have local ephemeral storage, backed by
|
||
locally-attached writeable devices or, sometimes, by RAM.
|
||
"Ephemeral" means that there is no long-term guarantee about durability.
|
||
|
||
Pods use ephemeral local storage for scratch space, caching, and for logs.
|
||
The kubelet can provide scratch space to Pods using local ephemeral storage to
|
||
mount [`emptyDir`](/docs/concepts/storage/volumes/#emptydir)
|
||
{{< glossary_tooltip term_id="volume" text="volumes" >}} into containers.
|
||
-->
|
||
## 本地临时存储 {#local-ephemeral-storage}
|
||
|
||
<!-- feature gate LocalStorageCapacityIsolation -->
|
||
{{< feature-state for_k8s_version="v1.25" state="stable" >}}
|
||
|
||
节点通常还可以具有本地的临时性存储，由本地挂接的可写入设备或者有时也用 RAM
|
||
来提供支持。“临时（Ephemeral）”意味着对所存储的数据不提供长期可用性的保证。
|
||
|
||
Pods 通常可以使用临时性本地存储来实现缓冲区、保存日志等功能。
|
||
kubelet 可以为使用本地临时存储的 Pods 提供这种存储空间，允许后者使用
|
||
[`emptyDir`](/zh-cn/docs/concepts/storage/volumes/#emptydir)
|
||
类型的{{< glossary_tooltip term_id="volume" text="卷" >}}将其挂载到容器中。
|
||
|
||
<!--
|
||
The kubelet also uses this kind of storage to hold
|
||
[node-level container logs](/docs/concepts/cluster-administration/logging/#logging-at-the-node-level),
|
||
container images, and the writable layers of running containers.
|
||
-->
|
||
kubelet 也使用此类存储来保存[节点层面的容器日志](/zh-cn/docs/concepts/cluster-administration/logging/#logging-at-the-node-level)、
|
||
容器镜像文件以及运行中容器的可写入层。
|
||
|
||
{{< caution >}}
|
||
<!--
|
||
If a node fails, the data in its ephemeral storage can be lost.
|
||
Your applications cannot expect any performance SLAs (disk IOPS for example)
|
||
from local ephemeral storage.
|
||
-->
|
||
如果节点失效，存储在临时性存储中的数据会丢失。
|
||
你的应用不能对本地临时性存储的性能 SLA（例如磁盘 IOPS）作任何假定。
|
||
{{< /caution >}}
|
||
|
||
{{< note >}}
|
||
<!--
|
||
To make the resource quota work on ephemeral-storage, two things need to be done:
|
||
|
||
* An admin sets the resource quota for ephemeral-storage in a namespace.
|
||
* A user needs to specify limits for the ephemeral-storage resource in the Pod spec.
|
||
|
||
If the user doesn't specify the ephemeral-storage resource limit in the Pod spec,
|
||
the resource quota is not enforced on ephemeral-storage.
|
||
-->
|
||
为了使临时性存储的资源配额生效，需要完成以下两个步骤：
|
||
|
||
* 管理员在命名空间中设置临时性存储的资源配额。
|
||
* 用户需要在 Pod 规约中指定临时性存储资源的限制。
|
||
|
||
如果用户在 Pod 规约中未指定临时性存储资源的限制，
|
||
则临时性存储的资源配额不会生效。
|
||
{{< /note >}}
|
||
|
||
<!--
|
||
Kubernetes lets you track, reserve and limit the amount
|
||
of ephemeral local storage a Pod can consume.
|
||
-->
|
||
Kubernetes 允许你跟踪、预留和限制 Pod
|
||
可消耗的临时性本地存储数量。
|
||
|
||
<!--
|
||
### Configurations for local ephemeral storage
|
||
|
||
Kubernetes supports two ways to configure local ephemeral storage on a node:
|
||
|
||
In this configuration, you place all different kinds of ephemeral local data
|
||
(`emptyDir` volumes, writeable layers, container images, logs) into one filesystem.
|
||
The most effective way to configure the kubelet means dedicating this filesystem
|
||
to Kubernetes (kubelet) data.
|
||
|
||
The kubelet also writes
|
||
[node-level container logs](/docs/concepts/cluster-administration/logging/#logging-at-the-node-level)
|
||
and treats these similarly to ephemeral local storage.
|
||
-->
|
||
### 本地临时性存储的配置 {##configurations-for-local-ephemeral-storage}
|
||
|
||
Kubernetes 有两种方式支持节点上配置本地临时性存储：
|
||
|
||
{{< tabs name="local_storage_configurations" >}}
|
||
{{% tab name="单一文件系统" %}}
|
||
采用这种配置时，你会把所有类型的临时性本地数据（包括 `emptyDir`
|
||
卷、可写入容器层、容器镜像、日志等）放到同一个文件系统中。
|
||
作为最有效的 kubelet 配置方式，这意味着该文件系统是专门提供给 Kubernetes
|
||
（kubelet）来保存数据的。
|
||
|
||
kubelet 也会生成[节点层面的容器日志](/zh-cn/docs/concepts/cluster-administration/logging/#logging-at-the-node-level)，
|
||
并按临时性本地存储的方式对待之。
|
||
|
||
<!--
|
||
The kubelet writes logs to files inside its configured log directory (`/var/log`
|
||
by default); and has a base directory for other locally stored data
|
||
(`/var/lib/kubelet` by default).
|
||
|
||
Typically, both `/var/lib/kubelet` and `/var/log` are on the system root filesystem,
|
||
and the kubelet is designed with that layout in mind.
|
||
|
||
Your node can have as many other filesystems, not used for Kubernetes,
|
||
as you like.
|
||
-->
|
||
kubelet 会将日志写入到所配置的日志目录（默认为 `/var/log`）下的文件中；
|
||
还会针对其他本地存储的数据使用同一个基础目录（默认为 `/var/lib/kubelet`）。
|
||
|
||
通常，`/var/lib/kubelet` 和 `/var/log` 都是在系统的根文件系统中。kubelet
|
||
的设计也考虑到这一点。
|
||
|
||
你的集群节点当然可以包含其他的、并非用于 Kubernetes 的很多文件系统。
|
||
{{% /tab %}}
|
||
|
||
{{% tab name="双文件系统" %}}
|
||
<!--
|
||
You have a filesystem on the node that you're using for ephemeral data that
|
||
comes from running Pods: logs, and `emptyDir` volumes. You can use this filesystem
|
||
for other data (for example: system logs not related to Kubernetes); it can even
|
||
be the root filesystem.
|
||
|
||
The kubelet also writes
|
||
[node-level container logs](/docs/concepts/cluster-administration/logging/#logging-at-the-node-level)
|
||
into the first filesystem, and treats these similarly to ephemeral local storage.
|
||
-->
|
||
你使用节点上的某个文件系统来保存运行 Pod 时产生的临时性数据：日志和
|
||
`emptyDir` 卷等。你可以使用这个文件系统来保存其他数据（例如：与 Kubernetes
|
||
无关的其他系统日志）；这个文件系统还可以是根文件系统。
|
||
|
||
kubelet 也将[节点层面的容器日志](/zh-cn/docs/concepts/cluster-administration/logging/#logging-at-the-node-level)
|
||
写入到第一个文件系统中，并按临时性本地存储的方式对待之。
|
||
|
||
<!--
|
||
You also use a separate filesystem, backed by a different logical storage device.
|
||
In this configuration, the directory where you tell the kubelet to place
|
||
container image layers and writeable layers is on this second filesystem.
|
||
|
||
The first filesystem does not hold any image layers or writeable layers.
|
||
|
||
Your node can have as many other filesystems, not used for Kubernetes,
|
||
as you like.
|
||
-->
|
||
同时你使用另一个由不同逻辑存储设备支持的文件系统。在这种配置下，你会告诉
|
||
kubelet 将容器镜像层和可写层保存到这第二个文件系统上的某个目录中。
|
||
|
||
第一个文件系统中不包含任何镜像层和可写层数据。
|
||
|
||
当然，你的集群节点上还可以有很多其他与 Kubernetes 没有关联的文件系统。
|
||
{{% /tab %}}
|
||
{{< /tabs >}}
|
||
|
||
<!--
|
||
The kubelet can measure how much local storage it is using. It does this provided
|
||
that you have set up the node using one of the supported configurations for local
|
||
ephemeral storage.
|
||
|
||
If you have a different configuration, then the kubelet does not apply resource
|
||
limits for ephemeral local storage.
|
||
-->
|
||
kubelet 能够度量其本地存储的用量。
|
||
实现度量机制的前提是你已使用本地临时存储所支持的配置之一对节点进行配置。
|
||
|
||
如果你的节点配置不同于以上预期，kubelet 就无法对临时性本地存储实施资源限制。
|
||
|
||
{{< note >}}
|
||
<!--
|
||
The kubelet tracks `tmpfs` emptyDir volumes as container memory use, rather
|
||
than as local ephemeral storage.
|
||
-->
|
||
kubelet 会将 `tmpfs` emptyDir 卷的用量当作容器内存用量，而不是本地临时性存储来统计。
|
||
{{< /note >}}
|
||
|
||
{{< note >}}
|
||
<!--
|
||
The kubelet will only track the root filesystem for ephemeral storage. OS layouts that mount a separate disk to `/var/lib/kubelet` or `/var/lib/containers` will not report ephemeral storage correctly.
|
||
-->
|
||
kubelet 将仅跟踪临时存储的根文件系统。
|
||
挂载一个单独磁盘到 `/var/lib/kubelet` 或 `/var/lib/containers` 的操作系统布局将不会正确地报告临时存储。
|
||
{{< /note >}}
|
||
|
||
<!--
|
||
### Setting requests and limits for local ephemeral storage
|
||
|
||
You can specify `ephemeral-storage` for managing local ephemeral storage. Each
|
||
container of a Pod can specify either or both of the following:
|
||
|
||
* `spec.containers[].resources.limits.ephemeral-storage`
|
||
* `spec.containers[].resources.requests.ephemeral-storage`
|
||
-->
|
||
### 为本地临时性存储设置请求和限制 {#setting-requests-and-limits-for-local-ephemeral-storage}
|
||
|
||
你可以指定 `ephemeral-storage` 来管理本地临时性存储。
|
||
Pod 中的每个容器可以设置以下属性：
|
||
|
||
* `spec.containers[].resources.limits.ephemeral-storage`
|
||
* `spec.containers[].resources.requests.ephemeral-storage`
|
||
|
||
<!--
|
||
Limits and requests for `ephemeral-storage` are measured in byte quantities.
|
||
You can express storage as a plain integer or as a fixed-point number using one of these suffixes:
|
||
E, P, T, G, M, k. You can also use the power-of-two equivalents: Ei, Pi, Ti, Gi,
|
||
Mi, Ki. For example, the following quantities all represent roughly the same value:
|
||
-->
|
||
`ephemeral-storage` 的请求和限制是按量纲计量的。
|
||
你可以使用一般整数或者定点数字加上下面的后缀来表达存储量：E、P、T、G、M、k。
|
||
你也可以使用对应的 2 的幂级数来表达：Ei、Pi、Ti、Gi、Mi、Ki。
|
||
例如，下面的表达式所表达的大致是同一个值：
|
||
|
||
- `128974848`
|
||
- `129e6`
|
||
- `129M`
|
||
- `123Mi`
|
||
|
||
<!--
|
||
Pay attention to the case of the suffixes. If you request `400m` of ephemeral-storage, this is a request
|
||
for 0.4 bytes. Someone who types that probably meant to ask for 400 mebibytes (`400Mi`)
|
||
or 400 megabytes (`400M`).
|
||
-->
|
||
请注意后缀的大小写。如果你请求 `400m` 临时存储，实际上所请求的是 0.4 字节。
|
||
如果有人这样设定资源请求或限制，可能他的实际想法是申请 400Mi 字节（`400Mi`）
|
||
或者 400M 字节。
|
||
|
||
<!--
|
||
In the following example, the Pod has two containers. Each container has a request of
|
||
2GiB of local ephemeral storage. Each container has a limit of 4GiB of local ephemeral
|
||
storage. Therefore, the Pod has a request of 4GiB of local ephemeral storage, and
|
||
a limit of 8GiB of local ephemeral storage. 500Mi of that limit could be
|
||
consumed by the `emptyDir` volume.
|
||
-->
|
||
在下面的例子中，Pod 包含两个容器。每个容器请求 2 GiB 大小的本地临时性存储。
|
||
每个容器都设置了 4 GiB 作为其本地临时性存储的限制。
|
||
因此，整个 Pod 的本地临时性存储请求是 4 GiB，且其本地临时性存储的限制为 8 GiB。
|
||
该限制值中有 500Mi 可供 `emptyDir` 卷使用。
|
||
|
||
```yaml
|
||
apiVersion: v1
|
||
kind: Pod
|
||
metadata:
|
||
name: frontend
|
||
spec:
|
||
containers:
|
||
- name: app
|
||
image: images.my-company.example/app:v4
|
||
resources:
|
||
requests:
|
||
ephemeral-storage: "2Gi"
|
||
limits:
|
||
ephemeral-storage: "4Gi"
|
||
volumeMounts:
|
||
- name: ephemeral
|
||
mountPath: "/tmp"
|
||
- name: log-aggregator
|
||
image: images.my-company.example/log-aggregator:v6
|
||
resources:
|
||
requests:
|
||
ephemeral-storage: "2Gi"
|
||
limits:
|
||
ephemeral-storage: "4Gi"
|
||
volumeMounts:
|
||
- name: ephemeral
|
||
mountPath: "/tmp"
|
||
volumes:
|
||
- name: ephemeral
|
||
emptyDir:
|
||
sizeLimit: 500Mi
|
||
```
|
||
|
||
<!--
|
||
### How Pods with ephemeral-storage requests are scheduled
|
||
|
||
When you create a Pod, the Kubernetes scheduler selects a node for the Pod to
|
||
run on. Each node has a maximum amount of local ephemeral storage it can provide for Pods.
|
||
For more information, see
|
||
[Node Allocatable](/docs/tasks/administer-cluster/reserve-compute-resources/#node-allocatable).
|
||
|
||
The scheduler ensures that the sum of the resource requests of the scheduled containers is less than the capacity of the node.
|
||
-->
|
||
### 带临时性存储的 Pods 的调度行为 {#how-pods-with-ephemeral-storage-requests-are-scheduled}
|
||
|
||
当你创建一个 Pod 时，Kubernetes 调度器会为 Pod 选择一个节点来运行之。
|
||
每个节点都有一个本地临时性存储的上限，是其可提供给 Pod 使用的总量。
|
||
欲了解更多信息，
|
||
可参考[节点可分配资源](/zh-cn/docs/tasks/administer-cluster/reserve-compute-resources/#node-allocatable)节。
|
||
|
||
调度器会确保所调度的容器的资源请求总和不会超出节点的资源容量。
|
||
|
||
<!--
|
||
### Ephemeral storage consumption management {#resource-emphemeralstorage-consumption}
|
||
|
||
If the kubelet is managing local ephemeral storage as a resource, then the
|
||
kubelet measures storage use in:
|
||
|
||
- `emptyDir` volumes, except _tmpfs_ `emptyDir` volumes
|
||
- directories holding node-level logs
|
||
- writeable container layers
|
||
|
||
If a Pod is using more ephemeral storage than you allow it to, the kubelet
|
||
sets an eviction signal that triggers Pod eviction.
|
||
-->
|
||
### 临时性存储消耗的管理 {#resource-emphemeralstorage-consumption}
|
||
|
||
如果 kubelet 将本地临时性存储作为资源来管理，则 kubelet 会度量以下各处的存储用量：
|
||
|
||
- `emptyDir` 卷，除了 **tmpfs** `emptyDir` 卷
|
||
- 保存节点层面日志的目录
|
||
- 可写入的容器镜像层
|
||
|
||
如果某 Pod 的临时存储用量超出了你所允许的范围，kubelet
|
||
会向其发出逐出（eviction）信号，触发该 Pod 被逐出所在节点。
|
||
|
||
<!--
|
||
For container-level isolation, if a container's writable layer and log
|
||
usage exceeds its storage limit, the kubelet marks the Pod for eviction.
|
||
|
||
For pod-level isolation the kubelet works out an overall Pod storage limit by
|
||
summing the limits for the containers in that Pod. In this case, if the sum of
|
||
the local ephemeral storage usage from all containers and also the Pod's `emptyDir`
|
||
volumes exceeds the overall Pod storage limit, then the kubelet also marks the Pod
|
||
for eviction.
|
||
-->
|
||
就容器层面的隔离而言，如果某容器的可写入镜像层和日志用量超出其存储限制，
|
||
kubelet 也会将所在的 Pod 标记为逐出候选。
|
||
|
||
就 Pod 层面的隔离而言，kubelet 会将 Pod 中所有容器的限制相加，得到 Pod
|
||
存储限制的总值。如果所有容器的本地临时性存储用量总和加上 Pod 的 `emptyDir`
|
||
卷的用量超出 Pod 存储限制，kubelet 也会将该 Pod 标记为逐出候选。
|
||
|
||
{{< caution >}}
|
||
<!--
|
||
If the kubelet is not measuring local ephemeral storage, then a Pod
|
||
that exceeds its local storage limit will not be evicted for breaching
|
||
local storage resource limits.
|
||
|
||
However, if the filesystem space for writeable container layers, node-level logs,
|
||
or `emptyDir` volumes falls low, the node
|
||
{{< glossary_tooltip text="taints" term_id="taint" >}} itself as short on local storage
|
||
and this taint triggers eviction for any Pods that don't specifically tolerate the taint.
|
||
|
||
See the supported [configurations](#configurations-for-local-ephemeral-storage)
|
||
for ephemeral local storage.
|
||
-->
|
||
如果 kubelet 没有度量本地临时性存储的用量，即使 Pod
|
||
的本地存储用量超出其限制也不会被逐出。
|
||
|
||
不过，如果用于可写入容器镜像层、节点层面日志或者 `emptyDir` 卷的文件系统中可用空间太少，
|
||
节点会为自身设置本地存储不足的{{< glossary_tooltip text="污点" term_id="taint" >}}标签。
|
||
这一污点会触发对那些无法容忍该污点的 Pod 的逐出操作。
|
||
|
||
关于临时性本地存储的配置信息，请参考[这里](#configurations-for-local-ephemeral-storage)
|
||
{{< /caution >}}
|
||
|
||
<!--
|
||
The kubelet supports different ways to measure Pod storage use:
|
||
-->
|
||
kubelet 支持使用不同方式来度量 Pod 的存储用量：
|
||
|
||
{{< tabs name="resource-emphemeralstorage-measurement" >}}
|
||
{{% tab name="周期性扫描" %}}
|
||
|
||
<!--
|
||
The kubelet performs regular, scheduled checks that scan each
|
||
`emptyDir` volume, container log directory, and writeable container layer.
|
||
|
||
The scan measures how much space is used.
|
||
-->
|
||
kubelet 按预定周期执行扫描操作，检查 `emptyDir` 卷、容器日志目录以及可写入容器镜像层。
|
||
|
||
这一扫描会度量存储空间用量。
|
||
|
||
{{< note >}}
|
||
<!--
|
||
In this mode, the kubelet does not track open file descriptors
|
||
for deleted files.
|
||
|
||
If you (or a container) create a file inside an `emptyDir` volume,
|
||
something then opens that file, and you delete the file while it is
|
||
still open, then the inode for the deleted file stays until you close
|
||
that file but the kubelet does not categorize the space as in use.
|
||
-->
|
||
在这种模式下，kubelet 并不检查已删除文件所对应的、仍处于打开状态的文件描述符。
|
||
|
||
如果你（或者容器）在 `emptyDir` 卷中创建了一个文件，
|
||
写入一些内容之后再次打开该文件并执行了删除操作，所删除文件对应的 inode 仍然存在，
|
||
直到你关闭该文件为止。kubelet 不会将该文件所占用的空间视为已使用空间。
|
||
{{< /note >}}
|
||
|
||
{{% /tab %}}
|
||
|
||
{{% tab name="文件系统项目配额" %}}
|
||
|
||
{{< feature-state feature_gate_name="LocalStorageCapacityIsolationFSQuotaMonitoring" >}}
|
||
|
||
<!--
|
||
Project quotas are an operating-system level feature for managing
|
||
storage use on filesystems. With Kubernetes, you can enable project
|
||
quotas for monitoring storage use. Make sure that the filesystem
|
||
backing the `emptyDir` volumes, on the node, provides project quota support.
|
||
For example, XFS and ext4fs offer project quotas.
|
||
-->
|
||
项目配额（Project Quota）是一个操作系统层的功能特性，用来管理文件系统中的存储用量。
|
||
在 Kubernetes 中，你可以启用项目配额以监视存储用量。
|
||
你需要确保节点上为 `emptyDir` 提供存储的文件系统支持项目配额。
|
||
例如，XFS 和 ext4fs 文件系统都支持项目配额。
|
||
|
||
{{< note >}}
|
||
<!--
|
||
Project quotas let you monitor storage use; they do not enforce limits.
|
||
-->
|
||
项目配额可以帮你监视存储用量，但无法强制执行限制。
|
||
{{< /note >}}
|
||
|
||
<!--
|
||
Kubernetes uses project IDs starting from `1048576`. The IDs in use are
|
||
registered in `/etc/projects` and `/etc/projid`. If project IDs in
|
||
this range are used for other purposes on the system, those project
|
||
IDs must be registered in `/etc/projects` and `/etc/projid` so that
|
||
Kubernetes does not use them.
|
||
|
||
Quotas are faster and more accurate than directory scanning. When a
|
||
directory is assigned to a project, all files created under a
|
||
directory are created in that project, and the kernel merely has to
|
||
keep track of how many blocks are in use by files in that project.
|
||
If a file is created and deleted, but has an open file descriptor,
|
||
it continues to consume space. Quota tracking records that space accurately
|
||
whereas directory scans overlook the storage used by deleted files.
|
||
-->
|
||
Kubernetes 所使用的项目 ID 始于 `1048576`。
|
||
所使用的 IDs 会注册在 `/etc/projects` 和 `/etc/projid` 文件中。
|
||
如果该范围中的项目 ID 已经在系统中被用于其他目的，则已占用的项目 ID
|
||
也必须注册到 `/etc/projects` 和 `/etc/projid` 中，这样 Kubernetes
|
||
才不会使用它们。
|
||
|
||
配额方式与目录扫描方式相比速度更快，结果更精确。当某个目录被分配给某个项目时，
|
||
该目录下所创建的所有文件都属于该项目，内核只需要跟踪该项目中的文件所使用的存储块个数。
|
||
如果某文件被创建后又被删除，但对应文件描述符仍处于打开状态，
|
||
该文件会继续耗用存储空间。配额跟踪技术能够精确第记录对应存储空间的状态，
|
||
而目录扫描方式会忽略被删除文件所占用的空间。
|
||
|
||
<!--
|
||
To use quotas to track a pod's resource usage, the pod must be in
|
||
a user namespace. Within user namespaces, the kernel restricts changes
|
||
to projectIDs on the filesystem, ensuring the reliability of storage
|
||
metrics calculated by quotas.
|
||
-->
|
||
要使用配额来跟踪 Pod 的资源使用情况，Pod 必须位于用户命名空间中。
|
||
在用户命名空间内，内核限制对文件系统上 projectID 的更改，从而确保按配额计算的存储指标的可靠性。
|
||
|
||
<!--
|
||
If you want to use project quotas, you should:
|
||
|
||
* Enable the `LocalStorageCapacityIsolationFSQuotaMonitoring=true`
|
||
[feature gate](/docs/reference/command-line-tools-reference/feature-gates/)
|
||
using the `featureGates` field in the
|
||
[kubelet configuration](/docs/reference/config-api/kubelet-config.v1beta1/).
|
||
-->
|
||
如果你希望使用项目配额，你需要：
|
||
|
||
* 在 [kubelet 配置](/zh-cn/docs/reference/config-api/kubelet-config.v1beta1/)中使用
|
||
`featureGates` 字段启用
|
||
`LocalStorageCapacityIsolationFSQuotaMonitoring=true` [特性门控](/zh-cn/docs/reference/command-line-tools-reference/feature-gates/)。
|
||
|
||
<!--
|
||
* Ensure the `UserNamespacesSupport`
|
||
[feature gate](/docs/reference/command-line-tools-reference/feature-gates/)
|
||
is enabled, and that the kernel, CRI implementation and OCI runtime support user namespaces.
|
||
-->
|
||
* 确保 `UserNamespacesSupport` [特性门控](/zh-cn/docs/reference/command-line-tools-reference/feature-gates/)已启用，
|
||
并且内核、CRI 实现和 OCI 运行时支持用户命名空间。
|
||
|
||
<!--
|
||
* Ensure that the root filesystem (or optional runtime filesystem)
|
||
has project quotas enabled. All XFS filesystems support project quotas.
|
||
For ext4 filesystems, you need to enable the project quota tracking feature
|
||
while the filesystem is not mounted.
|
||
|
||
```bash
|
||
# For ext4, with /dev/block-device not mounted
|
||
sudo tune2fs -O project -Q prjquota /dev/block-device
|
||
```
|
||
-->
|
||
* 确保根文件系统（或者可选的运行时文件系统）启用了项目配额。所有 XFS
|
||
文件系统都支持项目配额。
|
||
对 extf 文件系统而言，你需要在文件系统尚未被挂载时启用项目配额跟踪特性：
|
||
|
||
```bash
|
||
# 对 ext4 而言，在 /dev/block-device 尚未被挂载时执行下面操作
|
||
sudo tune2fs -O project -Q prjquota /dev/block-device
|
||
```
|
||
|
||
<!--
|
||
* Ensure that the root filesystem (or optional runtime filesystem) is
|
||
mounted with project quotas enabled. For both XFS and ext4fs, the
|
||
mount option is named `prjquota`.
|
||
-->
|
||
* 确保根文件系统（或者可选的运行时文件系统）在挂载时项目配额特性是被启用了的。
|
||
对于 XFS 和 ext4fs 而言，对应的挂载选项称作 `prjquota`。
|
||
|
||
<!--
|
||
If you don't want to use project quotas, you should:
|
||
|
||
* Disable the `LocalStorageCapacityIsolationFSQuotaMonitoring`
|
||
[feature gate](/docs/reference/command-line-tools-reference/feature-gates/)
|
||
using the `featureGates` field in the
|
||
[kubelet configuration](/docs/reference/config-api/kubelet-config.v1beta1/).
|
||
-->
|
||
如果不想使用项目配额，你应该：
|
||
|
||
* 使用 [kubelet 配置](/zh-cn/docs/reference/config-api/kubelet-config.v1beta1/)中的
|
||
`featureGates` 字段禁用 `LocalStorageCapacityIsolationFSQuotaMonitoring`
|
||
[特性门控](/zh-cn/docs/reference/command-line-tools-reference/feature-gates/)。
|
||
|
||
{{% /tab %}}
|
||
{{< /tabs >}}
|
||
|
||
<!--
|
||
## Extended resources
|
||
|
||
Extended resources are fully-qualified resource names outside the
|
||
`kubernetes.io` domain. They allow cluster operators to advertise and users to
|
||
consume the non-Kubernetes-built-in resources.
|
||
|
||
There are two steps required to use Extended Resources. First, the cluster
|
||
operator must advertise an Extended Resource. Second, users must request the
|
||
Extended Resource in Pods.
|
||
-->
|
||
## 扩展资源（Extended Resources） {#extended-resources}
|
||
|
||
扩展资源是 `kubernetes.io` 域名之外的标准资源名称。
|
||
它们使得集群管理员能够颁布非 Kubernetes 内置资源，而用户可以使用他们。
|
||
|
||
使用扩展资源需要两个步骤。首先，集群管理员必须颁布扩展资源。
|
||
其次，用户必须在 Pod 中请求扩展资源。
|
||
|
||
<!--
|
||
### Managing extended resources
|
||
|
||
#### Node-level extended resources
|
||
|
||
Node-level extended resources are tied to nodes.
|
||
|
||
##### Device plugin managed resources
|
||
|
||
See [Device
|
||
Plugin](/docs/concepts/extend-kubernetes/compute-storage-net/device-plugins/)
|
||
for how to advertise device plugin managed resources on each node.
|
||
-->
|
||
### 管理扩展资源 {#managing-extended-resources}
|
||
|
||
#### 节点级扩展资源 {#node-level-extended-resources}
|
||
|
||
节点级扩展资源绑定到节点。
|
||
|
||
##### 设备插件管理的资源 {#device-plugin-managed-resources}
|
||
|
||
有关如何颁布在各节点上由设备插件所管理的资源，
|
||
请参阅[设备插件](/zh-cn/docs/concepts/extend-kubernetes/compute-storage-net/device-plugins/)。
|
||
|
||
<!--
|
||
##### Other resources
|
||
|
||
To advertise a new node-level extended resource, the cluster operator can
|
||
submit a `PATCH` HTTP request to the API server to specify the available
|
||
quantity in the `status.capacity` for a node in the cluster. After this
|
||
operation, the node's `status.capacity` will include a new resource. The
|
||
`status.allocatable` field is updated automatically with the new resource
|
||
asynchronously by the kubelet.
|
||
-->
|
||
##### 其他资源 {#other-resources}
|
||
|
||
为了颁布新的节点级扩展资源，集群操作员可以向 API 服务器提交 `PATCH` HTTP 请求，
|
||
以在集群中节点的 `status.capacity` 中为其配置可用数量。
|
||
完成此操作后，节点的 `status.capacity` 字段中将包含新资源。
|
||
kubelet 会异步地对 `status.allocatable` 字段执行自动更新操作，使之包含新资源。
|
||
|
||
<!--
|
||
Because the scheduler uses the node's `status.allocatable` value when
|
||
evaluating Pod fitness, the scheduler only takes account of the new value after
|
||
that asynchronous update. There may be a short delay between patching the
|
||
node capacity with a new resource and the time when the first Pod that requests
|
||
the resource can be scheduled on that node.
|
||
-->
|
||
由于调度器在评估 Pod 是否适合在某节点上执行时会使用节点的 `status.allocatable` 值，
|
||
调度器只会考虑异步更新之后的新值。
|
||
在更新节点容量使之包含新资源之后和请求该资源的第一个 Pod 被调度到该节点之间，
|
||
可能会有短暂的延迟。
|
||
|
||
<!--
|
||
**Example:**
|
||
|
||
Here is an example showing how to use `curl` to form an HTTP request that
|
||
advertises five "example.com/foo" resources on node `k8s-node-1` whose master
|
||
is `k8s-master`.
|
||
-->
|
||
**示例：**
|
||
|
||
这是一个示例，显示了如何使用 `curl` 构造 HTTP 请求，公告主节点为 `k8s-master`
|
||
的节点 `k8s-node-1` 上存在五个 `example.com/foo` 资源。
|
||
|
||
```shell
|
||
curl --header "Content-Type: application/json-patch+json" \
|
||
--request PATCH \
|
||
--data '[{"op": "add", "path": "/status/capacity/example.com~1foo", "value": "5"}]' \
|
||
http://k8s-master:8080/api/v1/nodes/k8s-node-1/status
|
||
```
|
||
|
||
{{< note >}}
|
||
<!--
|
||
In the preceding request, `~1` is the encoding for the character `/`
|
||
in the patch path. The operation path value in JSON-Patch is interpreted as a
|
||
JSON-Pointer. For more details, see
|
||
[IETF RFC 6901, section 3](https://tools.ietf.org/html/rfc6901#section-3).
|
||
-->
|
||
在前面的请求中，`~1` 是在 patch 路径中对字符 `/` 的编码。
|
||
JSON-Patch 中的操作路径的值被视为 JSON-Pointer 类型。
|
||
有关更多详细信息，请参见
|
||
[IETF RFC 6901 第 3 节](https://tools.ietf.org/html/rfc6901#section-3)。
|
||
{{< /note >}}
|
||
|
||
<!--
|
||
#### Cluster-level extended resources
|
||
|
||
Cluster-level extended resources are not tied to nodes. They are usually managed
|
||
by scheduler extenders, which handle the resource consumption and resource quota.
|
||
|
||
You can specify the extended resources that are handled by scheduler extenders
|
||
in [scheduler configuration](/docs/reference/config-api/kube-scheduler-config.v1/)
|
||
-->
|
||
#### 集群层面的扩展资源 {#cluster-level-extended-resources}
|
||
|
||
集群层面的扩展资源并不绑定到具体节点。
|
||
它们通常由调度器扩展程序（Scheduler Extenders）管理，这些程序处理资源消耗和资源配额。
|
||
|
||
你可以在[调度器配置](/zh-cn/docs/reference/config-api/kube-scheduler-config.v1/)
|
||
中指定由调度器扩展程序处理的扩展资源。
|
||
|
||
<!--
|
||
**Example:**
|
||
|
||
The following configuration for a scheduler policy indicates that the
|
||
cluster-level extended resource "example.com/foo" is handled by the scheduler
|
||
extender.
|
||
|
||
- The scheduler sends a Pod to the scheduler extender only if the Pod requests
|
||
"example.com/foo".
|
||
- The `ignoredByScheduler` field specifies that the scheduler does not check
|
||
the "example.com/foo" resource in its `PodFitsResources` predicate.
|
||
-->
|
||
**示例：**
|
||
|
||
下面的调度器策略配置标明集群层扩展资源 "example.com/foo" 由调度器扩展程序处理。
|
||
|
||
- 仅当 Pod 请求 "example.com/foo" 时，调度器才会将 Pod 发送到调度器扩展程序。
|
||
- `ignoredByScheduler` 字段指定调度器不要在其 `PodFitsResources` 断言中检查
|
||
"example.com/foo" 资源。
|
||
|
||
```json
|
||
{
|
||
"kind": "Policy",
|
||
"apiVersion": "v1",
|
||
"extenders": [
|
||
{
|
||
"urlPrefix": "<extender-endpoint>",
|
||
"bindVerb": "bind",
|
||
"managedResources": [
|
||
{
|
||
"name": "example.com/foo",
|
||
"ignoredByScheduler": true
|
||
}
|
||
]
|
||
}
|
||
]
|
||
}
|
||
```
|
||
|
||
<!--
|
||
### Consuming extended resources
|
||
|
||
Users can consume extended resources in Pod specs like CPU and memory.
|
||
The scheduler takes care of the resource accounting so that no more than the
|
||
available amount is simultaneously allocated to Pods.
|
||
-->
|
||
### 使用扩展资源 {#consuming-extended-resources}
|
||
|
||
就像 CPU 和内存一样，用户可以在 Pod 的规约中使用扩展资源。
|
||
调度器负责资源的核算，确保同时分配给 Pod 的资源总量不会超过可用数量。
|
||
|
||
<!--
|
||
The API server restricts quantities of extended resources to whole numbers.
|
||
Examples of _valid_ quantities are `3`, `3000m` and `3Ki`. Examples of
|
||
_invalid_ quantities are `0.5` and `1500m` (because `1500m` would result in `1.5`).
|
||
-->
|
||
API 服务器将扩展资源的数量限制为整数。
|
||
**有效** 数量的示例是 `3`、`3000m` 和 `3Ki`。
|
||
**无效** 数量的示例是 `0.5` 和 `1500m`（因为 `1500m` 结果等同于 `1.5`）。
|
||
|
||
{{< note >}}
|
||
<!--
|
||
Extended resources replace Opaque Integer Resources.
|
||
Users can use any domain name prefix other than `kubernetes.io` which is reserved.
|
||
-->
|
||
扩展资源取代了非透明整数资源（Opaque Integer Resources，OIR）。
|
||
用户可以使用 `kubernetes.io`（保留）以外的任何域名前缀。
|
||
{{< /note >}}
|
||
|
||
<!--
|
||
To consume an extended resource in a Pod, include the resource name as a key
|
||
in the `spec.containers[].resources.limits` map in the container spec.
|
||
-->
|
||
要在 Pod 中使用扩展资源，请在容器规约的 `spec.containers[].resources.limits`
|
||
映射中包含资源名称作为键。
|
||
|
||
{{< note >}}
|
||
<!--
|
||
Extended resources cannot be overcommitted, so request and limit
|
||
must be equal if both are present in a container spec.
|
||
-->
|
||
扩展资源不能过量使用，因此如果容器规约中同时存在请求和限制，则它们的取值必须相同。
|
||
{{< /note >}}
|
||
|
||
<!--
|
||
A Pod is scheduled only if all of the resource requests are satisfied, including
|
||
CPU, memory and any extended resources. The Pod remains in the `PENDING` state
|
||
as long as the resource request cannot be satisfied.
|
||
|
||
**Example:**
|
||
|
||
The Pod below requests 2 CPUs and 1 "example.com/foo" (an extended resource).
|
||
-->
|
||
仅当所有资源请求（包括 CPU、内存和任何扩展资源）都被满足时，Pod 才能被调度。
|
||
在资源请求无法满足时，Pod 会保持在 `PENDING` 状态。
|
||
|
||
**示例：**
|
||
|
||
下面的 Pod 请求 2 个 CPU 和 1 个 "example.com/foo"（扩展资源）。
|
||
|
||
```yaml
|
||
apiVersion: v1
|
||
kind: Pod
|
||
metadata:
|
||
name: my-pod
|
||
spec:
|
||
containers:
|
||
- name: my-container
|
||
image: myimage
|
||
resources:
|
||
requests:
|
||
cpu: 2
|
||
example.com/foo: 1
|
||
limits:
|
||
example.com/foo: 1
|
||
```
|
||
|
||
<!--
|
||
## PID limiting
|
||
|
||
Process ID (PID) limits allow for the configuration of a kubelet
|
||
to limit the number of PIDs that a given Pod can consume. See
|
||
[PID Limiting](/docs/concepts/policy/pid-limiting/) for information.
|
||
-->
|
||
## PID 限制 {#pid-limiting}
|
||
|
||
进程 ID（PID）限制允许对 kubelet 进行配置，以限制给定 Pod 可以消耗的 PID 数量。
|
||
有关信息，请参见 [PID 限制](/zh-cn/docs/concepts/policy/pid-limiting/)。
|
||
|
||
<!--
|
||
## Troubleshooting
|
||
|
||
### My Pods are pending with event message `FailedScheduling`
|
||
|
||
If the scheduler cannot find any node where a Pod can fit, the Pod remains
|
||
unscheduled until a place can be found. An
|
||
[Event](/docs/reference/kubernetes-api/cluster-resources/event-v1/) is produced
|
||
each time the scheduler fails to find a place for the Pod. You can use `kubectl`
|
||
to view the events for a Pod; for example:
|
||
-->
|
||
## 疑难解答 {#troubleshooting}
|
||
|
||
### 我的 Pod 处于悬决状态且事件信息显示 `FailedScheduling` {#my-pods-are-pending-with-event-message-failedscheduling}
|
||
|
||
如果调度器找不到该 Pod 可以匹配的任何节点，则该 Pod 将保持未被调度状态，
|
||
直到找到一个可以被调度到的位置。每当调度器找不到 Pod 可以调度的地方时，
|
||
会产生一个 [Event](/zh-cn/docs/reference/kubernetes-api/cluster-resources/event-v1/)。
|
||
你可以使用 `kubectl` 来查看 Pod 的事件；例如：
|
||
|
||
```shell
|
||
kubectl describe pod frontend | grep -A 9999999999 Events
|
||
```
|
||
|
||
```
|
||
Events:
|
||
Type Reason Age From Message
|
||
---- ------ ---- ---- -------
|
||
Warning FailedScheduling 23s default-scheduler 0/42 nodes available: insufficient cpu
|
||
```
|
||
|
||
<!--
|
||
In the preceding example, the Pod named "frontend" fails to be scheduled due to
|
||
insufficient CPU resource on any node. Similar error messages can also suggest
|
||
failure due to insufficient memory (PodExceedsFreeMemory). In general, if a Pod
|
||
is pending with a message of this type, there are several things to try:
|
||
|
||
- Add more nodes to the cluster.
|
||
- Terminate unneeded Pods to make room for pending Pods.
|
||
- Check that the Pod is not larger than all the nodes. For example, if all the
|
||
nodes have a capacity of `cpu: 1`, then a Pod with a request of `cpu: 1.1` will
|
||
never be scheduled.
|
||
- Check for node taints. If most of your nodes are tainted, and the new Pod does
|
||
not tolerate that taint, the scheduler only considers placements onto the
|
||
remaining nodes that don't have that taint.
|
||
|
||
You can check node capacities and amounts allocated with the
|
||
`kubectl describe nodes` command. For example:
|
||
-->
|
||
在上述示例中，由于节点上的 CPU 资源不足，名为 “frontend” 的 Pod 无法被调度。
|
||
由于内存不足（PodExceedsFreeMemory）而导致失败时，也有类似的错误消息。
|
||
一般来说，如果 Pod 处于悬决状态且有这种类型的消息时，你可以尝试如下几件事情：
|
||
|
||
- 向集群添加更多节点。
|
||
- 终止不需要的 Pod，为悬决的 Pod 腾出空间。
|
||
- 检查 Pod 所需的资源是否超出所有节点的资源容量。例如，如果所有节点的容量都是 `cpu：1`，
|
||
那么一个请求为 `cpu: 1.1` 的 Pod 永远不会被调度。
|
||
- 检查节点上的污点设置。如果集群中节点上存在污点，而新的 Pod 不能容忍污点，
|
||
调度器只会考虑将 Pod 调度到不带有该污点的节点上。
|
||
|
||
你可以使用 `kubectl describe nodes` 命令检查节点容量和已分配的资源数量。例如：
|
||
|
||
```shell
|
||
kubectl describe nodes e2e-test-node-pool-4lw4
|
||
```
|
||
|
||
```
|
||
Name: e2e-test-node-pool-4lw4
|
||
[ ... 这里忽略了若干行以便阅读 ...]
|
||
Capacity:
|
||
cpu: 2
|
||
memory: 7679792Ki
|
||
pods: 110
|
||
Allocatable:
|
||
cpu: 1800m
|
||
memory: 7474992Ki
|
||
pods: 110
|
||
[ ... 这里忽略了若干行以便阅读 ...]
|
||
Non-terminated Pods: (5 in total)
|
||
Namespace Name CPU Requests CPU Limits Memory Requests Memory Limits
|
||
--------- ---- ------------ ---------- --------------- -------------
|
||
kube-system fluentd-gcp-v1.38-28bv1 100m (5%) 0 (0%) 200Mi (2%) 200Mi (2%)
|
||
kube-system kube-dns-3297075139-61lj3 260m (13%) 0 (0%) 100Mi (1%) 170Mi (2%)
|
||
kube-system kube-proxy-e2e-test-... 100m (5%) 0 (0%) 0 (0%) 0 (0%)
|
||
kube-system monitoring-influxdb-grafana-v4-z1m12 200m (10%) 200m (10%) 600Mi (8%) 600Mi (8%)
|
||
kube-system node-problem-detector-v0.1-fj7m3 20m (1%) 200m (10%) 20Mi (0%) 100Mi (1%)
|
||
Allocated resources:
|
||
(Total limits may be over 100 percent, i.e., overcommitted.)
|
||
CPU Requests CPU Limits Memory Requests Memory Limits
|
||
------------ ---------- --------------- -------------
|
||
680m (34%) 400m (20%) 920Mi (11%) 1070Mi (13%)
|
||
```
|
||
|
||
<!--
|
||
In the preceding output, you can see that if a Pod requests more than 1.120 CPUs
|
||
or more than 6.23Gi of memory, that Pod will not fit on the node.
|
||
|
||
By looking at the “Pods” section, you can see which Pods are taking up space on
|
||
the node.
|
||
-->
|
||
在上面的输出中，你可以看到如果 Pod 请求超过 1.120 CPU 或者 6.23Gi 内存，节点将无法满足。
|
||
|
||
通过查看 "Pods" 部分，你将看到哪些 Pod 占用了节点上的资源。
|
||
|
||
<!--
|
||
The amount of resources available to Pods is less than the node capacity because
|
||
system daemons use a portion of the available resources. Within the Kubernetes API,
|
||
each Node has a `.status.allocatable` field
|
||
(see [NodeStatus](/docs/reference/kubernetes-api/cluster-resources/node-v1/#NodeStatus)
|
||
for details).
|
||
-->
|
||
Pods 可用的资源量低于节点的资源总量，因为系统守护进程也会使用一部分可用资源。
|
||
在 Kubernetes API 中，每个 Node 都有一个 `.status.allocatable` 字段
|
||
（详情参见 [NodeStatus](/zh-cn/docs/reference/kubernetes-api/cluster-resources/node-v1/#NodeStatus)）。
|
||
|
||
<!--
|
||
The `.status.allocatable` field describes the amount of resources that are available
|
||
to Pods on that node (for example: 15 virtual CPUs and 7538 MiB of memory).
|
||
For more information on node allocatable resources in Kubernetes, see
|
||
[Reserve Compute Resources for System Daemons](/docs/tasks/administer-cluster/reserve-compute-resources/).
|
||
-->
|
||
字段 `.status.allocatable` 描述节点上可以用于 Pod 的资源总量（例如：15 个虚拟
|
||
CPU、7538 MiB 内存）。关于 Kubernetes 中节点可分配资源的信息，
|
||
可参阅[为系统守护进程预留计算资源](/zh-cn/docs/tasks/administer-cluster/reserve-compute-resources/)。
|
||
|
||
<!--
|
||
You can configure [resource quotas](/docs/concepts/policy/resource-quotas/)
|
||
to limit the total amount of resources that a namespace can consume.
|
||
Kubernetes enforces quotas for objects in particular namespace when there is a
|
||
ResourceQuota in that namespace.
|
||
For example, if you assign specific namespaces to different teams, you
|
||
can add ResourceQuotas into those namespaces. Setting resource quotas helps to
|
||
prevent one team from using so much of any resource that this over-use affects other teams.
|
||
|
||
You should also consider what access you grant to that namespace:
|
||
**full** write access to a namespace allows someone with that access to remove any
|
||
resource, including a configured ResourceQuota.
|
||
-->
|
||
你可以配置[资源配额](/zh-cn/docs/concepts/policy/resource-quotas/)功能特性以限制每个名字空间可以使用的资源总量。
|
||
当某名字空间中存在 ResourceQuota 时，Kubernetes 会在该名字空间中的对象强制实施配额。
|
||
例如，如果你为不同的团队分配名字空间，你可以为这些名字空间添加 ResourceQuota。
|
||
设置资源配额有助于防止一个团队占用太多资源，以至于这种占用会影响其他团队。
|
||
|
||
你还需要考虑为这些名字空间设置授权访问：
|
||
为名字空间提供**全部**的写权限时，具有合适权限的人可能删除所有资源，
|
||
包括所配置的 ResourceQuota。
|
||
|
||
<!--
|
||
### My container is terminated
|
||
|
||
Your container might get terminated because it is resource-starved. To check
|
||
whether a container is being killed because it is hitting a resource limit, call
|
||
`kubectl describe pod` on the Pod of interest:
|
||
-->
|
||
|
||
### 我的容器被终止了 {#my-container-is-terminated}
|
||
|
||
你的容器可能因为资源紧张而被终止。要查看容器是否因为遇到资源限制而被杀死，
|
||
请针对相关的 Pod 执行 `kubectl describe pod`：
|
||
|
||
```shell
|
||
kubectl describe pod simmemleak-hra99
|
||
```
|
||
|
||
<!--
|
||
The output is similar to:
|
||
-->
|
||
输出类似于：
|
||
|
||
```
|
||
Name: simmemleak-hra99
|
||
Namespace: default
|
||
Image(s): saadali/simmemleak
|
||
Node: kubernetes-node-tf0f/10.240.216.66
|
||
Labels: name=simmemleak
|
||
Status: Running
|
||
Reason:
|
||
Message:
|
||
IP: 10.244.2.75
|
||
Containers:
|
||
simmemleak:
|
||
Image: saadali/simmemleak:latest
|
||
Limits:
|
||
cpu: 100m
|
||
memory: 50Mi
|
||
State: Running
|
||
Started: Tue, 07 Jul 2019 12:54:41 -0700
|
||
Last State: Terminated
|
||
Reason: OOMKilled
|
||
Exit Code: 137
|
||
Started: Fri, 07 Jul 2019 12:54:30 -0700
|
||
Finished: Fri, 07 Jul 2019 12:54:33 -0700
|
||
Ready: False
|
||
Restart Count: 5
|
||
Conditions:
|
||
Type Status
|
||
Ready False
|
||
Events:
|
||
Type Reason Age From Message
|
||
---- ------ ---- ---- -------
|
||
Normal Scheduled 42s default-scheduler Successfully assigned simmemleak-hra99 to kubernetes-node-tf0f
|
||
Normal Pulled 41s kubelet Container image "saadali/simmemleak:latest" already present on machine
|
||
Normal Created 41s kubelet Created container simmemleak
|
||
Normal Started 40s kubelet Started container simmemleak
|
||
Normal Killing 32s kubelet Killing container with id ead3fb35-5cf5-44ed-9ae1-488115be66c6: Need to kill Pod
|
||
```
|
||
|
||
<!--
|
||
In the preceding example, the `Restart Count: 5` indicates that the `simmemleak`
|
||
container in the Pod was terminated and restarted five times (so far).
|
||
The `OOMKilled` reason shows that the container tried to use more memory than its limit.
|
||
-->
|
||
在上面的例子中，`Restart Count: 5` 意味着 Pod 中的 `simmemleak`
|
||
容器被终止并且（到目前为止）重启了五次。
|
||
原因 `OOMKilled` 显示容器尝试使用超出其限制的内存量。
|
||
|
||
<!--
|
||
Your next step might be to check the application code for a memory leak. If you
|
||
find that the application is behaving how you expect, consider setting a higher
|
||
memory limit (and possibly request) for that container.
|
||
-->
|
||
你接下来要做的或许是检查应用代码，看看是否存在内存泄露。
|
||
如果你发现应用的行为与你所预期的相同，则可以考虑为该容器设置一个更高的内存限制
|
||
（也可能需要设置请求值）。
|
||
|
||
## {{% heading "whatsnext" %}}
|
||
|
||
<!--
|
||
* Get hands-on experience [assigning Memory resources to containers and Pods](/docs/tasks/configure-pod-container/assign-memory-resource/).
|
||
* Get hands-on experience [assigning CPU resources to containers and Pods](/docs/tasks/configure-pod-container/assign-cpu-resource/).
|
||
* Read how the API reference defines a [container](/docs/reference/kubernetes-api/workload-resources/pod-v1/#Container)
|
||
and its [resource requirements](/docs/reference/kubernetes-api/workload-resources/pod-v1/#resources)
|
||
* Read about [project quotas](https://www.linux.org/docs/man8/xfs_quota.html) in XFS
|
||
* Read more about the [kube-scheduler configuration reference (v1)](/docs/reference/config-api/kube-scheduler-config.v1/)
|
||
* Read more about [Quality of Service classes for Pods](/docs/concepts/workloads/pods/pod-qos/)
|
||
-->
|
||
* 获取[分配内存资源给容器和 Pod](/zh-cn/docs/tasks/configure-pod-container/assign-memory-resource/) 的实践经验
|
||
* 获取[分配 CPU 资源给容器和 Pod](/zh-cn/docs/tasks/configure-pod-container/assign-cpu-resource/) 的实践经验
|
||
* 阅读 API 参考如何定义[容器](/zh-cn/docs/reference/kubernetes-api/workload-resources/pod-v1/#Container)
|
||
及其[资源请求](/zh-cn/docs/reference/kubernetes-api/workload-resources/pod-v1/#resources)。
|
||
* 阅读 XFS 中[项目配额](https://www.linux.org/docs/man8/xfs_quota.html)的文档
|
||
* 进一步阅读 [kube-scheduler 配置参考（v1）](/zh-cn/docs/reference/config-api/kube-scheduler-config.v1/)
|
||
* 进一步阅读 [Pod 的服务质量等级](/zh-cn/docs/concepts/workloads/pods/pod-qos/)
|