Migrate Kafka components installation to new components (#4939)

* Migrate Kafka components installation to new components

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Remove reset offset

Signed-off-by: Pierangelo Di Pilato <pierdipi@redhat.com>

* Deprecate consolidated and distributed channels
This commit is contained in:
Pierangelo Di Pilato 2022-06-29 22:24:30 +02:00 committed by GitHub
parent 60664eaa0a
commit 1f5bde59f2
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
4 changed files with 46 additions and 19 deletions

View File

@ -16,9 +16,11 @@ This is a non-exhaustive list of the available Channels for Knative Eventing.
!!! note !!! note
Inclusion in this list is not an endorsement, nor does it imply any level of support. Inclusion in this list is not an endorsement, nor does it imply any level of support.
Name | Status | Support | Description Name | Status | Support | Description
--- | --- | --- | --- --- |------------------| --- | ---
[GCP PubSub](https://github.com/google/knative-gcp) | Proof of Concept | None | Channels are backed by [GCP PubSub](https://cloud.google.com/pubsub/). [GCP PubSub](https://github.com/google/knative-gcp) | Proof of Concept | None | Channels are backed by [GCP PubSub](https://cloud.google.com/pubsub/).
[InMemoryChannel](https://github.com/knative/eventing/tree/{{ branch }}/config/channels/in-memory-channel/README.md) | Proof of Concept | None | In-memory channels are a best effort Channel. They should NOT be used in Production. They are useful for development. [InMemoryChannel](https://github.com/knative/eventing/tree/{{ branch }}/config/channels/in-memory-channel/README.md) | Proof of Concept | None | In-memory channels are a best effort Channel. They should NOT be used in Production. They are useful for development.
[KafkaChannel](https://github.com/knative-sandbox/eventing-kafka-broker/tree/{{ branch }}/docs/channel/README.md) | Proof of Concept | None | Channels are backed by [Apache Kafka](http://kafka.apache.org/) topics. [KafkaChannel](https://github.com/knative-sandbox/eventing-kafka-broker/tree/{{ branch }}/README.md) | Beta | None | Channels are backed by [Apache Kafka](http://kafka.apache.org/) topics.
[NatssChannel](https://github.com/knative-sandbox/eventing-natss/tree/{{ branch }}/config/README.md) | Proof of Concept | None | Channels are backed by [NATS Streaming](https://github.com/nats-io/nats-streaming-server#configuring). [NatssChannel](https://github.com/knative-sandbox/eventing-natss/tree/{{ branch }}/config/README.md) | Proof of Concept | None | Channels are backed by [NATS Streaming](https://github.com/nats-io/nats-streaming-server#configuring).
[KafkaChannel - Consolidated](https://github.com/knative-sandbox/eventing-kafka/tree/{{ branch }}/pkg/channel/consolidated/README.md) | Deprecated | None | Channels are backed by [Apache Kafka](http://kafka.apache.org/) topics. The original Knative KafkaChannel implementation which utilizes a single combined Kafka Producer / Consumer deployment.
[KafkaChannel - Distributed](https://github.com/knative-sandbox/eventing-kafka/tree/{{ branch }}/pkg/channel/distributed/README.md) | Deprecated | None | Channels are backed by [Apache Kafka](http://kafka.apache.org/) topics. An alternate KafkaChannel implementation, contributed by SAP's [Kyma](https://kyma-project.io/) project, which provides a more granular deployment of Producers / Consumers.

View File

@ -7,8 +7,8 @@ channels:
description: > description: >
In-memory channels are a best effort Channel. They should NOT be used in Production. They are useful for development. In-memory channels are a best effort Channel. They should NOT be used in Production. They are useful for development.
- name: KafkaChannel - name: KafkaChannel
url: https://github.com/knative-sandbox/eventing-kafka/tree/{{< branch >}}/pkg/channel/consolidated/README.md url: https://github.com/knative-sandbox/eventing-kafka-broker/tree/{{< branch >}}/README.md
status: Proof of Concept status: Beta
support: None support: None
description: > description: >
Channels are backed by [Apache Kafka](http://kafka.apache.org/) topics. Channels are backed by [Apache Kafka](http://kafka.apache.org/) topics.
@ -24,9 +24,3 @@ channels:
support: None support: None
description: > description: >
Channels are backed by [GCP PubSub](https://cloud.google.com/pubsub/). Channels are backed by [GCP PubSub](https://cloud.google.com/pubsub/).
- name: Knative sandbox channel that uses Confluent Go Client, and the librdkafka C library
url: https://github.com/knative-sandbox/eventing-kafka
status: Proof of Concept
support: None
description: >
Kafka Channel implementation, contributed by SAP's Kyma project, is a Knative Eventing implementation of a Kafka backed channel which provides advanced functionality and production grade qualities.

View File

@ -176,7 +176,7 @@ Uninstall any Eventing extensions you have installed by following the relevant p
Uninstall the Apache Kafka source by running: Uninstall the Apache Kafka source by running:
```bash ```bash
kubectl delete -f {{ artifact(org="knative-sandbox", repo="eventing-kafka", file="source.yaml") }} kubectl delete -f {{ artifact(org="knative-sandbox", repo="eventing-kafka-broker", file="eventing-kafka-source.yaml") }}
``` ```
@ -263,9 +263,7 @@ Uninstall each channel layer you have installed:
Uninstall the Apache Kafka Channel by running: Uninstall the Apache Kafka Channel by running:
```bash ```bash
curl -L "{{ artifact(org="knative-sandbox", repo="eventing-kafka", file="channel-consolidated.yaml") }}" \ kubectl delete -f {{ artifact(org="knative-sandbox",repo="eventing-kafka-broker",file="eventing-kafka-channel.yaml")}}
| sed 's/REPLACE_WITH_CLUSTER_URL/my-cluster-kafka-bootstrap.kafka:9092/' \
| kubectl delete -f -
``` ```
<!-- Ideally write steps for uninstalling Apache Kafka for Kubernetes here. --> <!-- Ideally write steps for uninstalling Apache Kafka for Kubernetes here. -->

View File

@ -50,8 +50,28 @@ Follow the procedure for the Channel of your choice:
=== "Apache Kafka Channel" === "Apache Kafka Channel"
1. Install [Strimzi](https://strimzi.io/quickstarts/).
1. Install the Apache Kafka Channel for Knative from the [`knative-sandbox` repository](https://github.com/knative-sandbox/eventing-kafka). The following commands install the KafkaChannel and run event routing in a system
namespace. The `knative-eventing` namespace is used by default.
1. Install the Kafka controller by running the following command:
```bash
kubectl apply -f {{ artifact(org="knative-sandbox",repo="eventing-kafka-broker",file="eventing-kafka-controller.yaml")}}
```
1. Install the KafkaChannel data plane by running the following command:
```bash
kubectl apply -f {{ artifact(org="knative-sandbox",repo="eventing-kafka-broker",file="eventing-kafka-channel.yaml")}}
```
1. If you're upgrading from the previous version, run the following command:
```bash
kubectl apply -f {{ artifact(org="knative-sandbox",repo="eventing-kafka-broker",file="eventing-kafka-post-install.yaml")}}
```
=== "Google Cloud Pub/Sub Channel" === "Google Cloud Pub/Sub Channel"
@ -115,6 +135,13 @@ Follow the procedure for the Broker of your choice:
kubectl apply -f {{ artifact(org="knative-sandbox",repo="eventing-kafka-broker",file="eventing-kafka-broker.yaml")}} kubectl apply -f {{ artifact(org="knative-sandbox",repo="eventing-kafka-broker",file="eventing-kafka-broker.yaml")}}
``` ```
1. If you're upgrading from the previous version, run the following command:
```bash
kubectl apply -f {{ artifact(org="knative-sandbox",repo="eventing-kafka-broker",file="eventing-kafka-post-install.yaml")}}
```
For more information, see the [Kafka Broker](../../../eventing/broker/kafka-broker/README.md) documentation. For more information, see the [Kafka Broker](../../../eventing/broker/kafka-broker/README.md) documentation.
=== "MT-Channel-based" === "MT-Channel-based"
@ -265,10 +292,16 @@ The following tabs expand to show instructions for installing each Eventing exte
=== "Apache Kafka Source" === "Apache Kafka Source"
* Install the Apache Kafka Source by running the command: 1. Install the Apache Kafka Source by running the command:
```bash ```bash
kubectl apply -f {{ artifact(org="knative-sandbox",repo="eventing-kafka",file="source.yaml")}} kubectl apply -f {{ artifact(org="knative-sandbox",repo="eventing-kafka-broker",file="eventing-kafka-source.yaml")}}
```
1. If you're upgrading from the previous version, run the following command:
```bash
kubectl apply -f {{ artifact(org="knative-sandbox",repo="eventing-kafka-broker",file="eventing-kafka-post-install.yaml")}}
``` ```
To learn more, try the [Apache Kafka source sample](../../../eventing/sources/kafka-source/README.md). To learn more, try the [Apache Kafka source sample](../../../eventing/sources/kafka-source/README.md).