diff --git a/daprdocs/content/en/developing-applications/building-blocks/pubsub/pubsub-message-ttl.md b/daprdocs/content/en/developing-applications/building-blocks/pubsub/pubsub-message-ttl.md new file mode 100644 index 000000000..239df03ab --- /dev/null +++ b/daprdocs/content/en/developing-applications/building-blocks/pubsub/pubsub-message-ttl.md @@ -0,0 +1,72 @@ +--- +type: docs +title: "Message Time-To-Live" +linkTitle: "Message TTL" +weight: 6000 +description: "Use time-to-live in Pub/Sub messages." +--- + +## Introduction + +Dapr enables per-message time-to-live (TTL). This means that applications can set time-to-live per message, and subscribers will not receive those messages after expiration. + +All Dapr [pub/sub components]({{< ref supported-pubsub >}}) are compatible with message TTL, as Dapr handles the TTL logic within the runtime. Simply set the `ttlInSeconds` metadata when publishing a message. + +In some components, such as Kafka, time-to-live can be configured in the topic via `retention.ms` as per [documentation](https://kafka.apache.org/documentation/#topicconfigs_retention.ms). With message TTL in Dapr, applications using Kafka can now set time-to-live per message in addition to per topic. + +## Native message TTL support + +When message time-to-live has native support in the component, Dapr will simply forward the time-to-live configuration without adding extra logic, keeping predictable behavior. This is helpful when the expired messages are handled differently by the component - like in Azure Service Bus, where expired messages are stored in the dead letter queue and not simply deleted. + +### Supported components + +#### Azure Service Bus + +Azure Service Bus supports [entity level time-to-live]((https://docs.microsoft.com/en-us/azure/service-bus-messaging/message-expiration)). It means that messages have a default time-to-live but can also be set with a shorter timespan at publishing time. Dapr will propagate the time-to-live metadata for the message and let Azure Service Bus handle expiration directly. + +## Non-Dapr subscribers + +If messages are consumed by subscribers without Dapr, expired messages are not automatically dropped, as expiration is handled by the Dapr runtime when a Dapr application receives a message. However, subscribers can programmatically drop expired messages by adding logic to handle the `expiration` attribute in the cloud event, which follows the [RFC3339](https://tools.ietf.org/html/rfc3339) format. + +When non-Dapr subscribers use components such as Azure Service Bus, which natively handle message TTL, they will not receive expired messages. No extra logic is needed. + +## Example + +Message TTL can be set in the metadata as part of the publishing request: + +{{< tabs curl "Python SDK">}} + +{{% codetab %}} +```bash +curl -X "POST" http://localhost:3500/v1.0/publish/pubsub/TOPIC_A?metadata.ttlInSeconds=120 -H "Content-Type: application/json" -d '{"order-number": "345"}' +``` +{{% /codetab %}} + +{{% codetab %}} +```python +from dapr.clients import DaprClient + +with DaprClient() as d: + req_data = { + 'order-number': '345' + } + # Create a typed message with content type and body + resp = d.publish_event( + pubsub_name='pubsub', + topic='TOPIC_A', + data=json.dumps(req_data), + metadata=( + ('ttlInSeconds', '120') + ) + ) + # Print the request + print(req_data, flush=True) +``` +{{% /codetab %}} + +{{< /tabs >}} + +See [this guide]({{< ref pubsub_api.md >}}) for a full reference on the pub/sub API. + +## Related links +- [Pub/sub API reference]({{< ref pubsub_api.md >}}) \ No newline at end of file diff --git a/daprdocs/content/en/reference/api/pubsub_api.md b/daprdocs/content/en/reference/api/pubsub_api.md index eedff06ad..3a1e29626 100644 --- a/daprdocs/content/en/reference/api/pubsub_api.md +++ b/daprdocs/content/en/reference/api/pubsub_api.md @@ -14,7 +14,7 @@ Dapr guarantees at least once semantics for this endpoint. ### HTTP Request ``` -POST http://localhost:/v1.0/publish// +POST http://localhost:/v1.0/publish//[?] ``` ### HTTP Response codes @@ -31,8 +31,9 @@ Code | Description Parameter | Description --------- | ----------- daprPort | the Dapr port -pubsubname | the name of pubsub component. +pubsubname | the name of pubsub component topic | the name of the topic +metadata | query parameters for metadata as described below > Note, all URL parameters are case-sensitive. @@ -44,6 +45,16 @@ curl -X POST http://localhost:3500/v1.0/publish/pubsubName/deathStarStatus \ }' ``` +#### Metadata + +Metadata can be sent via query parameters in the request's URL. It must be prefixed with `metadata.` as shown below. + +Parameter | Description +--------- | ----------- +metadata.ttlInSeconds | the number of seconds for the message to expire as [described here]({{< ref pubsub-message-ttl.md >}}) + +> Additional metadata parameters are available based on each pubsub component. + ## Optional Application (User Code) Routes ### Provide a route for Dapr to discover topic subscriptions