Commit Graph

317 Commits

Author SHA1 Message Date
Dominic Evans 1c657f7b5b
chore(deps): bump sarama to v1.41.0 (#3108)
Signed-off-by: Dominic Evans <dominic.evans@uk.ibm.com>
Signed-off-by: Bernd Verst <github@bernd.dev>
Co-authored-by: Bernd Verst <github@bernd.dev>
2023-08-30 00:47:25 +00:00
Josh van Leeuwen 9be6d157a4
tests/certification: Updates dapr/dapr to `master` HEAD (#3084)
Signed-off-by: joshvanl <me@joshvanl.dev>
Co-authored-by: Bernd Verst <github@bernd.dev>
2023-08-21 17:06:55 -07:00
Álvaro Aguilar-Tablada Espinosa e10d5b7e86
[RabbitMQ pub/sub] Allow quorum queues (#2816)
Signed-off-by: Bernd Verst <github@bernd.dev>
Signed-off-by: Alvaro Aguilar <alvaro.aguilar@scrm.lidl>
Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Álvaro Aguilar <95039001@lidl.de>
Signed-off-by: Álvaro Aguilar <alvaroteleco@hotmail.com>
Co-authored-by: Bernd Verst <github@bernd.dev>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Álvaro Aguilar <95039001@lidl.de>
2023-08-07 06:28:58 -07:00
Josh van Leeuwen 7937d34bb7
Pubsub pulsar authentication ~OIDC~ OAuth2 (#3026)
Signed-off-by: joshvanl <me@joshvanl.dev>
Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Co-authored-by: Bernd Verst <github@bernd.dev>
2023-08-02 17:17:55 -07:00
Alessandro (Ale) Segala c43af14d31 Revert "Adds OIDC authentication support for pubsub Apache Pulsar (#3023)"
This reverts commit af5bacebf4.
2023-08-01 12:03:04 -07:00
Josh van Leeuwen af5bacebf4
Adds OIDC authentication support for pubsub Apache Pulsar (#3023)
Signed-off-by: joshvanl <me@joshvanl.dev>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
2023-08-01 11:38:33 -07:00
Andre Bossard 9f4086fbb0
RabbitMQ Bindings: Support for mTLS and external authentication with SASL (#2656)
Signed-off-by: Andre Bossard <anbossar@microsoft.com>
Signed-off-by: Andre Bossard <abossard@users.noreply.github.com>
Co-authored-by: Andre Bossard <anbossar@microsoft.com>
Co-authored-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
Co-authored-by: Bernd Verst <github@bernd.dev>
2023-05-03 22:07:50 +00:00
Yaron Schneider a1bf2ea00a
Add Apache Pulsar e2e encryption (#2812)
Signed-off-by: yaron2 <schneider.yaron@live.com>
Co-authored-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
2023-04-28 18:19:15 +00:00
Roberto Rojas 413eee94db
GCP PubSub - Certification Tests (#2689)
Signed-off-by: Roberto J Rojas <robertojrojas@gmail.com>
Signed-off-by: Bernd Verst <github@bernd.dev>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Bernd Verst <github@bernd.dev>
2023-04-24 22:23:34 +00:00
Alessandro (Ale) Segala 3938c3e7c0
Cert tests: use a single go.mod for all certification tests (#2748)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-04-04 12:28:11 -07:00
Alessandro (Ale) Segala a9be2a6db7
Crypto components: add methods that return the list of supported algorithms (#2735)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-04-03 16:15:24 +00:00
Alessandro (Ale) Segala 3cd727a562
Crypto building block: core parts (#2690)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-03-23 00:51:27 +00:00
Ryan Lettieri 7e9b5a8b46
Creation of request and interface method for Workflow raise event (#2667)
Signed-off-by: Ryan Lettieri <ryanLettieri@microsoft.com>
Co-authored-by: Ryan Lettieri <ryanLettieri@microsoft.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2023-03-17 21:15:47 +00:00
Yaron Schneider 0e83c4adc5
Add priority queue support to rabbitmq pub/sub (#2680)
Signed-off-by: yaron2 <schneider.yaron@live.com>
2023-03-17 13:00:49 +00:00
Andre Bossard d87f4bb5a1
RabbitMQ: Support for external authentication with SASL (#2515)
Signed-off-by: Andre Bossard <anbossar@microsoft.com>
Signed-off-by: Andre Bossard <abossard@users.noreply.github.com>
Co-authored-by: Andre Bossard <anbossar@microsoft.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
2023-03-16 16:30:54 +00:00
ItalyPaleAle c20ab76972 Merge branch 'master' of https://github.com/dapr/components-contrib into merge-release-1.10-master
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-03-15 19:25:12 +00:00
bingo1229 cfb4d7ecc9
Add partition support for pulsar (#2647)
Signed-off-by: oops-oom <734819342@qq.com>
Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
2023-03-14 16:37:31 +00:00
Bernd Verst d5d6273ff2
Upgrade `azidentity` to 1.3.0-beta.4 (#2665)
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-03-13 20:16:27 +00:00
Bernd Verst 86a39f6c37 Upgrade service bus SDK to 1.2.1
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-03-07 11:53:51 -08:00
Alessandro (Ale) Segala 050ee73d61
Remove now-unused metadata properties (#2637)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-03-06 21:52:58 +00:00
Bernd Verst f2a9e30cdd
[Maintenance task] upgrade lots of libraries (#2630)
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-03-04 00:38:17 +00:00
Bernd Verst d6f35401af
Dapr 1.11: Support Azure CLI Credential for Azure Track 2 components (#2472)
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-03-03 21:23:25 +00:00
Bernd Verst 1708951cec Add Cloud Event Protobuf to PubSub Content Types
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-03-02 14:37:18 -08:00
ItalyPaleAle 8cc74c7331 Completed the removal of the Azure SDK track 1
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-27 22:37:23 +00:00
Bernd Verst c634533a83 go mod tidy
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-02-27 12:46:17 -08:00
Bernd Verst 1c48453fef Pin dapr 1.10 in cert test
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-02-24 18:20:03 -08:00
Bernd Verst 7c005d134a Upgrade Azure Storage Queue Binding to Track2 SDK
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-02-24 15:52:03 -08:00
ItalyPaleAle a583271b3f Updated to Go 1.20
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-22 21:19:41 +00:00
ItalyPaleAle 28ce086761 Updated pinned dapr/dapr in cert tests
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-17 21:29:39 +00:00
ItalyPaleAle 55b6a04805 Merge branch 'master' of https://github.com/dapr/components-contrib into newdeps
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-17 21:20:45 +00:00
ItalyPaleAle d4e4355b03 Removed mod replacement
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-17 01:16:30 +00:00
ItalyPaleAle a484d7ebc7 Merge branch 'master' of https://github.com/dapr/components-contrib into newdeps
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-16 23:35:28 +00:00
ItalyPaleAle f9cf54ca6f Merge branch 'master' of https://github.com/dapr/components-contrib into release-1.10
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-16 23:23:23 +00:00
Josh van Leeuwen d098e38d6a
Propagate context from caller to appropriate places in the code (#2474)
* Propagates contexts to callers where appropriate.

Signed-off-by: joshvanl <me@joshvanl.dev>

* Updates units tests with new func signature

Signed-off-by: joshvanl <me@joshvanl.dev>

* Fix linting errors

Signed-off-by: joshvanl <me@joshvanl.dev>

* Add atomic gate to alicloud rocketmq close channel.

Signed-off-by: joshvanl <me@joshvanl.dev>

* bindings/aws/kinesis use a separate ctx variable name

Signed-off-by: joshvanl <me@joshvanl.dev>

* binding/kafka: use atomic to prevent closing the channel twice

Signed-off-by: joshvanl <me@joshvanl.dev>

* bindings/mqtt3: use atomic bool to prevent close channel being closed multiple times

Signed-off-by: joshvanl <me@joshvanl.dev>

* bindings/mqtt3: use Background context for handle operations:w

Signed-off-by: joshvanl <me@joshvanl.dev>

* state/cocroachdb: add context to Ping()

Signed-off-by: joshvanl <me@joshvanl.dev>

* bindings/postgres: add comment explaining use of context.

Signed-off-by: joshvanl <me@joshvanl.dev>

* Adds comment header to health/pinger.go

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/aws/snssqs: add waitgroup to wait for all go routines to finish
and block on Close(). Shuts down the subscription if there are no topic
handlers.

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/mqtt3: add atomic bool to prevent multiple channel closes. Add
wait group to block close on all goroutines to finish.

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/rabbitmq: fixes race conditions, uses atomic to prevent multiple
closes, add wait group to block close on all goroutines

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/redis: revert ctx passed when it could be cancelled. Add wait
group wait when closing.

Signed-off-by: joshvanl <me@joshvanl.dev>

* state/postges: pass context in init, and wait group on close.

Signed-off-by: joshvanl <me@joshvanl.dev>

* Update all `Ping()` to `PingContext()` where possible.

Signed-off-by: joshvanl <me@joshvanl.dev>

* state/in-memory: add atomic bool to prevent closing channel multiple
times. Add wait group to block on close()

Signed-off-by: joshvanl <me@joshvanl.dev>

* state/mysql: don't use same ctx variable name

Signed-off-by: joshvanl <me@joshvanl.dev>

* Pass correct loop context to redis go routines

Signed-off-by: joshvanl <me@joshvanl.dev>

* Rename context when creating timeouts in state

Signed-off-by: joshvanl <me@joshvanl.dev>

* Remove state.Features() from requiring a context

Signed-off-by: joshvanl <me@joshvanl.dev>

* Revert wasm request handle Close func to be without context to
implement io.Closer interface. Add 5 second timeout. Add io.Closer
assertion in test.

Signed-off-by: joshvanl <me@joshvanl.dev>

* Remove superfluous go lint vet directive

Signed-off-by: joshvanl <me@joshvanl.dev>

* Change Configuration Init function to take context

Signed-off-by: joshvanl <me@joshvanl.dev>

* Updates input binding interface to include a `Close() error` function. `Close`
blocks until all resources have been released and go routines have returned.

Signed-off-by: joshvanl <me@joshvanl.dev>

* Change `Close() error` in input binding struct to `io.Closer` interface.

Signed-off-by: joshvanl <me@joshvanl.dev>

* Update go.mod files to point to dapr/dapr PR https://github.com/dapr/dapr/pull/5831

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/redis: watch closeCh to shutdown worker instead of init context.

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/aws/snssqs + bindings/kubemq: ensure closeCh is caught so Close
correctly returns

Signed-off-by: joshvanl <me@joshvanl.dev>

* Close kubemq binding client on close. Ensure kafka consumer channel
cannot be closed more than once.

Signed-off-by: joshvanl <me@joshvanl.dev>

* Tweaks

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed cert tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* binding/mqtt3: add inline Background context instead of passing to
handleMessage

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/mqtt3: remove context from createSubscriberClientOptions

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/mqtt3: Remove `ResetConnection` func

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/kafka: Don't resubscribe if Subscribe is cancelled.

Signed-off-by: joshvanl <me@joshvanl.dev>

* binding/mqtt3: don't use context to control establishing connection

Signed-off-by: joshvanl <me@joshvanl.dev>

* bindings/mqtt3: Fix linting errors

Signed-off-by: joshvanl <me@joshvanl.dev>

---------

Signed-off-by: joshvanl <me@joshvanl.dev>
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
2023-02-16 14:18:35 -08:00
ItalyPaleAle 8686fd35b5 Updated more deps
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-16 00:32:26 +00:00
Alessandro (Ale) Segala 12acf8effe
[release-1.10] Azure Service Bus: fix goroutine "explosion" after recovering from failure and many other bugs (#2523)
* Fixed context leak

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Finalize messages in background

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* More tweaks

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Moved a lot more code to the shared implementation package

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed:
- Fixed: if number of messages received in bulk is greater than maxConcurrentHandlers, a deadlock happens
- Fixed: maxRetriableErrorsPerSec was not working

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Some refactorings

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Simplifications

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Avoid checking if topic/queue exists every time we send a message

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Ensuring locks are renewed for all 3 components

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Updated ASB SDK

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Improvements to closing

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Improvements to closing

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Changed context propagation

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Debug logs in cert tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Initial delay before renewing locks

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* That last change was actually unnecessary

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Tweaks

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* More tweaks

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 💄

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

---------

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-13 09:23:03 -08:00
Bernd Verst cac417aa68 Use Go SDK v1.7.0 in certification tests
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-02-02 13:21:41 -08:00
Bernd Verst c7245bd800 pin 1.10.0-rc.2 in certification tests
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-02-02 12:15:33 -08:00
Bernd Verst 51d4a1f25c
Merge pull request #2386 from Sbolder/multiEnv_awsSqsSns
fix bug multi environment on aws sqs/sns #2364
2023-01-31 15:11:11 -08:00
Bernd Verst 608a3b0d81 Pin certification tests to v1.10.0-rc.1
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-01-31 14:15:38 -08:00
ItalyPaleAle 54cfe54c95 Fixed typo in ASB metadata property name
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-30 19:47:34 +00:00
Roberto Rojas 857c126c19
Merge branch 'master' into snssqs-cert-test-1971-disableDeleteOnRetryLimit 2023-01-26 18:47:55 -05:00
Roberto J Rojas 33cb71cf51 adds aws snssqs disableDeleteOnRetryLimit cert test
Signed-off-by: Roberto J Rojas <robertojrojas@gmail.com>
2023-01-26 18:32:47 -05:00
ItalyPaleAle 8365df0f07 Fix flaky RabbitMQ certification tests
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-26 22:09:35 +00:00
Yaron Schneider 1dc20e6c69
Add schema support to apache pulsar (#2475)
* add schema support to apache pulsar

Signed-off-by: yaron2 <schneider.yaron@live.com>

* linter and avro support

Signed-off-by: yaron2 <schneider.yaron@live.com>

* fix nit

Signed-off-by: yaron2 <schneider.yaron@live.com>

* fix go.mod

Signed-off-by: yaron2 <schneider.yaron@live.com>

* update cert test go.mod

Signed-off-by: yaron2 <schneider.yaron@live.com>

* update cert test metadata to latest

Signed-off-by: yaron2 <schneider.yaron@live.com>

* schema identifier refactor to handle edge case

Signed-off-by: yaron2 <schneider.yaron@live.com>

* fix shadow

Signed-off-by: yaron2 <schneider.yaron@live.com>

Signed-off-by: yaron2 <schneider.yaron@live.com>
2023-01-26 13:10:58 -08:00
Roberto Rojas df6ab5fb6c
Merge branch 'master' into snssqs-cert-test-1971-deadletter 2023-01-26 13:00:13 -05:00
Bernd Verst 7f7362e620
Merge branch 'master' into update-deps 2023-01-26 09:28:29 -08:00
ItalyPaleAle 76bf347533 Reverted manual changes to indirect deps and updated dapr/kit
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-26 16:18:34 +00:00
ItalyPaleAle fd5768032f 💄
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-26 01:24:47 +00:00
ItalyPaleAle cabfd3c570 Updated dependencies
Most notable: `github.com/hashicorp/golang-lru` to `/v2`

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-26 01:10:48 +00:00