* improve log of kafkaf components cert test
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* add close() method to kafka binding component to fix the consumer rebalance bug
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
* Complete Eventhubs bindings certification test
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* check if single test point runs all good
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* check if single test point runs all good
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* increase the sleep time to fix timeout
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* increase the sleep time to fix timeout
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* increase sleep for all other testpoints too
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* test behavior of single partition test
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* delete eventhub and container afer run
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* delete eventhub and container afer run
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* delete eventhub and container afer run
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* test reconnection in one test point only
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* test reconnection in one test point only
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* test reconnection in one test point only
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* test reconnection in one test point only
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* test reconnection in one test point only
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* delete the container after every test run for cleanup
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* run service principal test
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* Go mod tidy-all
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* revert back changes to last clean state
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* add unique consumer id per component yaml
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* remove consumer id from singlepartition test component yaml
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* remove repetitive test case, test service principal case
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* remove repetitive test case, test service principal case
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* test iothub
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* test iothub
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* run service principal test
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* run service principal test
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* run service principal test
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* run service principal test
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* add connection string to eventhub service principal yaml
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* use a particular partition
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* enable iothub test
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* enable iothub test
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* enable iothub test
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* final cleanup and test run
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* final cleanup and test run
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* final cleanup and test run
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* add test plan readme
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* rollback the bicep change that is not needed
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* make sure through test that a specific partition receives specific data
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* clean the container between two partiton assertions
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* put back partition id in yaml
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* add same level of partition testing for both partitions
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
* address feedback
Signed-off-by: tanvigour <tanvi.gour@gmail.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
* Moved ASB subscription code to a shared package
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
* Moved ASBQ binding to use the shared ASB implementation
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
* Updating Azure Service Bus SDK version
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
* Make Service Bus attempt to reconnect forever in case of issues
With exponential back-off configurable between min and max time. Fixes#1612
Also includes fixes:
- Binding: make sure it actually retries to connect forever
- Binding: add delay (exponential backoff) before reconnecting
- PubSub: better handling of failures such as topics disabled or other non-connection issues
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
* 💄
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
* Added warning for deprecated metadata options
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
* 💄
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
* Updated sendgrid binding to add the option to add names for the to and from addresses. This commit relates to #1749
Signed-off-by: Adam Rahja <adam@resolve.com>
* Updated sendgrid binding from code suggestion.
Signed-off-by: Adam Rahja <adam@resolve.com>
This commit is related to dapr/dapr#4624. As noted there, we have an issue in the runtime where all components are shut down after the grace period, when the app is likely already stopped. Because of that, certain input components (the subscribe part of pubsub and the input part of bindings - the latter not in scope of this PR), can continue bringing new work when it's known to fail.
In order to fix the issue linked above properly, we need to implement a way for PubSub components to have the "publish" part closed before the "subscribe" one (and in the future that will need to be done for input bindings too).
This commit achieves precisely that by adding a context in the Subscribe method. When that context is canceled (which can be at any time), the subscription is removed.
PS: This API change was implemented so it can one day be used for dapr/dapr#814 too, as it allows canceling individual subscriptions by using a different context. Although that's not possible today because it requires more work on the runtime, it does implement everything that's needed in the pubsub components already.
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
* Added test for multiple pubsub handlers
This patch adds conformance tests for PubSub with multiple handlers, each listening on a different topic.
It's meant to catch issues such as #1709
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
* Added missing go.mod for storagequeues binding test
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
* Fixes for SNS/SQS PubSub
Including:
- Fixed adding multiple handlers for different topics (tests in #1743 are now passing)
- Fixed delivering wrong message when concurrency mode is parallel
- Avoid having multiple pollers at the same time competing for messages
& more smaller fixes
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
* Fixed tests
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
* add certification test for kafka binding, the first version is copied from kafka pubsub to verify github flow
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* only run kafka pubsub and binding cert test in development
* fix typo
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* run only kafka bindings
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* add certification test for kafka binding: with and without retry
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* add config.yaml file back for kafka binding certification test
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* rollback to run all cert test before PR
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* update dependencies for kafka pubsub certification test
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* update dependencies for kafka pubsub certification test(again)
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* add network interruption test back
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* Added certification tests for Azure Storage Queue Bindings
Signed-off-by: Amulya Varote <amulyavarote@microsoft.com>
* Changes based on the review comments
Signed-off-by: Amulya Varote <amulyavarote@microsoft.com>
* Added ttl test case to fetch the unexpired messages
Signed-off-by: Amulya Varote <amulyavarote@microsoft.com>
This helps avoiding issues when multiple subscribers are added in a short period of time
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Fixes#1735
Includes:
- Adding a lock in `Subscribe` to prevent concurrency issues with multiple reconnections at the same time
- Increase default timeout from 3 to 30 seconds
- Avoid logging full message body in debug logs
- `connect` supports a context
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Bernd Verst
Alessandro (Ale) Segala
seeflood
Sky Ao
shiling02404
tanvigour
Yaron Schneider
Christian Kaps
deepanshuagarwal
Loong Dai
saber-wang
dependabot[bot]
Laurence
arahja
Pravin Pushkar
Shubham Sharma
amulyavarote