dapr
/
components-contrib
mirror of https://github.com/dapr/components-contrib.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,132 Commits 55 Branches 159 Tags 84 MiB
Commit Graph

390 Commits

Author SHA1 Message Date
Tomasz Pietrek 7a3746b33a Fix lint errors 
Signed-off-by: Tomasz Pietrek <tomasz@nats.io>
 2022-10-12 11:44:00 +02:00
Tomasz Pietrek 84742aa1a8 Add more JetStream options 
Signed-off-by: Tomasz Pietrek <tomasz@nats.io>
 2022-10-12 11:23:03 +02:00
ItalyPaleAle 3bc20a1de5 Merge branch 'master' into merge-1.9 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-11 20:26:35 +00:00
Alessandro (Ale) Segala ef74e7f8b6
Azure Service Bus: consider receiving 0 messages as an error that requires reconnecting (#2169) 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-11 12:57:06 -07:00
Bernd Verst f137bc7373 rabbitmq: use ctx for publishing 
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-10-10 14:37:21 -07:00
Deepanshu Agarwal f74b4d648d Update EntryID to EntryId 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-29 15:49:45 +05:30
Shubham Sharma d29c0d6200
Add ctx to BulkPublish API (#2134) 
Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
 2022-09-28 09:55:47 -07:00
deepanshuagarwal bcd101abad
Keys rename (#2135) 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-28 09:52:59 -07:00
Mukundan Sundararajan fbde4c706b
Merge branch 'master' into feature/pubsub-batching 2022-09-27 08:15:37 +05:30
Yash Nisar ad5397ea25
Add time to CloudEvent automatically if not present (#2123) 
Closes https://github.com/dapr/dapr/issues/5137

Signed-off-by: Yash Nisar <yashnisar@microsoft.com>

Signed-off-by: Yash Nisar <yashnisar@microsoft.com>
 2022-09-26 14:44:57 -07:00
Mukundan Sundararajan 803c0591c2
Merge branch 'master' into feature/pubsub-batching 2022-09-25 12:35:33 +05:30
Mario Reggiori b0d267317d
Add individual connection arguments to pubsub.rabbitmq metadata (#2129) 
Signed-off-by: Mario Reggiori <git@marioreggiori.com>

Signed-off-by: Mario Reggiori <git@marioreggiori.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
 2022-09-23 23:37:09 -07:00
ItalyPaleAle 4724a38a01 MQTT: Add metadata options "producerID" 
Fixes dapr/dapr#5235

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-09-23 18:46:27 +00:00
Shubham Sharma cd206609ce
Use request metadata instead of component metadata (#2119) 
Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
 2022-09-23 10:49:39 -07:00
Shubham Sharma 4f406a597f
Add bulk subscribe support to Azure Service Bus (#2100) 
* Initial implementation

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* ✅

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Add tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Add comment

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor messages.go and add tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update message tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor servicebus.go logic

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor handleAsync

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor ReceiveAndBlock

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update binding

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Review comments addressed

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Lint

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update metadata name

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update activeMessagesChan logic for concurrency control

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Fix tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update metadata name

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Use request metadata instead of component metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Review comments addressed

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Fix merge issue with metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Remove unused metadata key

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Fix merge issue with metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Lint!!!

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
 2022-09-23 10:49:06 -07:00
Shubham Sharma b298b65cfe
Add bulk publish support to Azure Service Bus (#2106) 
* Initial implementation

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Some improvements

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor and add tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Lint

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Use request metadata instead of component metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Remove unused method

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Review comments addressed

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Doc comments

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
 2022-09-23 09:57:00 -07:00
deepanshuagarwal 8500da577c
Conf test for Bulk Subscribe and Kafka fixes (#2113) 
* Conf test for Bulk Sub and Kafka Fixes

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Fix linting

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Incorporating comments

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-23 09:54:21 -07:00
Mukundan Sundararajan e1697ba115 Merge branch 'master' into feature/pubsub-batching 2022-09-23 06:47:47 +05:30
mandarj123 e7be027c28
Update mqtt.go 
Signed-off-by: mandarj123 <mandar.jogalekar@capgemini.com>
 2022-09-22 10:02:08 +05:30
mandarj123 7ea805a83e
Update mqtt.go 
remove mandatory "-producer" to clientId

Signed-off-by: mandarj123 <mandar.jogalekar@capgemini.com>
 2022-09-21 16:53:53 +05:30
Mukundan Sundararajan a45f7db8b2 add bulkpublish-conf-test 
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
 2022-09-21 11:46:46 +05:30
Bernd Verst e9e750bce6 fix linter issues 
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-09-20 13:02:52 -07:00
Bernd Verst ea0e9770d4
Merge pull request #2089 from shubham1172/shubham1172/add-azure-eh-bulk-publish 
Add bulk publish support to Azure Event Hubs
 2022-09-20 11:34:51 -07:00
Deepanshu Agarwal 217505fd16 Move common costants to common utils 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-16 22:22:54 +05:30
Deepanshu Agarwal d602e0ab0c Move constants to utils 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-16 22:07:38 +05:30
Shubham Sharma 313aa9ece1 Add comment 
Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
 2022-09-16 20:11:55 +05:30
Deepanshu Agarwal 81898d5ee5 Config Per Topic and using maxAwaitDuration 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-16 20:04:32 +05:30
Shubham Sharma f7e9d25a5c Return correctly 
Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
 2022-09-16 18:26:09 +05:30
Shubham Sharma c81eefcc46 Add bulk publish for event hub 
Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
 2022-09-16 17:51:23 +05:30
Deepanshu Agarwal d31f4d99f5 Merge branch 'feature/pubsub-batching' of github.com:dapr/components-contrib into ps_batch_c_kafka 2022-09-16 11:36:23 +05:30
Mukundan Sundararajan 3f9c42c4b8
Kafka bulk publish (#2059) 
* Contrib updates for Batch Subscribe

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* commit

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Commit pubsub

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Update structs

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Update Default Batch struct name

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Update Default Batch

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Update return type for BatchPublish

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Add docs

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Rename batch to bulk

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* snssqs renam batch to bulk

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Renaming Bulker to BulkMessager

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Renaming names as discussed

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Minor updates

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Remove ContentType from BulkPublishRequest

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Update error type

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Changes to bulk subscribe and error type

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Segregating Bulk Publisher and Bulk Subscriber and removing them as mandatory

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Event Type name correction

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Docs update as per comments

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* bulk publish implementation for kafka

Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>

* Add ctx to BulkPublish.

Signed-off-by: Artur Souza <artursouza.ms@outlook.com>

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
Signed-off-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
 2022-09-15 13:17:17 -07:00
Deepanshu Agarwal f5542c70b9 Incorporate review comments and remove index based entryID 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-15 16:02:30 +05:30
Deepanshu Agarwal 70a418bfbb Merge branch 'ps_batch_c' of github.com:DeepanshuA/components-contrib into ps_batch_c_kafka 2022-09-15 15:08:36 +05:30
Deepanshu Agarwal c913c5593c Docs update as per comments 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-15 14:27:54 +05:30
Bruce Huang a6ad8cb4bf
RocketMQ fix metadata properties (#1817) 
* Removes the useless metadata attributes, AccessProto and ConsumerBatchSize, rename GroupName to ProducerGroup

Signed-off-by: helbing <helbingxxx@gmail.com>

* RocketMQ SendTimeout unit is seconds

Signed-off-by: helbing <helbingxxx@gmail.com>

* avoid breaking change

Signed-off-by: helbing <helbingxxx@gmail.com>

* implement ConsumerBatchSize option

Signed-off-by: helbing <helbingxxx@gmail.com>

* avoid breaking change

Signed-off-by: helbing <helbingxxx@gmail.com>

* add deprecated log

Signed-off-by: helbing <helbingxxx@gmail.com>

* backwards-compatibility sendTimeOut

Signed-off-by: helbing <helbingxxx@gmail.com>

* fix lint

Signed-off-by: helbing <helbingxxx@gmail.com>

* add logger import

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: helbing <helbingxxx@gmail.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: addjuarez <addiajuarez@gmail.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-09-14 14:45:47 -07:00
Deepanshu Agarwal e483dfe334 Merge branch 'ps_batch_c' of github.com:DeepanshuA/components-contrib into ps_batch_c_kafka 2022-09-14 12:20:51 +05:30
Deepanshu Agarwal 5f50fd96ae Event Type name correction 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-14 11:54:30 +05:30
Deepanshu Agarwal a1b1e3b871 Segregating Bulk Publisher and Bulk Subscriber and removing them as mandatory 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-14 10:55:48 +05:30
Crypt Keeper b379f80b75
middleware: changes wasm basic to use waPC (#1833) 
Updates wasm basic middleware and simplifies some code inside of it,
notably by using [waPC](https://github.com/wapc/wapc-go).

This changes the entrypoint function to be named "rewrite" and
uses a pool because known memory allocators are not goroutine
safe.

Signed-off-by: Adrian Cole <adrian@tetrate.io>

Signed-off-by: Adrian Cole <adrian@tetrate.io>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
 2022-09-13 17:12:59 -07:00
Xingru ed483dc88b
refactored aws sqs policy inserting (#1807) 
* refactored aws sqs policy inserting

Signed-off-by: Xingru <x.xingruxu@student.maastrichtuniversity.nl>

* Add tests and fixed tryInsertCondition not inserting bug

Signed-off-by: Xingru <x.xingruxu@student.maastrichtuniversity.nl>

* fixed lint in snssqs_test.go

Signed-off-by: Xingru <x.xingruxu@student.maastrichtuniversity.nl>

* fixed lint

Signed-off-by: Xingru <x.xingruxu@student.maastrichtuniversity.nl>

* fixed lint error in policy.go

Signed-off-by: Xingru <x.xingruxu@student.maastrichtuniversity.nl>

Signed-off-by: Xingru <x.xingruxu@student.maastrichtuniversity.nl>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Loong Dai <long.dai@intel.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
 2022-09-13 17:11:58 -07:00
Shivam Kumar 9c9df2ff76
Update log level for successful retry (#2066) 
* Update log level for successful retry

Signed-off-by: shivam <shivamkm07@gmail.com>

* Logging error after retries exhausted

Signed-off-by: shivam <shivamkm07@gmail.com>

* Fix linter error

Signed-off-by: shivam <shivamkm07@gmail.com>

Signed-off-by: shivam <shivamkm07@gmail.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
 2022-09-13 15:57:47 -07:00
Bernd Verst 1d0ad9c6d8 Use standardized metadata parser 
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-09-12 18:50:05 -07:00
Deepanshu Agarwal 059461c6f4 Add kafka changes for bulk subscribe 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-13 01:01:05 +05:30
Deepanshu Agarwal d1d3384d65 Update envelope 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-12 23:14:48 +05:30
Deepanshu Agarwal ca40728f3d Changes to bulk subscribe and error type 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-12 10:21:00 +05:30
Deepanshu Agarwal 83055bce1a Update error type 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-08 16:53:31 +05:30
Deepanshu Agarwal 287bbb12fb Remove ContentType from BulkPublishRequest 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-08 14:10:28 +05:30
Deepanshu Agarwal 335e8d9935 Minor updates 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-08 14:08:59 +05:30
Deepanshu Agarwal 9512ed284d Renaming names as discussed 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-07 18:01:13 +05:30
Deepanshu Agarwal 9988a62f4b Renaming Bulker to BulkMessager 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-07 12:47:24 +05:30
Deepanshu Agarwal d52d5f5af1 snssqs renam batch to bulk 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-07 12:05:57 +05:30
Deepanshu Agarwal 9a844a1bb0 Rename batch to bulk 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-07 12:00:08 +05:30
Deepanshu Agarwal 1ec4efd309 Add docs 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-05 15:53:02 +05:30
Deepanshu Agarwal 26bc37d867 Update return type for BatchPublish 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-05 14:00:29 +05:30
Deepanshu Agarwal 4a2da64e94 Update Default Batch 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-05 13:50:23 +05:30
Deepanshu Agarwal 2e45f528be Update Default Batch struct name 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-05 13:48:18 +05:30
Deepanshu Agarwal f59f5e509b Update structs 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-05 13:45:41 +05:30
deepanshuagarwal 36c0cd73c6
Merge branch 'master' into ps_batch_c 2022-08-31 21:57:06 +05:30
Yaron Schneider edd2c9d5a9
Merge branch 'master' into redis-pubsub-fix 2022-08-29 07:00:16 -07:00
Fabian Martinez ce2570cfa2 bugfix: stuck pending messages 
Signed-off-by: Fabian Martinez <46371672+famarting@users.noreply.github.com>
 2022-08-29 15:25:49 +02:00
Deepanshu Agarwal ae78b77989 Commit pubsub 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-08-27 17:20:18 +05:30
Deepanshu Agarwal 3c7eed33ae commit 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-08-27 16:56:05 +05:30
Deepanshu Agarwal 23fb488a9c Contrib updates for Batch Subscribe 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-08-27 16:49:54 +05:30
Alessandro (Ale) Segala bcea284c7b
Components' init functions should return interfaces (#1997) 
* Components' init functions should return interfaces

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 💄

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* pin latest berndverst contrib fork

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Fixed component registration in tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Updated all cert tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-08-25 18:27:45 -07:00
Marcos Candeia 8964d8bf41
Define common metadata across components (#1994) 
* Add base metadata for all components

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>

* Fix lint issues on consul and mysql tests

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>

* Pin candeia/dapr runtime version

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>

* Add replace directive to use mcandeia/dapr on all go submodules

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>

* Fixed runtime config instantiation

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>
 2022-08-25 10:10:53 -07:00
Bernd Verst e87cd5e4cb
Go 1.19 support and linter fixes (#1975) 
* Go 1.19 support and linter fixes

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update workflows for Go1.19 and new linter version

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Remove unnecessary space in nolint directive

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* disable additional linters which aren't used because of Go generics

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* enable gosec linter again

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update bindings/zeebe/command/publish_message_test.go

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update bindings/output_binding.go

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Use prepared statement for mysql table creation

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Ping is not ping

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* c'mon linter

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Fix MySQL gosec issue

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* revert mysql to be fixed later

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-08-18 00:45:23 -07:00
Alessandro (Ale) Segala b3e18bb11d
pubsub.in-memory: add support for wildcard topics (#1966) 
* pubsub.in-memory: add support for wildcard topics

Fixes #1964

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* make modtidy-all

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-08-12 17:13:47 -07:00
addjuarez cd740b4a7b
Handle service bus exported errors (#1942) 
* Add service bus exported error handling

Signed-off-by: Addison Juarez <adjuarez@microsoft.com>

* Add service bus exported error handling

Signed-off-by: Addison Juarez <adjuarez@microsoft.com>

Signed-off-by: Addison Juarez <adjuarez@microsoft.com>
Co-authored-by: Loong Dai <long.dai@intel.com>
 2022-08-12 14:47:14 -05:00
Nick 248f7f458d
feat(pubsub/jetstream): allow tls client authentication (#1924) 
Signed-off-by: NickLarsenNZ <nick@aptiv.co.nz>

Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
 2022-08-04 16:29:53 -07:00
Clare Liguori 6777a4d6c7
pubsub.snssqs: Support regions in other AWS partitions (#1925) 
Fixes #1907

Signed-off-by: Clare Liguori <liguori@amazon.com>
 2022-08-03 08:59:54 -07:00
Alessandro (Ale) Segala c399efa594
pubsub.mqtt: support multiple wildcards in subscriptions (#1901) 
Fixes #1881

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
 2022-07-21 15:30:26 -07:00
Alessandro (Ale) Segala 801297c724
Added pubsub.FeatureSubscribeWildcards capability (#1887) 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
 2022-07-18 18:04:59 -07:00
Alessandro (Ale) Segala 66eee69188
pubsub.mqtt: support wildcard and shared subscriptions (#1882) 
Fixes #1881

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-07-18 17:26:07 -07:00
Alessandro (Ale) Segala 1a4e2725ec
pubsub.redis: better ack for messages (#1886) 
Also do not log errors for "context canceled" during shutdown

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-07-18 11:23:35 -07:00
Alessandro (Ale) Segala d38c786771
Add contexts to input bindings (#1831) 
This is the last part of the "shutdown sequence fix": it allows shutting down input bindings before output ones.

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-07-12 12:19:27 -07:00
Alessandro (Ale) Segala a2f3a84b96
Moved authentication to be an internal pkg (#1855) 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-07-06 11:05:34 -07:00
Alessandro (Ale) Segala a193cc1ede
Add support for AAD auth in Azure Storage Queues binding (#1842) 
* Add support for AAD auth in Azure Storage Queues binding

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 🧹

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-07-03 14:17:38 -07:00
ItalyPaleAle 13b822b95f Reverting #1798 for Event Hubs 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-07-01 17:45:38 +00:00
Alessandro (Ale) Segala 4bf6cc4ca6
Updated development docs (#1835) 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
 2022-06-30 22:23:41 -07:00
ItalyPaleAle b58464ad1c Make RabbitMQ retry more than once 
Also updated tests to remove unused options and add more logging

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-06-27 22:31:31 +00:00
ItalyPaleAle 476b95990f Pulsar: do not disconnect in case of error processing message 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-06-27 21:29:54 +00:00
ItalyPaleAle a942b05b4a Added redeliveryDelay to pubsub.pulsar 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-06-27 21:12:34 +00:00
ItalyPaleAle 0c40dccd07 pubsub.mqtt: re-enqueue messages when they fail 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-06-27 20:47:16 +00:00
ItalyPaleAle be2fed6b3a MQTT: re-set "retain" to false as default 
Support for "retain" is currently broken

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-06-27 20:36:15 +00:00
Bernd Verst 8974eca74c Fix MQTT metadata test 
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-06-27 20:36:15 +00:00
Alessandro (Ale) Segala f55dedbbe9 More sane defaults for default values in MQTT metadata (#1810) 
Fixes #1809

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-06-27 20:36:15 +00:00
ItalyPaleAle 6cf1afc264 Re-add built-in retries to pubsub.hazelcast 
See: https://github.com/dapr/components-contrib/issues/1808
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-06-27 20:36:15 +00:00
ItalyPaleAle 35034aa877 Disable built-in retries in pubsub components 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-06-27 20:36:15 +00:00
Alessandro (Ale) Segala a08988c25e
Shared implementation for Azure Service Bus subscriptions for binding and pubsub (#1791) 
* Moved ASB subscription code to a shared package

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Moved ASBQ binding to use the shared ASB implementation

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Updating Azure Service Bus SDK version

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-06-17 15:12:15 -07:00
Bernd Verst f25b26fc0c
Upgrade to Azure Table Storage Track 2 SDK in State Store and add CosmosDB Table API support (#1792) 
* Upgrade to Azure Table Storage Track 2 SDK in State Store

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* make modtidy-all

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* don't panic

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* fix error parsing

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Adds support for empty rowKeys again

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Pin aztables v1.0.1

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add support for Cosmos DB Table API

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add Azure Table Storage CosmosDB conformance test

Signed-off-by: GitHub <noreply@github.com>

* Address code review

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Create Table Storage State store subtests

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Address linter issue

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* context instead of ctx

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* load state store in conf tests

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* use cosmosDB mode in cosmosDB test

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add Azure AD support for Table Storage

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* remove shadow declaration

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* make accountKey optional

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add options to skip table creation

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-06-17 14:04:53 -07:00
deepanshuagarwal a0ef46265b
Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784) 
* add `Pinger` interface.

Signed-off-by: chanyong.moon <dev.chanyongmoon@gmail.com>

* Convert Ping fuction to optional

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Removing unrequired Ping implementations

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Addressing comments

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

Co-authored-by: chanyong.moon <dev.chanyongmoon@gmail.com>
 2022-06-14 08:27:54 -07:00
saber-wang d7eb3b7b27
[pubsub][rabbitmq]add support for binding multiple routingkeys at the same time (#1750) 
* Add metadata property to configure BatchingMaxSize&batchingMaxMessages in Pulsar
Signed-off-by: saberwang <saberwang@hotmail.com>

* sort field
Signed-off-by: saberwang <saberwang@hotmail.com>

* [pubsub]fix unit test bug
Signed-off-by: saberwang <saberwang@hotmail.com>

* remove unrelated changes
Signed-off-by: saberwang <saberwang@hotmail.com>

* Delete hard coded Metadata
Signed-off-by: saberwang <saberwang@hotmail.com>

* remove  .history

Signed-off-by: saberwang <saberwang@hotmail.com>

* restore .gitignore

Signed-off-by: saberwang <saberwang@hotmail.com>

* Hard coding default values and adding 'BatchingMaxPublishDelay' metadata

Signed-off-by: saberwang <saberwang@hotmail.com>

* fix code format

Signed-off-by: saberwang <saberwang@hotmail.com>

* formatting code

Signed-off-by: saberwang <saberwang@hotmail.com>

* [pubsub][rabbitmq]Add support for binding multiple routingkeys at the same time

Signed-off-by: saberwang <saberwang@hotmail.com>

* add TestSubscribeBindRoutingKeys

Signed-off-by: saberwang <saberwang@hotmail.com>

* fix: Infof to Debugf

Signed-off-by: saberwang <saberwang@hotmail.com>

* Update pubsub/rabbitmq/rabbitmq_test.go

Co-authored-by: Looong Dai <long.dai@intel.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
 2022-06-10 16:34:15 -07:00
Alessandro (Ale) Segala 98aed5c571
Make Service Bus attempt to reconnect forever in case of issues (#1783) 
* Make Service Bus attempt to reconnect forever in case of issues

With exponential back-off configurable between min and max time. Fixes #1612

Also includes fixes:

- Binding: make sure it actually retries to connect forever
- Binding: add delay (exponential backoff) before reconnecting
- PubSub: better handling of failures such as topics disabled or other non-connection issues

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 💄

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Added warning for deprecated metadata options

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 💄

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-06-10 15:54:46 -07:00
Alessandro (Ale) Segala 6f3234d5ac
Rabbitmq publisher confirm (#1762) 
* Added `publishConfirm` option to RabbitMQ

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Changed to publisherConfirm per feedback

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-06-10 12:47:02 -07:00
Alessandro (Ale) Segala 157ddc6d6b
Bumped dapr/dapr in cert tests (#1773) 
* Bumped dapr/dapr in cert tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Updated interface

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Added missing go.mod

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* More fixes

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fix eventhubs not closing on context cancelation

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-06-07 08:24:15 -07:00
Alessandro (Ale) Segala 704f4dd730
Add contexts to pubsub.Subscribe to allow early cancelation (#1756) 
This commit is related to dapr/dapr#4624. As noted there, we have an issue in the runtime where all components are shut down after the grace period, when the app is likely already stopped. Because of that, certain input components (the subscribe part of pubsub and the input part of bindings - the latter not in scope of this PR), can continue bringing new work when it's known to fail.

In order to fix the issue linked above properly, we need to implement a way for PubSub components to have the "publish" part closed before the "subscribe" one (and in the future that will need to be done for input bindings too).

This commit achieves precisely that by adding a context in the Subscribe method. When that context is canceled (which can be at any time), the subscription is removed.

PS: This API change was implemented so it can one day be used for dapr/dapr#814 too, as it allows canceling individual subscriptions by using a different context. Although that's not possible today because it requires more work on the runtime, it does implement everything that's needed in the pubsub components already.
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-06-02 15:06:36 -07:00
Alessandro (Ale) Segala 7c35a4e04c
Added test for multiple pubsub handlers (#1743) 
* Added test for multiple pubsub handlers

This patch adds conformance tests for PubSub with multiple handlers, each listening on a different topic.

It's meant to catch issues such as #1709

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Added missing go.mod for storagequeues binding test

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-06-02 10:22:15 -07:00
Alessandro (Ale) Segala 6c7ff60c9e
Fixes for SNS/SQS PubSub (#1754) 
* Fixes for SNS/SQS PubSub

Including:

- Fixed adding multiple handlers for different topics (tests in #1743 are now passing)
- Fixed delivering wrong message when concurrency mode is parallel
- Avoid having multiple pollers at the same time competing for messages

& more smaller fixes

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-06-01 15:49:51 -07:00
Alessandro (Ale) Segala ca9fbf690e
Fixed Kafka PubSub to allow multiple handlers for different topics (#1755) 
* Fixed Kafka PubSub to allow multiple handlers for different topics

With this, tests from #1743 are passing

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Removed read lock (for now)

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Updated as requested by @skyao

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Use interface type everywhere

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed panic

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
 2022-06-01 15:31:11 -07:00
yaron2 05922117c6 add parallel test 
Signed-off-by: yaron2 <schneider.yaron@live.com>
 2022-05-27 09:52:39 -07:00