dapr
/
components-contrib
mirror of https://github.com/dapr/components-contrib.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,232 Commits 54 Branches 155 Tags 76 MiB
Commit Graph

245 Commits

Author SHA1 Message Date
ItalyPaleAle 456caaef6a WIP 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-12-12 20:06:04 +00:00
ItalyPaleAle 385d0480a7 Added authorization 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-12-10 02:31:41 +00:00
ItalyPaleAle 30750ab058 Added draft code for the Worker 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-12-10 00:51:47 +00:00
Joni Collinge a4a2466d2b
remove dead code 
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
 2022-12-09 15:14:34 +00:00
Joni Collinge e488f6d304
remove dead code 
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
 2022-12-09 15:13:47 +00:00
Joni Collinge cad8a7c0ad
remove auto blank session id 
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
 2022-12-09 13:07:50 +00:00
Joni Collinge d63f3c3015
lint 
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
 2022-12-09 12:45:19 +00:00
Joni Collinge 72e9676c5a
add some unit tests 
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
 2022-12-09 11:59:22 +00:00
Joni Collinge a7d6bdecfc
move session config to per subscription metadata 
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
 2022-12-09 11:48:25 +00:00
Joni Collinge ec1dfbe8fe
If require sessions and no session id, set blank 
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
 2022-12-09 10:08:51 +00:00
Joni Collinge ed68140bf7
Support blank session IDs 
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
 2022-12-09 08:36:51 +00:00
John Ewart ee9bd09620 Check the correct error object in a few places inside blobstorage client 
Signed-off-by: John Ewart <john@johnewart.net>
 2022-12-08 11:21:21 -08:00
Joni Collinge eeae60e429
Add sessionIdleTimeoutInSec md 
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
 2022-12-07 15:56:45 +00:00
Joni Collinge bfbc382422
lint 
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
 2022-12-07 15:41:01 +00:00
Joni Collinge dde82c6c41
remove dead code 
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
 2022-12-07 15:33:47 +00:00
Joni Collinge 75025d5fba
Add metadata 
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
 2022-12-07 15:23:18 +00:00
Joni Collinge 303182341a
WIP: Support ASB sessions 
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
 2022-12-06 16:35:51 +00:00
Joni Collinge c27a6580a8
WIP: ASB sessions 
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
 2022-12-02 15:40:48 +00:00
Bernd Verst 7d5c06bc8d Make blob metadata case insensitive 
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-11-23 01:43:24 +00:00
Bernd Verst f1b9374f9a Move tests around 
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-11-18 18:02:09 -08:00
Bernd Verst 23d36a08d7 more refactoring and address code review 
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-11-18 17:56:02 -08:00
Bernd Verst f11fc2421e fix linter issue 
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-11-17 21:43:20 -08:00
Bernd Verst 8811d5e64f AzBlob components: Extract shared code 
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-11-17 21:37:17 -08:00
Alessandro (Ale) Segala 04242ce38a
New PubSub component: Azure Service Bus Queues (#2211) 
* Implementation for Azure Service Bus Queue pubsub component

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed syntax errors in unused files

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Moved components to subfolders and enabled conf tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-10-24 14:07:23 -07:00
ItalyPaleAle 254a2141ad Moved sender handling to common implementation too 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-19 21:01:15 +00:00
ItalyPaleAle 065ef86ee5 Moved client creation to common implementation 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-19 20:34:10 +00:00
ItalyPaleAle 7ecfb6edd0 Moved code to add metadata to ASB messages to shared impl too 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-19 20:08:07 +00:00
ItalyPaleAle 8bce0d5200 Moved metadata to impl package 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-19 19:47:26 +00:00
ItalyPaleAle 0057a31b88 Moved errors 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-18 21:51:17 +00:00
Bernd Verst 0f0aaf4e9b Merge remote-tracking branch 'upstream/master' into merge19intomaster 2022-10-14 12:16:57 -07:00
Sky Ao ec091b8237 rollback code to set config.net.tls.enable=true when auth is required and tls is not required 
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
 2022-10-13 09:06:27 -07:00
Sky Ao 5cc923bcc4 rollback code to set config.net.tls.enable=true when auth is required and tls is not required 
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
 2022-10-13 12:02:05 +00:00
ItalyPaleAle 047f3948c5 Fix for handling "context deadline exceeded" on ASB publishing 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-12 18:18:33 +00:00
ItalyPaleAle f1c4555078 Fixed merge conflict 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-11 23:33:54 +00:00
ItalyPaleAle 3bc20a1de5 Merge branch 'master' into merge-1.9 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-11 20:26:35 +00:00
Alessandro (Ale) Segala ef74e7f8b6
Azure Service Bus: consider receiving 0 messages as an error that requires reconnecting (#2169) 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-11 12:57:06 -07:00
Crypt Keeper 535c670252
Handles request URI edge cases (#2168) 
Signed-off-by: Adrian Cole <adrian@tetrate.io>

Signed-off-by: Adrian Cole <adrian@tetrate.io>
 2022-10-10 08:35:57 -07:00
Alessandro (Ale) Segala 78c7373784
Merge branch 'master' into net-http-middlewares 2022-10-04 14:06:22 -07:00
ItalyPaleAle 7a1a623ea7 Updated the last middlewares 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-09-29 20:21:41 +00:00
Deepanshu Agarwal 376cfed216 Fix linting 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-29 16:27:04 +05:30
Deepanshu Agarwal f74b4d648d Update EntryID to EntryId 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-29 15:49:45 +05:30
ItalyPaleAle 038bcf4666 Updated OAuth2 middleware 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-09-29 00:26:47 +00:00
ItalyPaleAle fb76c277af Started work on converting middlewares to net/http 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-09-28 23:25:58 +00:00
deepanshuagarwal bcd101abad
Keys rename (#2135) 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-28 09:52:59 -07:00
Mukundan Sundararajan 8b60079501 Merge remote-tracking branch 'upstream/master' into fix-kafka-session-done-merge-master 2022-09-24 00:11:19 +05:30
Shubham Sharma 4f406a597f
Add bulk subscribe support to Azure Service Bus (#2100) 
* Initial implementation

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* ✅

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Add tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Add comment

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor messages.go and add tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update message tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor servicebus.go logic

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor handleAsync

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor ReceiveAndBlock

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update binding

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Review comments addressed

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Lint

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update metadata name

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update activeMessagesChan logic for concurrency control

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Fix tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update metadata name

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Use request metadata instead of component metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Review comments addressed

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Fix merge issue with metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Remove unused metadata key

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Fix merge issue with metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Lint!!!

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
 2022-09-23 10:49:06 -07:00
Shubham Sharma b298b65cfe
Add bulk publish support to Azure Service Bus (#2106) 
* Initial implementation

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Some improvements

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor and add tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Lint

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Use request metadata instead of component metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Remove unused method

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Review comments addressed

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Doc comments

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
 2022-09-23 09:57:00 -07:00
cong 1a7882fca5
fix(kafka): ConsumeClaim should return when messages channel closed (#2120) 
Signed-off-by: cong <zhangcong1992@gmail.com>

Signed-off-by: cong <zhangcong1992@gmail.com>
 2022-09-23 09:54:59 -07:00
deepanshuagarwal 8500da577c
Conf test for Bulk Subscribe and Kafka fixes (#2113) 
* Conf test for Bulk Sub and Kafka Fixes

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Fix linting

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Incorporating comments

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-23 09:54:21 -07:00
Mukundan Sundararajan e1697ba115 Merge branch 'master' into feature/pubsub-batching 2022-09-23 06:47:47 +05:30
Mukundan Sundararajan 4354f036e4 properly parse response errors from kafka on sending multiple messages in bulk publish 
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
 2022-09-22 16:51:34 +05:30
Bernd Verst ac73313d6f
Merge branch 'master' into master 2022-09-21 23:40:53 -07:00
Mukundan Sundararajan a45f7db8b2 add bulkpublish-conf-test 
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
 2022-09-21 11:46:46 +05:30
Bernd Verst e9e750bce6 fix linter issues 
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-09-20 13:02:52 -07:00
Deepanshu Agarwal 609f4080fc Use index as entryID 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-19 09:17:40 +05:30
Deepanshu Agarwal 3656a495fc Incorporating comments 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-16 23:03:58 +05:30
Deepanshu Agarwal 217505fd16 Move common costants to common utils 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-16 22:22:54 +05:30
Deepanshu Agarwal d602e0ab0c Move constants to utils 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-16 22:07:38 +05:30
Deepanshu Agarwal 55ad67d510 When UUID could not be generated 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-16 21:44:37 +05:30
Deepanshu Agarwal 81898d5ee5 Config Per Topic and using maxAwaitDuration 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-16 20:04:32 +05:30
Deepanshu Agarwal d31f4d99f5 Merge branch 'feature/pubsub-batching' of github.com:dapr/components-contrib into ps_batch_c_kafka 2022-09-16 11:36:23 +05:30
Mukundan Sundararajan 3f9c42c4b8
Kafka bulk publish (#2059) 
* Contrib updates for Batch Subscribe

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* commit

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Commit pubsub

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Update structs

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Update Default Batch struct name

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Update Default Batch

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Update return type for BatchPublish

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Add docs

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Rename batch to bulk

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* snssqs renam batch to bulk

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Renaming Bulker to BulkMessager

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Renaming names as discussed

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Minor updates

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Remove ContentType from BulkPublishRequest

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Update error type

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Changes to bulk subscribe and error type

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Segregating Bulk Publisher and Bulk Subscriber and removing them as mandatory

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Event Type name correction

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Docs update as per comments

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* bulk publish implementation for kafka

Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>

* Add ctx to BulkPublish.

Signed-off-by: Artur Souza <artursouza.ms@outlook.com>

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
Signed-off-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
 2022-09-15 13:17:17 -07:00
Deepanshu Agarwal f11660e70d Change to warning normal subscribe part as well 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-15 16:09:47 +05:30
Deepanshu Agarwal f5542c70b9 Incorporate review comments and remove index based entryID 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-15 16:02:30 +05:30
Deepanshu Agarwal 31a38e5aaa Change marking message logic 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-14 13:01:30 +05:30
Deepanshu Agarwal 059461c6f4 Add kafka changes for bulk subscribe 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-13 01:01:05 +05:30
zcong1993 320ae2d674
fix(kafka): should return when session context is done in ConsumeClaim 
Signed-off-by: zcong1993 <zhangcong1992@gmail.com>
 2022-09-05 16:28:49 +08:00
Mukundan Sundararajan 35590e0857 read record header as metadata if available in kafka 
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
 2022-08-26 12:02:15 +05:30
Bernd Verst e87cd5e4cb
Go 1.19 support and linter fixes (#1975) 
* Go 1.19 support and linter fixes

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update workflows for Go1.19 and new linter version

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Remove unnecessary space in nolint directive

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* disable additional linters which aren't used because of Go generics

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* enable gosec linter again

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update bindings/zeebe/command/publish_message_test.go

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update bindings/output_binding.go

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Use prepared statement for mysql table creation

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Ping is not ping

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* c'mon linter

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Fix MySQL gosec issue

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* revert mysql to be fixed later

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-08-18 00:45:23 -07:00
cong 38fc439410
fix(kafka): ConsumeClaim should not return err when retry recovery failed (#1965) 
* fix(kafka): ConsumeClaim should not return err when retry recovery failed

Signed-off-by: zcong1993 <zhangcong1992@gmail.com>

* chore: tweak error log message

Signed-off-by: zcong1993 <zhangcong1992@gmail.com>

Signed-off-by: zcong1993 <zhangcong1992@gmail.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
 2022-08-12 19:16:02 -07:00
Alessandro (Ale) Segala b3e18bb11d
pubsub.in-memory: add support for wildcard topics (#1966) 
* pubsub.in-memory: add support for wildcard topics

Fixes #1964

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* make modtidy-all

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-08-12 17:13:47 -07:00
Alessandro (Ale) Segala f2ac0cda69
Ensure locks in channels are properly released (#1957) 
Fixes #1865

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-08-10 14:52:46 -07:00
qiangmzsx 79a3cd990a
Removing the use of the ioutil package And Fix CVE-2021-42576 (#1954) 
* fix CVE-2021-42576

Signed-off-by: qiangmzsx <qiangmzsx@gmail.com>

* Removing the use of the ioutil package

Signed-off-by: qiangmzsx <qiangmzsx@gmail.com>

* Update middleware/http/nethttpadaptor/nethttpadaptor.go

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: qiangmzsx <qiangmzsx@gmail.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-08-10 13:45:00 -07:00
Joni Collinge 5afb1c9b8f
Use unique message key in Azure ServiceBus PubSub (#1898) 2022-07-21 10:13:58 -07:00
Carlos Mendible 20e987b778
azure appconfig configuration store (#1874) 
* azure appconfig configuration store

Signed-off-by: cmendible <cmendible@gmail.com>

* added retry options

Signed-off-by: cmendible <cmendible@gmail.com>

* removed unused property

Signed-off-by: cmendible <cmendible@gmail.com>

* fixed error msgs, typos and test names

Signed-off-by: cmendible <cmendible@gmail.com>

* resource documenation

Signed-off-by: cmendible <cmendible@gmail.com>

* return err from not implemented functions

Signed-off-by: cmendible <cmendible@gmail.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Loong Dai <long.dai@intel.com>
 2022-07-20 09:14:13 -07:00
Clare Liguori 3195217f12
Add user agent to AWS requests (#1890) 
* Add user agent to AWS requests

Signed-off-by: Clare Liguori <liguori@amazon.com>

* Fix import spacing

Signed-off-by: Clare Liguori <liguori@amazon.com>
 2022-07-18 15:07:34 -07:00
Andrew 2b3712b755
Ft/sasl scram sha 256 512 (#1856) 
* working with hardcoded SHA-512

Signed-off-by: Andrew Duss <andy.duss@storable.com>

* cleanup code

Signed-off-by: Andrew Duss <andy.duss@storable.com>

* Do not hardcode specific testTopicName

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Andrew Duss <andy.duss@storable.com>

* Ensure context propagation in MySQL binding (#1829)

Spin-off from PR adding contexts to input bindings

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
Signed-off-by: Andrew Duss <andy.duss@storable.com>

* Add support for AAD auth in Azure Storage Queues binding (#1842)

* Add support for AAD auth in Azure Storage Queues binding

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 🧹

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Signed-off-by: Andrew Duss <andy.duss@storable.com>

* Moved authentication to be an internal pkg (#1855)

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Andrew Duss <andy.duss@storable.com>

* Azure AD support in SignalR (#1852)

* WIP: Azure AD support in SignalR

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Correct SignalR AAD details

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Misc fixes

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* azauth package name

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Andrew Duss <andy.duss@storable.com>

* rename SCRAM properly as SASL

Signed-off-by: Andrew Duss <andy.duss@storable.com>

* update gomod/sum

Signed-off-by: Andrew Duss <andy.duss@storable.com>

* gofmt

Signed-off-by: Andrew Duss <andy.duss@storable.com>

* mod tidy

Signed-off-by: Andrew Duss <andy.duss@storable.com>

* goval

Signed-off-by: Andrew Duss <andy.duss@storable.com>

* use xdg-go instead of depreicated xdg library

Signed-off-by: Andrew Duss <andy.duss@storable.com>

Co-authored-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
 2022-07-08 06:08:40 -07:00
Alessandro (Ale) Segala 3821c00131
Azure AD support in SignalR (#1852) 
* WIP: Azure AD support in SignalR

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Correct SignalR AAD details

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Misc fixes

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* azauth package name

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-07-06 14:05:24 -07:00
Alessandro (Ale) Segala a2f3a84b96
Moved authentication to be an internal pkg (#1855) 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-07-06 11:05:34 -07:00
Alessandro (Ale) Segala 9b7db8927a
Improvements to S3 binding (#1824) 
* Improvements to S3 binding

Ensure context propagation in output bindings + other fixes

Spin-off from PR adding contexts to input bindings

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
 2022-06-30 17:27:48 -07:00
Sky Ao d6dd10e19d
improve log of kafkaf components cert test (#1800) 
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
 2022-06-20 09:49:09 -07:00
Alessandro (Ale) Segala a08988c25e
Shared implementation for Azure Service Bus subscriptions for binding and pubsub (#1791) 
* Moved ASB subscription code to a shared package

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Moved ASBQ binding to use the shared ASB implementation

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Updating Azure Service Bus SDK version

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-06-17 15:12:15 -07:00
Alessandro (Ale) Segala 704f4dd730
Add contexts to pubsub.Subscribe to allow early cancelation (#1756) 
This commit is related to dapr/dapr#4624. As noted there, we have an issue in the runtime where all components are shut down after the grace period, when the app is likely already stopped. Because of that, certain input components (the subscribe part of pubsub and the input part of bindings - the latter not in scope of this PR), can continue bringing new work when it's known to fail.

In order to fix the issue linked above properly, we need to implement a way for PubSub components to have the "publish" part closed before the "subscribe" one (and in the future that will need to be done for input bindings too).

This commit achieves precisely that by adding a context in the Subscribe method. When that context is canceled (which can be at any time), the subscription is removed.

PS: This API change was implemented so it can one day be used for dapr/dapr#814 too, as it allows canceling individual subscriptions by using a different context. Although that's not possible today because it requires more work on the runtime, it does implement everything that's needed in the pubsub components already.
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-06-02 15:06:36 -07:00
Alessandro (Ale) Segala 7c35a4e04c
Added test for multiple pubsub handlers (#1743) 
* Added test for multiple pubsub handlers

This patch adds conformance tests for PubSub with multiple handlers, each listening on a different topic.

It's meant to catch issues such as #1709

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Added missing go.mod for storagequeues binding test

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-06-02 10:22:15 -07:00
Alessandro (Ale) Segala ca9fbf690e
Fixed Kafka PubSub to allow multiple handlers for different topics (#1755) 
* Fixed Kafka PubSub to allow multiple handlers for different topics

With this, tests from #1743 are passing

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Removed read lock (for now)

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Updated as requested by @skyao

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Use interface type everywhere

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed panic

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
 2022-06-01 15:31:11 -07:00
Sky Ao 8b5554dc71
Refactory kafka binding to reuse the kafka common code extracting from kafka pubsub component (#1696) 
* refactory kafka pubsub code to extract common kafka code for reuse

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* fix lint;add unit test for subscribeAdapter

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* move topics filed from internal kafak struct to pubsub kafka struct, since in input binding the topics will confiured in metadata

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* reuse internal  kafka code for bindings

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* add redis standalone_test back which is delete by mistaken

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* small code improvement to trigger test

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* add license headers

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* try to set disbaleTls to true to verify the kafka connection fail

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* don't enable consum retry in kafka binding component;if authenticaion is disabled, need not set TLSDisable at the same time;

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* fix lint

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

Co-authored-by: Loong Dai <long.dai@intel.com>
 2022-05-10 20:07:23 -07:00
seeflood dc849d40a0
feat: lock component (#1574) 
* feat: lock store.
Signed-off-by: seeflood <349895584@qq.com>

* make modtidy-all

Signed-off-by: seeflood <349895584@qq.com>

* lock/redis/standalone.go

Signed-off-by: seeflood <349895584@qq.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
 2022-04-24 18:11:13 -07:00
Dmitry Shmulevich c7adb917f3
update license to Apache v2.0 (#1406) 2022-01-04 19:53:31 -08:00
Taction 3f6c2e867c
add redis username metadata (#1177) 
Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
 2021-10-06 12:54:00 -07:00
Phil Kedy ff65172407
Removing internal config and retry packages that were moved to dapr/kit. (#988) 
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
 2021-07-02 20:17:52 -07:00
Phil Kedy 9cd7de95a1
Use a channel to signal that the retry go routine and hopefully remove the race condition that makes this a flaky test. (#937) 2021-06-11 16:18:00 -07:00
Taction 14870cb7bc
Add backoff for rabbitmq PubSub component (#862) 
* Add backoff for rabbitmq

* fix lint

* fix lint

* remove backOffEnable config

* Delete backoff enable metadata

* Add a default config setting max retry to 0

* fix lint

Co-authored-by: Phil Kedy <phil.kedy@gmail.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
 2021-06-10 00:19:46 -07:00
Taction 464d53d94b
Move the common Redis code to internal (#859) 
* Move pubsub redis client to internal

* Add failover for common redis. Refactor state redis.

* refactor binding redis

* fix lint

* Refactor to setting partten

* fix db and lint

* fix lint

* for backward compatibility

* Using a type alias to handle decoding duration values of -1 for Redis.

* Linter fixes

Co-authored-by: Phil Kedy <phil.kedy@gmail.com>
 2021-06-06 23:24:36 -07:00
Phil Kedy 1b30e75e60
Configurable retry (#854) 
* no message

* Switching over usages of retry to the new package and making use of the DecodeConfig function

* Added decoding configuration using settings with a specific prefix

* Linter fixes

* Fixing linter error

* time.Sleep is the enemy

* Fix typo in comment

* Moving config to a pointer parameter so that the component can pass in the config with default values that make sense for that component.

* Renamed config struct

* Fix comment

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
 2021-05-06 09:43:57 -07:00
Phil Kedy 715cc8d688
Refactored conformance tests to use a new config package (#712) 
* Refactored the conformance tests to use a new config package
Removed dependency on k8s apimachinery sets

* Comment tweak

* Renamed kit package to internal
 2021-03-01 13:03:39 -08:00