dapr
/
components-contrib
mirror of https://github.com/dapr/components-contrib.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,940 Commits 55 Branches 159 Tags 84 MiB
Commit Graph

72 Commits

Author SHA1 Message Date
Alessandro (Ale) Segala 04242ce38a
New PubSub component: Azure Service Bus Queues (#2211) 
* Implementation for Azure Service Bus Queue pubsub component

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed syntax errors in unused files

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Moved components to subfolders and enabled conf tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-10-24 14:07:23 -07:00
ItalyPaleAle 254a2141ad Moved sender handling to common implementation too 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-19 21:01:15 +00:00
ItalyPaleAle 065ef86ee5 Moved client creation to common implementation 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-19 20:34:10 +00:00
ItalyPaleAle 7ecfb6edd0 Moved code to add metadata to ASB messages to shared impl too 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-19 20:08:07 +00:00
ItalyPaleAle 8bce0d5200 Moved metadata to impl package 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-19 19:47:26 +00:00
ItalyPaleAle 0057a31b88 Moved errors 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-18 21:51:17 +00:00
Bernd Verst 0f0aaf4e9b Merge remote-tracking branch 'upstream/master' into merge19intomaster 2022-10-14 12:16:57 -07:00
Sky Ao ec091b8237 rollback code to set config.net.tls.enable=true when auth is required and tls is not required 
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
 2022-10-13 09:06:27 -07:00
Sky Ao 5cc923bcc4 rollback code to set config.net.tls.enable=true when auth is required and tls is not required 
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
 2022-10-13 12:02:05 +00:00
ItalyPaleAle 047f3948c5 Fix for handling "context deadline exceeded" on ASB publishing 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-12 18:18:33 +00:00
ItalyPaleAle f1c4555078 Fixed merge conflict 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-11 23:33:54 +00:00
ItalyPaleAle 3bc20a1de5 Merge branch 'master' into merge-1.9 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-11 20:26:35 +00:00
Alessandro (Ale) Segala ef74e7f8b6
Azure Service Bus: consider receiving 0 messages as an error that requires reconnecting (#2169) 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-10-11 12:57:06 -07:00
Crypt Keeper 535c670252
Handles request URI edge cases (#2168) 
Signed-off-by: Adrian Cole <adrian@tetrate.io>

Signed-off-by: Adrian Cole <adrian@tetrate.io>
 2022-10-10 08:35:57 -07:00
Alessandro (Ale) Segala 78c7373784
Merge branch 'master' into net-http-middlewares 2022-10-04 14:06:22 -07:00
ItalyPaleAle 7a1a623ea7 Updated the last middlewares 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-09-29 20:21:41 +00:00
Deepanshu Agarwal 376cfed216 Fix linting 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-29 16:27:04 +05:30
Deepanshu Agarwal f74b4d648d Update EntryID to EntryId 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-29 15:49:45 +05:30
ItalyPaleAle 038bcf4666 Updated OAuth2 middleware 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-09-29 00:26:47 +00:00
ItalyPaleAle fb76c277af Started work on converting middlewares to net/http 
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-09-28 23:25:58 +00:00
deepanshuagarwal bcd101abad
Keys rename (#2135) 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-28 09:52:59 -07:00
Mukundan Sundararajan 8b60079501 Merge remote-tracking branch 'upstream/master' into fix-kafka-session-done-merge-master 2022-09-24 00:11:19 +05:30
Shubham Sharma 4f406a597f
Add bulk subscribe support to Azure Service Bus (#2100) 
* Initial implementation

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* ✅

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Add tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Add comment

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor messages.go and add tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update message tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor servicebus.go logic

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor handleAsync

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor ReceiveAndBlock

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update binding

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Review comments addressed

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Lint

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update metadata name

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update activeMessagesChan logic for concurrency control

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Fix tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update metadata name

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Use request metadata instead of component metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Review comments addressed

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Fix merge issue with metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Remove unused metadata key

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Fix merge issue with metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Lint!!!

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
 2022-09-23 10:49:06 -07:00
Shubham Sharma b298b65cfe
Add bulk publish support to Azure Service Bus (#2106) 
* Initial implementation

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Some improvements

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor and add tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Lint

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Use request metadata instead of component metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Remove unused method

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Review comments addressed

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Doc comments

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
 2022-09-23 09:57:00 -07:00
cong 1a7882fca5
fix(kafka): ConsumeClaim should return when messages channel closed (#2120) 
Signed-off-by: cong <zhangcong1992@gmail.com>

Signed-off-by: cong <zhangcong1992@gmail.com>
 2022-09-23 09:54:59 -07:00
deepanshuagarwal 8500da577c
Conf test for Bulk Subscribe and Kafka fixes (#2113) 
* Conf test for Bulk Sub and Kafka Fixes

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Fix linting

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Incorporating comments

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-23 09:54:21 -07:00
Mukundan Sundararajan e1697ba115 Merge branch 'master' into feature/pubsub-batching 2022-09-23 06:47:47 +05:30
Mukundan Sundararajan 4354f036e4 properly parse response errors from kafka on sending multiple messages in bulk publish 
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
 2022-09-22 16:51:34 +05:30
Bernd Verst ac73313d6f
Merge branch 'master' into master 2022-09-21 23:40:53 -07:00
Mukundan Sundararajan a45f7db8b2 add bulkpublish-conf-test 
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
 2022-09-21 11:46:46 +05:30
Bernd Verst e9e750bce6 fix linter issues 
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-09-20 13:02:52 -07:00
Deepanshu Agarwal 609f4080fc Use index as entryID 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-19 09:17:40 +05:30
Deepanshu Agarwal 3656a495fc Incorporating comments 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-16 23:03:58 +05:30
Deepanshu Agarwal 217505fd16 Move common costants to common utils 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-16 22:22:54 +05:30
Deepanshu Agarwal d602e0ab0c Move constants to utils 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-16 22:07:38 +05:30
Deepanshu Agarwal 55ad67d510 When UUID could not be generated 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-16 21:44:37 +05:30
Deepanshu Agarwal 81898d5ee5 Config Per Topic and using maxAwaitDuration 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-16 20:04:32 +05:30
Deepanshu Agarwal d31f4d99f5 Merge branch 'feature/pubsub-batching' of github.com:dapr/components-contrib into ps_batch_c_kafka 2022-09-16 11:36:23 +05:30
Mukundan Sundararajan 3f9c42c4b8
Kafka bulk publish (#2059) 
* Contrib updates for Batch Subscribe

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* commit

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Commit pubsub

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Update structs

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Update Default Batch struct name

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Update Default Batch

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Update return type for BatchPublish

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Add docs

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Rename batch to bulk

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* snssqs renam batch to bulk

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Renaming Bulker to BulkMessager

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Renaming names as discussed

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Minor updates

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Remove ContentType from BulkPublishRequest

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Update error type

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Changes to bulk subscribe and error type

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Segregating Bulk Publisher and Bulk Subscriber and removing them as mandatory

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Event Type name correction

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Docs update as per comments

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* bulk publish implementation for kafka

Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>

* Add ctx to BulkPublish.

Signed-off-by: Artur Souza <artursouza.ms@outlook.com>

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
Signed-off-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
 2022-09-15 13:17:17 -07:00
Deepanshu Agarwal f11660e70d Change to warning normal subscribe part as well 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-15 16:09:47 +05:30
Deepanshu Agarwal f5542c70b9 Incorporate review comments and remove index based entryID 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-15 16:02:30 +05:30
Deepanshu Agarwal 31a38e5aaa Change marking message logic 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-14 13:01:30 +05:30
Deepanshu Agarwal 059461c6f4 Add kafka changes for bulk subscribe 
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
 2022-09-13 01:01:05 +05:30
zcong1993 320ae2d674
fix(kafka): should return when session context is done in ConsumeClaim 
Signed-off-by: zcong1993 <zhangcong1992@gmail.com>
 2022-09-05 16:28:49 +08:00
Mukundan Sundararajan 35590e0857 read record header as metadata if available in kafka 
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
 2022-08-26 12:02:15 +05:30
Bernd Verst e87cd5e4cb
Go 1.19 support and linter fixes (#1975) 
* Go 1.19 support and linter fixes

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update workflows for Go1.19 and new linter version

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Remove unnecessary space in nolint directive

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* disable additional linters which aren't used because of Go generics

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* enable gosec linter again

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update bindings/zeebe/command/publish_message_test.go

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update bindings/output_binding.go

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Use prepared statement for mysql table creation

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Ping is not ping

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* c'mon linter

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Fix MySQL gosec issue

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* revert mysql to be fixed later

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-08-18 00:45:23 -07:00
cong 38fc439410
fix(kafka): ConsumeClaim should not return err when retry recovery failed (#1965) 
* fix(kafka): ConsumeClaim should not return err when retry recovery failed

Signed-off-by: zcong1993 <zhangcong1992@gmail.com>

* chore: tweak error log message

Signed-off-by: zcong1993 <zhangcong1992@gmail.com>

Signed-off-by: zcong1993 <zhangcong1992@gmail.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
 2022-08-12 19:16:02 -07:00
Alessandro (Ale) Segala b3e18bb11d
pubsub.in-memory: add support for wildcard topics (#1966) 
* pubsub.in-memory: add support for wildcard topics

Fixes #1964

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* make modtidy-all

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-08-12 17:13:47 -07:00
Alessandro (Ale) Segala f2ac0cda69
Ensure locks in channels are properly released (#1957) 
Fixes #1865

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
 2022-08-10 14:52:46 -07:00
qiangmzsx 79a3cd990a
Removing the use of the ioutil package And Fix CVE-2021-42576 (#1954) 
* fix CVE-2021-42576

Signed-off-by: qiangmzsx <qiangmzsx@gmail.com>

* Removing the use of the ioutil package

Signed-off-by: qiangmzsx <qiangmzsx@gmail.com>

* Update middleware/http/nethttpadaptor/nethttpadaptor.go

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: qiangmzsx <qiangmzsx@gmail.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
 2022-08-10 13:45:00 -07:00