Commit Graph

85 Commits

Author SHA1 Message Date
Alessandro (Ale) Segala ec05809ee6
[Metadata] Update validator and some other fixes (#2984)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Bernd Verst <github@bernd.dev>
2023-07-17 22:17:22 +00:00
Alessandro (Ale) Segala 5adc33d079
Azure Blob Storage: gracefully handle setting "endpoint" to non-emulator (#2959)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-06-30 19:32:41 +00:00
Bernd Verst 1dee97ffc4
ASB: ScheduledEnqueueTimeUtc improve date parsing and return err (#2875)
Signed-off-by: Bernd Verst <github@bernd.dev>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
2023-05-30 16:43:23 -07:00
Bernd Verst 4720f6336f address changes required due to package updates
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-05-10 13:43:21 -07:00
Tiago Alves Macambira 536ba55522
Added component metadata YAML for Azure Blob Storage state store. (#2770)
Signed-off-by: Tiago Alves Macambira <tmacam@burocrata.org>
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Bernd Verst <github@bernd.dev>
Co-authored-by: Bernd Verst <github@bernd.dev>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
2023-04-12 23:04:15 +00:00
Alessandro (Ale) Segala 5dad8a867c
Metadata parser: add support for built-in authentication profiles and metadata properties (#2760)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Bernd Verst <github@bernd.dev>
2023-04-12 00:04:34 +00:00
Bernd Verst 2b89d78a2d
Refactor Metadata Parsing of all PubSub Components (#2759)
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-04-09 18:21:56 +00:00
Bernd Verst cfbac4d794
Refactor of Metadata parsing in Bindings (#2720)
Signed-off-by: Bernd Verst <github@bernd.dev>
Signed-off-by: Shivam Kumar <shivamkm07@gmail.com>
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Roberto J Rojas <robertojrojas@gmail.com>
Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Roberto Rojas <robertojrojas@gmail.com>
Signed-off-by: spike <hello@spike.wiki>
Signed-off-by: zhangchao <zchao9100@gmail.com>
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
Signed-off-by: handlerww <handlerww@gmail.com>
Co-authored-by: Shivam Kumar <shivamkm07@gmail.com>
Co-authored-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Roberto Rojas <robertojrojas@gmail.com>
Co-authored-by: spike <39330606+SpikeWong@users.noreply.github.com>
Co-authored-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
Co-authored-by: Taction <zchao9100@gmail.com>
Co-authored-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
Co-authored-by: Yiwen Chen <handlerww@gmail.com>
2023-04-05 22:19:08 +00:00
ItalyPaleAle 8cc74c7331 Completed the removal of the Azure SDK track 1
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-27 22:37:23 +00:00
ItalyPaleAle 2916e53a72 WIP
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-27 21:28:08 +00:00
Bernd Verst 3a616c5678 Remove Track 1 SDK references
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-02-27 12:44:32 -08:00
ItalyPaleAle 55b6a04805 Merge branch 'master' of https://github.com/dapr/components-contrib into newdeps
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-17 21:20:45 +00:00
ItalyPaleAle 5616866edc Fixed panic when not using Azure AD
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-16 17:44:33 +00:00
ItalyPaleAle a8957062f0 Fixed tests
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-16 01:42:05 +00:00
ItalyPaleAle 6f30dbf6c6 Updated Azure Event Hubs and Azure Blob Storage SDKs
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-16 00:21:56 +00:00
ItalyPaleAle b395ecd725 Small concurrency fixes
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-14 21:07:35 +00:00
Alessandro (Ale) Segala b9f33ca14c
[release-1.10] Improve lock handling and renewal for ASB messages (fix #2532) (#2533)
* Improved lock renewal

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Better memory management

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Complete and abandon messages in parallel too

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 10->20

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

---------

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-14 11:33:13 -08:00
Alessandro (Ale) Segala 12acf8effe
[release-1.10] Azure Service Bus: fix goroutine "explosion" after recovering from failure and many other bugs (#2523)
* Fixed context leak

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Finalize messages in background

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* More tweaks

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Moved a lot more code to the shared implementation package

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed:
- Fixed: if number of messages received in bulk is greater than maxConcurrentHandlers, a deadlock happens
- Fixed: maxRetriableErrorsPerSec was not working

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Some refactorings

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Simplifications

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Avoid checking if topic/queue exists every time we send a message

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Ensuring locks are renewed for all 3 components

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Updated ASB SDK

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Improvements to closing

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Improvements to closing

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Changed context propagation

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Debug logs in cert tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Initial delay before renewing locks

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* That last change was actually unnecessary

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Tweaks

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* More tweaks

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 💄

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

---------

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-13 09:23:03 -08:00
ItalyPaleAle d2ddf87045 Compare context deadline exceeded error as strings too
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-31 18:09:21 +00:00
ItalyPaleAle 7047ad533d More logging when Service Bus reconnects after publishing error
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-31 17:58:30 +00:00
ItalyPaleAle 54cfe54c95 Fixed typo in ASB metadata property name
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-30 19:47:34 +00:00
ItalyPaleAle a84ab2d0f6 Some fixes
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-23 17:39:40 +00:00
ItalyPaleAle d986d3b6ff More fixes
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-21 20:00:45 +00:00
ItalyPaleAle 1fd48dd912 Fixes
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-21 19:40:52 +00:00
ItalyPaleAle 232c8d813f Working on binding
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-21 19:28:00 +00:00
ItalyPaleAle 857a865e4e Moved implementation to shared package
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-21 01:14:04 +00:00
ItalyPaleAle 8d679f06f9 Working on upgrading from track1 SDKs
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-20 16:59:27 +00:00
ItalyPaleAle 130afe5c1a Merge branch 'master' of https://github.com/dapr/components-contrib into eventhubs-track2
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-19 00:13:26 +00:00
ItalyPaleAle 0157bf0b72 WIP
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-19 00:12:10 +00:00
Joni Collinge 7e141e75e0
revert to using map and mutex
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
2023-01-18 19:23:52 +00:00
Joni Collinge 58daacbdcd
use sync.Map instead of map and mutex for active message tracking
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
2023-01-18 10:20:32 +00:00
Joni Collinge 77504a8289
assign to slice rather than append
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
2023-01-15 10:12:28 +00:00
Joni Collinge c1de465e64
revert active message snapshot to use append
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
2023-01-14 13:38:14 +00:00
Joni Collinge f6d31aba8d
Measure length after taking lock
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
2023-01-13 18:36:39 +00:00
Joni Collinge 382f84f30c
Add support for Azure Service Bus sessions for topics (#2346)
* WIP: ASB sessions

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* WIP: Support ASB sessions

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Add metadata

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* remove dead code

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* lint

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Add sessionIdleTimeoutInSec md

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Support blank session IDs

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* If require sessions and no session id, set blank

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* move session config to per subscription metadata

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* add some unit tests

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* lint

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* remove auto blank session id

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* go mod tidy

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* add basic cert test

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* update comment

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* remove dead code

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* remove dead code

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Update certification test

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Add comment

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Add cert test for roundrobin

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* go mod tidy

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Update readme

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Use struct for NewSubscription to simplify parameters

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Address feedback

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Address feedback

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Only async receive

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* isTruthy on map without check

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Use if not select for context check

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Feedback

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* lint

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

Signed-off-by: Joni Collinge <jonathancollinge@live.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-06 09:59:26 -08:00
Joni Collinge 1c342e32d0
lint
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
2023-01-05 14:25:40 +00:00
Joni Collinge e097a04842
Feedback
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
2023-01-05 14:15:00 +00:00
Joni Collinge 4b99832634
Use if not select for context check
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
2022-12-20 18:11:20 +00:00
Joni Collinge 5051e28b9c
Address feedback
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
2022-12-20 09:59:20 +00:00
Joni Collinge b6911b67fd
Use struct for NewSubscription to simplify parameters
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
2022-12-20 09:23:30 +00:00
Bernd Verst 87c338269a
Merge branch 'master' into jjcollinge/asb-sessions
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-12-16 14:37:38 -08:00
Joni Collinge 28003fcf4f
Add cert test for roundrobin
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
2022-12-16 16:45:17 +00:00
Bernd Verst 78a83c77fb
Merge branch 'master' into fix-blobstore-error-checks 2022-12-15 13:11:14 -08:00
Bernd Verst 64a2c3aad1 Revert "revert amqp changes, eventhubs library update"
This reverts commit b236279d81.
2022-12-14 16:19:06 -08:00
Bernd Verst b236279d81 revert amqp changes, eventhubs library update
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-12-14 15:05:56 -08:00
Bernd Verst fce17f592e Update SDKs again
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-12-13 12:27:40 -08:00
Joni Collinge f57727f4b4
Add comment
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
2022-12-12 21:57:44 +00:00
Joni Collinge 0db24fa04e
Update certification test
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
2022-12-12 21:43:18 +00:00
Joni Collinge a4a2466d2b
remove dead code
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
2022-12-09 15:14:34 +00:00
Joni Collinge e488f6d304
remove dead code
Signed-off-by: Joni Collinge <jonathancollinge@live.com>
2022-12-09 15:13:47 +00:00