Commit Graph

507 Commits

Author SHA1 Message Date
ItalyPaleAle 2afca71c2a Renamed mqtt components to mqtt3
Fixes #2359

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-13 09:51:30 -08:00
ItalyPaleAle 9eaccaf01f Merge branch 'master' of https://github.com/dapr/components-contrib into s3-fix
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-12 15:16:47 -08:00
Pravin Pushkar 1ef514df3f
HTTP binding: add TLS config options for client cert verification (#2399)
* adding client cert for client verification

Signed-off-by: Pravin Pushkar <ppushkar@microsoft.com>

* logic for getting certs is provided as pem encoded strings

Signed-off-by: Pravin Pushkar <ppushkar@microsoft.com>

* adding test for https endpoint

Signed-off-by: Pravin Pushkar <ppushkar@microsoft.com>

* tls min version

Signed-off-by: Pravin Pushkar <ppushkar@microsoft.com>

* adding tests

Signed-off-by: Pravin Pushkar <ppushkar@microsoft.com>

* added more tests and some test refactoring

Signed-off-by: Pravin Pushkar <ppushkar@microsoft.com>

* modify err check for file not exist

Signed-off-by: Pravin Pushkar <ppushkar@microsoft.com>

* review comments

Signed-off-by: Pravin Pushkar <ppushkar@microsoft.com>

Signed-off-by: Pravin Pushkar <ppushkar@microsoft.com>
2023-01-10 21:18:48 -08:00
ItalyPaleAle 2634e85e81 Merge branch 'master' of https://github.com/dapr/components-contrib into s3-fix 2023-01-10 14:47:10 -08:00
ItalyPaleAle cd800cdbff Last few fixes
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-10 18:35:29 +00:00
ItalyPaleAle 47e8e41492 Using metadata.DecodeMetadata + other fixes
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-10 18:28:35 +00:00
ItalyPaleAle 80dbd4f878 Misc improvements and fixes to S3 binding
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-10 18:14:01 +00:00
ItalyPaleAle 32f14568ec Moved Unquote to utils package
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-10 17:52:38 +00:00
ItalyPaleAle 3aefab1125 💄
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-10 17:19:16 +00:00
ItalyPaleAle c33be7f858 bindings.twilio.sms: Properly handle JSON-formatted req.Data
Fixes #2422

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-10 17:16:28 +00:00
Joni Collinge 382f84f30c
Add support for Azure Service Bus sessions for topics (#2346)
* WIP: ASB sessions

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* WIP: Support ASB sessions

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Add metadata

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* remove dead code

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* lint

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Add sessionIdleTimeoutInSec md

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Support blank session IDs

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* If require sessions and no session id, set blank

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* move session config to per subscription metadata

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* add some unit tests

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* lint

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* remove auto blank session id

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* go mod tidy

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* add basic cert test

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* update comment

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* remove dead code

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* remove dead code

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Update certification test

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Add comment

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Add cert test for roundrobin

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* go mod tidy

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Update readme

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Use struct for NewSubscription to simplify parameters

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Address feedback

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Address feedback

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Only async receive

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* isTruthy on map without check

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Use if not select for context check

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* Feedback

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* lint

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

Signed-off-by: Joni Collinge <jonathancollinge@live.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-06 09:59:26 -08:00
Alessandro (Ale) Segala ec5791492e
Merge branch 'master' into cfqueues-binding 2022-12-20 14:49:46 -08:00
ItalyPaleAle 135d460b05 Configurable timeouts
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-19 17:46:54 +00:00
ItalyPaleAle 6aa9ccc364 Binding -> CFBinding
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-19 17:39:30 +00:00
ItalyPaleAle 416aa46157 Added provisional links to docs
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-19 17:37:14 +00:00
seachen 5dda098868 feature: add context to lock&pubsub API
Signed-off-by: seachen <seachen@tencent.com>
2022-12-19 09:11:53 +08:00
Bernd Verst adc7bd8ca5
Merge branch 'master' into cfqueues-binding
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-12-16 14:46:03 -08:00
Bernd Verst 3e08736911
Add support for Redis 7 in all Dapr Components (#2228)
* Add support for Redis 7

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add Redis 7 to conformance tests

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* automatically detect redis version, make redis7 state conformant

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Additions for REDIS without JSON support

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Return helpful query API error when missing redis-json

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Change Redis 7 port for conformance test

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Fix nil reference

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Update Redis7 port

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Enable ContextTimeoutEnabled for Redis v9 client

Co-Authored-By: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Add timeouts, address code review

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add another timeout

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Redis: so much more context

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* modtidy

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* fix issue from latest merge

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* modtidy

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add generic redis nil error

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* fix redis version check

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* upgrade redis v9 client

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Remove flaky redis v7 pubsub conformance test

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* modtidy

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-16 14:12:11 -08:00
ItalyPaleAle e8353379e1 Merge branch 'master' of https://github.com/dapr/components-contrib into cfqueues-binding 2022-12-15 10:01:54 -08:00
seachen 1ea2cff9fd feature: add context to lock&pubsub API
Signed-off-by: seachen <seachen@tencent.com>
2022-12-15 09:53:32 +08:00
Bernd Verst 64a2c3aad1 Revert "revert amqp changes, eventhubs library update"
This reverts commit b236279d81.
2022-12-14 16:19:06 -08:00
Bernd Verst b236279d81 revert amqp changes, eventhubs library update
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-12-14 15:05:56 -08:00
seachen e59dfd63c0 feature: add context to lock&pubsub API
Signed-off-by: seachen <seachen@tencent.com>
2022-12-14 19:37:24 +08:00
Bernd Verst 0d7a7e73db pin latest dapr
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-12-13 17:10:10 -08:00
Bernd Verst fce17f592e Update SDKs again
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-12-13 12:27:40 -08:00
ItalyPaleAle 308f3c987c 💄
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-13 10:02:42 -08:00
ItalyPaleAle 47db769066 Add Cloudflare KV state store
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-13 01:52:06 +00:00
ItalyPaleAle d4b0980cec Refactored to use a shared package
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-13 00:32:55 +00:00
ItalyPaleAle adc70a0143 Automatically deploy and update workers
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-12 22:53:35 +00:00
ItalyPaleAle 456caaef6a WIP
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-12 20:06:04 +00:00
ItalyPaleAle 385d0480a7 Added authorization
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-10 02:31:41 +00:00
ItalyPaleAle 20285ba6f9 WIP: Added Cloudflare Queues binding
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-10 00:49:45 +00:00
Sarthak Sharma a4b27ae49b
fix flaky tests (#2338) 2022-12-03 13:59:42 -08:00
Sarthak Sharma 0e0cf8fe58
Add certification tests for Cron Binding (#2191)
* fix typos

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add basic tests

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* update tests

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add Readme

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* update mod file

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add entry in workflow

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add conformance test

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add conformance tests to workflow

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* use watcher to assert

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* update readme

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* fix linting

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* Apply suggestions from code review

Co-authored-by: Shubham Sharma <shubhash@microsoft.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* change to dapr/go-sdk from hunter007/dapr-go-sdk

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* fix cron delete operation

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add check if cron not triggered after delete

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* update README

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* parameterise application and assertions

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* use mock clock for cron

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* change cron to input only binding

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add forked cron library to internal/cron

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* use cron internal fork for binding

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* resolve comments

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* resolve comments

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add test matrix to test various schedules

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add cron init unit tests

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* resolve comments

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* fix linting

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* fix linting

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* go modtidy all

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* go modtidy

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* move cron fork to dapr/kit

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* use pinned v0.0.3 for dapr/kit

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Shubham Sharma <shubhash@microsoft.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-12-02 02:30:01 -08:00
John Ewart aef7ec77dc Fix naming to make ci-linter happy
Signed-off-by: John Ewart <john@johnewart.net>
2022-11-29 14:56:06 -08:00
John Ewart 49bdf702e9 gofumpt'd
Signed-off-by: John Ewart <john@johnewart.net>
2022-11-29 13:51:56 -08:00
John Ewart 4227cf7716 Update tests to be a little more isolated
Signed-off-by: John Ewart <john@johnewart.net>
2022-11-29 13:41:45 -08:00
John Ewart 9e9d7086e1 Allow HTTP binding to not error on non-200 responses
Signed-off-by: John Ewart <john@johnewart.net>
2022-11-29 13:41:36 -08:00
Bernd Verst 385c6b79b6 remove unnecessary reader close()
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-11-28 15:51:03 -08:00
Bernd Verst 23d36a08d7 more refactoring and address code review
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-11-18 17:56:02 -08:00
Bernd Verst 8811d5e64f AzBlob components: Extract shared code
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-11-17 21:37:17 -08:00
Bernd Verst 70eb9f3a9c Address code review comments
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-11-17 20:35:05 -08:00
Bernd Verst c3027b8fb1 some small improvements
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-11-17 19:54:32 -08:00
Bernd Verst 51e0aa992c Azure Blobstorage Binding: Migrate to Track2 Azure SDK
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-11-17 19:54:32 -08:00
ItalyPaleAle 1e728597b4 Misc refactorings
- Removed `state.DeleteWithOptions` and `state.SetWithOptions` which were useless at this point (likely a leftover from when there were retries)
- Some improvements in etag handling in postgres
- Other minor refactorings

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-11-17 16:29:29 +00:00
Bernd Verst 1b645097df
Merge branch 'master' into asbq-visibilitytimeout 2022-11-15 17:04:21 -08:00
Bernd Verst 14d89afeef Add user agent back to Cosmos DB Binding
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-11-15 14:59:04 -08:00
Bernd Verst 507fbc5c8b Merge branch 'master' into asbq-visibilitytimeout
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-11-15 12:57:34 -08:00
Bernd Verst d916808824 address linter issue
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-11-14 18:14:19 -08:00
Bernd Verst 5c9a5792be ASQ Binding: Make visibilityTimeout configurable
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-11-14 11:48:20 -08:00
Lior Nabat 1024190fcc update for gofumpt
Signed-off-by: Lior Nabat <lior.nabat@gmail.clom>
2022-11-11 23:41:09 +02:00
KubeMQ adb840bb84
Merge branch 'dapr:master' into master 2022-11-11 23:34:39 +02:00
Bernd Verst 462e2faadc Upgrade linter and fix linter issues
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-11-11 13:19:57 -08:00
Lior Nabat 12ad3b9bde update new line for linter
Signed-off-by: Lior Nabat <lior.nabat@gmail.clom>
2022-11-11 22:47:34 +02:00
Lior Nabat ac46b110c8 re-Arrange for lint
Signed-off-by: Lior Nabat <lior.nabat@gmail.clom>
2022-11-11 22:06:08 +02:00
Lior Nabat f928b2235e Remove Content-Type
Signed-off-by: Lior Nabat <lior.nabat@gmail.clom>
2022-11-11 21:47:55 +02:00
Lior Nabat a47d8f87dd Adding KubeMQ Binding - Queue
Signed-off-by: Lior Nabat <lior.nabat@gmail.clom>
2022-11-11 16:03:25 +02:00
Bernd Verst c8aa090e56
Merge branch 'master' into storagequeuesencode 2022-11-09 15:58:49 -08:00
wxbty e69ae3751d
feat:add redis binder invoke of del&get (#2197)
Signed-off-by: x-shadow-man <1494445739@qq.com>

Signed-off-by: x-shadow-man <1494445739@qq.com>
Co-authored-by: x-shadow-man <1494445739@qq.com>
2022-11-09 14:42:49 -08:00
Bernd Verst 73ec4e3cfc Storage Queues Binding: Add b64encoding option for messages
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-11-08 21:35:56 -08:00
Alessandro (Ale) Segala ca3e80b76b
Updated depguard linter config (#2245)
* Updated depguard linter config

1. Add older (pre-v4) versions of `github.com/cenkalti/backoff` to the denylist
2. Add `github.com/agrea/ptr` to the denylist (use `github.com/dapr/kit/ptr` instead)
3. Fixed error messages for denied deps

Port of dapr/dapr#5438

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* ⚙️🧹

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Remove some github.com/pkg/errors

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* make modtidy-all after rebase

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-11-03 22:19:21 -07:00
Bernd Verst 27365fbb35 Update many libraries again
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-11-01 16:00:27 -07:00
Alessandro (Ale) Segala cc856d4e13
Fix Azure Service Bus cert/conf tests (#2218)
* Correct location for certification test

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Removed log file added by mistake

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed parsing metadata for ASB Queue binding

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed replace path

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-10-24 15:05:36 -07:00
Alessandro (Ale) Segala 04242ce38a
New PubSub component: Azure Service Bus Queues (#2211)
* Implementation for Azure Service Bus Queue pubsub component

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed syntax errors in unused files

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Moved components to subfolders and enabled conf tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-10-24 14:07:23 -07:00
ItalyPaleAle 254a2141ad Moved sender handling to common implementation too
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-10-19 21:01:15 +00:00
ItalyPaleAle 065ef86ee5 Moved client creation to common implementation
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-10-19 20:34:10 +00:00
ItalyPaleAle 7ecfb6edd0 Moved code to add metadata to ASB messages to shared impl too
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-10-19 20:08:07 +00:00
ItalyPaleAle 8bce0d5200 Moved metadata to impl package
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-10-19 19:47:26 +00:00
Bernd Verst 0f0aaf4e9b Merge remote-tracking branch 'upstream/master' into merge19intomaster 2022-10-14 12:16:57 -07:00
ItalyPaleAle 4de7a2fc9d The people demand defers
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-10-12 18:46:38 +00:00
ItalyPaleAle 047f3948c5 Fix for handling "context deadline exceeded" on ASB publishing
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-10-12 18:18:33 +00:00
Bernd Verst e7367a4bbe update commercetools to v1.1.0
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-10-11 14:55:15 -07:00
Bernd Verst 83a562d71a update lots of dependencies
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-10-11 14:01:38 -07:00
Bernd Verst b9654bd979 upgrade to v5 of jackc/pgx
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-10-10 15:08:07 -07:00
Bernd Verst f137bc7373 rabbitmq: use ctx for publishing
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-10-10 14:37:21 -07:00
ItalyPaleAle 132acafe54 Remove ipfs binding which is not part of the runtime
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-10-07 22:24:57 +00:00
deepanshuagarwal 38c58ac87b
Merge branch 'master' into feature/pubsub-batching 2022-09-29 13:16:43 +05:30
Yaron Schneider b4d68ed28a
Add AWS S3 standalone presign operation (#2138)
* add aws s3 standalone presign operation

Signed-off-by: yaron2 <schneider.yaron@live.com>

* linter

Signed-off-by: yaron2 <schneider.yaron@live.com>

Signed-off-by: yaron2 <schneider.yaron@live.com>
2022-09-28 16:01:30 -07:00
Mukundan Sundararajan eab68d1a7e
Merge branch 'master' into feature/pubsub-batching 2022-09-28 09:14:03 +05:30
Alessandro (Ale) Segala f15a50581d
Component metadata schema and tools (#2077)
* Component metadata schema and tools

Includes tools to generate and validate components' schema, and a CI check to ensure the schema is always up-to-date.

Also, includes schemas for 4 components as a starter

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Changed version as requested

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* fix workflow

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-09-27 10:44:54 -07:00
Mukundan Sundararajan 803c0591c2
Merge branch 'master' into feature/pubsub-batching 2022-09-25 12:35:33 +05:30
Yaron Schneider 47d5b90e44
Add presigning to aws s3 binding (#2121)
* add presigning to aws s3 binding

Signed-off-by: yaron2 <schneider.yaron@live.com>

* fix error shadowing

Signed-off-by: yaron2 <schneider.yaron@live.com>

* typo and error consistency

Signed-off-by: yaron2 <schneider.yaron@live.com>

Signed-off-by: yaron2 <schneider.yaron@live.com>
2022-09-23 15:35:15 -07:00
Shubham Sharma 4f406a597f
Add bulk subscribe support to Azure Service Bus (#2100)
* Initial implementation

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* 

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Add tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Add comment

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor messages.go and add tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update message tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor servicebus.go logic

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor handleAsync

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor ReceiveAndBlock

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update binding

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Review comments addressed

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Lint

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update metadata name

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update activeMessagesChan logic for concurrency control

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Fix tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update metadata name

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Use request metadata instead of component metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Review comments addressed

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Fix merge issue with metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Remove unused metadata key

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Fix merge issue with metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Lint!!!

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
2022-09-23 10:49:06 -07:00
deepanshuagarwal 8500da577c
Conf test for Bulk Subscribe and Kafka fixes (#2113)
* Conf test for Bulk Sub and Kafka Fixes

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Fix linting

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Incorporating comments

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
2022-09-23 09:54:21 -07:00
ItalyPaleAle 1a6e11fc63 Do not allow Unicode letters in sanitized metadata
Follow-up from #2112

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-09-22 16:46:14 +00:00
Bernd Verst 0b8b663e3e add warning message for changing metadata key
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-09-21 23:05:22 -07:00
Bernd Verst abb3ce3030
Merge branch 'master' into creatblobmetadata 2022-09-21 22:53:30 -07:00
Bernd Verst ddf16a11b2 add test case
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-09-21 22:34:28 -07:00
Bernd Verst 6e4f8e9ca9 sanitize creatBlob request metadata in AzStorageBlob
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-09-21 18:39:14 -07:00
Bernd Verst 0510b094bf Use latest Azure SDK for Go minor / patch SDK versions
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-09-21 14:54:24 -07:00
Crypt Keeper b379f80b75
middleware: changes wasm basic to use waPC (#1833)
Updates wasm basic middleware and simplifies some code inside of it,
notably by using [waPC](https://github.com/wapc/wapc-go).

This changes the entrypoint function to be named "rewrite" and
uses a pool because known memory allocators are not goroutine
safe.

Signed-off-by: Adrian Cole <adrian@tetrate.io>

Signed-off-by: Adrian Cole <adrian@tetrate.io>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2022-09-13 17:12:59 -07:00
Bernd Verst ed31cfa815 revert zeebe duration type
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-09-12 18:57:13 -07:00
Bernd Verst 1d0ad9c6d8 Use standardized metadata parser
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-09-12 18:50:05 -07:00
Bernd Verst 393f24280b Fix Zeebe metadata duration issue
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-09-12 16:42:36 -07:00
Bernd Verst 385bb9fe82
Azure Service Bus Queues Binding: disable entity management option (#2022) 2022-08-26 23:49:39 -07:00
Alessandro (Ale) Segala bcea284c7b
Components' init functions should return interfaces (#1997)
* Components' init functions should return interfaces

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 💄

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* pin latest berndverst contrib fork

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Fixed component registration in tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Updated all cert tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-08-25 18:27:45 -07:00
Marcos Candeia 8964d8bf41
Define common metadata across components (#1994)
* Add base metadata for all components

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>

* Fix lint issues on consul and mysql tests

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>

* Pin candeia/dapr runtime version

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>

* Add replace directive to use mcandeia/dapr on all go submodules

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>

* Fixed runtime config instantiation

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>
2022-08-25 10:10:53 -07:00
Bernd Verst e87cd5e4cb
Go 1.19 support and linter fixes (#1975)
* Go 1.19 support and linter fixes

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update workflows for Go1.19 and new linter version

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Remove unnecessary space in nolint directive

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* disable additional linters which aren't used because of Go generics

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* enable gosec linter again

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update bindings/zeebe/command/publish_message_test.go

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update bindings/output_binding.go

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Use prepared statement for mysql table creation

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Ping is not ping

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* c'mon linter

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Fix MySQL gosec issue

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* revert mysql to be fixed later

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-08-18 00:45:23 -07:00
halspang 4bc800f612
Allow metadata to flow through service bus queue (#1911)
* Allow metadata to flow through service bus queue

This commit lets metadata bind to a message and be read when
the message is received. This allows for the distributed tracing
of events.

Signed-off-by: Hal Spang <halspang@microsoft.com>

* Remove saved fields from ApplicationProperties

Signed-off-by: Hal Spang <halspang@microsoft.com>

* Add a certification test for metadata

Signed-off-by: Hal Spang <halspang@microsoft.com>

Signed-off-by: Hal Spang <halspang@microsoft.com>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-08-15 17:31:14 -07:00
yellow chicks 0ffa1f3119
fix: bindings.ipfs unit test (#1961)
Signed-off-by: 1046102779 <seachen@tencent.com>

Signed-off-by: 1046102779 <seachen@tencent.com>
2022-08-11 16:13:18 -07:00
qiangmzsx 79a3cd990a
Removing the use of the ioutil package And Fix CVE-2021-42576 (#1954)
* fix CVE-2021-42576

Signed-off-by: qiangmzsx <qiangmzsx@gmail.com>

* Removing the use of the ioutil package

Signed-off-by: qiangmzsx <qiangmzsx@gmail.com>

* Update middleware/http/nethttpadaptor/nethttpadaptor.go

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: qiangmzsx <qiangmzsx@gmail.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-08-10 13:45:00 -07:00
Ryan Lettieri ac1e16f58f
Adding in track2 SDK support for CosmosDB Bindings (#1876)
* Adding in track2 SDK support for CosmosDB Bindings

Signed-off-by: Ryan Lettieri <ryanLettieri@microsoft.com>

* Removing non needed ID check

Signed-off-by: Ryan Lettieri <ryanLettieri@microsoft.com>

* Addressing container read operation

Signed-off-by: Ryan Lettieri <67934986+RyanLettieri@users.noreply.github.com>

* Updating linting

Signed-off-by: Ryan Lettieri <67934986+RyanLettieri@users.noreply.github.com>

Co-authored-by: Ryan Lettieri <ryanLettieri@microsoft.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-08-09 12:30:00 -07:00
Alessandro (Ale) Segala 697afe8608
bindings.cron: ensure it can resume correctly after context cancellation (#1943)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-08-09 11:37:07 -07:00
Christian Leinweber 1148776d37
binding.eventhub: use same name schema for storage leases like on pubsub.eventhub (#1940)
* binding.eventhub: use same name schema for storage leases like on pubsub.eventhub

Signed-off-by: Christian Leinweber <christian.leinweber@maibornwolff.de>

* binding.eventhub: rename AzureEventshub local var

Signed-off-by: Christian Leinweber <christian.leinweber@maibornwolff.de>
2022-08-08 09:53:04 -07:00
Mr.Black 66d92cd7ff
add a new binding component : alicloud sls log storage (#1873)
* new a bingding componet alicloud sls logstorage

Signed-off-by: RcXu <honeyxhl@163.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* update sls binding component

Signed-off-by: RcXu <honeyxhl@163.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* update the metadata decode method

Signed-off-by: RcXu <honeyxhl@163.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* make modtidy-all

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* sort imports

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Co-authored-by: RcXu <rongcai.xu@ivydad.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-08-05 16:44:31 -07:00
hypernova3 9a17d327f3
add ipfs binding (#1849)
* add web3.ipfs binding

Signed-off-by: hypernova3 <108718961+hypernova3@users.noreply.github.com>

* Replaced go module as old versions brought in a dep with LGPL license

Signed-off-by: hypernova3 <108718961+hypernova3@users.noreply.github.com>

* lint

Signed-off-by: hypernova3 <108718961+hypernova3@users.noreply.github.com>

* changed cid -> path

Signed-off-by: hypernova3 <108718961+hypernova3@users.noreply.github.com>

* add "ls" command

Signed-off-by: hypernova3 <108718961+hypernova3@users.noreply.github.com>

* pin-ls returns cids

Signed-off-by: hypernova3 <108718961+hypernova3@users.noreply.github.com>

* just "bindings.ipfs"

Signed-off-by: hypernova3 <108718961+hypernova3@users.noreply.github.com>

* updated library to kubo

Signed-off-by: hypernova3 <108718961+hypernova3@users.noreply.github.com>

* added tests

Signed-off-by: hypernova3 <108718961+hypernova3@users.noreply.github.com>

* linted

Signed-off-by: hypernova3 <108718961+hypernova3@users.noreply.github.com>

Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-08-05 12:53:59 -07:00
Christian Kaps 295f66a9dd
Add auto-completion flag for Zeebe (#1908)
Signed-off-by: Christian Kaps <ck-github@mohiva.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-08-04 19:47:31 -07:00
yellow chicks 24be879a40
modify error msg (#1897)
Signed-off-by: 1046102779 <seachen@tencent.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-07-20 13:05:40 -07:00
Alessandro (Ale) Segala d38c786771
Add contexts to input bindings (#1831)
This is the last part of the "shutdown sequence fix": it allows shutting down input bindings before output ones.

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-07-12 12:19:27 -07:00
yellow chicks 0742818cfd
optimize: add context to huawei/obs (#1820)
* optimize: add context to huawei/obs

Signed-off-by: 1046102779 <seachen@tencent.com>

* optimize: add context to huawei/obs

Signed-off-by: 1046102779 <seachen@tencent.com>

* optimize: add context to huawei/obs

Signed-off-by: 1046102779 <seachen@tencent.com>

Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-07-12 09:36:52 -07:00
Ben Coleman 7eb619dba7
Fixes 400 error empty content from sendgrid (#1867)
Signed-off-by: Ben Coleman <benc.uk@gmail.com>
2022-07-11 12:02:52 -07:00
cmendible 0e78291bf5 Fixing #1845
Signed-off-by: cmendible <cmendible@gmail.com>
2022-07-07 15:50:22 -07:00
Alessandro (Ale) Segala 3821c00131
Azure AD support in SignalR (#1852)
* WIP: Azure AD support in SignalR

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Correct SignalR AAD details

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Misc fixes

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* azauth package name

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-07-06 14:05:24 -07:00
Alessandro (Ale) Segala a2f3a84b96
Moved authentication to be an internal pkg (#1855)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-07-06 11:05:34 -07:00
Alessandro (Ale) Segala a193cc1ede
Add support for AAD auth in Azure Storage Queues binding (#1842)
* Add support for AAD auth in Azure Storage Queues binding

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 🧹

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-07-03 14:17:38 -07:00
Alessandro (Ale) Segala f283971d8c
Ensure context propagation in MySQL binding (#1829)
Spin-off from PR adding contexts to input bindings

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-07-01 12:53:52 -07:00
Alessandro (Ale) Segala cedaacbb7c
Make metadata keys uniform for Azure Storage components (#1837)
* Make metadata keys uniform for Azure Storage components

By using aliases we are preserving backwards-compatibility

Fixes #1832

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Updated bindings.azure.storagequeues too

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Updated state.azure.tablestorage too

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 💄

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 🧹

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Loong Dai <long.dai@intel.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-07-01 12:05:11 -07:00
Alessandro (Ale) Segala 4bf6cc4ca6
Updated development docs (#1835)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-06-30 22:23:41 -07:00
Alessandro (Ale) Segala 0cb7906c41
Ensure context propagation in SNS binding (#1825)
Spin-off from PR adding contexts to input bindings

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-06-30 21:36:09 -07:00
Alessandro (Ale) Segala a58d8dddda
Improvements to HTTP and graphQL bindings (#1828)
Ensure context propagation in output bindings + other fixes

Spin-off from PR adding contexts to input bindings

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-06-30 20:31:16 -07:00
Alessandro (Ale) Segala 1010f9c7ee
Ensure context propagation in signalr Invoke (#1827)
Spin-off from PR adding contexts to input bindings

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-06-30 18:37:29 -07:00
Alessandro (Ale) Segala 9b7db8927a
Improvements to S3 binding (#1824)
* Improvements to S3 binding

Ensure context propagation in output bindings + other fixes

Spin-off from PR adding contexts to input bindings

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-06-30 17:27:48 -07:00
Alessandro (Ale) Segala 921248462d
Updated Twilio components (#1830)
Ensure output binding propagates context (requires updated SDK)

Spin-off from PR adding contexts to input bindings

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-06-30 16:39:22 -07:00
Alessandro (Ale) Segala 07c88b13d6
Improvements to bindings.dingtalk.webhook (#1821)
* Improvements to bindings.dingtalk.webhook

Spin-off from PR adding contexts to input bindings

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Should not have been added

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-06-30 16:17:56 -07:00
Alessandro (Ale) Segala 2305dfb609
Improvements to DynamoDB binding (#1823)
Ensure context propagation in PutItem and other minor changes

Spin-off from PR adding contexts to input bindings

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-06-30 15:44:15 -07:00
Dapr Bot 7916719f9d
Merge branch 'master' into bc-blobstorage 2022-06-30 15:08:10 -07:00
Alessandro (Ale) Segala 17fe582d8c
Merge branch 'master' into context 2022-06-30 13:25:06 -07:00
ItalyPaleAle 14a9103bec Improvements to blobstorage binding
Spin-off from PR adding contexts to input bindings

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-06-29 19:55:02 +00:00
ItalyPaleAle bb828b84c6 Ensure context is propagated in Dubbo input binding
Spin-off from PR adding contexts to input bindings

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-06-29 19:31:32 +00:00
1046102779 1bf2bdb753 typo: modify package context
Signed-off-by: 1046102779 <seachen@tencent.com>
2022-06-29 12:57:24 +08:00
Sky Ao 0b2e48a4da
Fix kafka binding consumer rebalance (#1804)
* improve log of kafkaf components cert test

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* add close() method to kafka binding component to fix the consumer rebalance bug

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-06-21 06:56:09 -07:00
Alessandro (Ale) Segala a08988c25e
Shared implementation for Azure Service Bus subscriptions for binding and pubsub (#1791)
* Moved ASB subscription code to a shared package

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Moved ASBQ binding to use the shared ASB implementation

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Updating Azure Service Bus SDK version

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-06-17 15:12:15 -07:00
Bernd Verst f25b26fc0c
Upgrade to Azure Table Storage Track 2 SDK in State Store and add CosmosDB Table API support (#1792)
* Upgrade to Azure Table Storage Track 2 SDK in State Store

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* make modtidy-all

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* don't panic

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* fix error parsing

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Adds support for empty rowKeys again

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Pin aztables v1.0.1

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add support for Cosmos DB Table API

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add Azure Table Storage CosmosDB conformance test

Signed-off-by: GitHub <noreply@github.com>

* Address code review

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Create Table Storage State store subtests

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Address linter issue

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* context instead of ctx

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* load state store in conf tests

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* use cosmosDB mode in cosmosDB test

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add Azure AD support for Table Storage

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* remove shadow declaration

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* make accountKey optional

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add options to skip table creation

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-06-17 14:04:53 -07:00
Christian Kaps 6f159394b7
Update to Camunda Platform 8 (#1787)
Signed-off-by: Christian Kaps <ck-github@mohiva.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-06-14 10:01:41 -07:00
deepanshuagarwal a0ef46265b
Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784)
* add `Pinger` interface.

Signed-off-by: chanyong.moon <dev.chanyongmoon@gmail.com>

* Convert Ping fuction to optional

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Removing unrequired Ping implementations

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Addressing comments

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

Co-authored-by: chanyong.moon <dev.chanyongmoon@gmail.com>
2022-06-14 08:27:54 -07:00
Yaron Schneider 8728f8a4c9
add file upload to s3 (#1785)
Signed-off-by: yaron2 <schneider.yaron@live.com>
2022-06-13 11:48:50 -07:00
Alessandro (Ale) Segala 98aed5c571
Make Service Bus attempt to reconnect forever in case of issues (#1783)
* Make Service Bus attempt to reconnect forever in case of issues

With exponential back-off configurable between min and max time. Fixes #1612

Also includes fixes:

- Binding: make sure it actually retries to connect forever
- Binding: add delay (exponential backoff) before reconnecting
- PubSub: better handling of failures such as topics disabled or other non-connection issues

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 💄

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Added warning for deprecated metadata options

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 💄

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-06-10 15:54:46 -07:00
arahja 4322a2280e
Updated sendgrid binding to add the option to add names for the to an… (#1751)
* Updated sendgrid binding to add the option to add names for the to and from addresses. This commit relates to #1749

Signed-off-by: Adam Rahja <adam@resolve.com>

* Updated sendgrid binding from code suggestion.

Signed-off-by: Adam Rahja <adam@resolve.com>
2022-06-07 09:20:45 -07:00
Alessandro (Ale) Segala 704f4dd730
Add contexts to pubsub.Subscribe to allow early cancelation (#1756)
This commit is related to dapr/dapr#4624. As noted there, we have an issue in the runtime where all components are shut down after the grace period, when the app is likely already stopped. Because of that, certain input components (the subscribe part of pubsub and the input part of bindings - the latter not in scope of this PR), can continue bringing new work when it's known to fail.

In order to fix the issue linked above properly, we need to implement a way for PubSub components to have the "publish" part closed before the "subscribe" one (and in the future that will need to be done for input bindings too).

This commit achieves precisely that by adding a context in the Subscribe method. When that context is canceled (which can be at any time), the subscription is removed.

PS: This API change was implemented so it can one day be used for dapr/dapr#814 too, as it allows canceling individual subscriptions by using a different context. Although that's not possible today because it requires more work on the runtime, it does implement everything that's needed in the pubsub components already.
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-06-02 15:06:36 -07:00
Alessandro (Ale) Segala ca9fbf690e
Fixed Kafka PubSub to allow multiple handlers for different topics (#1755)
* Fixed Kafka PubSub to allow multiple handlers for different topics

With this, tests from #1743 are passing

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Removed read lock (for now)

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Updated as requested by @skyao

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Use interface type everywhere

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed panic

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
2022-06-01 15:31:11 -07:00
Laurence a323748d75
Feat: Add apache dubbo output binding (#1768)
* feat: support apache/dubbo

Signed-off-by: LaurenceLiZhixin <382673304@qq.com>

* fix: comments

Signed-off-by: LaurenceLiZhixin <382673304@qq.com>

* fix: gofumpt test file

Signed-off-by: LaurenceLiZhixin <382673304@qq.com>

* feat: dubbo cert test

Signed-off-by: LaurenceLiZhixin <382673304@qq.com>

* fix: add missiing header

Signed-off-by: LaurenceLiZhixin <382673304@qq.com>

Co-authored-by: Loong Dai <long.dai@intel.com>
2022-06-01 10:38:29 -07:00
Jasonli 499f6b2d49
Implement new bindings component for Huawei OBS (#1724)
* Add new bindings component for Huawei OBS

Signed-off-by: jasonlica <jasonli@huawei.com>

* resolve conflicts in go.sum respective to the changes #1710

Signed-off-by: jasonlica <jasonli@huawei.com>

* update go.mod

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update go.mod

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-05-17 23:12:39 -07:00
Alessandro (Ale) Segala e1b6b01223
Tweaks for ASB pubsub (#1729)
* Tweaks for ASB pubsub:
1. Do not attempt to reconnect when context was canceled
2. Message finalization uses a background context and not the running ctx, in case the app is shutting down

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* ASB: abandoned messages shouldn't be retried right away

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Ported fixes to servicebusqueues binding too

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Use a different approach to limit the number of messages processed in case of error

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Added maxRetriableErrorsPerSec to servicebusqueues binding too
Incl other improvements

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Do not reconnect to ASB every time we retrieve a message.

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* ⚙️

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-05-17 22:33:34 -07:00
Alessandro (Ale) Segala e5e9011655
Update Azure Service Bus components to track2 SDK (#1702)
* Updated to Go 1.18

Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* Updated Azure SDKs that are on track2
Includes some minor refactoring of auth code

Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* Updated Service Bus components to track2 SDK

Co-authored-by: halspang <halspang@microsoft.com>
Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* Initial Certification test for eventhubs binding [incomplete] (#1670)

* certification test for eventhubs binding

Signed-off-by: tanvigour <tanvi.gour@gmail.com>

* modified go.mod and go.sum

Signed-off-by: tanvigour <tanvi.gour@gmail.com>

* Add connection string testing

Signed-off-by: tanvigour <tanvi.gour@gmail.com>

* iothub testing

Signed-off-by: tanvigour <tanvi.gour@gmail.com>

* address feedback and run test

Signed-off-by: tanvigour <tanvi.gour@gmail.com>

* Install Azure CLI IOT hub extension

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* make modtidy-all

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* covering all eventhubs test cases

Signed-off-by: tanvigour <tanvi.gour@gmail.com>

* dependency changes after go modtidy-all

Signed-off-by: tanvigour <tanvi.gour@gmail.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Co-authored-by: Looong Dai <long.dai@intel.com>
Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* Use revive instead of golint (#1685)

Signed-off-by: pigletfly <wangbing.adam@gmail.com>

Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* Updated to Go 1.18 (#1697)

* Updated to Go 1.18

Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>

* Added go.work file
With Go 1.18, this allows gopls (the Go language server used for example in VS Code) to work inside test apps too.
See: https://go.dev/doc/tutorial/workspaces

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Removed go.work

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 💄

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* 💄 & 🧹

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* Add metadata property to configure Batching in Pulsar (#1707)

* Add metadata property to configure BatchingMaxSize&batchingMaxMessages in Pulsar
Signed-off-by: saberwang <saberwang@hotmail.com>

* sort field
Signed-off-by: saberwang <saberwang@hotmail.com>

* [pubsub]fix unit test bug
Signed-off-by: saberwang <saberwang@hotmail.com>

* remove unrelated changes
Signed-off-by: saberwang <saberwang@hotmail.com>

* Delete hard coded Metadata
Signed-off-by: saberwang <saberwang@hotmail.com>

* remove  .history

Signed-off-by: saberwang <saberwang@hotmail.com>

* restore .gitignore

Signed-off-by: saberwang <saberwang@hotmail.com>

* Hard coding default values and adding 'BatchingMaxPublishDelay' metadata

Signed-off-by: saberwang <saberwang@hotmail.com>

* fix code format

Signed-off-by: saberwang <saberwang@hotmail.com>

* formatting code

Signed-off-by: saberwang <saberwang@hotmail.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* This test can't work with track2 SDKs
The methods to create a message with a body are not exported

Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* 🧹

Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* There's such thing as too much logging

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Refactored subscription.go
This greatly simplifies certain parts of the code, reducing the number of goroutines and likely improving performance.
Performance for end-users improves too as there's no need anymore to pause for 2 seconds every time that we reach `maxActiveMessages`.
Additionally, with this change the config options `prefetchCount` and `maxActiveMessagesRecoveryInSec` are removed as unnecessary anymore.

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 💄

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed pubsub tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* These packages should have never been upgraded

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Ensuring we don't fetch 1 message more than max active

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Adding configurable timeout for servicebusqueues operations

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Persistent connection for invoking SB queues

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Reverted Event Hub SDK update

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Revert "Reverted Event Hub SDK update"

This reverts commit 212220aba0.

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fix Azure deploy for users with a first.last email

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Added some sleep that should help reduce flakiness in eventhubs binding cert test

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Changed servicebusqueue cert test
In case of a failure in the handler (ie. users' code), the message should be correctly re-enqueued, which means that messages will be re-delivered later and won't be in order.

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: halspang <halspang@microsoft.com>
Co-authored-by: tanvigour <60332928+tanvigour@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Co-authored-by: Looong Dai <long.dai@intel.com>
Co-authored-by: Wang Bing <wangbing.adam@gmail.com>
Co-authored-by: saber-wang <45062099+saber-wang@users.noreply.github.com>
2022-05-13 16:52:22 -07:00
lotuc 5e4bd89afd
Add topic metadata for mqtt input binding and support user defined topic for mqtt output binding (#1674)
* feat(bindings/mqtt): add data incoming topic to metadata

Signed-off-by: lotuc <lotu.c@outlook.com>

* feat(bindings/mqtt): support user defined topic on create action

Signed-off-by: lotuc <lotu.c@outlook.com>

* chore(bindings/mqtt): add integration test and topic response check test

Signed-off-by: lotuc <lotu.c@outlook.com>

* fix(bindings/mqtt): ignore misspell linting error for word mosquitto

Signed-off-by: lotuc <lotu.c@outlook.com>

Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
2022-05-11 12:11:51 -07:00
Sky Ao 8b5554dc71
Refactory kafka binding to reuse the kafka common code extracting from kafka pubsub component (#1696)
* refactory kafka pubsub code to extract common kafka code for reuse

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* fix lint;add unit test for subscribeAdapter

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* move topics filed from internal kafak struct to pubsub kafka struct, since in input binding the topics will confiured in metadata

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* reuse internal  kafka code for bindings

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* add redis standalone_test back which is delete by mistaken

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* small code improvement to trigger test

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* add license headers

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* try to set disbaleTls to true to verify the kafka connection fail

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* don't enable consum retry in kafka binding component;if authenticaion is disabled, need not set TLSDisable at the same time;

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

* fix lint

Signed-off-by: Sky Ao <aoxiaojian@gmail.com>

Co-authored-by: Loong Dai <long.dai@intel.com>
2022-05-10 20:07:23 -07:00
Janusz Dziurzynski 62c5a2b3d1
Support custom queueEndpoint in Azure Storage Queues (#1692)
* Support custom queueEndpoint in Azure Storage Queues

Signed-off-by: Janusz Dziurzynski <janusz@corechain.tech>

* run gofmt

Signed-off-by: Janusz Dziurzynski <janusz@corechain.tech>

* Add "Url" to JSON field name for clarity

Suggested by @msfussell in dapr/docs#2424

Signed-off-by: Janusz Dziurzynski <janusz@corechain.tech>
2022-05-10 12:27:10 -07:00
Alessandro (Ale) Segala e6c67356cd
Updated to Go 1.18 (#1697)
* Updated to Go 1.18

Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>

* Added go.work file
With Go 1.18, this allows gopls (the Go language server used for example in VS Code) to work inside test apps too.
See: https://go.dev/doc/tutorial/workspaces

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Removed go.work

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 💄

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-05-06 13:44:45 -07:00
Wang Bing db99b43068
Use revive instead of golint (#1685)
Signed-off-by: pigletfly <wangbing.adam@gmail.com>

Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
2022-05-06 12:55:17 -07:00
Wang Bing e6b8577997
Update readme of bindings (#1690)
Signed-off-by: pigletfly <wangbing.adam@gmail.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
2022-04-28 13:51:58 -07:00
pigletfly 84759553bc Add context in bindings
Signed-off-by: pigletfly <wangbing.adam@gmail.com>
2022-04-26 10:20:41 +08:00
pigletfly 5673b28b13 Add context in bindings interface
Signed-off-by: pigletfly <wangbing.adam@gmail.com>
2022-04-25 14:16:15 +08:00
Harry Kimpel 47cdbcd823 Adding binding for commercetools
Signed-off-by: Harry Kimpel <harrykimpel@hotmail.com>
2022-04-08 14:25:47 +02:00
Harry Kimpel b5056ddf72 Adding commercetools binding
Signed-off-by: Harry Kimpel <harrykimpel@hotmail.com>
2022-04-08 14:25:47 +02:00
Harry Kimpel 3e374406bc Adding commercetools binding
Signed-off-by: Harry Kimpel <harrykimpel@hotmail.com>
2022-04-08 14:25:47 +02:00
Alessandro (Ale) Segala 9a28bb2f70 Added retry logic and back-off to Cosmos DB components
Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
2022-03-24 22:32:05 +00:00
Alessandro (Ale) Segala cad688a7d9
Allow accepting self-signed TLS certs for S3 (#1593)
* Allow accepting self-signed TLS certs for S3

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed missing comma

Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* Linter was complaining

Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
2022-03-21 10:13:25 -07:00
Bernd Verst 40aadba329
Adds Azure Active Directory support to the Azure EventHubs Binding (#1572)
* Adds AAD support for Event Hubs Binding

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update test infra

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* EventHubs AAD permissions

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* WIP

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* EventHubs Binding AAD working with integration test

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update certification test role assignments

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* fix linter issues

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* rename validate function

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update commented out code for ACR resource.

Signed-off-by: Artur Souza <artursouza.ms@outlook.com>

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2022-03-18 14:46:49 -07:00
Yaron Schneider ad1a51d7d1
add disablessl option to s3 config (#1555)
Signed-off-by: yaron2 <schneider.yaron@live.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-03-09 17:11:10 -08:00
Shubham Sharma f1209fb068
Upgrade nacos sdk version to meet compliance (#1547)
* Upgrade nacos version

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Run go mod tidy all

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Add MaxSize to settings

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
2022-03-06 20:13:40 -08:00
龚一涛 0f44be44c2
feat: support query for influxdb in bindings (#1452)
* feat: support query for influxdb

Signed-off-by: uptutu <alexkung@outlook.com>

* test: add mock test

Signed-off-by: uptutu <alexkung@outlook.com>

* fix: remove debug log print

Signed-off-by: uptutu <alexkung@outlook.com>

* fix:fixed lint

Signed-off-by: uptutu <alexkung@outlook.com>

* fix:fixed lint

Signed-off-by: uptutu <alexkung@outlook.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-03-04 08:18:47 -08:00
Shubham Sharma c8a9b44a69
Add changes (#1515)
Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

Co-authored-by: Taction <zchao9100@gmail.com>
2022-02-24 22:40:10 -08:00
Daniel.Chung 4302917ee5
bingding/mysql: add select JSON_EXTRACT LONGTEXT column type to special case (#1486)
Signed-off-by: zdianjiang <zdianjiang@gmail.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-02-08 15:46:48 -08:00
light-pan ea55aea8c3
Support configuring broker version in Kafka bindings component (#1459)
* Update kafka.go

Support configuring broker version in Kafka bindings component

Signed-off-by: panxiangyue <panxiangyue@corp-ci.com>
Signed-off-by: light-pan <373465009@qq.com>

* Update kafka_test.go

kafka binding add version test

Signed-off-by: panxiangyue <panxiangyue@corp-ci.com>
Signed-off-by: light-pan <373465009@qq.com>

* Update kafka.go

gofumpt check

Co-Authored-By: light-pan <21969903+light-pan@users.noreply.github.com>
Signed-off-by: light-pan <373465009@qq.com>

Co-authored-by: light-pan <21969903+light-pan@users.noreply.github.com>
Co-authored-by: Taction <zchao9100@gmail.com>
2022-01-31 09:08:34 -08:00
Daniel.Chung 8fe02469ba
bingding/mysql: add TEXT column type to special case (#1466)
Signed-off-by: zdianjiang <zdianjiang@gmail.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-01-28 11:29:30 -08:00
Jigar 9078f11985
Added ContentType to pubsub/binding/state request-response (#1376)
Signed-off-by: jigargandhi <jigarr.gandhi@gmail.com>

Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Co-authored-by: Looong Dai <long.dai@intel.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2022-01-28 10:17:04 -08:00
Bernd Verst 0f2398670a
Certification tests for Azure Blob Storage Binding (#1435)
* initial blobstorage output binding certification

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* More blobstorage tests

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Rename some remnants from copy paste

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Blobstorage Binding - test file upload

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Blobstorage Output Binding Remove Pascal case

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Blobstorage Output Binding: Remove list from conf test

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Azure Blobstorage Binding - include name upon creation

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* blobstore binding - verify encoding option

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* go mod tidy

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Additional test cases

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* list blob tests WIP

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* More stable certification tests for AzBlob Binding

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Remaining Blob Storage Binding certification tests

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Lint blob storage certification tests

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* update go.mods

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Fix license header

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* use byte string instead of file

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Run make modtidy-all again

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2022-01-13 18:06:39 -08:00
yellow chicks 3c28fee80f
hotfix: bindings.cron Input & Output communicates through a signal queue (#1418)
Signed-off-by: 1046102779 <seachen@tencent.com>

Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
2022-01-07 15:53:19 -08:00
Gehhilfe 8332b6a9c5
Fix kafka input binding looping when not topics are set (#1412)
* binding kafka: check if topics are not empty before reading

Signed-off-by: Tim Burkert <burkert.tim@gmail.com>

* binding kafka: log warning instead of returning error

Signed-off-by: Tim Burkert <burkert.tim@gmail.com>

Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-01-07 11:06:17 -08:00
Dmitry Shmulevich c7adb917f3
update license to Apache v2.0 (#1406) 2022-01-04 19:53:31 -08:00
RainFD 0f97b52b90
add S3ForcePathStyle support for s3 binding (#1360)
* add S3ForcePathStyle support for s3 binding

Signed-off-by: rainfd <rainfd@live.cn>

* add S3ForcePathStyle unit test

Signed-off-by: rainfd <rainfd@live.cn>
2021-12-23 18:58:39 -08:00
Simon Leet 9ab218a393
Update azure-sdk-for-go to v59.3.0 for EventGrid (#1325)
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-12-08 17:19:43 -08:00
Bernd Verst 175b09ea40
Adds retry on CosmosDB Init in case of TooManyRequests error (#1329)
* Adds retry on CosmosDB Init in case of TooManyRequests error

* Use backoff v4

* missed some permanent errors

* clean up go.mod

* fix error type casting

* Add constant for HTTP 429
2021-11-29 12:05:43 -08:00
halspang d5a68041c9
Move Service Bus Pubsub/Binding to common auth (#1201)
* Move Service Bus Pubsub/Binding to common auth

Both the pubsub and input/output binding for Azure Service Bus were
connecting via a connection string. This is still supported but will
now fallback to using AAD from the common auth library. This is also
the recommended auth pattern going forward.

* Move AMPQ specific auth and fix linter issues

* Make conn string and namespace mutually exclusive

* Move resourceName to a constant

* Update auth_amqp.go

* Update auth.go

Co-authored-by: Long Dai <long.dai@intel.com>
Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-22 18:20:11 -08:00
Simon Leet 915180bfe5
Add internal retry to MQTT bindings Invoke() (#1289)
There is an internal race condition in MQTT client Publish method when
configured with autoreconnect (default) where the call can fail if the
connection is broken right after the outgoing event is queued but before
the dead connection is blocked.

This change mitigates that on the Dapr side with a limited retry loop
3 times at fixed 200ms interval as a patch before the Dapr resiliency
feature is introduced that exposes more generalized retry controls to
the dev.

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Long Dai <long.dai@intel.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-19 15:20:12 -08:00
Tao Jiang c75cb3ee96
upgrade vmware-go-kcl to v1.5.0 (#1257)
Upgrade vmware-go-kcl dependency to the latest v1.5.0.
update mod tidy

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-19 10:50:05 -08:00
Alessandro (Ale) Segala 3eafb8bcd4
Azure SDK "track 2": authentication and secretstore/azure/keyvault (#1290)
* Authentication for new Azure SDK

* Updated keyvault to use new Azure SDK

* 🙈

* Update authentication/azure/auth.go

* Update authentication/azure/auth.go

* Update authentication/azure/auth.go

* Reintroduce changes from PR 1132 without updating ASB

* Lint 💄

* Marking contexts as TODO as they'll need a timeout
As per conversation with @berndverst

* Update certification tests with no auth libraries

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2021-11-16 10:59:51 -08:00
halspang f5d8317c41 Revert "Bumping ASB version and fixing test for azure auth (MSI_ENDPOINT) (#1132)" (#1291) 2021-11-12 11:59:35 -08:00
Hossam Kandil 399d1230d0
rename CosmosGraphDB binding component to CosmosDBGremlinAPI #1246 (#1276) 2021-11-04 09:35:32 -07:00
Willem Meints ba268aa424
Fix warning in smtp binding when user and password are set (#1256)
* Fix warning in smtp binding when user and password are set

* Remove nolint comment

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-02 09:53:35 -07:00
Willem Meints 84f8ae6389
Fix body content parsing (#1254)
This fixes a problem with the body of e-mail messages sent by the
SMTP binding.

When the SMTP binding was invoked over GRPC it would not translate the
data of the request to the right format in the e-mail. Instead it would
send an empty body. When the SMTP binding was invoked over HTTP it would
correctly unquote the data of the request.
2021-10-31 15:00:48 -07:00
Long Dai 8b939a2e95
Merge branch 'master' into add_amqp_properties 2021-10-27 13:11:42 +08:00
Long Dai 5073f82e65
Merge branch 'master' into fix_mqtt_bindings_deadlock 2021-10-27 12:04:03 +08:00
Long Dai 925773dd21
Merge branch 'master' into add_amqp_properties 2021-10-27 10:14:38 +08:00
Simon Leet cdb2c6167e
Merge branch 'master' into service_queue 2021-10-26 17:18:42 -07:00
Simon Leet 7fedcfc751 Fix bindings.mqtt deadlock on Disconnect()
Update bindings.mqtt component to avoid deadlocking on Close() when the
app-provided message handler is blocked.

- Run the app-provided message handler in a separate goroutine so that
  the wrapper handler function it passes to the mqtt library can be
  canceled.
- Cancel the read context to terminate any in flight message handling
  before calling Disconnect() in Close()
2021-10-26 23:58:09 +00:00
Long Dai 77bf26a676
Merge branch 'master' into add_amqp_properties 2021-10-26 09:29:57 +08:00
Bernd Verst aa4f949838 Adds Dapr User Agent for Cosmos DB components 2021-10-25 17:59:34 -07:00
Hal Spang ce4ab8f40f Move to atomics instead of locks 2021-10-25 16:06:30 -07:00
Hal Spang 3d3f142c19 Reconnect forever in ASB Queue Binding
We reconnect/retry forever now in Azure Service Bus Queue binding
while reading. We have to reconnect for every error because the
errors that surface from the client involve connection issues.
2021-10-25 16:06:30 -07:00
Simon Leet 2006bcccb0 Support message-id in Event Hubs components 2021-10-25 18:12:16 +00:00
yellow chicks 5a33acfc59
binding/mysql: optimize output error (#1195)
* feature/pubsub: add delay queue params for pulsar

* feature/pubsub: add delay queue params for pulsar

* feature/pubsub: add delay queue params for pulsar

* binding/mysql: optimize output error

* binding/mysql: optimize output error

* Update mysql.go

* Update mysql.go

Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>
2021-10-18 17:25:35 -07:00
Bernd Verst 2bd3d22b91
Cosmos DB Output Binding - Conformance & Progress towards GA (#1180)
* cosmosdb binding - not as flexible as I'd like

conformance tests now pass

* add tests for new UUID injection logic

* Use nested property as partition key value

* avoid repeated string constants

* Disable Identification Hydrator to avoid struct requirement

* Remove struct

* Simplify PR

* Add comments ofor code maintenance
2021-10-12 10:47:36 -07:00
Javier Vela 32bba35bb2
azure storage queue fix double quotation (#1156)
* azure storage queue fix double quotation

* Trigger checks

* Trigger checks

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2021-10-07 13:54:20 -07:00
halspang 0fe6a98874
Force lowercase name for Azure Service Bus Queue (#1186)
Azure Service Bus Queue names are case-insensitive. When one is
created it will always be forced to lowercase. If a queue with a
non-lowercase is provided, it will be created but can never be
matched causing the next Init to fail.

https://github.com/dapr/components-contrib/issues/1185
2021-10-06 11:40:43 -07:00
Simon Leet a9cf218c04
Support setting up Azure IoT Hub for integration testing with EventHubs components (#1174)
* Add IoT Hub config to setup-azure-conf-test.sh

* Add EventHubs bindings integration test for IoT device event properties

* Add consumer group for IoT Hub events for pubsub EventHubs testing

* Add EventHubs pubsub integration test for IoT device event properties
2021-10-01 16:17:53 -07:00
Javier Vela 310b4fdeb1
gcp bucket update (#1128)
* gcp bucket update create operation: support upload files in base64

* gcp bucket add get operation

* gcp bucket add delete operation

* gcp bucket add list operation

* gcp bucket fix lint

* gcp bucked add backward compatibility 'key' replace 'name'

* gcp bucket fix lint

* gcp bucket create operation return object url to download

* gcp fix lint

* gcp fix lint

* gcp bucket fix lint

* gcp bucket fix lint

* gcp bucket fix error msg

* rerun checks

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
Co-authored-by: Long Dai <long0dai@foxmail.com>
Co-authored-by: Ian Luo <ian.luo@gmail.com>
2021-09-29 22:20:25 -07:00
Simon Leet 9a075cb43a
Fix existing integration tests (#1173)
* Fix servicebusqueues_integration_test.go compile errors

* Fix postgresql_integration_test.go deleteItemThatDoesNotExist expectations

* Fix mysql_integration_test.go deleteItemThatDoesNotExist expectations

* Fix mysql_integration_test.go for bindings

* Increase TTL in ServiceBusQueues tests for stability
2021-09-28 19:17:44 -07:00
Bernd Verst ac85ba2a8e
Add dapr user agent for Azure Components (#1152)
* Add dapr useragent for Service Bus and EventHubs

* Add useragent for tablestorage

* send dapr useragent

* more user agents

* formatting
2021-09-27 17:04:27 -07:00
Long Dai 988fed05ab
ci: standard linter config (#1102)
* ci: standard linter config

Signed-off-by: Long <long.dai@intel.com>

* Update utils.go

* fix pulsar issue

Signed-off-by: Long <long.dai@intel.com>

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-09-21 15:21:59 -07:00