Commit Graph

425 Commits

Author SHA1 Message Date
Alessandro (Ale) Segala 704f4dd730
Add contexts to pubsub.Subscribe to allow early cancelation (#1756)
This commit is related to dapr/dapr#4624. As noted there, we have an issue in the runtime where all components are shut down after the grace period, when the app is likely already stopped. Because of that, certain input components (the subscribe part of pubsub and the input part of bindings - the latter not in scope of this PR), can continue bringing new work when it's known to fail.

In order to fix the issue linked above properly, we need to implement a way for PubSub components to have the "publish" part closed before the "subscribe" one (and in the future that will need to be done for input bindings too).

This commit achieves precisely that by adding a context in the Subscribe method. When that context is canceled (which can be at any time), the subscription is removed.

PS: This API change was implemented so it can one day be used for dapr/dapr#814 too, as it allows canceling individual subscriptions by using a different context. Although that's not possible today because it requires more work on the runtime, it does implement everything that's needed in the pubsub components already.
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-06-02 15:06:36 -07:00
Laurence a323748d75
Feat: Add apache dubbo output binding (#1768)
* feat: support apache/dubbo

Signed-off-by: LaurenceLiZhixin <382673304@qq.com>

* fix: comments

Signed-off-by: LaurenceLiZhixin <382673304@qq.com>

* fix: gofumpt test file

Signed-off-by: LaurenceLiZhixin <382673304@qq.com>

* feat: dubbo cert test

Signed-off-by: LaurenceLiZhixin <382673304@qq.com>

* fix: add missiing header

Signed-off-by: LaurenceLiZhixin <382673304@qq.com>

Co-authored-by: Loong Dai <long.dai@intel.com>
2022-06-01 10:38:29 -07:00
Shubham Sharma d03aeba3e0
Upgrade rocketmq version (#1740)
* Upgrade rocketmq

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Trigger Build

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
2022-05-26 09:24:29 -07:00
Yaron Schneider 47e95c9a47
Update redis go to v8.11.5 (#1734)
* update redis go to v8.11.5

Signed-off-by: yaron2 <schneider.yaron@live.com>

* go mod update

Signed-off-by: yaron2 <schneider.yaron@live.com>
2022-05-20 11:55:17 -07:00
Jasonli 499f6b2d49
Implement new bindings component for Huawei OBS (#1724)
* Add new bindings component for Huawei OBS

Signed-off-by: jasonlica <jasonli@huawei.com>

* resolve conflicts in go.sum respective to the changes #1710

Signed-off-by: jasonlica <jasonli@huawei.com>

* update go.mod

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update go.mod

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-05-17 23:12:39 -07:00
Alessandro (Ale) Segala e1b6b01223
Tweaks for ASB pubsub (#1729)
* Tweaks for ASB pubsub:
1. Do not attempt to reconnect when context was canceled
2. Message finalization uses a background context and not the running ctx, in case the app is shutting down

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* ASB: abandoned messages shouldn't be retried right away

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Ported fixes to servicebusqueues binding too

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Use a different approach to limit the number of messages processed in case of error

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Added maxRetriableErrorsPerSec to servicebusqueues binding too
Incl other improvements

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Do not reconnect to ASB every time we retrieve a message.

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* ⚙️

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-05-17 22:33:34 -07:00
Alessandro (Ale) Segala e5e9011655
Update Azure Service Bus components to track2 SDK (#1702)
* Updated to Go 1.18

Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* Updated Azure SDKs that are on track2
Includes some minor refactoring of auth code

Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* Updated Service Bus components to track2 SDK

Co-authored-by: halspang <halspang@microsoft.com>
Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* Initial Certification test for eventhubs binding [incomplete] (#1670)

* certification test for eventhubs binding

Signed-off-by: tanvigour <tanvi.gour@gmail.com>

* modified go.mod and go.sum

Signed-off-by: tanvigour <tanvi.gour@gmail.com>

* Add connection string testing

Signed-off-by: tanvigour <tanvi.gour@gmail.com>

* iothub testing

Signed-off-by: tanvigour <tanvi.gour@gmail.com>

* address feedback and run test

Signed-off-by: tanvigour <tanvi.gour@gmail.com>

* Install Azure CLI IOT hub extension

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* make modtidy-all

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* covering all eventhubs test cases

Signed-off-by: tanvigour <tanvi.gour@gmail.com>

* dependency changes after go modtidy-all

Signed-off-by: tanvigour <tanvi.gour@gmail.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Co-authored-by: Looong Dai <long.dai@intel.com>
Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* Use revive instead of golint (#1685)

Signed-off-by: pigletfly <wangbing.adam@gmail.com>

Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* Updated to Go 1.18 (#1697)

* Updated to Go 1.18

Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>

* Added go.work file
With Go 1.18, this allows gopls (the Go language server used for example in VS Code) to work inside test apps too.
See: https://go.dev/doc/tutorial/workspaces

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Removed go.work

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 💄

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* 💄 & 🧹

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* Add metadata property to configure Batching in Pulsar (#1707)

* Add metadata property to configure BatchingMaxSize&batchingMaxMessages in Pulsar
Signed-off-by: saberwang <saberwang@hotmail.com>

* sort field
Signed-off-by: saberwang <saberwang@hotmail.com>

* [pubsub]fix unit test bug
Signed-off-by: saberwang <saberwang@hotmail.com>

* remove unrelated changes
Signed-off-by: saberwang <saberwang@hotmail.com>

* Delete hard coded Metadata
Signed-off-by: saberwang <saberwang@hotmail.com>

* remove  .history

Signed-off-by: saberwang <saberwang@hotmail.com>

* restore .gitignore

Signed-off-by: saberwang <saberwang@hotmail.com>

* Hard coding default values and adding 'BatchingMaxPublishDelay' metadata

Signed-off-by: saberwang <saberwang@hotmail.com>

* fix code format

Signed-off-by: saberwang <saberwang@hotmail.com>

* formatting code

Signed-off-by: saberwang <saberwang@hotmail.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* This test can't work with track2 SDKs
The methods to create a message with a body are not exported

Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* 🧹

Signed-off-by: Alessandro Segala (ItalyPaleAle) <43508+ItalyPaleAle@users.noreply.github.com>

* There's such thing as too much logging

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Refactored subscription.go
This greatly simplifies certain parts of the code, reducing the number of goroutines and likely improving performance.
Performance for end-users improves too as there's no need anymore to pause for 2 seconds every time that we reach `maxActiveMessages`.
Additionally, with this change the config options `prefetchCount` and `maxActiveMessagesRecoveryInSec` are removed as unnecessary anymore.

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 💄

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed pubsub tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* These packages should have never been upgraded

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Ensuring we don't fetch 1 message more than max active

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Adding configurable timeout for servicebusqueues operations

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Persistent connection for invoking SB queues

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Reverted Event Hub SDK update

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Revert "Reverted Event Hub SDK update"

This reverts commit 212220aba0.

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fix Azure deploy for users with a first.last email

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Added some sleep that should help reduce flakiness in eventhubs binding cert test

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Changed servicebusqueue cert test
In case of a failure in the handler (ie. users' code), the message should be correctly re-enqueued, which means that messages will be re-delivered later and won't be in order.

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: halspang <halspang@microsoft.com>
Co-authored-by: tanvigour <60332928+tanvigour@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Co-authored-by: Looong Dai <long.dai@intel.com>
Co-authored-by: Wang Bing <wangbing.adam@gmail.com>
Co-authored-by: saber-wang <45062099+saber-wang@users.noreply.github.com>
2022-05-13 16:52:22 -07:00
Chock Chen b818c2f83e
Implment a secret store based on Huawei CSMS (#1710)
Signed-off-by: Chen Cong <chock-cong.chen@outlook.com>

Co-authored-by: Chen Cong <chock-cong.chen@outlook.com>
2022-05-09 15:52:46 -07:00
Alessandro (Ale) Segala e6c67356cd
Updated to Go 1.18 (#1697)
* Updated to Go 1.18

Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>

* Added go.work file
With Go 1.18, this allows gopls (the Go language server used for example in VS Code) to work inside test apps too.
See: https://go.dev/doc/tutorial/workspaces

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Removed go.work

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 💄

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-05-06 13:44:45 -07:00
Harry Kimpel de52e92d0f
Merge branch 'master' into binding_commercetools 2022-04-08 14:45:49 +02:00
Harry Kimpel 3e374406bc Adding commercetools binding
Signed-off-by: Harry Kimpel <harrykimpel@hotmail.com>
2022-04-08 14:25:47 +02:00
Alessandro (Ale) Segala 407936745e
Yet another Cosmos DB auth fix
This is fixed by upgrading the upstream SDK
Also added a missing handling of throttling in the Delete method

Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
2022-04-05 21:01:22 +00:00
Alessandro (Ale) Segala be7c8768b5
Fixes an issue with DBs or collections with uppercase characters not working
Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
2022-03-31 23:10:27 +00:00
Alessandro (Ale) Segala 4551449f0c Workaround for Cosmos DB state store unable to launch when using AAD auth
Fixes #1603

Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
2022-03-24 20:55:09 +00:00
Shubham Sharma feab8eeeb1 Upgrade alibabacloud-go packages
Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
2022-03-21 07:37:04 +05:30
Shubham Sharma f9aed104f5 Mod tidy (add back empty lines)
Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
2022-03-17 17:59:21 +05:30
Shubham Sharma 36d35f60d9 Remove extra lines
Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
2022-03-17 17:54:53 +05:30
Shubham Sharma ca4abf24e2 Upgrade alibabacloud-go modules
Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
2022-03-17 10:24:43 +05:30
Bernd Verst 30f57d3359
Merge branch 'master' into shubham1172/upgrade-pulsar-client 2022-03-15 10:47:59 -07:00
Shubham Sharma d929d17706 Upgrade pulsar client
Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
2022-03-15 14:48:45 +05:30
Shubham Sharma 0ba77ab767 Merge remote-tracking branch 'origin' into shubham1172/upgrade-pulsar-client 2022-03-15 14:45:08 +05:30
dependabot[bot] d45f3b8ca3
Bump github.com/nats-io/nats-server/v2 from 2.7.2 to 2.7.4
Bumps [github.com/nats-io/nats-server/v2](https://github.com/nats-io/nats-server) from 2.7.2 to 2.7.4.
- [Release notes](https://github.com/nats-io/nats-server/releases)
- [Changelog](https://github.com/nats-io/nats-server/blob/main/.goreleaser.yml)
- [Commits](https://github.com/nats-io/nats-server/compare/v2.7.2...v2.7.4)

---
updated-dependencies:
- dependency-name: github.com/nats-io/nats-server/v2
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2022-03-14 20:58:23 +00:00
Bernd Verst f06254f8f4 Update Consul API to v1.11.0
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-03-14 13:36:59 -07:00
Shubham Sharma f1209fb068
Upgrade nacos sdk version to meet compliance (#1547)
* Upgrade nacos version

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Run go mod tidy all

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Add MaxSize to settings

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
2022-03-06 20:13:40 -08:00
Shubham Sharma 16e5f4558c Upgrade pulsar-client
Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
2022-03-03 14:23:13 +05:30
Bernd Verst d263a4a9b6
Upgrade keyring library for macOS security warnings (#1535)
Signed-off-by: GitHub <noreply@github.com>
2022-02-28 19:24:51 -08:00
Shubham Sharma c8a9b44a69
Add changes (#1515)
Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

Co-authored-by: Taction <zchao9100@gmail.com>
2022-02-24 22:40:10 -08:00
ZhangJian He 615abba62d Upgrade pulsar client to 0.8.0
Signed-off-by: ZhangJian He <shoothzj@gmail.com>
2022-02-23 09:48:50 +08:00
Shubham Sharma 75e48d22bf merge with master
Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
2022-02-21 10:09:25 +05:30
Artur Souza 339624b7a3
Update daprd in cert tests. (#1511)
Signed-off-by: Artur Souza <artursouza.ms@outlook.com>
2022-02-18 14:42:19 -08:00
Shubham Sharma 945f8a0746 Upgrade jsonx
Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
2022-02-18 15:07:31 +05:30
Gehhilfe 80c2bbe284
Jetstream KV state store component (#1501)
* Add support for nats jetstream kv state store

Add tests for jetstream state store

Update go mod

Signed-off-by: Tim Burkert <burkert.tim@gmail.com>

* Fix lint errors

Signed-off-by: Tim Burkert <burkert.tim@gmail.com>

* Mod tidy

Signed-off-by: Tim Burkert <burkert.tim@gmail.com>

* Mod tidy all

Signed-off-by: Tim Burkert <burkert.tim@gmail.com>

* Mod tidy all

Signed-off-by: Tim Burkert <burkert.tim@gmail.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
2022-02-17 10:19:03 -08:00
1046102779 2126b96dc6 feature/pulsar: add producer option disableBatching
Signed-off-by: 1046102779 <seachen@tencent.com>
2022-02-16 12:07:02 +08:00
Phil Kedy d5b2ce5377 Bump version of github.com/jackc/pgx/v4 to v4.15.0.
Signed-off-by: Phil Kedy <phil.kedy@gmail.com>
2022-02-11 15:53:31 -05:00
Lucas Jellema 625f955fee
Introducing Oracle Database backed state store component (#1454)
* Introducing Oracle Database backed state store component

Signed-off-by: lucasjellema <lucasjellema@gmail.com>

* Implement Ping method with proper database ping

Signed-off-by: lucasjellema <lucasjellema@gmail.com>

* adding results from make modtidy-all - updated go.sum files
Signed-off-by: lucasjellema <lucasjellema@gmail.com>

* etag only applied when first write policy requested - applied in integration test and component

Signed-off-by: lucasjellema <lucasjellema@gmail.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
2022-02-08 12:00:34 -08:00
Gehhilfe b835eb4e1e
pubsub jetstream: add nkey based authentication (#1441)
* pubsub jetstream: add nkey based authentication

Signed-off-by: Tim Burkert <burkert.tim@gmail.com>

* fix godot: comment should end in a period

Signed-off-by: Tim Burkert <burkert.tim@gmail.com>

* go mod tidy

Signed-off-by: Tim Burkert <burkert.tim@gmail.com>

* fix: go mod tidy

Signed-off-by: Tim Burkert <burkert.tim@gmail.com>

* pubsub jetstream: add e2e test

Signed-off-by: Tim Burkert <burkert.tim@gmail.com>

* Cleanup not needed files and move jwt

Signed-off-by: Tim Burkert <burkert.tim@gmail.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
2022-01-25 21:11:50 -08:00
Zheng Dayu 2d52913aa9
Add AlibabaCloud OOS Parameter Store as a secret component (#1402)
* secret stores supports alibabacloud oos parameterstore

Signed-off-by: Zheng Dayu <davidzheng23@gmail.com>

* run make modtidy-all

Signed-off-by: Zheng Dayu <davidzheng23@gmail.com>

Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Taction <zchao9100@gmail.com>
2022-01-13 09:56:44 -08:00
Yordan Pavlov b8063f2bdb
Fix #1250 by upgrading cloud.google.com/go/pubsub to v1.12.2 (#1285)
* upgrade cloud.google.com/go/pubsub to v1.12.2

Signed-off-by: Yordan Pavlov <yordan.pavlov@dunnhumby.com>

* update GCP secret manager test

Signed-off-by: Yordan Pavlov <yordan.pavlov@dunnhumby.com>

* make modtidy-all

Signed-off-by: Yordan Pavlov <yordan.pavlov@dunnhumby.com>

Co-authored-by: Yordan Pavlov <yordan.pavlov@dunnhumby.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
2022-01-13 09:26:42 -08:00
Joni Collinge 3af57ca5b7
Fix not setting status code in nethttpadaptor on response (#1429)
* fix not setting status code in nethttpadaptor on response

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* make test name consistent

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* git mod tidy

Signed-off-by: Joni Collinge <jonathancollinge@live.com>
2022-01-13 07:31:29 -08:00
Shivam Kumar 4631d6e41a
MQTT Pubsub Certification Testing + AutAckOff Fix for MQTT (#1420)
* MQTT Certification Test

Signed-off-by: shivam <shivamkm07@gmail.com>

* Using paho.mqtt.golang fork with AutoAck fix

Signed-off-by: shivam <shivamkm07@gmail.com>

* Adding MQTT component in certification.yml

Signed-off-by: shivam <shivamkm07@gmail.com>

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2022-01-07 10:33:54 -08:00
1046102779 00c99a4027 feature/pulsar: add producer option disableBatching
Signed-off-by: 1046102779 <seachen@tencent.com>
2022-01-07 12:45:14 +08:00
Lucas Jellema a013b58d6c
Implement State Store for OCI ObjectStorage service (#1401)
* Implement State Store for OCI ObjectStorage service

Signed-off-by: lucasjellema <lucasjellema@gmail.com>

* add go.mod and go.sum with dependencies on OCI SDK

Signed-off-by: lucasjellema <lucasjellema@gmail.com>

* Removed dependency in unit test on OCI account

Signed-off-by: lucasjellema <lucasjellema@gmail.com>

* Adding extensive unit test (coverage) using mock-OCI client

Signed-off-by: lucasjellema <lucasjellema@gmail.com>

* Correcting linting issues and review requests

Signed-off-by: lucasjellema <lucasjellema@gmail.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
2022-01-04 23:18:50 -08:00
yellow chicks 190a47cd87
hotfix: upgrade dgrijalva/jwt-go (#1391)
* feature/pubsub: add delay queue params for pulsar

* feature/pubsub: add delay queue params for pulsar

* feature/pubsub: add delay queue params for pulsar

* hotfix: upgrade dgrijalva/jwt-go

* hotfix: upgrade dgrijalva/jwt-go
2021-12-23 08:57:59 -08:00
Bernd Verst 9dbdaee296
Cosmos DB Output Binding - Authentication tests (#1373)
* Adds CosmosDB Binding authentication tests

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Enable Cosmos DB Binding Conformance test

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Initial cosmosdb binding certification plan WIP

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Go mod tidy

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update library and go mod tidy

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* make modtidy-all

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* CosmosDB Binding test plan details

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2021-12-13 15:08:07 -08:00
Simon Leet 9ab218a393
Update azure-sdk-for-go to v59.3.0 for EventGrid (#1325)
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-12-08 17:19:43 -08:00
Amit Mor 4918900c09
AWS PubSub SNS/SQS - FIFO support + refactoring (#1312)
* bugfix for sns topic deletion upon termination

* removed upstream github workflow files

* wrapping errors

* fifo and naming sanitization

* fifo and name santization tests

* component carrying id

* Update snssqs.go

removed unneeded import

* Update snssqs.go

* add missing github actions file

* linting

* fix go.mod

* schedule yml file

* const max lenght, bugfix in ack

* dapr bot schedule

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-30 10:52:00 -08:00
Dmitry Shmulevich f1be130563
bump up go to v1.17 (#1323) 2021-11-22 17:47:01 -08:00
Tao Jiang c75cb3ee96
upgrade vmware-go-kcl to v1.5.0 (#1257)
Upgrade vmware-go-kcl dependency to the latest v1.5.0.
update mod tidy

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-19 10:50:05 -08:00
Simon Leet dfe52cf88f
Remove Cloudstate component (#1303)
- Remove cloudstate state store component
- Update state/Readme.md

Fixes #1297

Co-authored-by: Long Dai <long.dai@intel.com>
2021-11-18 15:30:40 -08:00
Alessandro (Ale) Segala 3eafb8bcd4
Azure SDK "track 2": authentication and secretstore/azure/keyvault (#1290)
* Authentication for new Azure SDK

* Updated keyvault to use new Azure SDK

* 🙈

* Update authentication/azure/auth.go

* Update authentication/azure/auth.go

* Update authentication/azure/auth.go

* Reintroduce changes from PR 1132 without updating ASB

* Lint 💄

* Marking contexts as TODO as they'll need a timeout
As per conversation with @berndverst

* Update certification tests with no auth libraries

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2021-11-16 10:59:51 -08:00
halspang f5d8317c41 Revert "Bumping ASB version and fixing test for azure auth (MSI_ENDPOINT) (#1132)" (#1291) 2021-11-12 11:59:35 -08:00
yellow chicks 6e48068067
upgrade/pulsar: upgrade pulsar from v0.1.0 to master (#1247) 2021-11-01 18:34:42 -07:00
Bernd Verst aa4f949838 Adds Dapr User Agent for Cosmos DB components 2021-10-25 17:59:34 -07:00
Simon Leet f7edbb7eab
Update paho.mqtt.golang to v1.3.5 (#1192)
There are a couple of fixes for deadlock issues in paho.mqtt.golang in
versions 1.3.4 and 1.3.5, which are good robustness upgrades for the
Dapr MQTT components in addition to reduce the incidence of deadlock
failures in the conformance tests for MQTT pubsub and bindings.

Resolves #1053
2021-10-12 16:38:02 -07:00
Dmitry Shmulevich 4795f75270
properly close channel in rabbitmq (#1190) 2021-10-07 20:25:36 -07:00
Joni Collinge 893da2a3ef
Enable ASB Message Metadata (#1071)
* add asb message metadata

* add asb message metadata

* fix lint

* add server metadata to receiver

* add metadata prefix

* fix tests

* alway set delivery count

* lint

* nolint on nested if

* lint fix

* remove trailing period on license header

Co-authored-by: Long Dai <long0dai@foxmail.com>
Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-10-07 14:05:05 -07:00
Phil Kedy 45f577e137
Bumping ASB version and fixing test for azure auth (MSI_ENDPOINT) (#1132)
Co-authored-by: Bernd Verst <berndverst@users.noreply.github.com>

Co-authored-by: Bernd Verst <berndverst@users.noreply.github.com>
2021-09-13 11:06:04 -07:00
Manuel Riezebosch 18cbe25e4e
feat(pubsub): add in-memory pub/sub (#1106) 2021-09-02 17:31:17 -07:00
Alessandro (Ale) Segala a992cd19f0
Support Azure AD auth for Cosmos DB (#1104)
* Support Azure AD auth for Cosmos DB

* Fixed linting errors

* Tidying go.sum

* Removed the need for nolint:shadow

Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-09-01 12:44:05 -07:00
dependabot[bot] b4c794c840
Bump go.mongodb.org/mongo-driver from 1.1.2 to 1.5.1 (#1054)
* Bump go.mongodb.org/mongo-driver from 1.1.2 to 1.5.1

Bumps [go.mongodb.org/mongo-driver](https://github.com/mongodb/mongo-go-driver) from 1.1.2 to 1.5.1.
- [Release notes](https://github.com/mongodb/mongo-go-driver/releases)
- [Commits](https://github.com/mongodb/mongo-go-driver/compare/v1.1.2...v1.5.1)

---
updated-dependencies:
- dependency-name: go.mongodb.org/mongo-driver
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

* Update go.sum with mongo-driver update

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Simon Leet <simon.leet@microsoft.com>
Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>
2021-09-01 12:05:07 -07:00
Jaime Piña f4a5722806
Add JetStream support (#1101)
* Add JetStream support

* Add conformance tests

* Fix lint

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2021-09-01 11:50:16 -07:00
Bernd Verst 059dc8c0d2
Conformance tests & bugfixes for SQLServer (#1078)
* enable sqlserver conformance test

* Update SQL Server conformance test setup

* Fix sqlserver bug introduced in Go 1.16

* sqlserver almost conformant

* Fix conformance tests and stored procedure

* all sqlserver tests passing

* Minor touchup

* lint

* Remove unnecessary condition

* Add conformance test to GitHub workflow

* remove env variable

* Update stored procedure

* Simplify error handling

* Update state/sqlserver/sqlserver.go

Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>

* Update state/sqlserver/sqlserver.go

Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>

Co-authored-by: Bernd Verst <me@bernd.dev>
Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-08-19 17:47:56 -07:00
Long Dai 71f4748460
upgrade sentinel-golang to release version (#1086)
Signed-off-by: Long <long0dai@foxmail.com>

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-08-19 17:25:24 -07:00
Artur Souza 1042314c63
Add binding alicloud.tablestore (#1076)
* add binding alicoloud.tablestore

* Fix lint.

Co-authored-by: theonefx <chenxilzx1@gmail.com>
2021-08-13 10:03:14 -07:00
Long Dai 7496adf110
fix build error on Arm 32-bit (#1045)
Signed-off-by: Long <long0dai@foxmail.com>

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-08-03 19:24:38 -07:00
Christian Kaps 80f0110fa8
Return blob metadata and add list operation (#999)
* Return blob metadata if configured

* Enhance error msg

* Add list functionality

* Fix linting issues

* Finalize list implementation

* Fix linting errors

* Add backward compatibility and align code to be more consistent

* Add tests

* Fix linting errors

* Rename properties

* Fix max result logic

* Fix linting error

* Fix PR suggestions

* Add comments for constants

* Run go mod tidy

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2021-07-14 09:17:48 -07:00
Hossam Kandil 13f96c42a6
Added new output binding for Cosmos Graph DB - Gremlin (#885)
* Added new output binding for Cosmos Graph DB - Gremlin

* applying gofumpt on cosmosdbgraphdb

* removed unnecessary conversion from cosmosgraphdb

* removed unwanted comments from cosmosgraphdb

* resolving gomod confilicts

* resolving go mod conflict

* resolve conflicting error messages

* change Gremlin query to req.data.

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2021-07-14 08:49:40 -07:00
Simon Leet 3877f5c793
Return SystemProperties on events from EventHubs bindings and pubsub (#1009)
- Update azure-event-hubs-go dependency to currently supported v3 with
  IoT Hub SystemProperties.
- Write Event.SystemProperties to ReadResponse.Metadata for EventHubs
  input binding.
- Write Event.SystemProperties to NewMessage.Metadata for EventHubs
  pubsub.
2021-07-13 16:04:22 -07:00
Christian Kaps cb9a510d16
Implement E2E tests for zeebe (#973)
Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2021-07-12 11:40:38 -07:00
Long Dai c3cf138c6d
rebase (#982)
Signed-off-by: Long Dai <long0dai@foxmail.com>
2021-07-12 11:26:59 -07:00
Long Dai a538b80452
switch to golang-jwt (#993)
Signed-off-by: Long Dai <long0dai@foxmail.com>

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2021-07-08 10:49:44 -07:00
Long Dai 5e146311b9
update deps (#980)
Signed-off-by: Long Dai <long0dai@foxmail.com>

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-07-02 20:05:32 -07:00
Long Dai 4281cb2ea1
deps: upgrade dgrijalva/jwt-go (#981)
Signed-off-by: Long Dai <long0dai@foxmail.com>
2021-07-02 19:55:17 -07:00
Long Dai b1f584d40b
deps: upgrade buger/jsonparser (#983)
Signed-off-by: Long Dai <long0dai@foxmail.com>

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2021-06-30 17:13:18 -07:00
amirmm11 f438298214
Add GraphQL Binding (#844)
* add Hasura Binding

* Added GraphQL binding

* add prefix header

* add prefix header

* add prefix header

* Add Phil's changes

* Added a few fixes recommended by Phil

Co-authored-by: Amir Mousavi <amir@equilibriumenergy.com>
Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
Co-authored-by: Phil Kedy <phil.kedy@gmail.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-06-23 10:01:22 -07:00
Phil Kedy 8e6b36ecdf
Importing the retry and config packages from kit instead of internal (#940)
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-06-22 09:38:55 -07:00
Dmitry Shmulevich d1b898b020
Update gocql dependency (#942) 2021-06-16 11:09:52 -07:00
Christian Kaps 3689020fb5
Update Zeebe to version 1.0 (#876)
* Update Zeebe to version 1.0

* Fix lint error regarding import

* Don't panic on error

* Log error as string

* Pass reason msg to process engine on fail job command

* Pass job specific variables as headers to a worker

* Fix formatting issue

Co-authored-by: Phil Kedy <phil.kedy@gmail.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-06-11 16:34:01 -07:00
cinience de417e429d
Add bindings rocketmq (#815)
* Add bindings rocketmq

* Fix lint

* Update parseMetadata

* Update logger import

* Tweaks to use "the settings pattern"

* Add back off policy configuration

Co-authored-by: Phil Kedy <phil.kedy@gmail.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-05-13 15:41:49 -07:00
cinience 5e547d7efd
Add bindings nacos (#814)
* Add bindings nacos

* Fix lint

* Fixed CR #814

* Update logger import

* Update go.sum

* Remove signal handler

* Tweaks to move metadata to the "Settings pattern"

* Fixing typo

Co-authored-by: Phil Kedy <phil.kedy@gmail.com>
Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-05-13 12:53:54 -07:00
Ian Luo 55ee03a5a0
Sentinel middleware support (#829)
* a prototype for sentinel middleware

* adapt sentinel's logger to dapr and optimize configs

* fix lint issue

* fix lint issues

* go mod tidy

* revise accoring to the review comments

* go mod tidy

* enhance unit tests

* fix lint issue

* fix go.sum

Co-authored-by: Phil Kedy <phil.kedy@gmail.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-05-13 12:11:24 -07:00
Charlie Stanley b4e5569c24 Update Aerospike to v4.5.0 2021-05-10 18:40:33 +00:00
zhangchao 651d754496 Merge branch 'master' into upgrade_redis_client_to_v8
* master:
  add handle timeout to cancel req for it would be redelivered (#832)
  Add optional metadata param maxLen for redis stream PubSub component (#835)
  Implement bindings for the Zeebe workflow engine (#806)
  Automerge in contrib. (#849)

# Conflicts:
#	go.mod
#	go.sum
#	pubsub/redis/redis.go
2021-04-29 11:49:26 +08:00
Christian Kaps 83803f575d
Implement bindings for the Zeebe workflow engine (#806)
* Implement bindings for the Zeebe workflow engine

* Fix PR suggestion regarding error handling

* Refactor cancel_instance test to not use a mocking library

* Refactor all tests to not use a mocking library

* Use error vars

* Fix linting error regarding ineffective error assignment

* Check for mandatory jobType

* Remove double method call

* Fix suggestion regarding mock client instantiation

* Check if either bpmnProcessId or workflowKey is given for workflow instantiation

* Changed logger module to dapr/kit. Misc tweaks.

* Fix go.mod

* Fixing some lint errors

* Ignoring linter false positive

Co-authored-by: Phil Kedy <phil.kedy@gmail.com>
2021-04-28 17:23:11 -07:00
Phil Kedy 391fc98c58 Fixing go.mod 2021-04-22 14:42:56 -04:00
zhangchao 5190fe4e7d Merge branch 'master' into upgrade_redis_client_to_v8
resolve conflict

* master:
  Increasing overall test timeout to allow for conformance tests to run (#834)
  Improve SMTP binding performance (#782)
  add redis cluter mode for pubsub (#823)
  downgrade the verbosity of lock renewal errors from warn to debug. This error is expected when messages are processed before beingrenewed (#803)
  Improve pulsar publisher performance. (#827)
  optimze(state/redis): output detail redis error (#825)
  Consul nameresolution component (#750)
  Add DNS name resolver. Add unit tests. (#743)
  Azure Service Bus: Changed log level of error on close to info (#830)
  Removed dependency on dapr/dapr in favor of dapr/kit. Fixed go mod dependencies afterwards. Go 1.16 in go.mod. Removed accidental log dependency. (#807)
  Update state/blobstorage.go to add metadata. (#786)
  Azure Service Bus publishing retries when server is "too busy" (#821)

# Conflicts:
#	bindings/redis/redis.go
#	go.mod
#	go.sum
#	pubsub/redis/redis.go
2021-04-22 09:13:01 +08:00
Xueqian Wang f761b51c77
Improve pulsar publisher performance. (#827)
* Improve pulsar publisher performance.

* Addressed comments and added some debug logs

* Use peek instead of get for closing producers

* Fixed lint issue

* Added debug log in close

* Change back o 100

* Close producer before client

* Fixed cached number of producer and added todo for making it configurable

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2021-04-21 10:53:07 -07:00
Phil Kedy 688df9bda4
Removed dependency on dapr/dapr in favor of dapr/kit. Fixed go mod dependencies afterwards. Go 1.16 in go.mod. Removed accidental log dependency. (#807) 2021-04-19 12:06:10 -07:00
Phil Kedy 58b43fbfdb
Azure Service Bus publishing retries when server is "too busy" (#821)
* Adding retry/backoff to publishing to Azure Service Bus when the server is too busy and throttles the connection

* Fixing linter issues
2021-04-14 11:56:55 -07:00
zhangchao 3ec4b336a9 upgrade go-redis/redis to v8, and use context in pubsub/redis to cancel redis request. 2021-04-10 23:41:58 +08:00
Lynn Orrell 08305017c1
Localstorage (#753)
* Introduced localstorage binding

* Code cleanup

* Linter cleanup

* Linter cleanup

* Now using ioutil.ReadAll() as io.ReadAll() fails to build on Windows

* Renamed metadata field

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Phil Kedy <phil.kedy@gmail.com>
Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2021-03-23 18:00:56 -07:00
Phil Kedy 1b70adb9a0
Bumping dapr/dapr version and running go mod tidy (#738) 2021-03-03 14:42:42 -08:00
Phil Kedy 715cc8d688
Refactored conformance tests to use a new config package (#712)
* Refactored the conformance tests to use a new config package
Removed dependency on k8s apimachinery sets

* Comment tweak

* Renamed kit package to internal
2021-03-01 13:03:39 -08:00
Phil Kedy e8efbca072
Add MQTT pubsub to the conformance tests (#721)
* Add MQTT pubsub to the conformance tests

* Making the MQTT pubsub component conformance test against multiple brokers
2021-02-25 18:16:23 -08:00
Phil Kedy 5290fe157d
Removes github.com/satori/go.uuid in favor of google's uuid package (#704) 2021-02-18 21:11:36 -08:00
Joni Collinge f84b98b136
bump azure-service-bus-go version from 0.10.6 to 0.10.10 (#700) 2021-02-18 13:06:07 -08:00
Artur Souza dd3e463b52
Fix pubsub retry for Kafka (#688)
* Add conformance test for kafka pubsub + quickfix for Kafka error handling.

* Adding backoff/retry logic to the Kafka pub/sub component

* Add logic to return if error from backoff in kafka.

* Addressing PR comments and lint.

Co-authored-by: Phil Kedy <phil.kedy@gmail.com>
2021-02-12 00:08:46 -08:00
Edwin van Wijk 6baa30ee75
Add SMTP output binding (#646)
* Add smtp output binding

* Go mod tidy

* Remove obsolete func

* Refactor metadata overrides from request

* Add comment

* Fix mergeRequest func

* Add #nosec directive for SkipTLSVerify

* Add test for MergeWithRequestMetadata

* Format test code

* Change level of succesfull email logging

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-02-09 19:13:14 -08:00
Phil Kedy e6924c6d7b
Improving the versatility of the HTTP output binding (#661)
* no message

* Removing HTTP input binding from conformance test

* Moving // nolint: noctx

* Fixed linter issue

* Tweaks

* Tweak

* Setting request headers from metadata

* More comments and handling of non-200 response codes

* Fixing conformance test for HTTP

* Temporarily bumping up redis timeouts

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Charlie Stanley <charlie.stanley@microsoft.com>
2021-02-09 12:02:47 -08:00
halspang 6f31e9f14f
Add http input/output bindings test (#637)
* Refactor bindings and introduce input bindings

This commit adds Kafka output bindings tests and refactors the
general bindings tests to include input and output bindings in
the same set of tests. Azure Storage Queues are used as the
first input binding.

* Add http input/output bindings test

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-01-29 13:00:09 -08:00
Ian Luo 97912e75c6
mysql outbinding support (#615)
* mysql outbinding support

* fix lint issues

* use time duration string instead of number of seconds

* correct typo

* use 'addr' instead of 'server' and 'port' in order to align with url in dsn format

* simplify configuration, and allow PEM configurable

* jsonfy the query result

* add more unit test for mysql binding

* add unit test to verify timestamp

* add type verify in integration test

* add test to verify BOOLEAN

* update comment

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2021-01-25 18:45:26 -08:00
Nghia Tran 3086450ced
Add CosmosDB state store conformance tests (#622)
* Add CosmosDB conformance tests

* Fix workflow & lint

* Add more disclaimers to README.md
2021-01-20 14:38:09 -08:00
Mukundan Sundararajan 465d09e54d
Add initial set of conformance tests (#586)
* Add initial set of conformance tests

* remove go mod changes

* set and unset env var for test
2021-01-20 12:09:51 -08:00
Yaron Schneider a03a96c282
update kubernetes packages to 1.20 (#557) 2020-12-16 10:43:27 -08:00
Nghia Tran a4884f1d4b
Remove exporters component code (#553) 2020-12-10 13:38:26 -08:00
Michaël Hompus 6079c3b113
Add postmark as an output binding (#546)
* Add postmark as an output binding

* go tidy

* Update comments
2020-12-09 14:28:32 -08:00
Joni Collinge 31828b3779
Update ASB message finalization (#534)
* remove servicebus context hack

* add more verbose error message

* make error message lowercase

* update go-autorest

* update azure-sdk-for-go

* remove go mod replace go-autorest

* fix lint issues

* go mod tidy

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-12-04 22:13:00 -08:00
Yaron Schneider 763c856a44
update dependency for ocagent (#517) 2020-11-03 16:41:37 -08:00
Sky/敖小剑 ed7480237d
Upgrade grpc version to v1.32.0 (#501)
* remove etcd state store to prepare to update grpc to new version

* upgrade grpc version to v1.32.0

* upgrade grpc version to v1.32.0
2020-10-15 17:49:33 -07:00
Sky/敖小剑 4e77594a4d
remove etcd state store to prepare to update grpc to new version (#499)
* remove etcd state store to prepare to update grpc to new version

* update go.mod

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-10-15 09:53:49 -07:00
halspang f647d9eedb
Upgrade golang lint to 1.31 (#490)
Upgrade golang lint to 1.31.0

https://github.com/dapr/components-contrib/issues/439
2020-10-12 12:54:15 -07:00
Mark Chmarny fbc3a3dd87
RethinkDB state store support (#423)
* rethinkdb state store

* added actor state change binding

* updated db record

* reconnect

* passing lint

* updated binding repsonse keys

* rethinkdb load test

* lint validated tests

* updated comments

* updates TransactionalStateRequest

* parameterized table

* correct error message

Co-authored-by: Young Bu Park <youngp@microsoft.com>
2020-09-24 16:19:14 -07:00
Mark Chmarny d2dcd8e508
Bi-directional output binding for PostgreSQL (#468)
* wip: postgres

* postgres crud binding

* CRUD postgres bidirectional output binding

* live test setup comments

* updated example conn string

* lint fixes

* test sql linting

* pr review updates

* lint fixes

* comment spelling

* metadata optional for close
2020-09-23 17:19:37 -07:00
Artur Souza 5b88ef7ec9
Update github.com/a8m/documentdb to latest commit to fix consistency … (#475)
* Update github.com/a8m/documentdb to latest commit to fix consistency level options.

* go mod tidy
2020-09-23 16:55:32 -07:00
Nghia Tran e51cff7fec
Use concurrency control in Multi() (#466)
Change Multi() to use same setQuery and delQuery mechanisms as Set() and Delete().
2020-09-22 15:13:39 -07:00
Richard Simpson 775bbebc6a
feat(middleware): add opa middleware (#456)
* feat(middleware): add opa middleware

* address linting feedback

* unwind logic a little more

* are we gonna need to throw hands lint?

* remove accidental assertion lib include

* address pr feedback

* expand test suite to headers

* fix errors and moar test

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-09-12 12:29:42 -07:00
AbserAri 26b085baba
update logger form nats-io's to dapr's (#449)
* update logger form nats-io's to dapr's

* run go mod tidy and go mod delete the nats-io gnatsd

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-09-03 18:58:34 -07:00
Mukundan Sundararajan c6623da87e
Change Kubernetes client to official go-client in the events binding. (#436)
* Change Kubernetes client to official go-client in the events binding.

* Change adding flags to init

* go mod tidy

* Proper call for handler

* Remove commented out code

* Refactor indentation
2020-08-18 11:49:06 -07:00
Geert Baeke 467375c254
Influx binding (#401)
* influx binding

* corrected linting errors

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-08-17 12:45:58 -07:00
Florian Wagner e60fa843f2
Adding middleware component for non interactive oauth2 client credentials flow (#431)
* Initial commit with mock not working

Signed-off-by: Florian Wagner <flwagner@microsoft.com>

* changed structure for mocking, added first test

Signed-off-by: Florian Wagner <flwagner@microsoft.com>

* oauth2clientcredentials input checks and tests

Signed-off-by: Florian Wagner <flwagner@microsoft.com>

* rename metadata authHeaderName to HeaderName

Signed-off-by: Florian Wagner <flwagner@microsoft.com>

* Run 'go mod tidy'

Signed-off-by: Florian Wagner <flwagner@microsoft.com>

* use dapr logger from caller

Signed-off-by: Florian Wagner <flwagner@microsoft.com>

* Fix additional lint requirements by build pipeline

Signed-off-by: Florian Wagner <flwagner@microsoft.com>

Co-authored-by: Florian Wagner <flwagner@microsoft.com>
Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-08-16 11:05:24 -07:00
Brooke Hamilton a0a293ca1b
[WIP] PostgreSQL State Store (#353)
* Added postgres state files

* Fix SQL Server integration tests. (#324)

* Initial unit and int tests for postgres

* Implemented dbaccess interface

* Formatting updates

* Create state table if not exists

* Initial set implementation

* Get and set with integration test

* Added delete

* Create date and update date in database

* Integration tests for bulk set and bulk delete

* Etag processing, test refactor

* Added tests for etag processing

* Updated const, removed public metadata fields

* Cleanup edits

* Fixed linting issues

* Ran go mod tidy

* Initial implementation of TransactionalStore

* Fixed linting issues

* Added tests and validation

* Test for creating the state table

* Fixed issue with parsing param value as string

* Update to integration tests

* Fixed linting issues

* Added retry logic from state

* Changed primary key to text

* Updated debug logging

* Review updates

Co-authored-by: Young Bu Park <youngp@microsoft.com>
Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-07-09 13:56:08 -07:00
Mark Chmarny e98b3fc968 adds cron binding 2020-07-07 16:58:53 -07:00
Joni Collinge 4b2252b017
ASB lock renewal per topic (#365)
* bump asb sdk version to 0.10.2

* add isolation per topic for lock renewal

* added cancellations on async handlers

* refactored out subscription logic from namespace

* updated error handling

* defer async context cancel

* fixed lint issues

* add connection recovery

* fix lint

* update comments

* update comments

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-07-02 08:02:42 -07:00
Mukundan Sundararajan 5c62707aba
Upgrade go version to 1.14.3 and linter version to 1.26.0 (#352)
* Upgrade to go 1.14.3 and linter version to 1.26.0
2020-05-29 15:26:33 -07:00
John b54585c4f0
Apache Pulsar - pubsub component (#346)
* created pulsar component

* fixed multi topic issue

* moved metadata struct

* finished writing metadata tests

* fixed linter issues

* modifies consumer type to failover

* uncapitalized errors

* changed subscriptionName to consumerID

* acknowledge message only if there's no error returned from handler

Co-authored-by: john verdonck <John@johns-MacBook-Pro.local>
2020-05-22 10:04:07 -07:00
Mark Chmarny 0e731f96aa
Added Twitter search input binding (#318)
* titter search binding

* refactored signal processing for lint comp

* titter search binding

* refactored signal processing for lint comp

* fixed twitter ref

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-04-29 08:02:57 -07:00
Lynn Orrell 8480a29c18
EventGrid Component Updates (#319)
* event grid udpates

* Initial event grid input binding

* Added Write() support to EventGrid component

* Updated eventgrid binding to use fasthttp instead of net/http

* Fixed linting issue in EventGrid binding

* Tidy up go.mod

* Added handshakePort to allow custom port for EG callback

* Now properly throwing an http 500 on handler err

* Updated event grid sdk for cloud event 1.0 support
Added support for all event grid sources via scope
Now validating required metadata on read/write

* Updated tests

* Fixed linting issue

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
Co-authored-by: Young Bu Park <youngp@microsoft.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2020-04-29 08:02:22 -07:00
Ben Coleman ebf31ef7c5
Added SendGrid output binding for sending emails (#308)
* Added first cut of SendGrid binding

* Removed some junk

* tidy up based on PR review comments
Removed duped line, and logging, normalised error messages

* Silly mistakes on emailTo and subject checks

* Moving to new twilio folder structure

* adds BCC and CC, better error handling

* microscopic comment typo

* linter was complaining

* removing my accidental docs commit

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
Co-authored-by: Aman Bhardwaj <amanbha@users.noreply.github.com>
2020-04-22 21:54:01 -07:00
Pruthvidhar R Dhodda a36e498d02
Add TLS support for bindings.redis (#302)
* Add TLS support for bindings.redis

* Remove unsused dependencies

* Fix failing tests

* Remove unused variables
2020-04-09 12:02:24 -07:00
Sivamuthu Kumar b14500315a
Add Kinesis data stream binding (#273)
* Add Kinesis data stream binding

* fix lint kinesis

* Add license at top of the file

Co-authored-by: Young Bu Park <youngp@microsoft.com>
2020-03-24 11:33:23 -07:00
madhugilla dc1e938e61
Alicloudoss (#278)
* Object storage implementation for AliCloud

* linting fixes

* fixed comments and ran "go mod tidy" based on the feedback

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-03-20 12:34:38 -07:00
Abhishek Gupta 807e8893cb
Azure Event Hubs pubsub component (#242)
* event hubs pubsub

* go mod tidy

* go mod

Co-authored-by: yaron2 <yaronsc@microsoft.com>
Co-authored-by: Young Bu Park <youngp@microsoft.com>
2020-03-09 22:02:04 -07:00
Yaron Schneider 4602757a45
extend envelop to include a subject field (#249)
* extend envelop to include a subject field

* fix envelop test

* update mod

* try fix mod again
2020-03-04 22:59:26 -08:00
Young Bu Park ee97c3c56a
Use dapr logger (#238)
* Use dapr logger

* skip linter false alarm
2020-02-28 15:49:49 -08:00
Yaron Schneider c5ee4b273f
Add zero block for redis streams (#222)
* add zero block for redis streams

* update go.mod
2020-02-12 08:45:05 -08:00
Joni Collinge 6c65fda88d
Add Rate Limiting Middleware (#193)
* add initial ratelimit middleware

* fixed linting issues

* updated rate limiting logic

* removed redundant const

* remove obsolete go.uber.org/ratelimit reference in go mod

* migrated from juju/ratelimit to tollbooth rate limit

* moved adaptor to a separate package and added tests

* added RemoteAddr

* moved handler wrapped outside hot path

* fix linter
2020-02-07 13:25:36 -08:00
REDDY PRASAD 5f3f850852
Add GCP Secret Manager (#199)
*  Add GCP Secret Manager

* Update tests

* Fix lint errors

* Update as per review

* Run go mod tidy

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-01-30 21:51:52 -08:00
Yaron Schneider 4433e605f1
Add CloudState CRDT (#200)
* add CloudState CRDT

* fix linter

* add tests
2020-01-29 14:13:23 -08:00
Abhishek Gupta 6de230391d
Aerospike state store implementation (#196)
* aerospike state store impl

* fixed linter issues:

* addressed feedback

* Delete bearer_middleware.go

* Delete cassandra_test.go

* Revert "Delete cassandra_test.go"

This reverts commit 462c066814.

* Revert "Delete bearer_middleware.go"

This reverts commit ae114a1df1.

Co-authored-by: Young Bu Park <youngp@microsoft.com>
2020-01-28 18:55:14 -08:00
Ivan Gavryliuk 84c4e6bf8e Azure Table Storage state (#197)
* initial scaffolding

* tidy go.mod

* adding delete functionality and tests

* updating Readme.md

* ETag concurrency support and github review fixes

* removing unused isConflictError

* ping build, some issue with CI timing out

Co-authored-by: Young Bu Park <youngp@microsoft.com>
2020-01-28 09:20:18 -08:00
Abhishek Gupta 3734491718 NATS Streaming pubsub implementation (#173)
* NATS streaming pubsub impl

* after go mod tidy

* updates tests, other refactoring

* updated client ID generator

* updated test

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
Co-authored-by: Young Bu Park <youngp@microsoft.com>
2020-01-17 14:54:01 -08:00
Marcin Kosieradzki 381777dc3b Implemented OIDC Bearer middleware (#188)
* Implemented OIDC Bearer middleware

* Fixed indentation
Added support for case-insensitive scheme
Moved scheme to constant

Co-authored-by: Aman Bhardwaj <amanbha@users.noreply.github.com>
2020-01-16 13:26:30 -08:00
Francisco Beltrao 70381d8312 Add sql server state (#158)
* Add sql server state

* Fix lint

* Disable docker based tests

* Rename store to SQLServer
Use env variable DAPR_TEST_SQL_CONNSTRING to enable integratoion test

* Add support to Azure SQL on integration test

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-01-06 09:14:13 -08:00
Haishi2016 701f12e529
oAuth2 HTTP middleware (#151)
* oAuth2 HTTP middleware

* fix go mod

* refactor to use sessions

* go mod tidy
2019-12-17 09:43:14 -08:00
thinkerou a2f4b4c510 upgrade logrus to v1.4.2 (#150)
* fix conflict

* upgrade logrus to v1.4.2

* fix lint error

error: `depguard  `github.com/sirupsen/logrus` is in the blacklist`
2019-12-12 09:34:39 -08:00
stather 744880306f Azure storage queue binding implementation (#146)
* folders and files

* boilerplate added

* write queue done
parse metadata done

* refactor of init and write

* All done

* lint updates

* Additional lint fixes

* lint simplifications

* UPdated to make testable
Make read blocking

* working tests

* linting fix

* Added backoff so we dont eat CPU

* go mod tidy to fix error

* fixed test failures

* Fixed lint error
2019-12-03 21:31:46 -08:00
Francisco Beltrao f89682397b Add Azure SignalR binding (#148)
* Add Azure SignalR binding

* Fixes from go lint

* Go lint

* Use "github.com/dgrijalva/jwt-go" for jwt
Fix bug parsing connection string
Normalize usage of len vs == in strings

* Consistent usage of http header Set
2019-12-03 09:08:53 -08:00
Prafulla Anurag 9ffc7dc2ce Cloudkms secretstore (#121)
* Initial Commit creating cloudkmsclient

* Changes to go.mod go.sum

* Minor changes

* Add basic metadata structure, decrypt function

* Add GetSecret Module

* Add module to fetch secret file from cloud storage

* Finish coding the secret store

* Delete changes to go.mod

* Remove changes from go.mod and go.sum

* Add init test for cloudkms

* fix golint failures

* Edited the documentation
2019-11-29 12:23:23 -08:00
Abhishek Gupta c4bd2a47ea Implementation for Hazelcast based state store (#145)
* hazelcast store impl

* go.mod update
2019-11-27 21:12:47 -08:00
sayboras 08362d9e6b Added check for go.mod (#141)
* Added check for go.mod

* Rename the make target

* Grrrrr

* Update go.mod and go.sum

* Run gofmt and goimports

* Correct typo
2019-11-25 00:45:51 -08:00
Abhishek Gupta 356981000e Couchbase state store implementation (#100)
* first cut for couchbase store

* set and delete account for etag

* updated implementation

* fixed go mod
2019-11-18 23:13:41 -08:00
Leon Mai e7e02ee056 Servicediscovery (#118)
* service discovery component

* Update vendor files

* Remove dep on dapr

* lint

* Code review comments

* lint

* code review comments

* use const

* refactor

* code review
2019-11-14 13:14:57 -08:00
sayboras 32f5f81b9b Fixed dependency issue (#104) 2019-11-11 12:34:56 -08:00
Yoichi Kawasaki bd36a6759f Added state store: Cloud Firestore (#110)
* Added State Store: Cloud Firestore

* changed state store name
2019-11-08 14:43:43 -08:00
Joni Collinge ed3c829578 Azure ServiceBus PubSub Implementation (#93)
* initial skeleton code

* updated sub message handler

* lowercased errors

* added deadletter

* added context

* remove nil args

* added TODOs

* add max delivery count and timeout config

* refactored ensure methods

* removed confusing comment

* apply go fmt

* removed consumerID default

* updated go mod

* fixed up linter issues

* add package alias

* removed TODOs

* added additional servicebus config

* fix linting
2019-11-05 14:50:48 -08:00
Anubhav Mishra 4bbfb82e98 initial secretstore implementation of HashiCorp Vault (#84)
* initial secretstore implementation of HashiCorp vault

* updates after review

* fixing golangci-lint errors

* fixing temporary directory creation issues
2019-11-01 20:29:06 -07:00
Flier Lu 342e0d6223 [WIP] Add zookeeper state store (#80)
* [WIP] Add zookeeper state store

* go mod vendor

* fix lint warnings

* change state.StateStore to state.Store
2019-10-31 21:04:34 -07:00
Shalabh Mohan Shrivastava 3ae5547e41 Adding MongoDB State Store Implementation (#53)
* Adding MongoDB State Store Implementation

Adding MongoDB State Store Implementation

* Fix bugs and add unit tests

* Adding write/read concerns

* go sum changes

* adding defer cancellation

* fixing the bug for default case override

* Resolving code review comment

* Adding go mod vendor files

* Fixing lint errors
2019-10-31 12:03:04 -07:00
Abhilash Singh 0cae368496 [WIP] Add memcached state store (#71)
* Add memcached state store init

* Add parsing of optional parameters

* Add tests

* Update vendor

* Add memcached to supported state store list
2019-10-31 06:21:04 -07:00
Abhishek Gupta 49b6c9625c NATS pubsub component implementation (#65)
* inital version for  nats pubsub implementation

* added draft impl for nats pubsub

* updated impl, test

* new dependencies

* updated go.mod
2019-10-29 23:48:55 -07:00
sayboras 8adf323961 Add github action for CI (#59)
* Initial commit

* Fixed all linting error

* Used prepared query instead of string format

* Enabled linter for test
Enabled below linters
    - gochecknoglobals
    - gochecknoinits

* Enabled below linters
    - godox
    - interfacer
    - maligned

* Revert name change for StateStore in pkg state

* Incorporate review comments

* Cleanup the github ci

* Correct typo

* Add golangci-lint version in github ci step

* Update Readme.md
2019-10-28 15:39:48 -07:00
Anubhav Mishra cc7578c02b state: initial version for the consul state store implementation (#52)
* state: initial version for the consul state store implementation

* updates after review

* changes after running go mod vendor

* more clean up after review
2019-10-25 21:34:16 -07:00
Haishi2016 f157dab522 Support OpenCensus native exporter (#57)
* Support OpenCensus native exporter

* fix typo
2019-10-25 16:15:43 -07:00
Yaron Schneider f2b0cede8a
Add cassandra state store (#48)
* add cassandra state store

* refactor return statements
2019-10-23 12:47:28 -07:00
Haishi2016 5fccecbe44 update metadata properties from map of interfaces to map of strings (#47) 2019-10-23 12:03:58 -07:00
Yaron Schneider 0b93c5e585
Merge branch 'master' into exporters 2019-10-22 21:40:33 -07:00
Haishi Bai 4c3abdbf7f make exporters components 2019-10-22 18:51:01 -07:00
Roberto Rojas 63af15926b ETCD Implementation of State Store (#42)
* etcd: initial commit

* etcd: functionality and unit tests

* etcd: fixes marshaling data sent to etcd

* changes as per PR review
2019-10-22 14:30:15 -07:00
Yaron Schneider 887cd92b8d
vendor update (#34) 2019-10-14 23:49:50 -07:00
Yaron Schneider 2b8dbd2b44
dapr name change (#21) 2019-10-02 13:21:22 -07:00
Brendan Burns a1ab528d56 Add a Kubernetes input binding. (#15) 2019-09-30 22:01:43 -07:00
Yaron Schneider ad1d4aaec2
Add GCP Pub/Sub input and output binding (#18)
* add gcp pub-sub input/output binding

* update bindings list

* Update pubsub_test.go
2019-09-30 08:46:20 -07:00
Yaron Schneider a50e3de151
Add Azure Service Bus Queues binding (#13)
* add azure service bus queues bindings

* update table
2019-09-27 16:10:00 -07:00
Yaron Schneider 071f9ec31b
add azure blob storage binding (#4) 2019-09-27 07:45:26 -07:00
yaron2 22fea6f43d initial commit 2019-09-26 15:47:41 -07:00