Commit Graph

825 Commits

Author SHA1 Message Date
Dmitry Shmulevich c7adb917f3
update license to Apache v2.0 (#1406) 2022-01-04 19:53:31 -08:00
Will 8c67b86359
Add DCO requirements and updated code of conduct (#1395)
Issue reference: dapr/docs#2039

Signed-off-by: Will Tsai <william.wl.tsai@gmail.com>

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-01-04 09:40:04 -08:00
Mukundan Sundararajan fe6c9e37d9
rewrite eventhubs component (#1292)
Signed-off-by: Mukundan Sundararajan <msundar.ms@outlook.com>
2022-01-03 19:36:35 -08:00
Zach 5c9365b314
pub/sub rocketmq:upgrade with v2 (#1383)
* pub/sub rocketmq:upgrade with client v2

Signed-off-by: zach <zachchou016@gmail.com>

* pubsub/rocketmq:remove cache and add start with setup

Signed-off-by: zach <zachchou016@gmail.com>

* pubsub/rocketmq:fix variable golint

Signed-off-by: zach <zachchou016@gmail.com>

* pubsub/rocketmq:change license and fix goimports

Signed-off-by: zach <zachchou016@gmail.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
2021-12-31 12:18:27 -08:00
Scott Hussey 897c2a4db5
Add OAuth2/OIDC support to Kafka pubsub (#1229)
* parent dbb18e4d77
author Scott Hussey <sthussey@gmail.com> 1632277042 -0500
committer Scott Hussey <sthussey@gmail.com> 1639111222 -0600

Support Oauth2 authentication for Kafka

- Utilize the SASL OAUTHBEARER mechanism to support
  the Oauth2 client_credentials flow for Kafka
  authentication

- Deprecate `authRequired` field and introduce `authType`
  to support varied authentication mechanisms

- Add a metadata upgrade mechanism to support backwards
  compatability

- Recommend broker specific scopes to guard against a
  compromised broker replaying a token

Signed-off-by: Scott Hussey <sthussey@gmail.com>

* kafka test - use volumes instead of root

CI test fails due to losing data written to container
root

Signed-off-by: Scott Hussey <sthussey@gmail.com>

* Clean up volumes

- When bringing down the docker-compose context, cleanup
  volumes

Signed-off-by: Scott Hussey <sthussey@gmail.com>

* Clean up stale comment

Signed-off-by: Scott Hussey <sthussey@gmail.com>

* Resume config defaults

- Return some Kafka config to default values to lower config
  footprint and stabilize flaky CI runs

Signed-off-by: Scott Hussey <sthussey@gmail.com>
2021-12-28 10:34:28 -08:00
Taction 6d9d0bca35
fix nits: duplicated err handle (#1341)
* remove duplicated err handle

Signed-off-by: Taction <zchao9100@gmail.com>

* fix test go mod tidy

Signed-off-by: Taction <zchao9100@gmail.com>
2021-12-27 08:47:10 -08:00
mbimbij 1389ae5937
Fix cassandra statestore error - "Bind variables cannot be used for table names" - Introduce `fmt.Sprintf` where applicable (#1388)
* - Introduce `fmt.Sprintf` where applicable
- Add conformance test for cassandra component.

Signed-off-by: mbimbij <joseph.mbimbi@gmail.com>

* Start cassandra via docker-compose for its conformance test

Signed-off-by: mbimbij <joseph.mbimbi@gmail.com>

* Apply `go fmt` on `tests/conformance/common.go` as part of PR correction

Signed-off-by: mbimbij <joseph.mbimbi@gmail.com>
2021-12-26 21:35:02 -08:00
RainFD 0f97b52b90
add S3ForcePathStyle support for s3 binding (#1360)
* add S3ForcePathStyle support for s3 binding

Signed-off-by: rainfd <rainfd@live.cn>

* add S3ForcePathStyle unit test

Signed-off-by: rainfd <rainfd@live.cn>
2021-12-23 18:58:39 -08:00
yellow chicks 190a47cd87
hotfix: upgrade dgrijalva/jwt-go (#1391)
* feature/pubsub: add delay queue params for pulsar

* feature/pubsub: add delay queue params for pulsar

* feature/pubsub: add delay queue params for pulsar

* hotfix: upgrade dgrijalva/jwt-go

* hotfix: upgrade dgrijalva/jwt-go
2021-12-23 08:57:59 -08:00
Amit Mor b548aa8bcc
1385 disable policy creation (#1386)
* not modifying policy if disableEntity is set

Signed-off-by: Amit Mor <amit.mor@hotmail.com>

* not modifying policy if disableEntity is set

Signed-off-by: Amit Mor <amit.mor@hotmail.com>
2021-12-22 12:42:28 -08:00
Dmitry Shmulevich 7a631ef7aa
pub/sub rabbitmq: add publishing retries (#1382)
Signed-off-by: Dmitry Shmulevich <dmitry.shmulevich@gmail.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
2021-12-17 15:59:38 -08:00
Bernd Verst 29848e1ff6
CosmosDB Output Binding Stable Certification Tests (#1378)
* cosmosdb output binding certification tests

Signed-off-by: GitHub <noreply@github.com>

* linter touchup

Signed-off-by: GitHub <noreply@github.com>

* Rename some remnants from copy paste

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
2021-12-16 10:41:34 -08:00
RainFD 870fedb8a0
fix binding list test (#1317)
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-12-14 14:19:23 -08:00
Dmitry Shmulevich 3fcf50c044
pub/sub rabbitmq: fix subscribe error (#1377)
Signed-off-by: Dmitry Shmulevich <dmitry.shmulevich@gmail.com>
2021-12-14 08:22:35 -08:00
Bernd Verst 9dbdaee296
Cosmos DB Output Binding - Authentication tests (#1373)
* Adds CosmosDB Binding authentication tests

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Enable Cosmos DB Binding Conformance test

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Initial cosmosdb binding certification plan WIP

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Go mod tidy

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update library and go mod tidy

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* make modtidy-all

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* CosmosDB Binding test plan details

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2021-12-13 15:08:07 -08:00
Amit Mor 72bae26380
disable entity creation (#1375)
Signed-off-by: Amit Mor <amit.mor@hotmail.com>
2021-12-13 09:22:57 -08:00
halspang 168dd49fce
Fix dependency issue in service bus queue tests (#1374) 2021-12-09 21:12:41 -08:00
Bernd Verst dbb18e4d77
Fix test infrastructure setup script (#1366)
* Fix test infrastructure setup script

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* use more unique ACR resource name

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
2021-12-08 17:34:12 -08:00
Simon Leet 9ab218a393
Update azure-sdk-for-go to v59.3.0 for EventGrid (#1325)
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-12-08 17:19:43 -08:00
Amit Mor e97b1bf9f3
1335 bugfix #2 (#1368)
* bugfix for sns topic deletion upon termination

* removed upstream github workflow files

* Update snssqs.go

* dapr bot schedule

* read and append queue attributes

* unnecessary escaping in json tag

* unexporting structs

* bugfix in policy

* bugfix in policy. merged from master

* fifo suffix as const
2021-12-08 14:20:24 -08:00
Artur Souza cac03dbe87
Enables autoupdate for PRs to be in sync with master. (#1363) 2021-12-06 14:59:43 -08:00
Bernd Verst f6e6bd8120
Adds missing ACR resource definition for test infrastructure (#1359)
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-12-06 12:01:18 -08:00
Bernd Verst 021bf0c065
Tidy & Pin certification tests to latest Dapr/Dapr (#1361)
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-12-06 11:37:23 -08:00
halspang 3395bb7316
Add certification tests for ASB Queue binding (#1251)
* Add certification tests for ASB Queue binding

This commit adds certification tests for the Azure Service Bus Queue
Input/Output binding. This utilizes the new certification framework
and performs a series of tests as described in the test plan readme.

The general purpose of these tests is to serve as an integration test
and as such requires an actual Azure Service Bus connection and a
Dapr sidecar.

https://github.com/dapr/components-contrib/issues/957

* Add to github workflow and fix formatting

* Fix dependencies

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-12-06 11:20:53 -08:00
Amit Mor 4918900c09
AWS PubSub SNS/SQS - FIFO support + refactoring (#1312)
* bugfix for sns topic deletion upon termination

* removed upstream github workflow files

* wrapping errors

* fifo and naming sanitization

* fifo and name santization tests

* component carrying id

* Update snssqs.go

removed unneeded import

* Update snssqs.go

* add missing github actions file

* linting

* fix go.mod

* schedule yml file

* const max lenght, bugfix in ack

* dapr bot schedule

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-30 10:52:00 -08:00
Ian Luo b86128396b
upgrade dapr's version to fix go mod tidy issue in tests/certification #1319 (#1349) 2021-11-30 02:53:52 -08:00
Bernd Verst 4bbc1d2335
Ignore go.work for Go 1.18 Workspaces (#1324)
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-29 13:06:48 -08:00
Bernd Verst 175b09ea40
Adds retry on CosmosDB Init in case of TooManyRequests error (#1329)
* Adds retry on CosmosDB Init in case of TooManyRequests error

* Use backoff v4

* missed some permanent errors

* clean up go.mod

* fix error type casting

* Add constant for HTTP 429
2021-11-29 12:05:43 -08:00
Laurence 53c6ed7636
fix: add config subscription gr done (#1315)
* fix: add config subscription gr done

* unexpected comments

* fix comment

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-29 11:54:00 -08:00
Phil Kedy a49f4283fd
Forcing dapr/dapr commit to fix compatibility w/ components-contrib (#1345) 2021-11-29 11:08:35 -08:00
Dmitry Shmulevich 3c52b73608
fixed typo in Query JSON (#1344) 2021-11-29 09:44:28 -08:00
Amit Mor da7e8cfde7
#1335 bugfix - multi SNS topics publishing policy to SQS (#1337)
* bugfix for sns topic deletion upon termination

* removed upstream github workflow files

* Update snssqs.go

* dapr bot schedule

* read and append queue attributes

* unnecessary escaping in json tag

* unexporting structs
2021-11-26 08:39:56 -08:00
huazhongming 63d6329ae5
Support tracestate can be propagated in PubSub (#1264)
* support tracestate can be propagated in PubSub

* add trace state

Co-authored-by: Long Dai <long.dai@intel.com>
Co-authored-by: Ian Luo <ian.luo@gmail.com>
Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-24 12:30:35 -08:00
Simon Leet 4a203bb034
Update conformance and certification workflow github ref handling (#1273)
Co-authored-by: Long Dai <long.dai@intel.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-24 11:59:54 -08:00
xj524598 3a7137f9a1
update some ratelimit_middleware.go comments (#1330)
Co-authored-by: xujie <xujie1@shein.com>
2021-11-24 16:16:57 +02:00
Taction 4bf0dcbfcf
Fix the Route of subscription API does not work on pubsub.pulsar (#1283)
* feat(pulsar): add tenant and namesapce. fix topic parsing.

* add test

* fix review add topic format unit test

* fix review: add persistent to metadata, fix nits

* fix lint

Co-authored-by: Long Dai <long.dai@intel.com>
Co-authored-by: Mukundan Sundararajan <musundar@microsoft.com>
Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-22 18:57:53 -08:00
halspang d5a68041c9
Move Service Bus Pubsub/Binding to common auth (#1201)
* Move Service Bus Pubsub/Binding to common auth

Both the pubsub and input/output binding for Azure Service Bus were
connecting via a connection string. This is still supported but will
now fallback to using AAD from the common auth library. This is also
the recommended auth pattern going forward.

* Move AMPQ specific auth and fix linter issues

* Make conn string and namespace mutually exclusive

* Move resourceName to a constant

* Update auth_amqp.go

* Update auth.go

Co-authored-by: Long Dai <long.dai@intel.com>
Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-22 18:20:11 -08:00
Dmitry Shmulevich f1be130563
bump up go to v1.17 (#1323) 2021-11-22 17:47:01 -08:00
Simon Leet 915180bfe5
Add internal retry to MQTT bindings Invoke() (#1289)
There is an internal race condition in MQTT client Publish method when
configured with autoreconnect (default) where the call can fail if the
connection is broken right after the outgoing event is queued but before
the dead connection is blocked.

This change mitigates that on the Dapr side with a limited retry loop
3 times at fixed 200ms interval as a patch before the Dapr resiliency
feature is introduced that exposes more generalized retry controls to
the dev.

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Long Dai <long.dai@intel.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-19 15:20:12 -08:00
Tao Jiang c75cb3ee96
upgrade vmware-go-kcl to v1.5.0 (#1257)
Upgrade vmware-go-kcl dependency to the latest v1.5.0.
update mod tidy

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-19 10:50:05 -08:00
Artur Souza 8fe2a4b56c
Allow DaprBot to auto update all open PRs. (#1314) 2021-11-18 21:35:26 -08:00
Simon Leet d4040f2dab
Add make modtidy-all action (#1308)
With the addition of the certification tests, changes in the go.mod
definition for component-contrib will also need to be propagated to the
go.mod for each of the tests under tests/certification.

- Add a `make modtidy-all` action to support updating all go.mod files.
- Update developing-component.md to include use of `make modtidy-all`.

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-18 17:02:18 -08:00
Simon Leet b04b4c735b
Expand ngrok logging in conformance.yml (#1304)
Co-authored-by: Long Dai <long.dai@intel.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-11-18 16:11:11 -08:00
Simon Leet dfe52cf88f
Remove Cloudstate component (#1303)
- Remove cloudstate state store component
- Update state/Readme.md

Fixes #1297

Co-authored-by: Long Dai <long.dai@intel.com>
2021-11-18 15:30:40 -08:00
Alessandro (Ale) Segala 3eafb8bcd4
Azure SDK "track 2": authentication and secretstore/azure/keyvault (#1290)
* Authentication for new Azure SDK

* Updated keyvault to use new Azure SDK

* 🙈

* Update authentication/azure/auth.go

* Update authentication/azure/auth.go

* Update authentication/azure/auth.go

* Reintroduce changes from PR 1132 without updating ASB

* Lint 💄

* Marking contexts as TODO as they'll need a timeout
As per conversation with @berndverst

* Update certification tests with no auth libraries

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2021-11-16 10:59:51 -08:00
Dmitry Shmulevich ad433a27e1
add troubleshooting info (#1278)
add retries for pubsub subscribe
fix race conditions
2021-11-15 16:33:21 -08:00
Bernd Verst 3e3b64c0a2
Merge pull request #1302 from berndverst/master-release-1.5-merge
Merge Release 1.5 into Master
2021-11-12 13:10:15 -08:00
Bernd Verst 09fb60c5e7 Update to use latest Dev Container 2021-11-12 11:59:35 -08:00
Bernd Verst ad1c08d218 Update certification tests to Runtime v1.5.0 (#1295) 2021-11-12 11:59:35 -08:00
halspang f5d8317c41 Revert "Bumping ASB version and fixing test for azure auth (MSI_ENDPOINT) (#1132)" (#1291) 2021-11-12 11:59:35 -08:00