Commit Graph

3297 Commits

Author SHA1 Message Date
Joni Collinge 3af57ca5b7
Fix not setting status code in nethttpadaptor on response (#1429)
* fix not setting status code in nethttpadaptor on response

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* make test name consistent

Signed-off-by: Joni Collinge <jonathancollinge@live.com>

* git mod tidy

Signed-off-by: Joni Collinge <jonathancollinge@live.com>
2022-01-13 07:31:29 -08:00
Amit Mor c8844ccaed
Pubsub AWS SNS/SQS - adding context, cancellation, timeouts, retrying \w backoff & disable delete of messages on failure (#1433)
* squash

Signed-off-by: Amit Mor <amit.mor@hotmail.com>

* comment

Signed-off-by: Amit Mor <amit.mor@hotmail.com>

* gofumpted

Signed-off-by: Amit Mor <amit.mor@hotmail.com>

* breakdown of metadata loading

Signed-off-by: Amit Mor <amit.mor@hotmail.com>

* metadata further refactoring

Signed-off-by: Amit Mor <amit.mor@hotmail.com>
2022-01-13 07:27:49 -08:00
Dapr Bot 6c599fa8a9
Merge branch 'master' into feature/pulsar0107 2022-01-07 15:53:59 -08:00
yellow chicks 3c28fee80f
hotfix: bindings.cron Input & Output communicates through a signal queue (#1418)
Signed-off-by: 1046102779 <seachen@tencent.com>

Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
2022-01-07 15:53:19 -08:00
Dapr Bot 61a62f75d0
Merge branch 'master' into feature/pulsar0107 2022-01-07 11:43:59 -08:00
Amit Mor 736730e55a
conformance tests for AWS pubsub SQS SNS (#1394)
* conformance tests

Signed-off-by: Amit Mor <amit.mor@hotmail.com>

* latest localstack. snssqs to conformance list

Signed-off-by: Amit Mor <amit.mor@hotmail.com>

Co-authored-by: Mukundan Sundararajan <musundar@microsoft.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-01-07 11:34:44 -08:00
Dapr Bot 5cd0e11004
Merge branch 'master' into feature/pulsar0107 2022-01-07 11:17:07 -08:00
Gehhilfe 8332b6a9c5
Fix kafka input binding looping when not topics are set (#1412)
* binding kafka: check if topics are not empty before reading

Signed-off-by: Tim Burkert <burkert.tim@gmail.com>

* binding kafka: log warning instead of returning error

Signed-off-by: Tim Burkert <burkert.tim@gmail.com>

Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-01-07 11:06:17 -08:00
Dapr Bot 5104bf0211
Merge branch 'master' into feature/pulsar0107 2022-01-07 10:47:54 -08:00
Shivam Kumar 4631d6e41a
MQTT Pubsub Certification Testing + AutAckOff Fix for MQTT (#1420)
* MQTT Certification Test

Signed-off-by: shivam <shivamkm07@gmail.com>

* Using paho.mqtt.golang fork with AutoAck fix

Signed-off-by: shivam <shivamkm07@gmail.com>

* Adding MQTT component in certification.yml

Signed-off-by: shivam <shivamkm07@gmail.com>

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2022-01-07 10:33:54 -08:00
Artur Souza abfc3e26f6
Merge branch 'master' into feature/pulsar0107 2022-01-07 10:30:49 -08:00
Mukundan Sundararajan a5f1d864fd
fix eventhubs conformance tests (#1421)
Signed-off-by: Mukundan Sundararajan <msundar.ms@outlook.com>
2022-01-07 10:15:25 -08:00
1046102779 5af0f02c68 feature/pulsar: add producer option disableBatching
Signed-off-by: 1046102779 <seachen@tencent.com>
2022-01-07 13:18:06 +08:00
1046102779 eda86a2711 feature/pulsar: add producer option disableBatching
Signed-off-by: 1046102779 <seachen@tencent.com>
2022-01-07 13:15:14 +08:00
1046102779 db05ea0e13 feature/pulsar: add producer option disableBatching
Signed-off-by: 1046102779 <seachen@tencent.com>
2022-01-07 13:10:25 +08:00
1046102779 00c99a4027 feature/pulsar: add producer option disableBatching
Signed-off-by: 1046102779 <seachen@tencent.com>
2022-01-07 12:45:14 +08:00
Bernd Verst ab91ae1aa4
update certification tests to latest daprd master (#1417)
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-01-06 18:36:43 -08:00
Dmitry Shmulevich 0bb78660e6
use the latest dapr/dapr in pubsub cert tests (#1416) 2022-01-06 13:29:46 -08:00
Bernd Verst 83a2e8089f
Ensure all go.mods are tidied with no diff (#1415)
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-01-06 12:02:01 -08:00
Phil Kedy 265fa9a9c2
Kafka PubSub: Use metadata as message headers. (#1409)
* Kafka PubSub: Setting metadata as message headers.

Signed-off-by: Phil Kedy <phil.kedy@gmail.com>

* running go mod tidy on certification tests

Signed-off-by: Phil Kedy <phil.kedy@gmail.com>
2022-01-06 10:10:37 -08:00
Bernd Verst bc2b5cc39c
Fix Blobstorage Bindings Conformance Test (#1410) 2022-01-06 10:09:16 -08:00
Lucas Jellema a013b58d6c
Implement State Store for OCI ObjectStorage service (#1401)
* Implement State Store for OCI ObjectStorage service

Signed-off-by: lucasjellema <lucasjellema@gmail.com>

* add go.mod and go.sum with dependencies on OCI SDK

Signed-off-by: lucasjellema <lucasjellema@gmail.com>

* Removed dependency in unit test on OCI account

Signed-off-by: lucasjellema <lucasjellema@gmail.com>

* Adding extensive unit test (coverage) using mock-OCI client

Signed-off-by: lucasjellema <lucasjellema@gmail.com>

* Correcting linting issues and review requests

Signed-off-by: lucasjellema <lucasjellema@gmail.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
2022-01-04 23:18:50 -08:00
Dmitry Shmulevich c7adb917f3
update license to Apache v2.0 (#1406) 2022-01-04 19:53:31 -08:00
Will 8c67b86359
Add DCO requirements and updated code of conduct (#1395)
Issue reference: dapr/docs#2039

Signed-off-by: Will Tsai <william.wl.tsai@gmail.com>

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-01-04 09:40:04 -08:00
Mukundan Sundararajan fe6c9e37d9
rewrite eventhubs component (#1292)
Signed-off-by: Mukundan Sundararajan <msundar.ms@outlook.com>
2022-01-03 19:36:35 -08:00
Zach 5c9365b314
pub/sub rocketmq:upgrade with v2 (#1383)
* pub/sub rocketmq:upgrade with client v2

Signed-off-by: zach <zachchou016@gmail.com>

* pubsub/rocketmq:remove cache and add start with setup

Signed-off-by: zach <zachchou016@gmail.com>

* pubsub/rocketmq:fix variable golint

Signed-off-by: zach <zachchou016@gmail.com>

* pubsub/rocketmq:change license and fix goimports

Signed-off-by: zach <zachchou016@gmail.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
2021-12-31 12:18:27 -08:00
Scott Hussey 897c2a4db5
Add OAuth2/OIDC support to Kafka pubsub (#1229)
* parent dbb18e4d77
author Scott Hussey <sthussey@gmail.com> 1632277042 -0500
committer Scott Hussey <sthussey@gmail.com> 1639111222 -0600

Support Oauth2 authentication for Kafka

- Utilize the SASL OAUTHBEARER mechanism to support
  the Oauth2 client_credentials flow for Kafka
  authentication

- Deprecate `authRequired` field and introduce `authType`
  to support varied authentication mechanisms

- Add a metadata upgrade mechanism to support backwards
  compatability

- Recommend broker specific scopes to guard against a
  compromised broker replaying a token

Signed-off-by: Scott Hussey <sthussey@gmail.com>

* kafka test - use volumes instead of root

CI test fails due to losing data written to container
root

Signed-off-by: Scott Hussey <sthussey@gmail.com>

* Clean up volumes

- When bringing down the docker-compose context, cleanup
  volumes

Signed-off-by: Scott Hussey <sthussey@gmail.com>

* Clean up stale comment

Signed-off-by: Scott Hussey <sthussey@gmail.com>

* Resume config defaults

- Return some Kafka config to default values to lower config
  footprint and stabilize flaky CI runs

Signed-off-by: Scott Hussey <sthussey@gmail.com>
2021-12-28 10:34:28 -08:00
Taction 6d9d0bca35
fix nits: duplicated err handle (#1341)
* remove duplicated err handle

Signed-off-by: Taction <zchao9100@gmail.com>

* fix test go mod tidy

Signed-off-by: Taction <zchao9100@gmail.com>
2021-12-27 08:47:10 -08:00
mbimbij 1389ae5937
Fix cassandra statestore error - "Bind variables cannot be used for table names" - Introduce `fmt.Sprintf` where applicable (#1388)
* - Introduce `fmt.Sprintf` where applicable
- Add conformance test for cassandra component.

Signed-off-by: mbimbij <joseph.mbimbi@gmail.com>

* Start cassandra via docker-compose for its conformance test

Signed-off-by: mbimbij <joseph.mbimbi@gmail.com>

* Apply `go fmt` on `tests/conformance/common.go` as part of PR correction

Signed-off-by: mbimbij <joseph.mbimbi@gmail.com>
2021-12-26 21:35:02 -08:00
RainFD 0f97b52b90
add S3ForcePathStyle support for s3 binding (#1360)
* add S3ForcePathStyle support for s3 binding

Signed-off-by: rainfd <rainfd@live.cn>

* add S3ForcePathStyle unit test

Signed-off-by: rainfd <rainfd@live.cn>
2021-12-23 18:58:39 -08:00
yellow chicks 190a47cd87
hotfix: upgrade dgrijalva/jwt-go (#1391)
* feature/pubsub: add delay queue params for pulsar

* feature/pubsub: add delay queue params for pulsar

* feature/pubsub: add delay queue params for pulsar

* hotfix: upgrade dgrijalva/jwt-go

* hotfix: upgrade dgrijalva/jwt-go
2021-12-23 08:57:59 -08:00
Amit Mor b548aa8bcc
1385 disable policy creation (#1386)
* not modifying policy if disableEntity is set

Signed-off-by: Amit Mor <amit.mor@hotmail.com>

* not modifying policy if disableEntity is set

Signed-off-by: Amit Mor <amit.mor@hotmail.com>
2021-12-22 12:42:28 -08:00
Dmitry Shmulevich 7a631ef7aa
pub/sub rabbitmq: add publishing retries (#1382)
Signed-off-by: Dmitry Shmulevich <dmitry.shmulevich@gmail.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
2021-12-17 15:59:38 -08:00
Bernd Verst 29848e1ff6
CosmosDB Output Binding Stable Certification Tests (#1378)
* cosmosdb output binding certification tests

Signed-off-by: GitHub <noreply@github.com>

* linter touchup

Signed-off-by: GitHub <noreply@github.com>

* Rename some remnants from copy paste

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
2021-12-16 10:41:34 -08:00
RainFD 870fedb8a0
fix binding list test (#1317)
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-12-14 14:19:23 -08:00
Dmitry Shmulevich 3fcf50c044
pub/sub rabbitmq: fix subscribe error (#1377)
Signed-off-by: Dmitry Shmulevich <dmitry.shmulevich@gmail.com>
2021-12-14 08:22:35 -08:00
Bernd Verst 9dbdaee296
Cosmos DB Output Binding - Authentication tests (#1373)
* Adds CosmosDB Binding authentication tests

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Enable Cosmos DB Binding Conformance test

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Initial cosmosdb binding certification plan WIP

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Go mod tidy

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update library and go mod tidy

Signed-off-by: GitHub <noreply@github.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* make modtidy-all

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* CosmosDB Binding test plan details

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2021-12-13 15:08:07 -08:00
Amit Mor 72bae26380
disable entity creation (#1375)
Signed-off-by: Amit Mor <amit.mor@hotmail.com>
2021-12-13 09:22:57 -08:00
halspang 168dd49fce
Fix dependency issue in service bus queue tests (#1374) 2021-12-09 21:12:41 -08:00
Bernd Verst dbb18e4d77
Fix test infrastructure setup script (#1366)
* Fix test infrastructure setup script

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* use more unique ACR resource name

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
2021-12-08 17:34:12 -08:00
Simon Leet 9ab218a393
Update azure-sdk-for-go to v59.3.0 for EventGrid (#1325)
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-12-08 17:19:43 -08:00
Amit Mor e97b1bf9f3
1335 bugfix #2 (#1368)
* bugfix for sns topic deletion upon termination

* removed upstream github workflow files

* Update snssqs.go

* dapr bot schedule

* read and append queue attributes

* unnecessary escaping in json tag

* unexporting structs

* bugfix in policy

* bugfix in policy. merged from master

* fifo suffix as const
2021-12-08 14:20:24 -08:00
Artur Souza cac03dbe87
Enables autoupdate for PRs to be in sync with master. (#1363) 2021-12-06 14:59:43 -08:00
Bernd Verst f6e6bd8120
Adds missing ACR resource definition for test infrastructure (#1359)
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-12-06 12:01:18 -08:00
Bernd Verst 021bf0c065
Tidy & Pin certification tests to latest Dapr/Dapr (#1361)
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-12-06 11:37:23 -08:00
halspang 3395bb7316
Add certification tests for ASB Queue binding (#1251)
* Add certification tests for ASB Queue binding

This commit adds certification tests for the Azure Service Bus Queue
Input/Output binding. This utilizes the new certification framework
and performs a series of tests as described in the test plan readme.

The general purpose of these tests is to serve as an integration test
and as such requires an actual Azure Service Bus connection and a
Dapr sidecar.

https://github.com/dapr/components-contrib/issues/957

* Add to github workflow and fix formatting

* Fix dependencies

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-12-06 11:20:53 -08:00
Amit Mor 4918900c09
AWS PubSub SNS/SQS - FIFO support + refactoring (#1312)
* bugfix for sns topic deletion upon termination

* removed upstream github workflow files

* wrapping errors

* fifo and naming sanitization

* fifo and name santization tests

* component carrying id

* Update snssqs.go

removed unneeded import

* Update snssqs.go

* add missing github actions file

* linting

* fix go.mod

* schedule yml file

* const max lenght, bugfix in ack

* dapr bot schedule

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-30 10:52:00 -08:00
Ian Luo b86128396b
upgrade dapr's version to fix go mod tidy issue in tests/certification #1319 (#1349) 2021-11-30 02:53:52 -08:00
Bernd Verst 4bbc1d2335
Ignore go.work for Go 1.18 Workspaces (#1324)
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-29 13:06:48 -08:00
Bernd Verst 175b09ea40
Adds retry on CosmosDB Init in case of TooManyRequests error (#1329)
* Adds retry on CosmosDB Init in case of TooManyRequests error

* Use backoff v4

* missed some permanent errors

* clean up go.mod

* fix error type casting

* Add constant for HTTP 429
2021-11-29 12:05:43 -08:00