Commit Graph

57 Commits

Author SHA1 Message Date
Bernd Verst 98742f7b1b
Merge branch 'master' into workflow-dev 2022-10-24 14:35:40 -07:00
Alessandro (Ale) Segala 04242ce38a
New PubSub component: Azure Service Bus Queues (#2211)
* Implementation for Azure Service Bus Queue pubsub component

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed syntax errors in unused files

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Moved components to subfolders and enabled conf tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-10-24 14:07:23 -07:00
Ryan Lettieri d3bdfa5281
Merge branch 'master' into workflow-dev
Signed-off-by: Ryan Lettieri <67934986+RyanLettieri@users.noreply.github.com>
2022-09-12 10:27:18 -06:00
amulyavarote 57e4ca0f29
Added postgres conformance test for binding (#2034)
* Added postgres conformance test for binding

Signed-off-by: Amulya Varote <amulyavarote@microsoft.com>

* Added quotations to the connection string

Signed-off-by: Amulya Varote <amulyavarote@microsoft.com>

* Added postgres docker for bindings

Signed-off-by: Amulya Varote <amulyavarote@microsoft.com>

* Changes based on the review comment

Signed-off-by: Amulya Varote <amulyavarote@microsoft.com>

Signed-off-by: Amulya Varote <amulyavarote@microsoft.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-08-30 12:06:40 -07:00
Tiago Alves Macambira b84adbf03a Conformance tests for Hashicorp Vault.
This PR adds conformance tests for Hashicorp Vault secret store component.
This will help brining this component to stable status.

This addresses (but does not fix) #1926.

Signed-off-by: Tiago Alves Macambira <tmacam@burocrata.org>
2022-08-29 21:26:51 -07:00
Bernd Verst 587156bead
Enable conformance tests for rethink db. Make it Beta. Remove Etag feature. (#2015)
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-08-26 09:04:19 -07:00
Bernd Verst e87cd5e4cb
Go 1.19 support and linter fixes (#1975)
* Go 1.19 support and linter fixes

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update workflows for Go1.19 and new linter version

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Remove unnecessary space in nolint directive

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* disable additional linters which aren't used because of Go generics

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* enable gosec linter again

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update bindings/zeebe/command/publish_message_test.go

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update bindings/output_binding.go

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Use prepared statement for mysql table creation

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Ping is not ping

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* c'mon linter

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Fix MySQL gosec issue

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* revert mysql to be fixed later

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-08-18 00:45:23 -07:00
qiangmzsx 79a3cd990a
Removing the use of the ioutil package And Fix CVE-2021-42576 (#1954)
* fix CVE-2021-42576

Signed-off-by: qiangmzsx <qiangmzsx@gmail.com>

* Removing the use of the ioutil package

Signed-off-by: qiangmzsx <qiangmzsx@gmail.com>

* Update middleware/http/nethttpadaptor/nethttpadaptor.go

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: qiangmzsx <qiangmzsx@gmail.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-08-10 13:45:00 -07:00
Bernd Verst e818de3590
Enable conformance test for memcached state store (#1949) 2022-08-09 16:12:33 -07:00
Ryan Lettieri 7233fefcb3 Initial creation of workflows building block
Signed-off-by: Ryan Lettieri <ryanLettieri@microsoft.com>
2022-08-01 11:55:01 -06:00
amulyavarote e639685e83
Added conformance tests for rabbitmq bindings (#1910)
* Added conformance tests for rabbitmq bindings

Signed-off-by: Amulya Varote <amulyavarote@microsoft.com>

* Fixing lint issues

Signed-off-by: Amulya Varote <amulyavarote@microsoft.com>
2022-07-31 12:31:57 -07:00
ItalyPaleAle 05a8dbb75b Added conformance test for Azure Blob Storage state store
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-07-07 15:50:22 -07:00
Bernd Verst f25b26fc0c
Upgrade to Azure Table Storage Track 2 SDK in State Store and add CosmosDB Table API support (#1792)
* Upgrade to Azure Table Storage Track 2 SDK in State Store

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* make modtidy-all

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* don't panic

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* fix error parsing

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Adds support for empty rowKeys again

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Pin aztables v1.0.1

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add support for Cosmos DB Table API

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add Azure Table Storage CosmosDB conformance test

Signed-off-by: GitHub <noreply@github.com>

* Address code review

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Create Table Storage State store subtests

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Address linter issue

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* context instead of ctx

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* load state store in conf tests

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* use cosmosDB mode in cosmosDB test

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add Azure AD support for Table Storage

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* remove shadow declaration

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* make accountKey optional

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add options to skip table creation

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-06-17 14:04:53 -07:00
Ricardo Corrêa 4d44c2f04f
StateStore API implementation for CockroachDB (#1559)
* statestore for CockroachDB

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* Upgrade nacos sdk version to meet compliance (#1547)

* Upgrade nacos version

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Run go mod tidy all

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Add MaxSize to settings

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* conformance tests for CockroachDB

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* fix comment for internalNew func (CockroachDB)

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* remove metadata from log (CockroachDB)

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* removed unnecessary nil fields from GetResponse

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* Fix ordering in transaction API for CockroachDB

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* fix non-deterministic etag error (CockroachDB)

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* fix error message for delete operation without key (CockroachDB)

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

Co-authored-by: Shubham Sharma <shubhash@microsoft.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Co-authored-by: Taction <zchao9100@gmail.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Looong Dai <long.dai@intel.com>
2022-03-22 08:24:14 -07:00
Amit Mor 736730e55a
conformance tests for AWS pubsub SQS SNS (#1394)
* conformance tests

Signed-off-by: Amit Mor <amit.mor@hotmail.com>

* latest localstack. snssqs to conformance list

Signed-off-by: Amit Mor <amit.mor@hotmail.com>

Co-authored-by: Mukundan Sundararajan <musundar@microsoft.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-01-07 11:34:44 -08:00
Dmitry Shmulevich c7adb917f3
update license to Apache v2.0 (#1406) 2022-01-04 19:53:31 -08:00
mbimbij 1389ae5937
Fix cassandra statestore error - "Bind variables cannot be used for table names" - Introduce `fmt.Sprintf` where applicable (#1388)
* - Introduce `fmt.Sprintf` where applicable
- Add conformance test for cassandra component.

Signed-off-by: mbimbij <joseph.mbimbi@gmail.com>

* Start cassandra via docker-compose for its conformance test

Signed-off-by: mbimbij <joseph.mbimbi@gmail.com>

* Apply `go fmt` on `tests/conformance/common.go` as part of PR correction

Signed-off-by: mbimbij <joseph.mbimbi@gmail.com>
2021-12-26 21:35:02 -08:00
Ian Luo 117408f76d
add state conformance test for postgresql #1117 (#1118)
* add state conformance test for postgresql #1117

* make postgresql pass comformance test

* include postgresql to github's workflow

* add newline at end of file for Linux text file

* enhance return

* add newline at end of file for valid Linux text file

* fix lint issue

* handle byte[] in special way so that to stick to json type in DB

* use jsonb instead of json

* fix lint issue

* doesn't allow "", a special case

* enhance assertEquals

* remove unused 'expectedReadResponse' to fix lint issue

* go fmt to fix lint issue

* fix lint issue

Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>
Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Long Dai <long.dai@intel.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-10-21 14:56:14 -07:00
Bernd Verst 93e3b5ddc9 enable akv serviceprincipal auth conformance test 2021-10-19 17:39:36 -07:00
Bernd Verst 342fbde8cd Integration test setup for AKV 2021-10-19 17:39:36 -07:00
Bernd Verst 2bd3d22b91
Cosmos DB Output Binding - Conformance & Progress towards GA (#1180)
* cosmosdb binding - not as flexible as I'd like

conformance tests now pass

* add tests for new UUID injection logic

* Use nested property as partition key value

* avoid repeated string constants

* Disable Identification Hydrator to avoid struct requirement

* Remove struct

* Simplify PR

* Add comments ofor code maintenance
2021-10-12 10:47:36 -07:00
Simon Leet 9f77037de2
Add state.sqlserver conformance test against Azure SQL (#1182)
* Add Azure SQL to setup-azure-conf-test.sh

* Add state.sqlserver conformance test on Azure SQL

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-10-06 12:33:50 -07:00
Bernd Verst d2580bcf51 tablestorage conformance WIP 2021-09-21 16:33:04 -07:00
Long Dai 988fed05ab
ci: standard linter config (#1102)
* ci: standard linter config

Signed-off-by: Long <long.dai@intel.com>

* Update utils.go

* fix pulsar issue

Signed-off-by: Long <long.dai@intel.com>

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-09-21 15:21:59 -07:00
Ian Luo b208d80055
Add mysql conformance test (#1124)
* Add mysql conformance test and fix mysql state to make it pass the test #1122

* remove unused code

* add newline at end of Linux text file

* enhance setValue and relevant unit tests

* fix lint issue

* fix lint issue
2021-09-11 08:00:25 -07:00
Manuel Riezebosch 18cbe25e4e
feat(pubsub): add in-memory pub/sub (#1106) 2021-09-02 17:31:17 -07:00
Simon Leet 9bcf71d62a
Add conformance test for influx bindings (#1115)
- Add `OutputData` property to bindings conformance test `TestConfig`.
  This is necessary to accommodate bindings like influx, cosmosdbgraph,
  alibaba.table and other bindings that require a specific data format.

- Add docker-compose definition and conformance test configuration for
  influx binding.

- Add influx bindings to conformance test workflow matrix.
2021-09-02 09:28:58 -07:00
Jaime Piña f4a5722806
Add JetStream support (#1101)
* Add JetStream support

* Add conformance tests

* Fix lint

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2021-09-01 11:50:16 -07:00
Bernd Verst 059dc8c0d2
Conformance tests & bugfixes for SQLServer (#1078)
* enable sqlserver conformance test

* Update SQL Server conformance test setup

* Fix sqlserver bug introduced in Go 1.16

* sqlserver almost conformant

* Fix conformance tests and stored procedure

* all sqlserver tests passing

* Minor touchup

* lint

* Remove unnecessary condition

* Add conformance test to GitHub workflow

* remove env variable

* Update stored procedure

* Simplify error handling

* Update state/sqlserver/sqlserver.go

Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>

* Update state/sqlserver/sqlserver.go

Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>

Co-authored-by: Bernd Verst <me@bernd.dev>
Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-08-19 17:47:56 -07:00
Simon Leet dc7ee55e2a
Add Event Hubs pubsub and bindings conformance tests (#1040)
* Add conformance test for EventHubs bindings

* Update EventHubs pubsub to pass conformance tests

- Add conformance tests for Azure EventHubs PubSub component
- Add retry & backoff handling on subscriber handling error to EventHubs
  PubSub component for conformance tests.
- Add cancellation context to Azure EventHubs and update Close() to
  invoke cancel prior to closing the hub, which cleans up both senders
  and receivers.
2021-08-02 18:03:24 -07:00
Long Dai 4ee732e0bd
ci: enable gofumt linter (#887)
Signed-off-by: Long Dai <long0dai@foxmail.com>
2021-05-27 22:21:24 -07:00
Phil Kedy 688df9bda4
Removed dependency on dapr/dapr in favor of dapr/kit. Fixed go mod dependencies afterwards. Go 1.16 in go.mod. Removed accidental log dependency. (#807) 2021-04-19 12:06:10 -07:00
Phil Kedy 08d9ce05cf Fixed linter issue 2021-03-26 11:10:41 -04:00
Phil Kedy bad759f6d8 Adding the mqtt binding to the conformance tests 2021-03-26 11:05:19 -04:00
Phil Kedy a1a0ad2c25
Adding RabbitMQ to the conformance tests (#739)
* Initial pass at adding RabbitMQ to the conformance tests

* Fixing unit tests
2021-03-04 11:56:35 -08:00
Phil Kedy 44d64598b8
Added Hazelcast to conformance tests and retry to prevent message loss (#724) 2021-03-03 13:08:58 -08:00
Phil Kedy 715cc8d688
Refactored conformance tests to use a new config package (#712)
* Refactored the conformance tests to use a new config package
Removed dependency on k8s apimachinery sets

* Comment tweak

* Renamed kit package to internal
2021-03-01 13:03:39 -08:00
Phil Kedy e8efbca072
Add MQTT pubsub to the conformance tests (#721)
* Add MQTT pubsub to the conformance tests

* Making the MQTT pubsub component conformance test against multiple brokers
2021-02-25 18:16:23 -08:00
Phil Kedy 4a0011bcbd
Improve conformance tests and add pulsar (#702)
* Improve conformance tests and add pulsar

* Fix linter error

* Fix linter errors

* Tweaks to pulsar pubsub per PR

* Switching uuid import

* Using Stringer interface to print message keys as base64 in logger

* Disabling some checks w/ Redis pubsub until the component can be enhanced

* Adding comment to eventually remove the simulateErrors option

* Add comment asBase64String to explain what it does

* Adding redelivery (reclaims) to the Redis pubsub component
Removed the temporary simulateErrors flag now that Redis is passing

* Fixing linter issues

* using a wait group instead of a sleep to wait for processing to complete

* More comments and refactoring

* comment tweaks

* Tweaks per PR

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-02-23 13:31:52 -08:00
Artur Souza c4a7f0bae1 Merge remote-tracking branch 'upstream/release-1.0' into merge_release_master 2021-02-17 15:23:42 -08:00
Artur Souza 13051e2197
Adds conf test for natsstreaming. (#690) 2021-02-12 08:09:50 -08:00
Artur Souza dd3e463b52
Fix pubsub retry for Kafka (#688)
* Add conformance test for kafka pubsub + quickfix for Kafka error handling.

* Adding backoff/retry logic to the Kafka pub/sub component

* Add logic to return if error from backoff in kafka.

* Addressing PR comments and lint.

Co-authored-by: Phil Kedy <phil.kedy@gmail.com>
2021-02-12 00:08:46 -08:00
Nghia Tran 724473462b
Run conformance tests for Kuberentes secret store (#673)
* Run K8s secret store tests

* Add workaround for https://github.com/golang/go/issues/40795

* Add clarity to the hack
2021-02-11 14:40:32 -08:00
Yaron Schneider 3ef025c604
change headers (#679) 2021-02-09 18:57:55 -08:00
Phil Kedy e6924c6d7b
Improving the versatility of the HTTP output binding (#661)
* no message

* Removing HTTP input binding from conformance test

* Moving // nolint: noctx

* Fixed linter issue

* Tweaks

* Tweak

* Setting request headers from metadata

* More comments and handling of non-200 response codes

* Fixing conformance test for HTTP

* Temporarily bumping up redis timeouts

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Charlie Stanley <charlie.stanley@microsoft.com>
2021-02-09 12:02:47 -08:00
Nghia Tran 33af2809e2
Add Azure Keyvault secret store (#654)
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-02-07 18:23:50 -08:00
Artur Souza 795b62417e
Add verbosity to conf tests. More debug logging in eventgrid binding. (#662) 2021-02-05 17:41:06 -08:00
Artur Souza a020fd0f27
Adds conf test for Azure Event Grid. (#659) 2021-02-05 15:05:48 -08:00
halspang 13092f20df
Add Azure Service Bus Queues binding to tests (#651)
https://github.com/dapr/components-contrib/issues/619

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-02-04 15:21:38 -08:00
halspang 6f31e9f14f
Add http input/output bindings test (#637)
* Refactor bindings and introduce input bindings

This commit adds Kafka output bindings tests and refactors the
general bindings tests to include input and output bindings in
the same set of tests. Azure Storage Queues are used as the
first input binding.

* Add http input/output bindings test

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-01-29 13:00:09 -08:00