Commit Graph

255 Commits

Author SHA1 Message Date
ItalyPaleAle 2446a698cb Renamed KV -> Workers KV to be consistent with branding
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-19 17:35:53 +00:00
ItalyPaleAle d50ad603be Merge branch 'master' of https://github.com/dapr/components-contrib into cfqueues-binding 2022-12-19 17:33:19 +00:00
Marcos Candeia d680006c33
Allow bindings conformance tests for uninitialized components (#2348)
Signed-off-by: Marcos Candeia <marrcooos@gmail.com>

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-12-19 09:26:24 -08:00
addjuarez c096a8586f Merge branch 'master' into certInfrastructure 2022-12-18 20:35:48 -06:00
seachen 5dda098868 feature: add context to lock&pubsub API
Signed-off-by: seachen <seachen@tencent.com>
2022-12-19 09:11:53 +08:00
Mukundan Sundararajan b7817c0ee7 Merge branch 'master' into optimize-bulkpubres-struct 2022-12-17 11:05:39 +05:30
Bernd Verst adc7bd8ca5
Merge branch 'master' into cfqueues-binding
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-12-16 14:46:03 -08:00
Bernd Verst 3e08736911
Add support for Redis 7 in all Dapr Components (#2228)
* Add support for Redis 7

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add Redis 7 to conformance tests

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* automatically detect redis version, make redis7 state conformant

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Additions for REDIS without JSON support

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Return helpful query API error when missing redis-json

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Change Redis 7 port for conformance test

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Fix nil reference

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Update Redis7 port

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Enable ContextTimeoutEnabled for Redis v9 client

Co-Authored-By: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Add timeouts, address code review

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add another timeout

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Redis: so much more context

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* modtidy

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* fix issue from latest merge

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* modtidy

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add generic redis nil error

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* fix redis version check

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* upgrade redis v9 client

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Remove flaky redis v7 pubsub conformance test

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* modtidy

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-16 14:12:11 -08:00
addjuarez fb9e0bdbf1
Merge branch 'master' into certInfrastructure 2022-12-15 13:49:01 -06:00
addjuarez dfd00d4152 rework comformance
Signed-off-by: addjuarez <6789375+addjuarez@users.noreply.github.com>
2022-12-15 19:48:09 +00:00
seachen e59dfd63c0 feature: add context to lock&pubsub API
Signed-off-by: seachen <seachen@tencent.com>
2022-12-14 19:37:24 +08:00
Mukundan Sundararajan 4b1bb38820 Merge branch 'master' into optimize-bulkpubres-struct 2022-12-14 10:52:40 +05:30
ItalyPaleAle ab10db95dd 💄
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-14 01:33:04 +00:00
ItalyPaleAle 717bfcf23a Enabled conf tests for state.cloudflare.kv
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-14 00:34:09 +00:00
ItalyPaleAle a1c863d7fd Small fixes
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-13 10:11:36 -08:00
Mukundan Sundararajan 2b61b61dad use slices contains function from import
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
2022-12-13 21:23:06 +05:30
Mukundan Sundararajan 72695529f6 optimize bulk pub response to contain only failed entries
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
2022-12-13 11:49:04 +05:30
1046102779 2dd7433a59 feature: add context to state API
Signed-off-by: 1046102779 <seachen@tencent.com>
2022-12-08 15:56:51 +08:00
Sarthak Sharma 0e0cf8fe58
Add certification tests for Cron Binding (#2191)
* fix typos

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add basic tests

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* update tests

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add Readme

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* update mod file

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add entry in workflow

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add conformance test

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add conformance tests to workflow

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* use watcher to assert

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* update readme

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* fix linting

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* Apply suggestions from code review

Co-authored-by: Shubham Sharma <shubhash@microsoft.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* change to dapr/go-sdk from hunter007/dapr-go-sdk

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* fix cron delete operation

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add check if cron not triggered after delete

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* update README

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* parameterise application and assertions

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* use mock clock for cron

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* change cron to input only binding

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add forked cron library to internal/cron

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* use cron internal fork for binding

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* resolve comments

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* resolve comments

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add test matrix to test various schedules

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* add cron init unit tests

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* resolve comments

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* fix linting

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* fix linting

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* go modtidy all

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* go modtidy

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* move cron fork to dapr/kit

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

* use pinned v0.0.3 for dapr/kit

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>

Signed-off-by: Sarthak Sharma <sartsharma@microsoft.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Shubham Sharma <shubhash@microsoft.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-12-02 02:30:01 -08:00
Alessandro (Ale) Segala bd76503d27
Merge branch 'master' into ttl-conf-tests 2022-11-21 21:56:37 -08:00
Alessandro (Ale) Segala 4dde34c2d1
Fix state.in-memory and enable conformance tests (#2303)
* Fix state.in-memory and enable conf tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed unit tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* 💄

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-11-21 21:53:51 -08:00
ItalyPaleAle 4d4b98d339 Add conformance test for TTL in state stores
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-11-22 04:33:47 +00:00
Ryan Lettieri deb647c241 Updating workflows request struct
Signed-off-by: Ryan Lettieri <ryanLettieri@microsoft.com>
2022-11-14 12:39:35 -07:00
Ryan Lettieri 4ebe7ea400
Merge branch 'dapr:master' into master 2022-11-14 10:10:02 -07:00
Ryan Lettieri 9d39e9ee87 Adding in optional parameter for a namespace into temporal
Signed-off-by: Ryan Lettieri <ryanLettieri@microsoft.com>
2022-11-12 11:04:32 -07:00
KubeMQ adb840bb84
Merge branch 'dapr:master' into master 2022-11-11 23:34:39 +02:00
Bernd Verst 462e2faadc Upgrade linter and fix linter issues
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-11-11 13:19:57 -08:00
Lior Nabat a47d8f87dd Adding KubeMQ Binding - Queue
Signed-off-by: Lior Nabat <lior.nabat@gmail.clom>
2022-11-11 16:03:25 +02:00
Bernd Verst bfc482d3e4 Merge remote-tracking branch 'upstream/master' into kubemq-io/master 2022-11-02 15:14:33 -07:00
1046102779 5a350f1dd6 Merge branch 'master' into feature/state_context1021 2022-11-01 09:23:57 +08:00
ItalyPaleAle c4b63b3975 Run conf tests for state.mysql against MariaDB too
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-10-31 19:48:11 +00:00
Ryan Lettieri 79ba329b3e Fixed typo for workflows test function
Signed-off-by: Ryan Lettieri <ryanLettieri@microsoft.com>
2022-10-24 21:55:34 -06:00
1046102779 b42d9ab730 feature: add context to state API
Signed-off-by: 1046102779 <seachen@tencent.com>
2022-10-25 07:26:56 +08:00
Alessandro (Ale) Segala 04242ce38a
New PubSub component: Azure Service Bus Queues (#2211)
* Implementation for Azure Service Bus Queue pubsub component

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed syntax errors in unused files

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Moved components to subfolders and enabled conf tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-10-24 14:07:23 -07:00
Lior Nabat bed3d69a6f Add new PubSub component - KubeMQ Kubernetes message broker 2022-10-22 18:51:11 +03:00
Bernd Verst 98742f7b1b
Merge branch 'master' into workflow-dev 2022-10-24 14:35:40 -07:00
Ryan Lettieri d7ef6d41bc Updating responses from workflows building block to be more generic
Signed-off-by: Ryan Lettieri <ryanLettieri@microsoft.com>
2022-10-21 23:58:48 -06:00
1046102779 08f665cb83 feature: add context to state API
Signed-off-by: 1046102779 <seachen@tencent.com>
2022-10-21 21:05:47 +08:00
1046102779 5a367b401a feature: add context to state API
Signed-off-by: 1046102779 <seachen@tencent.com>
2022-10-21 17:25:14 +08:00
Ryan Lettieri 21cbd928e8 Merged in changes from master into workflows
Signed-off-by: Ryan Lettieri <ryanLettieri@microsoft.com>
2022-10-10 09:44:27 -06:00
Deepanshu Agarwal f74b4d648d Update EntryID to EntryId
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
2022-09-29 15:49:45 +05:30
deepanshuagarwal bcd101abad
Keys rename (#2135)
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
2022-09-28 09:52:59 -07:00
Shubham Sharma 4f406a597f
Add bulk subscribe support to Azure Service Bus (#2100)
* Initial implementation

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* 

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Add tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Add comment

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor messages.go and add tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update message tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor servicebus.go logic

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor handleAsync

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Refactor ReceiveAndBlock

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update binding

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Review comments addressed

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Lint

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update metadata name

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update activeMessagesChan logic for concurrency control

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Fix tests

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Update metadata name

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Use request metadata instead of component metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Review comments addressed

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Fix merge issue with metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Remove unused metadata key

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Fix merge issue with metadata

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Lint!!!

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
2022-09-23 10:49:06 -07:00
deepanshuagarwal 8500da577c
Conf test for Bulk Subscribe and Kafka fixes (#2113)
* Conf test for Bulk Sub and Kafka Fixes

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Fix linting

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Incorporating comments

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
2022-09-23 09:54:21 -07:00
Mukundan Sundararajan e1697ba115 Merge branch 'master' into feature/pubsub-batching 2022-09-23 06:47:47 +05:30
Mukundan Sundararajan db0ace71bc address review comments
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
2022-09-22 13:30:56 +05:30
Mukundan Sundararajan fffb91aed6 fix skipping bulk publish scenario
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
2022-09-21 14:06:07 +05:30
Mukundan Sundararajan 0f185d9e38 add conf test for bulk publish
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
2022-09-21 12:10:51 +05:30
Mukundan Sundararajan a45f7db8b2 add bulkpublish-conf-test
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
2022-09-21 11:46:46 +05:30
Dapr Bot 7fced084f8
Merge branch 'master' into workflow-dev 2022-09-14 15:31:59 -07:00
yellow chicks 57b5acc1cb
feature(secretstore): add context to api and tencent/ssm (#1973)
* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* Add Features list to Tencent SSM

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* pin custom dapr in cert tests for bindings context change

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* feature(secretstore): add context to api and tencent/ssm

Signed-off-by: 1046102779 <seachen@tencent.com>

* optimize(middleware): Middleware to middleware.Middleware API

Signed-off-by: 1046102779 <seachen@tencent.com>

* fix pinning of custom dapr in cert tests

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update cassandra cert test with new secretstore context

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* modtidy again

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: 1046102779 <seachen@tencent.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-09-14 15:18:12 -07:00
Ryan Lettieri a193af3abb Fixed linter errors in workflows
Signed-off-by: Ryan Lettieri <ryanLettieri@microsoft.com>
2022-09-12 15:49:26 -06:00
Ryan Lettieri 50473bfccf Addressing more review comments from workflows building block review
Signed-off-by: Ryan Lettieri <ryanLettieri@microsoft.com>
2022-09-12 15:19:32 -06:00
Ryan Lettieri d3bdfa5281
Merge branch 'master' into workflow-dev
Signed-off-by: Ryan Lettieri <67934986+RyanLettieri@users.noreply.github.com>
2022-09-12 10:27:18 -06:00
Ryan Lettieri 1205859e3e Addressing review comments for workflow building block API
Signed-off-by: Ryan Lettieri <ryanLettieri@microsoft.com>
2022-09-08 16:17:19 -06:00
Ryan Lettieri b52df7150a Updates to workflows and temporal for testing and API Changes
Signed-off-by: Ryan Lettieri <ryanLettieri@microsoft.com>
2022-09-02 16:22:28 -06:00
amulyavarote 57e4ca0f29
Added postgres conformance test for binding (#2034)
* Added postgres conformance test for binding

Signed-off-by: Amulya Varote <amulyavarote@microsoft.com>

* Added quotations to the connection string

Signed-off-by: Amulya Varote <amulyavarote@microsoft.com>

* Added postgres docker for bindings

Signed-off-by: Amulya Varote <amulyavarote@microsoft.com>

* Changes based on the review comment

Signed-off-by: Amulya Varote <amulyavarote@microsoft.com>

Signed-off-by: Amulya Varote <amulyavarote@microsoft.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-08-30 12:06:40 -07:00
Tiago Alves Macambira b84adbf03a Conformance tests for Hashicorp Vault.
This PR adds conformance tests for Hashicorp Vault secret store component.
This will help brining this component to stable status.

This addresses (but does not fix) #1926.

Signed-off-by: Tiago Alves Macambira <tmacam@burocrata.org>
2022-08-29 21:26:51 -07:00
Bernd Verst 587156bead
Enable conformance tests for rethink db. Make it Beta. Remove Etag feature. (#2015)
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-08-26 09:04:19 -07:00
Marcos Candeia 8964d8bf41
Define common metadata across components (#1994)
* Add base metadata for all components

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>

* Fix lint issues on consul and mysql tests

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>

* Pin candeia/dapr runtime version

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>

* Add replace directive to use mcandeia/dapr on all go submodules

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>

* Fixed runtime config instantiation

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>

Signed-off-by: Marcos Candeia <marrcooos@gmail.com>
2022-08-25 10:10:53 -07:00
Ryan Lettieri 3066378a62 Updates to workflow requests and responses 2022-08-24 15:14:08 -06:00
Bernd Verst e87cd5e4cb
Go 1.19 support and linter fixes (#1975)
* Go 1.19 support and linter fixes

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update workflows for Go1.19 and new linter version

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Remove unnecessary space in nolint directive

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* disable additional linters which aren't used because of Go generics

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* enable gosec linter again

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update bindings/zeebe/command/publish_message_test.go

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Update bindings/output_binding.go

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Use prepared statement for mysql table creation

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Ping is not ping

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* c'mon linter

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Fix MySQL gosec issue

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* revert mysql to be fixed later

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-08-18 00:45:23 -07:00
Ryan Lettieri a154700b7e Missing workflows file 2022-08-17 14:07:00 -06:00
qiangmzsx 79a3cd990a
Removing the use of the ioutil package And Fix CVE-2021-42576 (#1954)
* fix CVE-2021-42576

Signed-off-by: qiangmzsx <qiangmzsx@gmail.com>

* Removing the use of the ioutil package

Signed-off-by: qiangmzsx <qiangmzsx@gmail.com>

* Update middleware/http/nethttpadaptor/nethttpadaptor.go

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: qiangmzsx <qiangmzsx@gmail.com>
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-08-10 13:45:00 -07:00
Bernd Verst e818de3590
Enable conformance test for memcached state store (#1949) 2022-08-09 16:12:33 -07:00
Ryan Lettieri 7233fefcb3 Initial creation of workflows building block
Signed-off-by: Ryan Lettieri <ryanLettieri@microsoft.com>
2022-08-01 11:55:01 -06:00
amulyavarote e639685e83
Added conformance tests for rabbitmq bindings (#1910)
* Added conformance tests for rabbitmq bindings

Signed-off-by: Amulya Varote <amulyavarote@microsoft.com>

* Fixing lint issues

Signed-off-by: Amulya Varote <amulyavarote@microsoft.com>
2022-07-31 12:31:57 -07:00
Alessandro (Ale) Segala d38c786771
Add contexts to input bindings (#1831)
This is the last part of the "shutdown sequence fix": it allows shutting down input bindings before output ones.

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-07-12 12:19:27 -07:00
ItalyPaleAle 12d2e7852c Added more logging to state conformance tests
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-07-07 15:50:22 -07:00
ItalyPaleAle 05a8dbb75b Added conformance test for Azure Blob Storage state store
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-07-07 15:50:22 -07:00
ItalyPaleAle a021fb5f9d Track out-of-order messages only on first retry
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-06-27 20:36:15 +00:00
Bernd Verst f25b26fc0c
Upgrade to Azure Table Storage Track 2 SDK in State Store and add CosmosDB Table API support (#1792)
* Upgrade to Azure Table Storage Track 2 SDK in State Store

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* make modtidy-all

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* don't panic

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* fix error parsing

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Adds support for empty rowKeys again

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Pin aztables v1.0.1

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add support for Cosmos DB Table API

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add Azure Table Storage CosmosDB conformance test

Signed-off-by: GitHub <noreply@github.com>

* Address code review

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Create Table Storage State store subtests

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Address linter issue

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* context instead of ctx

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* load state store in conf tests

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* use cosmosDB mode in cosmosDB test

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add Azure AD support for Table Storage

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* remove shadow declaration

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* make accountKey optional

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add options to skip table creation

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-06-17 14:04:53 -07:00
deepanshuagarwal a0ef46265b
Adding Pinger interface and Removing mandatory nature of Ping fuction (#1784)
* add `Pinger` interface.

Signed-off-by: chanyong.moon <dev.chanyongmoon@gmail.com>

* Convert Ping fuction to optional

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Removing unrequired Ping implementations

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

* Addressing comments

Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>

Co-authored-by: chanyong.moon <dev.chanyongmoon@gmail.com>
2022-06-14 08:27:54 -07:00
Alessandro (Ale) Segala 704f4dd730
Add contexts to pubsub.Subscribe to allow early cancelation (#1756)
This commit is related to dapr/dapr#4624. As noted there, we have an issue in the runtime where all components are shut down after the grace period, when the app is likely already stopped. Because of that, certain input components (the subscribe part of pubsub and the input part of bindings - the latter not in scope of this PR), can continue bringing new work when it's known to fail.

In order to fix the issue linked above properly, we need to implement a way for PubSub components to have the "publish" part closed before the "subscribe" one (and in the future that will need to be done for input bindings too).

This commit achieves precisely that by adding a context in the Subscribe method. When that context is canceled (which can be at any time), the subscription is removed.

PS: This API change was implemented so it can one day be used for dapr/dapr#814 too, as it allows canceling individual subscriptions by using a different context. Although that's not possible today because it requires more work on the runtime, it does implement everything that's needed in the pubsub components already.
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-06-02 15:06:36 -07:00
Alessandro (Ale) Segala 7c35a4e04c
Added test for multiple pubsub handlers (#1743)
* Added test for multiple pubsub handlers

This patch adds conformance tests for PubSub with multiple handlers, each listening on a different topic.

It's meant to catch issues such as #1709

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Added missing go.mod for storagequeues binding test

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-06-02 10:22:15 -07:00
pigletfly 5673b28b13 Add context in bindings interface
Signed-off-by: pigletfly <wangbing.adam@gmail.com>
2022-04-25 14:16:15 +08:00
Ricardo Corrêa 4d44c2f04f
StateStore API implementation for CockroachDB (#1559)
* statestore for CockroachDB

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* Upgrade nacos sdk version to meet compliance (#1547)

* Upgrade nacos version

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Run go mod tidy all

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>

* Add MaxSize to settings

Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* conformance tests for CockroachDB

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* fix comment for internalNew func (CockroachDB)

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* remove metadata from log (CockroachDB)

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* removed unnecessary nil fields from GetResponse

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* Fix ordering in transaction API for CockroachDB

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* fix non-deterministic etag error (CockroachDB)

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* fix error message for delete operation without key (CockroachDB)

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

Co-authored-by: Shubham Sharma <shubhash@microsoft.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
Co-authored-by: Taction <zchao9100@gmail.com>
Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Co-authored-by: Looong Dai <long.dai@intel.com>
2022-03-22 08:24:14 -07:00
Mukundan Sundararajan 22d8bb2ab9 unexport struct
Signed-off-by: Mukundan Sundararajan <msundar.ms@outlook.com>
2022-03-16 09:15:58 +05:30
Mukundan Sundararajan 9545d8204d
Merge branch 'master' into fix-mongodb-canonical 2022-03-16 09:06:40 +05:30
Mukundan Sundararajan 83914e8eed marshall mongodb bson into relaxed json
Signed-off-by: Mukundan Sundararajan <msundar.ms@outlook.com>
2022-03-16 02:21:53 +05:30
Shubham Sharma f4ad3bb5e3 Add conf test for transaction ordering
Signed-off-by: Shubham Sharma <shubhash@microsoft.com>
2022-03-03 12:47:01 +05:30
Dmitry Shmulevich f819b290f7
redis state store: implement state query API (#1488)
Signed-off-by: Dmitry Shmulevich <dmitry.shmulevich@gmail.com>
2022-03-02 10:51:09 -08:00
Dmitry Shmulevich 7fdebda09b
state store query API: remove preceding '.' in key names (#1500)
Signed-off-by: Dmitry Shmulevich <dmitry.shmulevich@gmail.com>
2022-02-11 15:00:43 -08:00
Dmitry Shmulevich 1cb659c0b8
update conformance tests (#1492)
Signed-off-by: Dmitry Shmulevich <dmitry.shmulevich@gmail.com>
2022-02-09 17:58:48 -08:00
Ricardo Corrêa 8297fc929b
Query StateStore API implementation for PostgreSQL StateStore (#1457)
* query state integration with dbaccess (postgresql)

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* query state integration with postgresql component

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* query state for postgresql

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* fix: linter error 'rowserrcheck'

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* query state integration with dbaccess (postgresql)

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* query state integration with postgresql component

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* fix: linter error 'rowserrcheck'

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* fix: linter error 'goimports -ed with -local github.com/dapr/'

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* performance improvementt in PosgreSQL Query API

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

* added conformance test for PostgreSQL Query API

Signed-off-by: Ricardo Corrêa <r.c.correa@outlook.com>

Co-authored-by: Looong Dai <long.dai@intel.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
2022-02-02 18:14:18 -08:00
Amit Mor 736730e55a
conformance tests for AWS pubsub SQS SNS (#1394)
* conformance tests

Signed-off-by: Amit Mor <amit.mor@hotmail.com>

* latest localstack. snssqs to conformance list

Signed-off-by: Amit Mor <amit.mor@hotmail.com>

Co-authored-by: Mukundan Sundararajan <musundar@microsoft.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2022-01-07 11:34:44 -08:00
Dmitry Shmulevich c7adb917f3
update license to Apache v2.0 (#1406) 2022-01-04 19:53:31 -08:00
mbimbij 1389ae5937
Fix cassandra statestore error - "Bind variables cannot be used for table names" - Introduce `fmt.Sprintf` where applicable (#1388)
* - Introduce `fmt.Sprintf` where applicable
- Add conformance test for cassandra component.

Signed-off-by: mbimbij <joseph.mbimbi@gmail.com>

* Start cassandra via docker-compose for its conformance test

Signed-off-by: mbimbij <joseph.mbimbi@gmail.com>

* Apply `go fmt` on `tests/conformance/common.go` as part of PR correction

Signed-off-by: mbimbij <joseph.mbimbi@gmail.com>
2021-12-26 21:35:02 -08:00
RainFD 870fedb8a0
fix binding list test (#1317)
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-12-14 14:19:23 -08:00
Dmitry Shmulevich 3c52b73608
fixed typo in Query JSON (#1344) 2021-11-29 09:44:28 -08:00
Simon Leet dfb9e90ede Add more tracing to bindings conformance tests 2021-10-26 23:28:08 +00:00
Ian Luo 117408f76d
add state conformance test for postgresql #1117 (#1118)
* add state conformance test for postgresql #1117

* make postgresql pass comformance test

* include postgresql to github's workflow

* add newline at end of file for Linux text file

* enhance return

* add newline at end of file for valid Linux text file

* fix lint issue

* handle byte[] in special way so that to stick to json type in DB

* use jsonb instead of json

* fix lint issue

* doesn't allow "", a special case

* enhance assertEquals

* remove unused 'expectedReadResponse' to fix lint issue

* go fmt to fix lint issue

* fix lint issue

Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>
Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Long Dai <long.dai@intel.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-10-21 14:56:14 -07:00
Dmitry Shmulevich f96a71e4d7
add metadata to query request/response (#1215) 2021-10-20 17:22:42 -07:00
Bernd Verst 93e3b5ddc9 enable akv serviceprincipal auth conformance test 2021-10-19 17:39:36 -07:00
Bernd Verst 342fbde8cd Integration test setup for AKV 2021-10-19 17:39:36 -07:00
Dmitry Shmulevich e369fec17e
Add StateStore query API (#1153)
Add StateStore query API implementation for MongoDB, CosmosDB
2021-10-18 13:55:26 -07:00
Bernd Verst 2bd3d22b91
Cosmos DB Output Binding - Conformance & Progress towards GA (#1180)
* cosmosdb binding - not as flexible as I'd like

conformance tests now pass

* add tests for new UUID injection logic

* Use nested property as partition key value

* avoid repeated string constants

* Disable Identification Hydrator to avoid struct requirement

* Remove struct

* Simplify PR

* Add comments ofor code maintenance
2021-10-12 10:47:36 -07:00
Simon Leet 9f77037de2
Add state.sqlserver conformance test against Azure SQL (#1182)
* Add Azure SQL to setup-azure-conf-test.sh

* Add state.sqlserver conformance test on Azure SQL

Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-10-06 12:33:50 -07:00
Bernd Verst d2580bcf51 tablestorage conformance WIP 2021-09-21 16:33:04 -07:00
Long Dai 988fed05ab
ci: standard linter config (#1102)
* ci: standard linter config

Signed-off-by: Long <long.dai@intel.com>

* Update utils.go

* fix pulsar issue

Signed-off-by: Long <long.dai@intel.com>

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-09-21 15:21:59 -07:00
Ian Luo b208d80055
Add mysql conformance test (#1124)
* Add mysql conformance test and fix mysql state to make it pass the test #1122

* remove unused code

* add newline at end of Linux text file

* enhance setValue and relevant unit tests

* fix lint issue

* fix lint issue
2021-09-11 08:00:25 -07:00
Manuel Riezebosch 18cbe25e4e
feat(pubsub): add in-memory pub/sub (#1106) 2021-09-02 17:31:17 -07:00
Simon Leet 9bcf71d62a
Add conformance test for influx bindings (#1115)
- Add `OutputData` property to bindings conformance test `TestConfig`.
  This is necessary to accommodate bindings like influx, cosmosdbgraph,
  alibaba.table and other bindings that require a specific data format.

- Add docker-compose definition and conformance test configuration for
  influx binding.

- Add influx bindings to conformance test workflow matrix.
2021-09-02 09:28:58 -07:00
Jaime Piña f4a5722806
Add JetStream support (#1101)
* Add JetStream support

* Add conformance tests

* Fix lint

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2021-09-01 11:50:16 -07:00
Bernd Verst c1495037cf
Contributor Docs: Debugging conformance tests (#1079)
* Add conformance test debug instructions

* Update tests/conformance/README.md

Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>

* Update tests/conformance/README.md

Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>

Co-authored-by: Bernd Verst <me@bernd.dev>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-08-26 15:29:14 -07:00
Bernd Verst 059dc8c0d2
Conformance tests & bugfixes for SQLServer (#1078)
* enable sqlserver conformance test

* Update SQL Server conformance test setup

* Fix sqlserver bug introduced in Go 1.16

* sqlserver almost conformant

* Fix conformance tests and stored procedure

* all sqlserver tests passing

* Minor touchup

* lint

* Remove unnecessary condition

* Add conformance test to GitHub workflow

* remove env variable

* Update stored procedure

* Simplify error handling

* Update state/sqlserver/sqlserver.go

Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>

* Update state/sqlserver/sqlserver.go

Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>

Co-authored-by: Bernd Verst <me@bernd.dev>
Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-08-19 17:47:56 -07:00
Simon Leet 796df4dd61
Add Close() function to Azure ServiceBusQueues binding (#1052)
* Add Close() conformance test

* Add Close() to AzureServiceBusQueues binding

* Accept nil on bindings Read Close() test

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-08-13 18:15:39 -07:00
Simon Leet 6c28306b10
Customize sleep in EventGrid bindings conformance test between read and publish (#1050)
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-08-04 14:38:50 -07:00
Long Dai 10a2e5ee85
state: correct FIRST_WRITE (#995)
* state: correct FIRST_WRITE

Signed-off-by: Long Dai <long0dai@foxmail.com>

* add a test case

Signed-off-by: Long <long0dai@foxmail.com>
2021-08-03 17:26:45 -07:00
Simon Leet dc7ee55e2a
Add Event Hubs pubsub and bindings conformance tests (#1040)
* Add conformance test for EventHubs bindings

* Update EventHubs pubsub to pass conformance tests

- Add conformance tests for Azure EventHubs PubSub component
- Add retry & backoff handling on subscriber handling error to EventHubs
  PubSub component for conformance tests.
- Add cancellation context to Azure EventHubs and update Close() to
  invoke cancel prior to closing the hub, which cleans up both senders
  and receivers.
2021-08-02 18:03:24 -07:00
Simon Leet 9c84bd202c
Add automation for deploying Azure conformance test resources (#1001)
* Add automation for deploying Azure conformance test resources

- Add .bicep definitions for Azure deployment of conformance test resources.
- Add setup-azure-conf-test.sh script for deploying .bicep definition and
  configuring other assets needed for the Azure conformance tests:
   - Creates the appropriate service principals and their credentials
     for the test.
   - Populates the key vault with the test parameters and secrets used by
     the GitHub conformance.yml test workflow.
   - Generates a .rc file that can be invoked with `source` to configure
     the local environment variables and secrets for running conformance
     tests described in tests/conformance/README.md.
   - Generates a teardown script that can be used to dispose of the
     deployed Azure resources when done.

* Move setup-azure-conf-test under azure/ subfolder

* Add documentation for Azure conformance test automation

- Add README.md to .github/infrastructure/conformance/azure describing
  use of automation script.
- Update tests/conformance/README.md with reference to Azure
  conformance test infrastructure automation.
- Fix spelling and issues in tests/conformance/README.md reported by
  markdownlint.
2021-07-28 10:06:14 -07:00
Phil Kedy 8e6b36ecdf
Importing the retry and config packages from kit instead of internal (#940)
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-06-22 09:38:55 -07:00
Long Dai 4ee732e0bd
ci: enable gofumt linter (#887)
Signed-off-by: Long Dai <long0dai@foxmail.com>
2021-05-27 22:21:24 -07:00
문찬용 b387fcdff3
add Ping operation to`store` interface. (#757)
* add `Ping` operation.

* add `Ping` implementation of GA components

* add context to an argument for Ping

* add `Ping` implementation of blobstorage

* fix error string for passing lint

* Update blobstorage.go

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-05-25 23:48:46 -07:00
Phil Kedy 6d00917246 pubsub conformance tests: Use a single timer for the duration of the subscribe wait loop 2021-04-22 13:35:45 -04:00
Phil Kedy 688df9bda4
Removed dependency on dapr/dapr in favor of dapr/kit. Fixed go mod dependencies afterwards. Go 1.16 in go.mod. Removed accidental log dependency. (#807) 2021-04-19 12:06:10 -07:00
Artur Souza 3993d9a559
Merge branch 'master' into jjcollinge/pubsub-context 2021-04-08 14:11:01 -07:00
Phil Kedy 08d9ce05cf Fixed linter issue 2021-03-26 11:10:41 -04:00
Phil Kedy bad759f6d8 Adding the mqtt binding to the conformance tests 2021-03-26 11:05:19 -04:00
Joni Collinge 9fd461b255 Merge branch 'master' into jjcollinge/pubsub-context 2021-03-23 17:45:05 +00:00
Yaron Schneider 192461889c
Add app response to input binding event (#764)
* add app response to input binding event

* lint
2021-03-18 14:22:14 -07:00
Artur Souza 931048aa60
Add Feature list for state store. (#744)
* Add Feature list for state store.

* List Transactional as a feature for state store.

* Fixing comments about etag.
2021-03-05 14:55:23 -08:00
Phil Kedy a1a0ad2c25
Adding RabbitMQ to the conformance tests (#739)
* Initial pass at adding RabbitMQ to the conformance tests

* Fixing unit tests
2021-03-04 11:56:35 -08:00
Phil Kedy a15c616bb0
Make state.GetResponse ETag to a *string (#733)
* Make state.GetResponse ETag to a *string

* Small fixes post merge of #716

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-03-03 13:28:59 -08:00
Phil Kedy 44d64598b8
Added Hazelcast to conformance tests and retry to prevent message loss (#724) 2021-03-03 13:08:58 -08:00
halspang cb3c881d39
Add ETag operation to statestore conformance test (#716)
* Add ETag operation to statestore conformance test

ETags are used to enable concurrency guarantees and are part of the
statestore specification. Not all stores need to use them, however
if the store chooses to, it should be part of the certification
process. This commit adds a simple ETag test scenario that verifies
the basic behaviors of ETags.

https://github.com/dapr/components-contrib/issues/711

* Update tests.yml

* Error on mongodb when etag does not match on delete.

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-03-03 12:27:10 -08:00
Phil Kedy 715cc8d688
Refactored conformance tests to use a new config package (#712)
* Refactored the conformance tests to use a new config package
Removed dependency on k8s apimachinery sets

* Comment tweak

* Renamed kit package to internal
2021-03-01 13:03:39 -08:00
Phil Kedy df1d80d411
Conformance Test: PubSub - Ignore already processed messages (#722)
* Conformance Test: PubSub - Ignore already processed messages

* Fixing a race condition in StartHTTPServer
2021-02-26 01:32:00 -08:00
Phil Kedy e8efbca072
Add MQTT pubsub to the conformance tests (#721)
* Add MQTT pubsub to the conformance tests

* Making the MQTT pubsub component conformance test against multiple brokers
2021-02-25 18:16:23 -08:00
Joni Collinge 2ff6ca4302 merge master 2021-02-25 16:15:26 +00:00
Phil Kedy 4a0011bcbd
Improve conformance tests and add pulsar (#702)
* Improve conformance tests and add pulsar

* Fix linter error

* Fix linter errors

* Tweaks to pulsar pubsub per PR

* Switching uuid import

* Using Stringer interface to print message keys as base64 in logger

* Disabling some checks w/ Redis pubsub until the component can be enhanced

* Adding comment to eventually remove the simulateErrors option

* Add comment asBase64String to explain what it does

* Adding redelivery (reclaims) to the Redis pubsub component
Removed the temporary simulateErrors flag now that Redis is passing

* Fixing linter issues

* using a wait group instead of a sleep to wait for processing to complete

* More comments and refactoring

* comment tweaks

* Tweaks per PR

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-02-23 13:31:52 -08:00
Artur Souza c4a7f0bae1 Merge remote-tracking branch 'upstream/release-1.0' into merge_release_master 2021-02-17 15:23:42 -08:00
Mukundan Sundararajan d4c7df42d5
Update conf test readme (#693)
* Update conf test readme

* Update README.md

* address review comments

* Update tests.yml

* Update README.md

* Update README.md
2021-02-16 14:56:01 -08:00
Artur Souza 13051e2197
Adds conf test for natsstreaming. (#690) 2021-02-12 08:09:50 -08:00
Artur Souza dd3e463b52
Fix pubsub retry for Kafka (#688)
* Add conformance test for kafka pubsub + quickfix for Kafka error handling.

* Adding backoff/retry logic to the Kafka pub/sub component

* Add logic to return if error from backoff in kafka.

* Addressing PR comments and lint.

Co-authored-by: Phil Kedy <phil.kedy@gmail.com>
2021-02-12 00:08:46 -08:00
Nghia Tran 724473462b
Run conformance tests for Kuberentes secret store (#673)
* Run K8s secret store tests

* Add workaround for https://github.com/golang/go/issues/40795

* Add clarity to the hack
2021-02-11 14:40:32 -08:00
Artur Souza 2562908dee
Conf state trx + Change mongodb get result for key not found + Fix byte[] in cosmosdb (#680)
* Add state transaction conf test.

* Does not return error for key not found in mongodb.

* Rewrite state conf test.

* Handle []byte in cosmosdb state txn (#664)

Fixes: dapr/dotnet-sdk#579

The issue here is that we had missed the case of pre-marshaled bytes in
the state transaction code path, which would result in the encoding/json
package doing it's normal thing and base64 encoding the data as a JSON
string.

The fix is to use json.RawMessage to avoid that. Turns out this code can
be simplified a bit.

* Fix cosmosdb handling of byte[].

* Fix lint.

* Fix UT for cosmosdb.

* Remove config from state store conf test.

Co-authored-by: Ryan Nowak <nowakra@gmail.com>
2021-02-10 18:15:59 -08:00
Yaron Schneider 3ef025c604
change headers (#679) 2021-02-09 18:57:55 -08:00
Phil Kedy e6924c6d7b
Improving the versatility of the HTTP output binding (#661)
* no message

* Removing HTTP input binding from conformance test

* Moving // nolint: noctx

* Fixed linter issue

* Tweaks

* Tweak

* Setting request headers from metadata

* More comments and handling of non-200 response codes

* Fixing conformance test for HTTP

* Temporarily bumping up redis timeouts

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Charlie Stanley <charlie.stanley@microsoft.com>
2021-02-09 12:02:47 -08:00
Artur Souza 6a26165f92
Increase timeout for conf test + more logging for EventGrid. (#666) 2021-02-07 18:38:49 -08:00
Nghia Tran 33af2809e2
Add Azure Keyvault secret store (#654)
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-02-07 18:23:50 -08:00
Artur Souza 795b62417e
Add verbosity to conf tests. More debug logging in eventgrid binding. (#662) 2021-02-05 17:41:06 -08:00
Artur Souza a020fd0f27
Adds conf test for Azure Event Grid. (#659) 2021-02-05 15:05:48 -08:00
halspang 13092f20df
Add Azure Service Bus Queues binding to tests (#651)
https://github.com/dapr/components-contrib/issues/619

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-02-04 15:21:38 -08:00
halspang aba184f942
Use a channel to block server start before tests (#644)
The http server required for the http binding tests was not up
before the tests began to execute. This change adds a channel to
allow the server to block until it's ready.

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-01-29 18:42:34 -08:00
Mukundan Sundararajan 2a100c05bf
add license header to conf test files (#643) 2021-01-29 16:46:29 -08:00
halspang 6f31e9f14f
Add http input/output bindings test (#637)
* Refactor bindings and introduce input bindings

This commit adds Kafka output bindings tests and refactors the
general bindings tests to include input and output bindings in
the same set of tests. Azure Storage Queues are used as the
first input binding.

* Add http input/output bindings test

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-01-29 13:00:09 -08:00
Mukundan Sundararajan d079beacd3
Refactor conformance tests (#626)
* Fix running output bindings with errors
Refactor tests to make it simpler for go test filtering.
Add get operation for blobstorage binding.

* remove unused code
2021-01-21 19:19:34 -08:00
Mukundan Sundararajan a9aeffbb30
Azure service bus conf tests (#614)
* Add azure service bus conformance tests
Bubble up error on required env var not set

* Update common.go

* Fix running output bindings with errors

* update readme

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-01-21 17:06:33 -08:00
Nghia Tran a9d20c95b6
Conformance tests for MongoDB State Store (#623)
* Tests MongoDB statestore

* Increase test timeout a bit

* Increase durations even more.

* Clarify the mongodb and redis version

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-01-21 11:20:45 -08:00