Commit Graph

565 Commits

Author SHA1 Message Date
Josh van Leeuwen f125940490
oracale: return ttlExpiryTime in GetResponse (#2897)
Signed-off-by: joshvanl <me@joshvanl.dev>
2023-06-08 15:37:58 +00:00
Josh van Leeuwen fa90710794
cosmosdb: return ttlExpiryTime in GetResponse (#2898)
Signed-off-by: joshvanl <me@joshvanl.dev>
2023-06-08 15:34:25 +00:00
Josh van Leeuwen dfc28528b5
dynamodb: return ttlExpiryTime in GetResponse (#2899)
Signed-off-by: joshvanl <me@joshvanl.dev>
2023-06-08 15:32:59 +00:00
Josh van Leeuwen 69a1c01801
mysql: return ttlExpiryTime in GetResponse (#2871)
Signed-off-by: joshvanl <me@joshvanl.dev>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
2023-06-07 20:45:24 +00:00
Josh van Leeuwen 85be43ad5c
memached: if tllInSeconds larger than 30 days, convert to unix timestamp (#2892)
Signed-off-by: joshvanl <me@joshvanl.dev>
2023-06-06 09:19:32 -07:00
Josh van Leeuwen 06defdcc22
memached: if tllInSeconds larger than 30 days, convert to unix timestamp (#2890)
Signed-off-by: joshvanl <me@joshvanl.dev>
2023-06-06 15:45:11 +00:00
Josh van Leeuwen 638b106bdb
inmemory return ttlExpiryTime in GetResponse (#2870)
Signed-off-by: joshvanl <me@joshvanl.dev>
Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
2023-06-06 15:28:08 +00:00
Josh van Leeuwen ff06ae6b33
MongoDB return ttlExpiryTime in GetResponse (#2888)
Signed-off-by: joshvanl <me@joshvanl.dev>
Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
2023-06-06 15:18:06 +00:00
Josh van Leeuwen 1963726043
Postgresql + cockroachDB return `ttlExpiryTime` in `GetResponse` (#2864)
Signed-off-by: joshvanl <me@joshvanl.dev>
Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
2023-06-06 15:14:18 +00:00
Josh van Leeuwen f689322570
sqlite return ttlExpiryTime in GetResponse (#2869)
Signed-off-by: joshvanl <me@joshvanl.dev>
2023-06-06 08:03:44 -07:00
Alessandro (Ale) Segala 899f4407dd
[Metadata] Clarify that MySQL components work with MariaDB too (#2866) 2023-05-26 15:19:40 -07:00
Bernd Verst d467890cf8 Merge remote-tracking branch 'upstream/master' into merge-release1.11-master 2023-05-25 10:33:12 -07:00
Bernd Verst 5bb753be94 always use UTC
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-05-25 00:05:04 -07:00
Bernd Verst 5999c2a3d5 fix lint in mongo test
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-05-24 22:57:00 -07:00
Bernd Verst 9d3b070bc4 update test to work in multiple time zones
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-05-24 22:51:49 -07:00
Bernd Verst 1d6d90cea6 fix mongo data type json marshaling
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-05-24 22:16:52 -07:00
Bernd Verst ac20c0a703 Merge remote-tracking branch 'upstream/master' into merge-release-1.11-rc4-into-master 2023-05-17 18:27:42 -07:00
Alessandro (Ale) Segala 1f27fd0e8b
Add conformance tests for etags in Bulk operations (#2843)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2023-05-17 16:28:29 -07:00
Alessandro (Ale) Segala e30d140479
Remove native/transactional BulkSet/BulkDelete from state stores (#2834)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-05-17 14:56:34 -07:00
Tiago Alves Macambira 6c596516d2
Update metadata.yaml (#2842)
Signed-off-by: Tiago Alves Macambira <tmacam@burocrata.org>
2023-05-16 20:08:39 -07:00
Roberto Rojas 181f3ad039
[AWS DynamoDB] Transaction Support (#2809)
Signed-off-by: Roberto J Rojas <robertojrojas@gmail.com>
Signed-off-by: roberto <roberto@diagrid.io>
Co-authored-by: roberto <roberto@diagrid.io>
Co-authored-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
2023-04-27 23:13:20 +00:00
Roberto Rojas e099a548fb
GCP Firestore - Certification Tests (#2754)
Signed-off-by: Roberto J Rojas <robertojrojas@gmail.com>
Signed-off-by: Bernd Verst <github@bernd.dev>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Bernd Verst <github@bernd.dev>
2023-04-26 22:12:56 +00:00
Tiago Alves Macambira 5128594307
Add component metadata YAML for bindings.redis. (#2796)
Signed-off-by: Tiago Alves Macambira <tmacam@burocrata.org>
Co-authored-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
Co-authored-by: Bernd Verst <github@bernd.dev>
2023-04-24 21:59:05 +00:00
Tiago Alves Macambira 470905bcf7
Metadata YAML for state.cassandra. (#2800)
Signed-off-by: Tiago Alves Macambira <tmacam@burocrata.org>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Bernd Verst <github@bernd.dev>
2023-04-24 10:59:34 -07:00
Bernd Verst a7ac906757
Fix Redis metadata parsing and reporting (#2803)
Signed-off-by: Bernd Verst <github@bernd.dev>
Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Tiago Alves Macambira <tmacam@burocrata.org>
2023-04-23 06:28:22 +00:00
Tiago Alves Macambira 7099066436
Metadata YAML for state.mysql and metadata parsing improvement. (#2799)
Signed-off-by: Tiago Alves Macambira <tmacam@burocrata.org>
Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
2023-04-19 23:04:37 +00:00
Tiago Alves Macambira 62a4a6f3c5
Improves metadata YAML for state.postgresql (#2798)
Signed-off-by: Tiago Alves Macambira <tmacam@burocrata.org>
2023-04-19 21:28:43 +00:00
Alessandro (Ale) Segala 6b0dedf772
state.sqlserver: Add support for Azure AD auth (+ metadata.yaml) (#2790)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
2023-04-19 17:26:24 +00:00
Tiago Alves Macambira 2c508eda3b
Minor updates to state.redis template (#2792)
Signed-off-by: Tiago Alves Macambira <tmacam@burocrata.org>
2023-04-18 16:50:57 -07:00
Tiago Alves Macambira c6546ffe7d
Add component metadata YAML for Azure CosmosDB output binding. (#2782)
Signed-off-by: Tiago Alves Macambira <tmacam@burocrata.org>
2023-04-14 15:09:12 -07:00
Alessandro (Ale) Segala ad6a26bf43
Add native BulkGet to state.mysql (#2762)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-04-13 19:33:04 +00:00
Bernd Verst 13193ffdd8
fixup: even numbers must be strings in metadata (#2777)
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-04-12 21:54:47 -07:00
Tiago Alves Macambira 536ba55522
Added component metadata YAML for Azure Blob Storage state store. (#2770)
Signed-off-by: Tiago Alves Macambira <tmacam@burocrata.org>
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Bernd Verst <github@bernd.dev>
Co-authored-by: Bernd Verst <github@bernd.dev>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
2023-04-12 23:04:15 +00:00
Alessandro (Ale) Segala 5dad8a867c
Metadata parser: add support for built-in authentication profiles and metadata properties (#2760)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Bernd Verst <github@bernd.dev>
2023-04-12 00:04:34 +00:00
Alessandro (Ale) Segala 4f94da95cf
Refactor state store bulk operations (#2747)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-04-07 19:19:47 +00:00
Bernd Verst cfbac4d794
Refactor of Metadata parsing in Bindings (#2720)
Signed-off-by: Bernd Verst <github@bernd.dev>
Signed-off-by: Shivam Kumar <shivamkm07@gmail.com>
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Roberto J Rojas <robertojrojas@gmail.com>
Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Roberto Rojas <robertojrojas@gmail.com>
Signed-off-by: spike <hello@spike.wiki>
Signed-off-by: zhangchao <zchao9100@gmail.com>
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
Signed-off-by: handlerww <handlerww@gmail.com>
Co-authored-by: Shivam Kumar <shivamkm07@gmail.com>
Co-authored-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Roberto Rojas <robertojrojas@gmail.com>
Co-authored-by: spike <39330606+SpikeWong@users.noreply.github.com>
Co-authored-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
Co-authored-by: Taction <zchao9100@gmail.com>
Co-authored-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
Co-authored-by: Yiwen Chen <handlerww@gmail.com>
2023-04-05 22:19:08 +00:00
Alessandro (Ale) Segala 3e8ea3180c
Fixes MS SQL TTL not working (#2750)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-04-04 21:54:11 -07:00
Mukundan Sundararajan 09fba22bad
refactor mongodb metadata.yaml file (#2739)
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
2023-04-03 11:02:46 -07:00
Yiwen Chen 6262e138a2
disable featureTransactional in alicloud tablestore statae backend (#2742)
Signed-off-by: handlerww <handlerww@gmail.com>
2023-04-03 17:49:29 +00:00
Alessandro (Ale) Segala 61573b33d8
Merge branch 'master' into fix-redis 2023-04-03 09:44:11 -07:00
Alessandro (Ale) Segala 986874a4ad
Apply suggestions from code review
Co-authored-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
2023-04-03 09:12:23 -07:00
Mukundan Sundararajan 9358516a5f
Merge branch 'master' into fix-redis 2023-04-03 21:22:14 +05:30
Mukundan Sundararajan 8a3a5e9ebc
Merge branch 'master' into rethinkdb-transactions 2023-04-03 21:20:18 +05:30
ItalyPaleAle 2a395395dd Ensure that Params, if set, start with ?
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-04-01 15:16:02 -07:00
ItalyPaleAle 0f30039ec8 Redis state store: fixed JSON handling in Multi
Also fixed a race condition in ClientHasJSONSupport

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-03-31 17:23:41 -07:00
ItalyPaleAle acfb21c6b0 RethinkDB: Disable transactions that were not working
The implementation of the "Multi" method in RethinkDB was not correct, as it caused operations to be executed in the wrong order and it was not using a transaction (per comment on code: `best effort, no transacts supported`)

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-03-31 20:06:24 +00:00
ItalyPaleAle 24ff1b6175 MongoDB: Detect replica sets to improve error reporting and bulk operations
Changes the MongoDB state store to detect if it's connected to a replica set.

- When performing BulkSet or BulkDelete operations and connected to a replica set, uses a transaction to perform the operations more correctly (atomically) and faster
- When performing transactions, return an error if not connected to a replica set (the operation would fail, but this short-circuits the effort)

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-03-31 20:01:05 +00:00
Alessandro (Ale) Segala 33f9c6ecef
SQLite: defer cancel's in select statements (#2717)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-03-30 16:17:59 -07:00
ItalyPaleAle 3b86dfae22 Merge branch 'release-1.10' of https://github.com/dapr/components-contrib into merge-release-1.10
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-03-30 22:53:52 +00:00
Deepanshu Agarwal d6ce7bb5c3
Add MySQL TTL and Cleanup (#2641)
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Bernd Verst <github@bernd.dev>
2023-03-30 15:45:57 -07:00
Alessandro (Ale) Segala a0041cd517
[release-1.10] Backport #2723 (#2728)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-03-30 12:09:36 -07:00
Bernd Verst 9c371b6362
Fix support for custom state store table names (#2724)
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-03-29 23:46:00 -07:00
Alessandro (Ale) Segala 04d1e71ce7
State stores should always allow values that are empty strings (#2723)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-03-29 23:08:12 +00:00
Alessandro (Ale) Segala 029040c6a9
Fix inconsistency with TTL and Etags in SQL databases + fix SQL Server cert tests (#2688)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Bernd Verst <github@bernd.dev>
Co-authored-by: Bernd Verst <github@bernd.dev>
2023-03-25 02:34:30 +00:00
Alessandro (Ale) Segala 6389cc207c
Add BulkGet support for SQLite and Postgres state stores (#2704)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Signed-off-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Josh van Leeuwen <me@joshvanl.dev>
Co-authored-by: Bernd Verst <github@bernd.dev>
2023-03-25 02:18:43 +00:00
Alessandro (Ale) Segala bc52e25c85
Many fixes to Oracle Database state store - now beta (#2702)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Bernd Verst <github@bernd.dev>
2023-03-25 00:18:35 +00:00
Bernd Verst e5cbb34990
Add metadata analyzer tools (#2696)
Signed-off-by: Bernd Verst <github@bernd.dev>
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Alessandro (Ale) Segala <43508+ItalyPaleAle@users.noreply.github.com>
2023-03-24 18:34:36 +00:00
Alessandro (Ale) Segala 99219b6731
SQL Server: case-insensitive matching for `database` in connstring (#2694)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-03-23 17:34:33 +00:00
MregXN def1dca6c2
Create component metadata for state.postgresql (#2695)
Signed-off-by: MregXN <46479059+MregXN@users.noreply.github.com>
2023-03-23 09:24:16 -07:00
Alessandro (Ale) Segala 3cd727a562
Crypto building block: core parts (#2690)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-03-23 00:51:27 +00:00
Josh van Leeuwen 76e33137d9
Adds TTL support to SQL Server using SQL Cleanup Strategy (#2682)
Signed-off-by: joshvanl <me@joshvanl.dev>
2023-03-20 20:04:17 +00:00
taenyang 6692168301
Add etcd state store (#2671)
Signed-off-by: taenyang <taenyang@outlook.com>
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-03-16 16:40:08 +00:00
ItalyPaleAle c20ab76972 Merge branch 'master' of https://github.com/dapr/components-contrib into merge-release-1.10-master
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-03-15 19:25:12 +00:00
MregXN c8df937286
Create component metadata for state.redis (#2669)
Signed-off-by: MregXN <mregxn@gmail.com>
Co-authored-by: Bernd Verst <github@bernd.dev>
2023-03-15 09:57:24 -07:00
Bernd Verst 575567e30f
Add `connectionString` metadata option for MongoDB (#2659)
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-03-14 16:40:17 +00:00
Josh van Leeuwen 85feb7c3d7
Consolidate SQL expired date garbage collector (#2633)
Signed-off-by: joshvanl <me@joshvanl.dev>
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-03-09 16:40:58 +00:00
Josh van Leeuwen 4be795d812
Remove `context.TODO()`s with passed context. (#2650)
Signed-off-by: joshvanl <me@joshvanl.dev>
2023-03-08 17:53:02 +00:00
Bernd Verst 6e588f1a45 Add warning to Redis State Store: Do not use Actor State
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-03-06 14:42:16 -08:00
Josh van Leeuwen acb4418271
Consolidate CockroachDB and PostgreSQL into single internal implementation (#2632)
Signed-off-by: joshvanl <me@joshvanl.dev>
2023-03-06 21:49:49 +00:00
Josh van Leeuwen 4827d5d119
Adds TTL support to the CockroachDB state. (#2618)
Signed-off-by: joshvanl <me@joshvanl.dev>
Co-authored-by: Bernd Verst <github@bernd.dev>
2023-03-03 14:36:40 +00:00
ItalyPaleAle 2916e53a72 WIP
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-27 21:28:08 +00:00
Bernd Verst 3a616c5678 Remove Track 1 SDK references
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-02-27 12:44:32 -08:00
Bernd Verst 4068531538
Merge branch 'master' into metadata 2023-02-22 16:46:43 -08:00
joshvanl 6e1efe2cc9 Use operator `$add` instead of `$addDate` to have compatibility with
older mongodb versions.

Signed-off-by: joshvanl <me@joshvanl.dev>
2023-02-22 13:09:47 +00:00
joshvanl 2b3374bd4b Remove `_dapr` prefix from mongodb state store ttl field name
Signed-off-by: joshvanl <me@joshvanl.dev>
2023-02-21 18:31:24 +00:00
Artur Souza 2cbe96ba98
Merge branch 'master' into state-store-ttl-mongodb 2023-02-20 19:44:26 -08:00
joshvanl de038d5080 Fix gofumpt linting errors
Signed-off-by: joshvanl <me@joshvanl.dev>
2023-02-20 11:11:18 +00:00
ItalyPaleAle 55b6a04805 Merge branch 'master' of https://github.com/dapr/components-contrib into newdeps
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-17 21:20:45 +00:00
Alessandro (Ale) Segala a6c37184c2
Merge branch 'master' into state-store-ttl-mongodb 2023-02-17 20:41:12 +00:00
joshvanl db56a28581 Don't case extra allocations. Revert 70s state wait for ttl deletion
Signed-off-by: joshvanl <me@joshvanl.dev>
2023-02-17 17:46:15 +00:00
Alessandro (Ale) Segala 974d2acd4e
Merge branch 'master' into state-store-ttl-mongodb 2023-02-17 17:37:01 +00:00
joshvanl 9cef173fe6 Fix go vet errors
Signed-off-by: joshvanl <me@joshvanl.dev>
2023-02-17 15:04:18 +00:00
ItalyPaleAle bc47aa3049 💄
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-17 00:59:25 +00:00
ItalyPaleAle a484d7ebc7 Merge branch 'master' of https://github.com/dapr/components-contrib into newdeps
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-16 23:35:28 +00:00
ItalyPaleAle f9cf54ca6f Merge branch 'master' of https://github.com/dapr/components-contrib into release-1.10
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-16 23:23:23 +00:00
Josh van Leeuwen d098e38d6a
Propagate context from caller to appropriate places in the code (#2474)
* Propagates contexts to callers where appropriate.

Signed-off-by: joshvanl <me@joshvanl.dev>

* Updates units tests with new func signature

Signed-off-by: joshvanl <me@joshvanl.dev>

* Fix linting errors

Signed-off-by: joshvanl <me@joshvanl.dev>

* Add atomic gate to alicloud rocketmq close channel.

Signed-off-by: joshvanl <me@joshvanl.dev>

* bindings/aws/kinesis use a separate ctx variable name

Signed-off-by: joshvanl <me@joshvanl.dev>

* binding/kafka: use atomic to prevent closing the channel twice

Signed-off-by: joshvanl <me@joshvanl.dev>

* bindings/mqtt3: use atomic bool to prevent close channel being closed multiple times

Signed-off-by: joshvanl <me@joshvanl.dev>

* bindings/mqtt3: use Background context for handle operations:w

Signed-off-by: joshvanl <me@joshvanl.dev>

* state/cocroachdb: add context to Ping()

Signed-off-by: joshvanl <me@joshvanl.dev>

* bindings/postgres: add comment explaining use of context.

Signed-off-by: joshvanl <me@joshvanl.dev>

* Adds comment header to health/pinger.go

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/aws/snssqs: add waitgroup to wait for all go routines to finish
and block on Close(). Shuts down the subscription if there are no topic
handlers.

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/mqtt3: add atomic bool to prevent multiple channel closes. Add
wait group to block close on all goroutines to finish.

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/rabbitmq: fixes race conditions, uses atomic to prevent multiple
closes, add wait group to block close on all goroutines

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/redis: revert ctx passed when it could be cancelled. Add wait
group wait when closing.

Signed-off-by: joshvanl <me@joshvanl.dev>

* state/postges: pass context in init, and wait group on close.

Signed-off-by: joshvanl <me@joshvanl.dev>

* Update all `Ping()` to `PingContext()` where possible.

Signed-off-by: joshvanl <me@joshvanl.dev>

* state/in-memory: add atomic bool to prevent closing channel multiple
times. Add wait group to block on close()

Signed-off-by: joshvanl <me@joshvanl.dev>

* state/mysql: don't use same ctx variable name

Signed-off-by: joshvanl <me@joshvanl.dev>

* Pass correct loop context to redis go routines

Signed-off-by: joshvanl <me@joshvanl.dev>

* Rename context when creating timeouts in state

Signed-off-by: joshvanl <me@joshvanl.dev>

* Remove state.Features() from requiring a context

Signed-off-by: joshvanl <me@joshvanl.dev>

* Revert wasm request handle Close func to be without context to
implement io.Closer interface. Add 5 second timeout. Add io.Closer
assertion in test.

Signed-off-by: joshvanl <me@joshvanl.dev>

* Remove superfluous go lint vet directive

Signed-off-by: joshvanl <me@joshvanl.dev>

* Change Configuration Init function to take context

Signed-off-by: joshvanl <me@joshvanl.dev>

* Updates input binding interface to include a `Close() error` function. `Close`
blocks until all resources have been released and go routines have returned.

Signed-off-by: joshvanl <me@joshvanl.dev>

* Change `Close() error` in input binding struct to `io.Closer` interface.

Signed-off-by: joshvanl <me@joshvanl.dev>

* Update go.mod files to point to dapr/dapr PR https://github.com/dapr/dapr/pull/5831

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/redis: watch closeCh to shutdown worker instead of init context.

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/aws/snssqs + bindings/kubemq: ensure closeCh is caught so Close
correctly returns

Signed-off-by: joshvanl <me@joshvanl.dev>

* Close kubemq binding client on close. Ensure kafka consumer channel
cannot be closed more than once.

Signed-off-by: joshvanl <me@joshvanl.dev>

* Tweaks

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Fixed cert tests

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* binding/mqtt3: add inline Background context instead of passing to
handleMessage

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/mqtt3: remove context from createSubscriberClientOptions

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/mqtt3: Remove `ResetConnection` func

Signed-off-by: joshvanl <me@joshvanl.dev>

* pubsub/kafka: Don't resubscribe if Subscribe is cancelled.

Signed-off-by: joshvanl <me@joshvanl.dev>

* binding/mqtt3: don't use context to control establishing connection

Signed-off-by: joshvanl <me@joshvanl.dev>

* bindings/mqtt3: Fix linting errors

Signed-off-by: joshvanl <me@joshvanl.dev>

---------

Signed-off-by: joshvanl <me@joshvanl.dev>
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
2023-02-16 14:18:35 -08:00
joshvanl 1a3e267d5d Adds review comments. Filter on TTL when getting documents. Add test to
ensure data is deleted.

Signed-off-by: joshvanl <me@joshvanl.dev>
2023-02-16 18:18:23 +00:00
ItalyPaleAle a8957062f0 Fixed tests
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-16 01:42:05 +00:00
ItalyPaleAle 2a6407d5b2 Updated memcached SDK which contains a Close() method
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-16 00:27:25 +00:00
ItalyPaleAle 6f30dbf6c6 Updated Azure Event Hubs and Azure Blob Storage SDKs
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-16 00:21:56 +00:00
ItalyPaleAle 643a2abff2 Removed go.uber.org/atomic and github.com/pkg/errors
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-15 19:56:20 +00:00
joshvanl 7402ff5cf9 Add TTL support to mongodb state store
Signed-off-by: joshvanl <me@joshvanl.dev>
2023-02-15 16:43:27 +00:00
Bernd Verst b1c1304a86 Add and update component metadata definition files
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-02-13 17:09:09 -08:00
ItalyPaleAle 9920d53f93 Changed SQLite metadata parsing per review feedback
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-08 23:05:01 +00:00
ItalyPaleAle 9855e94ed8 Fixed test
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-04 00:47:18 +00:00
ItalyPaleAle fd6e7ef1f1 💄
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-04 00:45:31 +00:00
ItalyPaleAle 95aa6fcbf1 Maintain CleanupIntervalInSeconds for backwards-compatibility
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-04 00:43:58 +00:00
ItalyPaleAle c88cec451c Added tests for migrations
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-04 00:13:43 +00:00
ItalyPaleAle 6bee9b6192 Fixed tests
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-03 23:34:31 +00:00
ItalyPaleAle 603eaab8ea Fixed: for in-memory DBs, we must use cache=shared
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-03 23:31:16 +00:00
ItalyPaleAle 12dbd1db6f Working on TTL tests
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-03 23:15:15 +00:00
ItalyPaleAle 38f29a6ff2 Use regular transactions
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-03 22:40:03 +00:00
ItalyPaleAle 89720a909d Fixes
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-03 22:31:23 +00:00
ItalyPaleAle 42d7309244 Concurrency control for TTL cleanup
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-03 21:53:50 +00:00
ItalyPaleAle aba965751c Fixed read-only DBS
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-03 21:04:34 +00:00
ItalyPaleAle e8eec3f4c4 WIP
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-03 20:09:40 +00:00
ItalyPaleAle 99989cad02 Added metadata table
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-03 19:21:03 +00:00
ItalyPaleAle 86a6da559d Unit tests for getConnectionString
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-03 18:48:45 +00:00
ItalyPaleAle 5811cb0dba Metadata options to control journaling and WAL
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-03 18:19:12 +00:00
ItalyPaleAle 37cee72884 WIP: certification test
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-03 01:41:02 +00:00
ItalyPaleAle 5aca0aed1b Updated locking used in SQLite
Rather than relying on mutexes which are specific to each process, uses the "native" SQLite locks and transactions

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-02-03 00:28:22 +00:00
ItalyPaleAle e47772c32e SQlite: do not create an index on expiration_time by default
This makes SQLite behave more like Postgres, where the "expiration_time" column does not have an index by default.

For an explanation on why: https://v1-10.docs.dapr.io/reference/components-reference/supported-state-stores/setup-postgresql/#ttls-and-cleanups

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-30 21:37:40 +00:00
Bernd Verst 60f5c3de32 do not include boolean in exported json
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-01-26 14:20:04 -08:00
Bernd Verst 92b7d60b99 support flexible casing for some properties
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-01-26 14:00:24 -08:00
Bernd Verst fc7e5d7084 GCP Firestore State Store: Add to skip indexing
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-01-26 13:58:56 -08:00
ItalyPaleAle 6f71753c13 New SQLite 3 state store
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2023-01-24 17:39:11 -08:00
Bernd Verst 9645d6b223 Update Aerospike statestore dependencies
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-01-23 14:22:52 -08:00
Bernd Verst 7accf82129 Replace deprecated zookeeper library
Signed-off-by: Bernd Verst <github@bernd.dev>
2023-01-23 10:14:11 -08:00
Roberto J Rojas 4f5a9c94ed fixes partition key incorrect implementation
Signed-off-by: Roberto J Rojas <robertojrojas@gmail.com>
2023-01-09 19:26:32 -05:00
Roberto Rojas 0158e438d0
Merge branch 'master' into metada-partition-key-2388 2022-12-30 10:05:47 -05:00
Bernd Verst 3efab74b51
Merge branch 'master' into postgres-pgx 2022-12-29 12:34:21 -08:00
Marcos Candeia b8226c174f Expose parsefilter function
Signed-off-by: Marcos Candeia <marrcooos@gmail.com>
2022-12-27 14:56:11 -03:00
Roberto Rojas d47933553a fixes linting
Signed-off-by: Roberto Rojas <robertojrojas@gmail.com>
2022-12-23 17:21:51 -05:00
Roberto Rojas de94416285 adds TestBulkDelete test
Signed-off-by: Roberto Rojas <robertojrojas@gmail.com>
2022-12-23 16:28:18 -05:00
Roberto Rojas 2aa3f602dc adds TestDelete test
Signed-off-by: Roberto Rojas <robertojrojas@gmail.com>
2022-12-23 16:25:41 -05:00
Roberto Rojas af7e1f9bab adds TestBulkSet test
Signed-off-by: Roberto Rojas <robertojrojas@gmail.com>
2022-12-23 16:22:35 -05:00
Roberto Rojas 87e271579f adds TestSet test
Signed-off-by: Roberto Rojas <robertojrojas@gmail.com>
2022-12-23 16:17:39 -05:00
Roberto Rojas 32975d04ad adds metadata field partition key
Signed-off-by: Roberto Rojas <robertojrojas@gmail.com>
2022-12-23 16:07:17 -05:00
Alessandro (Ale) Segala ae48594e7e
Merge branch 'master' into postgres-pgx 2022-12-22 15:39:08 -08:00
ItalyPaleAle b42e70606c 💄
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-22 23:38:55 +00:00
ItalyPaleAle b70a17ed59 DRY
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-22 19:53:27 +00:00
ItalyPaleAle 8a58434660 Make timeout configurable
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-22 19:49:20 +00:00
ItalyPaleAle 80b1bb14b7 Changed postgres state store to use pgx instead of db/sql
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-20 22:45:38 +00:00
ItalyPaleAle 280c35ed58 Workers KV: add TTL support
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-19 18:50:59 +00:00
ItalyPaleAle 135d460b05 Configurable timeouts
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-19 17:46:54 +00:00
ItalyPaleAle 6aa9ccc364 Binding -> CFBinding
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-19 17:39:30 +00:00
ItalyPaleAle 416aa46157 Added provisional links to docs
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-19 17:37:14 +00:00
ItalyPaleAle 2446a698cb Renamed KV -> Workers KV to be consistent with branding
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-19 17:35:53 +00:00
Bernd Verst adc7bd8ca5
Merge branch 'master' into cfqueues-binding
Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2022-12-16 14:46:03 -08:00
Bernd Verst 3e08736911
Add support for Redis 7 in all Dapr Components (#2228)
* Add support for Redis 7

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add Redis 7 to conformance tests

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* automatically detect redis version, make redis7 state conformant

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Additions for REDIS without JSON support

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Return helpful query API error when missing redis-json

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Change Redis 7 port for conformance test

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Fix nil reference

Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Update Redis7 port

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Enable ContextTimeoutEnabled for Redis v9 client

Co-Authored-By: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>

* Add timeouts, address code review

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add another timeout

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Redis: so much more context

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* modtidy

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* fix issue from latest merge

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* modtidy

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Add generic redis nil error

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* fix redis version check

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* upgrade redis v9 client

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* Remove flaky redis v7 pubsub conformance test

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

* modtidy

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>

Signed-off-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-16 14:12:11 -08:00
ItalyPaleAle 120f1a437d Comply with the updated interface for state stores
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-14 00:34:06 +00:00
ItalyPaleAle b1cc54f62c Merge branch 'master' of https://github.com/dapr/components-contrib into postgres-ttl
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-13 21:16:57 +00:00
ItalyPaleAle 76ff7a11b6 Merge branch 'master' of https://github.com/dapr/components-contrib into cfqueues-binding 2022-12-13 11:11:15 -08:00
ItalyPaleAle a1c863d7fd Small fixes
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-13 10:11:36 -08:00
ItalyPaleAle 308f3c987c 💄
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-13 10:02:42 -08:00
ItalyPaleAle fabf7fe5a7 No need for the KV namespace name
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-13 02:42:33 +00:00
ItalyPaleAle 47db769066 Add Cloudflare KV state store
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-13 01:52:06 +00:00
1046102779 2dd7433a59 feature: add context to state API
Signed-off-by: 1046102779 <seachen@tencent.com>
2022-12-08 15:56:51 +08:00
ItalyPaleAle f718462d23 💄
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-06 01:30:29 +00:00
ItalyPaleAle 413ee92d88 We don't need locks when we do things atomically
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
2022-12-06 01:27:17 +00:00