Commit Graph

63 Commits

Author SHA1 Message Date
Dmitry Shmulevich c7adb917f3
update license to Apache v2.0 (#1406) 2022-01-04 19:53:31 -08:00
Simon Leet 9ab218a393
Update azure-sdk-for-go to v59.3.0 for EventGrid (#1325)
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-12-08 17:19:43 -08:00
Bernd Verst 175b09ea40
Adds retry on CosmosDB Init in case of TooManyRequests error (#1329)
* Adds retry on CosmosDB Init in case of TooManyRequests error

* Use backoff v4

* missed some permanent errors

* clean up go.mod

* fix error type casting

* Add constant for HTTP 429
2021-11-29 12:05:43 -08:00
halspang d5a68041c9
Move Service Bus Pubsub/Binding to common auth (#1201)
* Move Service Bus Pubsub/Binding to common auth

Both the pubsub and input/output binding for Azure Service Bus were
connecting via a connection string. This is still supported but will
now fallback to using AAD from the common auth library. This is also
the recommended auth pattern going forward.

* Move AMPQ specific auth and fix linter issues

* Make conn string and namespace mutually exclusive

* Move resourceName to a constant

* Update auth_amqp.go

* Update auth.go

Co-authored-by: Long Dai <long.dai@intel.com>
Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-11-22 18:20:11 -08:00
Alessandro (Ale) Segala 3eafb8bcd4
Azure SDK "track 2": authentication and secretstore/azure/keyvault (#1290)
* Authentication for new Azure SDK

* Updated keyvault to use new Azure SDK

* 🙈

* Update authentication/azure/auth.go

* Update authentication/azure/auth.go

* Update authentication/azure/auth.go

* Reintroduce changes from PR 1132 without updating ASB

* Lint 💄

* Marking contexts as TODO as they'll need a timeout
As per conversation with @berndverst

* Update certification tests with no auth libraries

Co-authored-by: Bernd Verst <4535280+berndverst@users.noreply.github.com>
2021-11-16 10:59:51 -08:00
halspang f5d8317c41 Revert "Bumping ASB version and fixing test for azure auth (MSI_ENDPOINT) (#1132)" (#1291) 2021-11-12 11:59:35 -08:00
Hossam Kandil 399d1230d0
rename CosmosGraphDB binding component to CosmosDBGremlinAPI #1246 (#1276) 2021-11-04 09:35:32 -07:00
Long Dai 925773dd21
Merge branch 'master' into add_amqp_properties 2021-10-27 10:14:38 +08:00
Simon Leet cdb2c6167e
Merge branch 'master' into service_queue 2021-10-26 17:18:42 -07:00
Long Dai 77bf26a676
Merge branch 'master' into add_amqp_properties 2021-10-26 09:29:57 +08:00
Bernd Verst aa4f949838 Adds Dapr User Agent for Cosmos DB components 2021-10-25 17:59:34 -07:00
Hal Spang ce4ab8f40f Move to atomics instead of locks 2021-10-25 16:06:30 -07:00
Hal Spang 3d3f142c19 Reconnect forever in ASB Queue Binding
We reconnect/retry forever now in Azure Service Bus Queue binding
while reading. We have to reconnect for every error because the
errors that surface from the client involve connection issues.
2021-10-25 16:06:30 -07:00
Simon Leet 2006bcccb0 Support message-id in Event Hubs components 2021-10-25 18:12:16 +00:00
Bernd Verst 2bd3d22b91
Cosmos DB Output Binding - Conformance & Progress towards GA (#1180)
* cosmosdb binding - not as flexible as I'd like

conformance tests now pass

* add tests for new UUID injection logic

* Use nested property as partition key value

* avoid repeated string constants

* Disable Identification Hydrator to avoid struct requirement

* Remove struct

* Simplify PR

* Add comments ofor code maintenance
2021-10-12 10:47:36 -07:00
Javier Vela 32bba35bb2
azure storage queue fix double quotation (#1156)
* azure storage queue fix double quotation

* Trigger checks

* Trigger checks

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2021-10-07 13:54:20 -07:00
halspang 0fe6a98874
Force lowercase name for Azure Service Bus Queue (#1186)
Azure Service Bus Queue names are case-insensitive. When one is
created it will always be forced to lowercase. If a queue with a
non-lowercase is provided, it will be created but can never be
matched causing the next Init to fail.

https://github.com/dapr/components-contrib/issues/1185
2021-10-06 11:40:43 -07:00
Simon Leet a9cf218c04
Support setting up Azure IoT Hub for integration testing with EventHubs components (#1174)
* Add IoT Hub config to setup-azure-conf-test.sh

* Add EventHubs bindings integration test for IoT device event properties

* Add consumer group for IoT Hub events for pubsub EventHubs testing

* Add EventHubs pubsub integration test for IoT device event properties
2021-10-01 16:17:53 -07:00
Simon Leet 9a075cb43a
Fix existing integration tests (#1173)
* Fix servicebusqueues_integration_test.go compile errors

* Fix postgresql_integration_test.go deleteItemThatDoesNotExist expectations

* Fix mysql_integration_test.go deleteItemThatDoesNotExist expectations

* Fix mysql_integration_test.go for bindings

* Increase TTL in ServiceBusQueues tests for stability
2021-09-28 19:17:44 -07:00
Bernd Verst ac85ba2a8e
Add dapr user agent for Azure Components (#1152)
* Add dapr useragent for Service Bus and EventHubs

* Add useragent for tablestorage

* send dapr useragent

* more user agents

* formatting
2021-09-27 17:04:27 -07:00
Long Dai 988fed05ab
ci: standard linter config (#1102)
* ci: standard linter config

Signed-off-by: Long <long.dai@intel.com>

* Update utils.go

* fix pulsar issue

Signed-off-by: Long <long.dai@intel.com>

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-09-21 15:21:59 -07:00
Phil Kedy 45f577e137
Bumping ASB version and fixing test for azure auth (MSI_ENDPOINT) (#1132)
Co-authored-by: Bernd Verst <berndverst@users.noreply.github.com>

Co-authored-by: Bernd Verst <berndverst@users.noreply.github.com>
2021-09-13 11:06:04 -07:00
Alessandro (Ale) Segala a992cd19f0
Support Azure AD auth for Cosmos DB (#1104)
* Support Azure AD auth for Cosmos DB

* Fixed linting errors

* Tidying go.sum

* Removed the need for nolint:shadow

Co-authored-by: Simon Leet <31784195+CodeMonkeyLeet@users.noreply.github.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-09-01 12:44:05 -07:00
Simon Leet 6591b0de68
Add Close() method to EventHubs bindings (#1093)
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-08-26 15:56:15 -07:00
Simon Leet 796df4dd61
Add Close() function to Azure ServiceBusQueues binding (#1052)
* Add Close() conformance test

* Add Close() to AzureServiceBusQueues binding

* Accept nil on bindings Read Close() test

Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Dapr Bot <56698301+dapr-bot@users.noreply.github.com>
2021-08-13 18:15:39 -07:00
Christian Kaps 80f0110fa8
Return blob metadata and add list operation (#999)
* Return blob metadata if configured

* Enhance error msg

* Add list functionality

* Fix linting issues

* Finalize list implementation

* Fix linting errors

* Add backward compatibility and align code to be more consistent

* Add tests

* Fix linting errors

* Rename properties

* Fix max result logic

* Fix linting error

* Fix PR suggestions

* Add comments for constants

* Run go mod tidy

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2021-07-14 09:17:48 -07:00
Hossam Kandil 13f96c42a6
Added new output binding for Cosmos Graph DB - Gremlin (#885)
* Added new output binding for Cosmos Graph DB - Gremlin

* applying gofumpt on cosmosdbgraphdb

* removed unnecessary conversion from cosmosgraphdb

* removed unwanted comments from cosmosgraphdb

* resolving gomod confilicts

* resolving go mod conflict

* resolve conflicting error messages

* change Gremlin query to req.data.

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2021-07-14 08:49:40 -07:00
Simon Leet 3877f5c793
Return SystemProperties on events from EventHubs bindings and pubsub (#1009)
- Update azure-event-hubs-go dependency to currently supported v3 with
  IoT Hub SystemProperties.
- Write Event.SystemProperties to ReadResponse.Metadata for EventHubs
  input binding.
- Write Event.SystemProperties to NewMessage.Metadata for EventHubs
  pubsub.
2021-07-13 16:04:22 -07:00
Long Dai a538b80452
switch to golang-jwt (#993)
Signed-off-by: Long Dai <long0dai@foxmail.com>

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2021-07-08 10:49:44 -07:00
Fabian Steinbach 4412ba019f
unmarshal getBlobRetryCount as int (#919)
Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2021-07-08 10:45:52 -07:00
Long Dai 4281cb2ea1
deps: upgrade dgrijalva/jwt-go (#981)
Signed-off-by: Long Dai <long0dai@foxmail.com>
2021-07-02 19:55:17 -07:00
Phil Kedy 688df9bda4
Removed dependency on dapr/dapr in favor of dapr/kit. Fixed go mod dependencies afterwards. Go 1.16 in go.mod. Removed accidental log dependency. (#807) 2021-04-19 12:06:10 -07:00
Yaron Schneider 192461889c
Add app response to input binding event (#764)
* add app response to input binding event

* lint
2021-03-18 14:22:14 -07:00
Fabian Steinbach 3a3998bb60
add delete to blob storage binding (#705)
* add delete to blob storage binding

* adjust linting

* make deletesnapshotsoption configurable

* update linting

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2021-03-09 00:20:43 -08:00
Yaron Schneider 3ef025c604
change headers (#679) 2021-02-09 18:57:55 -08:00
Artur Souza ac28629cb0
Increase timeout for conf test + more logging for EventGrid. (#663) 2021-02-05 19:10:44 -08:00
Artur Souza 795b62417e
Add verbosity to conf tests. More debug logging in eventgrid binding. (#662) 2021-02-05 17:41:06 -08:00
Artur Souza e6dadfab6c
TTL in PubSub. (#565)
* TTL in PubSub.

* Handle message TTL only if component cannot handle it.

* Removig dead code for overflow check in pubsub expiration.
2020-12-29 14:28:52 -08:00
Yaron Schneider d260ec85e6
add access level to azure blob storage (#549) 2020-12-05 07:38:13 -08:00
Yaron Schneider 01f90bdbc8
Fix azure blob storage json payload (#516)
* fix azure blob storage json payload

* handle non-json strings
2020-11-03 10:05:30 -08:00
halspang f647d9eedb
Upgrade golang lint to 1.31 (#490)
Upgrade golang lint to 1.31.0

https://github.com/dapr/components-contrib/issues/439
2020-10-12 12:54:15 -07:00
Yaron Schneider 1e92e0e8e1
Add blob url to azure blob create (#474)
* add blob url to azure blob create

* add missing err statement
2020-09-23 17:42:46 -07:00
Yaron Schneider b91469732c
Add get operation for azure blob storage binding (#473)
* add get operation for azure blob storage binding

* fix retry count

* make retry configurable, add default
2020-09-23 15:00:34 -07:00
Mohammad Taghavi e5a50cb2da
add decodeBase64 option to azure blob storage component (#393)
* add decodeBase64 option to azure blob storage component

* fix lint error

* Apply suggestions from code review

some code improvements (apply review suggestion)

Co-authored-by: Nghia Tran <tcnghia@gmail.com>

* add comment to help assure the reader (resolve review comment)

Co-authored-by: Mohammad Taghavi <Mohammad.Taghavi@plan-b-gmbh.com>
Co-authored-by: Nghia Tran <tcnghia@gmail.com>
Co-authored-by: Young Bu Park <youngp@microsoft.com>
2020-09-22 13:44:36 -07:00
Nils Schmidt 4007ba3622
Handle errors in AzureEventHubs.Read (#371) 2020-06-30 07:16:36 -07:00
Yaron Schneider e82164f4e7
Add bi-directional bindings support (#350)
* add bi-directional bindings

* added invoke response

* added explicit types

* change operationtype to operationkind
2020-05-26 23:32:20 -07:00
Ben Coleman e97529a4a8
Unescape azure blob data (#313)
Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-04-30 08:15:18 -07:00
Lynn Orrell 8480a29c18
EventGrid Component Updates (#319)
* event grid udpates

* Initial event grid input binding

* Added Write() support to EventGrid component

* Updated eventgrid binding to use fasthttp instead of net/http

* Fixed linting issue in EventGrid binding

* Tidy up go.mod

* Added handshakePort to allow custom port for EG callback

* Now properly throwing an http 500 on handler err

* Updated event grid sdk for cloud event 1.0 support
Added support for all event grid sources via scope
Now validating required metadata on read/write

* Updated tests

* Fixed linting issue

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
Co-authored-by: Young Bu Park <youngp@microsoft.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2020-04-29 08:02:22 -07:00
Lynn Orrell 8827c58e78
Added Azure Event Grid Bindings (#290)
* event grid udpates

* Initial event grid input binding

* Added Write() support to EventGrid component

* Updated eventgrid binding to use fasthttp instead of net/http

* Fixed linting issue in EventGrid binding

* Tidy up go.mod

* Added handshakePort to allow custom port for EG callback

* Now properly throwing an http 500 on handler err

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
Co-authored-by: Young Bu Park <youngp@microsoft.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2020-04-28 12:50:13 -07:00
Sivamuthu Kumar fd531b006f
Cosmos - Nested PartitionKey Support (#296)
* Nested partition key in cosmosdb bindings

* fix lint

* Lookup values by iterating

* fix lint

Co-authored-by: Aman Bhardwaj <amanbha@users.noreply.github.com>
2020-04-15 10:29:43 -07:00