Commit Graph

569 Commits

Author SHA1 Message Date
Yaron Schneider df5be19205
add close method to event hubs pub/sub (#500) 2020-10-15 08:42:14 -07:00
Yaron Schneider 182d204111
Add close method to pub/sub (#494)
* add close method to pub/sub

* linter
2020-10-12 19:06:33 -07:00
halspang f647d9eedb
Upgrade golang lint to 1.31 (#490)
Upgrade golang lint to 1.31.0

https://github.com/dapr/components-contrib/issues/439
2020-10-12 12:54:15 -07:00
Yaron Schneider 653bdced85
add metadata to pubsub message (#477)
Co-authored-by: Young Bu Park <youngp@microsoft.com>
2020-09-24 12:04:42 -07:00
Artur Souza fbd04241b0
Adding PubSub response type. (#453) 2020-09-04 12:59:43 -07:00
AbserAri 26b085baba
update logger form nats-io's to dapr's (#449)
* update logger form nats-io's to dapr's

* run go mod tidy and go mod delete the nats-io gnatsd

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-09-03 18:58:34 -07:00
Mayank Kumar 7f9850a04f
Improve mqtt pubsub for multiple topics (#443)
- Listen on multiple topics when those are provided for subscription.
- Improve the current logic to use dedicated function from paho client.
2020-09-03 10:17:27 -07:00
Brightside Automation c344f68718 Merge branch 'master' into jjcollinge/pubsub-context 2020-08-19 14:46:03 +01:00
Yaron Schneider 677e551844
fix consumer exclusivity (#435) 2020-08-17 07:37:25 -07:00
Mayank Kumar f5f807ca73
Add pubsub support for mqtt over TLS (#429)
* Add pubsub support for mqtt over TLS

* Update mqtt host to include uri scheme.

- This is required to identify mode of connection used while
  connecting to broker.

* Add pubsub support for mqtt over TLS.

- add validation while initialisation.
- update test cases.
2020-08-16 11:01:12 -07:00
Leon Mai 08d2538796
Corresponding changes for multi pubsub (#434)
* Corresponding changes for multi pubsub

* Fix quote
2020-08-14 11:05:51 -07:00
jjcollinge 38a8948bd8 Merge branch 'jjcollinge/pubsub-context' of github.com:jjcollinge/components-contrib into jjcollinge/pubsub-context 2020-07-28 10:04:26 +01:00
jjcollinge 19442e67c8 update pubsub components to use new context 2020-07-28 10:03:23 +01:00
Joni Collinge f868dc9497
Merge branch 'master' into jjcollinge/pubsub-context 2020-07-28 09:25:34 +01:00
Yaron Schneider 5892feca63
update Cloud Events to 1.0 (#419) 2020-07-23 17:13:26 -07:00
Ally Parker cf3ee2a46a
Add topic to cloud events envelope (#396)
Co-authored-by: ibrahim.dursun <ibrahim.dursun@gmail.com>
2020-07-22 08:48:32 -07:00
Mark Chmarny 05e71ffdc2
data serialized object (#391)
Co-authored-by: Young Bu Park <youngp@microsoft.com>
2020-07-13 13:31:32 -07:00
Mark Chmarny dbc1a76dcf lint fix 2020-07-13 09:24:51 -07:00
Mark Chmarny 1589031af6 fiixes json array envelope parsing 2020-07-13 09:20:54 -07:00
Mark Chmarny 68c5a5537c changes cloudevent identification 2020-07-08 15:28:54 -07:00
Mark Chmarny f1f69bf3c8 fixes speeling mistakes in ccmments 2020-07-08 11:23:23 -07:00
Mark Chmarny 43092998ab uses provided CE as is, adds CE test 2020-07-08 06:50:10 -07:00
Mark Chmarny 194ff4f914 fixes double envelop 2020-07-07 16:47:47 -07:00
jjcollinge 07b046f140 rename asb handler type to handle 2020-07-07 13:01:24 +01:00
jjcollinge 7734d05288 Merge branch 'master' into jjcollinge/pubsub-context 2020-07-07 12:41:58 +01:00
jjcollinge 410628af3d add context to pubsub handler signature 2020-07-07 12:37:15 +01:00
Joni Collinge 4b2252b017
ASB lock renewal per topic (#365)
* bump asb sdk version to 0.10.2

* add isolation per topic for lock renewal

* added cancellations on async handlers

* refactored out subscription logic from namespace

* updated error handling

* defer async context cancel

* fixed lint issues

* add connection recovery

* fix lint

* update comments

* update comments

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-07-02 08:02:42 -07:00
Kyle Housley 9ef4fb5fb4
Make enableTLS work correctly (#373)
the enabletls does the opposite of what the config suggests
2020-06-29 14:39:55 -07:00
Mukundan Sundararajan 5c62707aba
Upgrade go version to 1.14.3 and linter version to 1.26.0 (#352)
* Upgrade to go 1.14.3 and linter version to 1.26.0
2020-05-29 15:26:33 -07:00
Trond Hindenes d3e9a7b3a7
Use shared aws auth package (#347)
* Use shared sqs auth package

* Goimports-ed files

* Added support for endpoint param in aws credentials abstraction, since the sqs-sns pubsub module required it

* Added endpoint support for all aws things

* Updated tests
2020-05-26 16:27:16 -07:00
Mayank Kumar 3ed4f0f63c
Add pubsub support for mqtt (#330)
* Add pubsub support for mqtt

- update README.md
- add tests for metadata parsing
- linting

* Add pubsub support for mqtt

- remove topic field from metadata.

* Add pubsub support for mqtt

- use consumerID as clientID for mqtt connection

* Add pubsub support for mqtt

- address review comments
2020-05-22 20:39:09 -07:00
Joni Collinge 1461b0e4a5
Fix issue with ASB pubsub throttling (#329)
* Applied throttling to receiver loop

* added init lock renewal

* added prefect count config option

* renew message locks before processing

* moved lock acquisition per go routine

* fix test

* added max active message throttles

* rename numConcurrentHandlers to maxConcurrentHandlers

* fix typo in abandonMessage func name

* set maxActiveMessages to minimum of prefetchCount

* remove prefetch count constraint

* removed conditional activeMessage tracking

Co-authored-by: Shalabh Mohan Shrivastava <shalabhs@microsoft.com>
Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-05-22 20:38:28 -07:00
John b54585c4f0
Apache Pulsar - pubsub component (#346)
* created pulsar component

* fixed multi topic issue

* moved metadata struct

* finished writing metadata tests

* fixed linter issues

* modifies consumer type to failover

* uncapitalized errors

* changed subscriptionName to consumerID

* acknowledge message only if there's no error returned from handler

Co-authored-by: john verdonck <John@johns-MacBook-Pro.local>
2020-05-22 10:04:07 -07:00
Kyle Housley 8eff31b191
Add AWS SNS/SQS support (#342)
* working but WIP aws pubsub

* working pubsub impl, problematic resource naming

* working implementation with tags and hashed topic/queue names

* add correct permissions for sqs queue to allow sns publishing

* fix logging messages, make awsToken optional, rename test functions, nits

* lowercase comments

* nits, repetitive use of 'the'

Co-authored-by: Aman Bhardwaj <amanbha@users.noreply.github.com>
Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-05-21 14:20:16 -07:00
Yaron Schneider 71eaf77932
Update Readme.md (#320) 2020-04-30 09:06:54 -07:00
Kyle Housley 0c4cade71f
Add pubsub support for kafka (#315)
* fixes issue #8: adds kafka as pubsub component

* fixes issue #8: adds kafka as pubsub component

* pubsub kafka: modifies readme

* pubsub kafka: fixes bug

* pubsub kafka: fixes bug

* pubsub kafka: changes are per PR review

* changes as PR review

* removed unused field

* only close channel once

* working kafka pubsub

* add testing for metadata parsing

* linting

* remove unused PublishTopic, remove loglevel

* Use one consumer group for subscriptions

Co-authored-by: Roberto J Rojas <robertojrojas@gmail.com>
Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
Co-authored-by: Young Bu Park <youngp@microsoft.com>
Co-authored-by: Aman Bhardwaj <amanbha@users.noreply.github.com>
2020-04-27 19:53:04 -07:00
Young Bu Park 0489fb17f3
Fix linter errors (#293) 2020-04-01 17:22:15 -07:00
Piotr Jasina 1ac30f7be5
Add Hazelcast pubsub support (#254) 2020-03-24 17:00:36 -07:00
Sivamuthu Kumar 16c230aec7
GCP Cloud Pubsub implementation (#266)
* GCP Cloud Pubsub pub sub implementation

* fixing lint

* using consumerID instead of subscription
2020-03-15 11:12:22 -07:00
Abhishek Gupta 807e8893cb
Azure Event Hubs pubsub component (#242)
* event hubs pubsub

* go mod tidy

* go mod

Co-authored-by: yaron2 <yaronsc@microsoft.com>
Co-authored-by: Young Bu Park <youngp@microsoft.com>
2020-03-09 22:02:04 -07:00
Yaron Schneider 4602757a45
extend envelop to include a subject field (#249)
* extend envelop to include a subject field

* fix envelop test

* update mod

* try fix mod again
2020-03-04 22:59:26 -08:00
Young Bu Park ee97c3c56a
Use dapr logger (#238)
* Use dapr logger

* skip linter false alarm
2020-02-28 15:49:49 -08:00
Yaron Schneider c5ee4b273f
Add zero block for redis streams (#222)
* add zero block for redis streams

* update go.mod
2020-02-12 08:45:05 -08:00
Yaron Schneider d2a6fa5264
close azure service bus sender connection (#209) 2020-02-06 22:19:55 -08:00
REDDY PRASAD 5f3f850852
Add GCP Secret Manager (#199)
*  Add GCP Secret Manager

* Update tests

* Fix lint errors

* Update as per review

* Run go mod tidy

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
2020-01-30 21:51:52 -08:00
Abhishek Gupta 6de230391d
Aerospike state store implementation (#196)
* aerospike state store impl

* fixed linter issues:

* addressed feedback

* Delete bearer_middleware.go

* Delete cassandra_test.go

* Revert "Delete cassandra_test.go"

This reverts commit 462c066814.

* Revert "Delete bearer_middleware.go"

This reverts commit ae114a1df1.

Co-authored-by: Young Bu Park <youngp@microsoft.com>
2020-01-28 18:55:14 -08:00
Joni Collinge ca2c3821a2 Add concurrency to Azure ServiceBus pubsub (#179)
* added worker pool for concurrent receive

* fixed missing end quote

* added type alias

* removed shadow decl

* added cleanup logic for subscription receiver

* renamed metadata property to numConcurrentHandlers and added handler specific timeout

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
Co-authored-by: Young Bu Park <youngp@microsoft.com>
2020-01-24 10:26:11 -08:00
Abhishek Gupta 3734491718 NATS Streaming pubsub implementation (#173)
* NATS streaming pubsub impl

* after go mod tidy

* updates tests, other refactoring

* updated client ID generator

* updated test

Co-authored-by: Yaron Schneider <yaronsc@microsoft.com>
Co-authored-by: Young Bu Park <youngp@microsoft.com>
2020-01-17 14:54:01 -08:00
Joni Collinge bcfc66c79b fixed retry logic for servicebus listener (#186) 2020-01-14 12:51:13 -08:00
Abhishek Gupta 9323c44ecf check etag for etcd update and delete ops (#175) 2020-01-09 12:33:23 -08:00
Yaron Schneider 8b89a57b4e
fix redis streams waiting for handler (#172) 2020-01-05 10:54:15 -08:00
thinkerou a2f4b4c510 upgrade logrus to v1.4.2 (#150)
* fix conflict

* upgrade logrus to v1.4.2

* fix lint error

error: `depguard  `github.com/sirupsen/logrus` is in the blacklist`
2019-12-12 09:34:39 -08:00
Francisco Beltrao f89682397b Add Azure SignalR binding (#148)
* Add Azure SignalR binding

* Fixes from go lint

* Go lint

* Use "github.com/dgrijalva/jwt-go" for jwt
Fix bug parsing connection string
Normalize usage of len vs == in strings

* Consistent usage of http header Set
2019-12-03 09:08:53 -08:00
Abhishek Gupta c4bd2a47ea Implementation for Hazelcast based state store (#145)
* hazelcast store impl

* go.mod update
2019-11-27 21:12:47 -08:00
Francisco Beltrao 9e78671fc0 Add RabbitMQ pub/sub (#124)
* Add RabbitMQ pub/sub

* Fix lint error (global variable)

* RabbitMQ pub/sub auto ack defaults to false
Fix log message incorrect prefix

* Remove extra line in go.mod

* Revert extra line in go.mod
2019-11-27 10:37:09 -08:00
Shalabh Mohan Shrivastava bcd23db009
Changes to include Package names pubsub/secret stores/state to be consistent with company name (#137)
* [Commit - PubSub changes ]

Changing the names of the packages directory so to be consistent with name of the company .

It is to be noted that package name can not have hyphen "-" in the name.
So changing the directory names and putting under company names.

For example - servicebus package would be

dapr/components-contrib/pubsub/azure/servicebus

* Commit 2 - Changes for Secret Stores

* Commit 3 - for the state store changes
2019-11-22 12:46:42 -08:00
Francisco Beltrao 8086a01455 Fix azure service bus error message typo (#117) 2019-11-11 12:29:56 -08:00
Joni Collinge c945e70212 fixes wrong metadata config check (#108) 2019-11-05 16:19:26 -08:00
Joni Collinge ed3c829578 Azure ServiceBus PubSub Implementation (#93)
* initial skeleton code

* updated sub message handler

* lowercased errors

* added deadletter

* added context

* remove nil args

* added TODOs

* add max delivery count and timeout config

* refactored ensure methods

* removed confusing comment

* apply go fmt

* removed consumerID default

* updated go mod

* fixed up linter issues

* add package alias

* removed TODOs

* added additional servicebus config

* fix linting
2019-11-05 14:50:48 -08:00
Yaron Schneider 718a51ff40
Use consumerID for queue name (#99)
* use consumerID for queue name

* update tests
2019-11-04 11:42:21 -08:00
Yaron Schneider 34e1757740
Add TLS connection option to Redis pub sub (#96)
* add tls option to redis pub sub

* make default skip verify

* fix tls assignment

* remove gosec check

* retry nosec
2019-11-04 11:00:57 -08:00
Yaron Schneider 298ac1c381
Update Readme.md (#79) 2019-10-30 00:02:25 -07:00
Abhishek Gupta 49b6c9625c NATS pubsub component implementation (#65)
* inital version for  nats pubsub implementation

* added draft impl for nats pubsub

* updated impl, test

* new dependencies

* updated go.mod
2019-10-29 23:48:55 -07:00
Yaron Schneider 99461da958
remove pubsub mock (#33) 2019-10-14 13:06:24 -07:00
Yaron Schneider 4e436865fa
added cloud events content type (#32) 2019-10-14 12:52:39 -07:00
Yaron Schneider 9682bc829c
Exclude mock file from build (#31)
* exclude mock from build

* exclude mock from build
2019-10-12 21:54:34 -07:00
Aman Bhardwaj 04bef3ac3f Adding license header and updating to MIT license. (#26) 2019-10-09 10:58:08 -07:00
Yaron Schneider 2b8dbd2b44
dapr name change (#21) 2019-10-02 13:21:22 -07:00
yaron2 22fea6f43d initial commit 2019-09-26 15:47:41 -07:00