cff6d7b6b1
Merge remote-tracking branch 'upstream/master' into optimize-bulkpubres-struct
2022-12-20 23:04:19 +05:30
e59dfd63c0
feature: add context to lock&pubsub API
...
Signed-off-by: seachen <seachen@tencent.com>
2022-12-14 19:37:24 +08:00
ace0d1a03c
changed to failed entries for bulk publish response
...
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
2022-12-13 16:22:45 +05:30
72695529f6
optimize bulk pub response to contain only failed entries
...
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
2022-12-13 11:49:04 +05:30
376cfed216
Fix linting
...
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
2022-09-29 16:27:04 +05:30
f74b4d648d
Update EntryID to EntryId
...
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
2022-09-29 15:49:45 +05:30
4354f036e4
properly parse response errors from kafka on sending multiple messages in bulk publish
...
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
2022-09-22 16:51:34 +05:30
a45f7db8b2
add bulkpublish-conf-test
...
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
2022-09-21 11:46:46 +05:30
3f9c42c4b8
Kafka bulk publish ( #2059 )
...
* Contrib updates for Batch Subscribe
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* commit
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* Commit pubsub
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* Update structs
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* Update Default Batch struct name
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* Update Default Batch
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* Update return type for BatchPublish
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* Add docs
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* Rename batch to bulk
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* snssqs renam batch to bulk
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* Renaming Bulker to BulkMessager
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* Renaming names as discussed
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* Minor updates
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* Remove ContentType from BulkPublishRequest
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* Update error type
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* Changes to bulk subscribe and error type
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* Segregating Bulk Publisher and Bulk Subscriber and removing them as mandatory
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* Event Type name correction
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* Docs update as per comments
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
* bulk publish implementation for kafka
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
* Add ctx to BulkPublish.
Signed-off-by: Artur Souza <artursouza.ms@outlook.com>
Signed-off-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
Signed-off-by: Mukundan Sundararajan <65565396+mukundansundar@users.noreply.github.com>
Signed-off-by: Artur Souza <artursouza.ms@outlook.com>
Co-authored-by: Deepanshu Agarwal <deepanshu.agarwal1984@gmail.com>
Co-authored-by: Artur Souza <artursouza.ms@outlook.com>
2022-09-15 13:17:17 -07:00
ca9fbf690e
Fixed Kafka PubSub to allow multiple handlers for different topics ( #1755 )
...
* Fixed Kafka PubSub to allow multiple handlers for different topics
With this, tests from #1743 are passing
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
* Removed read lock (for now)
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
* Updated as requested by @skyao
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
* Use interface type everywhere
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
* Fixed panic
Signed-off-by: ItalyPaleAle <43508+ItalyPaleAle@users.noreply.github.com>
Co-authored-by: Yaron Schneider <schneider.yaron@live.com>
2022-06-01 15:31:11 -07:00
8b5554dc71
Refactory kafka binding to reuse the kafka common code extracting from kafka pubsub component ( #1696 )
...
* refactory kafka pubsub code to extract common kafka code for reuse
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* fix lint;add unit test for subscribeAdapter
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* move topics filed from internal kafak struct to pubsub kafka struct, since in input binding the topics will confiured in metadata
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* reuse internal kafka code for bindings
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* add redis standalone_test back which is delete by mistaken
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* small code improvement to trigger test
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* add license headers
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* try to set disbaleTls to true to verify the kafka connection fail
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* don't enable consum retry in kafka binding component;if authenticaion is disabled, need not set TLSDisable at the same time;
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
* fix lint
Signed-off-by: Sky Ao <aoxiaojian@gmail.com>
Co-authored-by: Loong Dai <long.dai@intel.com>
2022-05-10 20:07:23 -07:00
Mukundan Sundararajan