0cdc7c1d0f
go.mod: update pd/client ( #554 )
...
* go.mod: update pd/client
Signed-off-by: Hangjie Mo <mohangjie1995@gmail.com>
* go mod tidy
Signed-off-by: Hangjie Mo <mohangjie1995@gmail.com>
* update go.mod in it
Signed-off-by: Hangjie Mo <mohangjie1995@gmail.com>
* fix test
Signed-off-by: Hangjie Mo <mohangjie1995@gmail.com>
2022-07-25 17:08:34 +08:00
aa9ded37d1
add checksum for apiv2 ( #549 )
...
* add checksum for apiv2
Signed-off-by: haojinming <jinming.hao@pingcap.com>
* fix test
Signed-off-by: haojinming <jinming.hao@pingcap.com>
* fix test
Signed-off-by: haojinming <jinming.hao@pingcap.com>
* address review comments
Signed-off-by: haojinming <jinming.hao@pingcap.com>
* address review comments
Signed-off-by: haojinming <jinming.hao@pingcap.com>
* add unit test for EncodeEncodeV2KeyRanges
Signed-off-by: haojinming <jinming.hao@pingcap.com>
Co-authored-by: iosmanthus <dengliming@pingcap.com>
2022-07-20 14:42:24 +08:00
86d51ba7eb
*: update google/btree to improve performance ( #547 )
...
* *: update google/btree to improve performance
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
* update ci
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
2022-07-18 16:02:14 +08:00
57c12f7c64
Handle more detailed statistics from TiKV ( #536 )
...
* support more detailed statistics returned from TiKV
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
* fix log formatting
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
* add to test
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2022-07-13 16:56:47 +08:00
68cd1bc6c1
Introduce API v2 ( #494 )
...
* introduce raw.Client with api v2
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* migrate rawkv test to api v2
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* git fire: refactoring the interface SplitRegion of CodecClientV2
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* go mod tidy
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* fix split region issue in CodecClientV2
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* rearrange imports
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* add version info for RegionCache
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* delay request encoding to RPCClient
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* prevent multiple encoding
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* wip: debugging retry logic
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* fix EpochNotMatch region decoding
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* remove txn request branch
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* copy request before encoding it
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* add gRPCDialOptions for rawkv.Client
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* fix api breaking change of raw.NewClient
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* address menglong's comments
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* go mod tidy
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* address comments and fix linter
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* fix api_test
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* fix TestScan
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* fix TestScan
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* fix compatibility
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
Co-authored-by: Xiaoguang Sun <sunxiaoguang@users.noreply.github.com>
2022-07-09 14:49:46 +08:00
114ba4082e
add replica read adjuster function in KVSnapshot ( #540 )
...
Signed-off-by: glorv <glorvs@163.com>
2022-07-07 17:12:24 +08:00
bb026bdad8
client: support requests with source label ( #506 )
...
* support request scope and source.
Signed-off-by: you06 <you1474600@gmail.com>
* update
Signed-off-by: you06 <you1474600@gmail.com>
* use counter for requests with too-many source
Signed-off-by: you06 <you1474600@gmail.com>
* refine resolve lock
Signed-off-by: you06 <you1474600@gmail.com>
* remove request source from resolve details
Signed-off-by: you06 <you1474600@gmail.com>
* address comment
Signed-off-by: you06 <you1474600@gmail.com>
2022-06-24 18:17:09 +08:00
be31f33ba0
Avoid sending requests to unhealthy leader ( #503 )
...
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2022-06-13 19:27:34 +08:00
e69cd80e58
Preserve is_retry_request flag for prewrite when retrying with region errors ( #513 )
...
* add a test to verify the incorrect setting of is_retry_request
Signed-off-by: ekexium <ekexium@gmail.com>
* preserve the retry flag for prewrite
Signed-off-by: ekexium <ekexium@gmail.com>
* fix test
Signed-off-by: ekexium <ekexium@gmail.com>
* add more explanations
Signed-off-by: ekexium <ekexium@gmail.com>
2022-05-31 16:04:28 +08:00
700cbe60d2
support find stores with tiflash_mpp label ( #481 )
...
Signed-off-by: guo-shaoge <shaoge1994@163.com>
Co-authored-by: Yilin Chen <sticnarf@gmail.com>
2022-05-23 11:22:53 +08:00
5d3195ce11
tiflash: Add TiFlash compact command ( #504 )
...
* Add TiFlash compact command
Signed-off-by: Wish <breezewish@outlook.com>
* Fix integration test go.mod
Signed-off-by: Wish <breezewish@outlook.com>
* Upgrade tidb dependency
Signed-off-by: Wish <breezewish@outlook.com>
* Use newer golang compiler
Signed-off-by: Wish <breezewish@outlook.com>
2022-05-17 21:31:43 +08:00
190a4d190c
fix the vulnerability of atomicity in async commit ( #492 )
...
* fix the vulnerability of atomicity in async commit
Signed-off-by: ekexium <ekexium@gmail.com>
Revert "fix the vulnerability of atomicity in async commit"
This reverts commit b0b34c56168ba288e1619e66e626321365cb0921.
tidy up
Signed-off-by: ekexium <ekexium@gmail.com>
* add test
Signed-off-by: ekexium <ekexium@gmail.com>
* shorten the time of the test
Signed-off-by: ekexium <ekexium@gmail.com>
* fix test
Signed-off-by: ekexium <ekexium@gmail.com>
Co-authored-by: Yilin Chen <sticnarf@gmail.com>
2022-05-13 17:09:52 +08:00
038b03552a
atomic PrewriteMaxBackoff ( #488 )
...
* atomic PrewriteMaxBackoff
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
* PrewriteMaxBackoff use uint64
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
Co-authored-by: Yilin Chen <sticnarf@gmail.com>
2022-05-10 10:24:53 +08:00
5b4040a95c
reconnect when meets store-not-match errors ( #456 )
...
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2022-03-24 17:30:51 +08:00
5042c6f2aa
Return assertion failed error less prior to other kinds of errors ( #448 )
...
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2022-03-11 12:36:19 +08:00
cd7e7681c2
Update lock ttl when retry to pessimistic lock keys ( #417 )
...
Signed-off-by: longfangsong <longfangsong@icloud.com>
2022-03-10 16:10:47 +08:00
7e34d88af3
region_cache: support buckets ( #439 )
...
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2022-03-09 13:52:39 +08:00
079e2dce4e
txn: support read-consistency read with tso checking ( #447 )
...
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2022-03-08 10:31:03 +08:00
1aa72efa9b
mockstore: fix assertion ( #446 )
...
Signed-off-by: disksing <i@disksing.com>
2022-03-07 13:10:35 +08:00
7cbe10ea93
integration: try not to skip tests when run with tikv ( #445 )
...
Signed-off-by: disksing <i@disksing.com>
2022-03-07 11:27:20 +08:00
a6db0c9a3e
Fix incorrect LockNoWait value ( #435 )
...
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2022-03-02 20:03:17 +08:00
0214a9efa0
integration: replace some unistore with mockstore ( #432 )
...
Signed-off-by: disksing <i@disksing.com>
2022-03-02 16:36:25 +08:00
cb9955362c
integration: use less tidb code ( #431 )
...
Signed-off-by: disksing <i@disksing.com>
2022-03-02 15:00:40 +08:00
e5f932ae27
txnkv: fix the issue that deleteRange cannot use nil as endkey ( #429 )
...
Signed-off-by: disksing <i@disksing.com>
2022-02-24 15:51:38 +08:00
79b962a84d
integration: update tidb to master branch ( #426 )
...
Signed-off-by: disksing <i@disksing.com>
2022-02-22 11:34:36 +08:00
589cf79b2a
*: update etcd client to v3.5.2 ( #423 )
...
Signed-off-by: disksing <i@disksing.com>
2022-02-17 22:01:16 +08:00
b5eb031edd
Support setting assertions and receiving assertion errors for Prewrite requests ( #311 )
...
* support set assertion in 2pc mutation
Signed-off-by: lysu <sulifx@gmail.com>
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Receive assertion fail errors from TiKV
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add test log
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Remove verbose log
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* update kvproto
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add metrics counter for assertions
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Address some comments
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Try to optimize assertion for pessimistic transactions
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix panic on optimistic transactions
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add InitCheckExistence method for LockCtx
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Support assertion level
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Check assertion level before doing assertion on client side
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Test bitoperations of menBUfferMutations.Push
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add test for assertion in tikv
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Support run assertion test with unistore
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix test
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix license
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix test
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* export DeleteKey
Signed-off-by: ekexium <ekexium@gmail.com>
* Renaming DeleteKey
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* fix build
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Address comments
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Avoid panic when running with old version of TiKV; Add schema check on fast assertion
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add test for fast assertion
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add test for pessimistic lock check existence
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Test assertion takes no effect if amending is enabled
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add HasAssertUnknown function
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add comments
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Cleanup locks after assertion fail
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* update tidb dependency
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix panic in TestIllegalTSO
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Address comments
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add comments
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Update dependency to tidb
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix test
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: lysu <sulifx@gmail.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: ekexium <ekexium@gmail.com>
2022-02-10 15:31:32 +08:00
cea0c4c6e6
update tidb version ( #419 )
...
Signed-off-by: lemonhx <lemonhx@lemonhx.tech>
2022-02-09 09:41:21 +08:00
d228150997
implement pd's global config ( #405 )
...
* update kvproto and pd, implement global config mock api
Signed-off-by: lemonhx <lemonhx@lemonhx.tech>
* update tidb version
Signed-off-by: lemonhx <lemonhx@lemonhx.tech>
* update pd version to pass tikv integration test
Signed-off-by: lemonhx <lemonhx@lemonhx.tech>
2022-01-06 20:00:26 -08:00
13298f12fb
rawkv: split BatchPut and BatchPutTTL ( #414 )
...
Signed-off-by: disksing <i@disksing.com>
2022-01-06 02:46:37 -08:00
fe2def20bb
fix RawBatchPutRequest forward compatibility ( #403 )
...
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
2022-01-05 22:53:06 -08:00
dd263ab9f1
integration_tests: speed up TestCommitOnTiKVDiskFullOpt ( #411 )
...
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2022-01-04 14:58:47 +08:00
62d6b4a2e8
txnkv: set TiKV RC for weak-consistency transactions ( #407 )
...
* add tikv-rc support
Signed-off-by: you06 <you1474600@gmail.com>
* add test
Signed-off-by: you06 <you1474600@gmail.com>
* format code
Signed-off-by: you06 <you1474600@gmail.com>
* address comment
Signed-off-by: you06 <you1474600@gmail.com>
* address comment
Signed-off-by: you06 <you1474600@gmail.com>
* update tidb && address comment
Signed-off-by: you06 <you1474600@gmail.com>
* update test log
Signed-off-by: you06 <you1474600@gmail.com>
2021-12-29 13:16:14 +08:00
e9de5625c4
txn: change IsUnnecessaryKeyValue interface to report error for unexpected paths ( #390 )
...
* change IsUnnecessaryKeyValue interface to report error for unexpected situations
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
* update integrated tests go mod
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
Co-authored-by: disksing <i@disksing.com>
2021-12-20 20:12:11 -08:00
6165dbaa95
introduce RPC interceptor mechanism ( #389 )
...
* Add interceptor mechanism for tikv RPC
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Rename comment
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Modify comments
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Fix ineffectual assignment
Signed-off-by: mornyx <mornyx.z@gmail.com>
* add AddInterceptor for KVTxn and KVSnapshot
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Separate intercepor package
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Add comments
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Add order test
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Fix integration tests
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Fix integration tests
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Move interceptor call from client to client_collapse
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Add comments
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Fix comment
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Add client_interceptor
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Modify comment
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Add ut
Signed-off-by: mornyx <mornyx.z@gmail.com>
2021-12-18 13:03:06 +08:00
c0e8766154
txnkv: decrease some max and base backoff time ( #388 )
...
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2021-12-06 15:29:23 +08:00
3a7675742e
txnkv: read through locks ( #380 )
...
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2021-12-01 16:35:10 +08:00
e0bf24b24d
add newly inserted flag to optimize delete your write ( #378 )
...
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2021-11-15 21:23:32 -08:00
3b9f591c3f
txnkv: add callback for setting ResourceGroupTag ( #368 )
...
* Replace resourceGroupTag with resourceGroupTagFactory(firstKey)
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Fix npe
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Abstract ResourceGroupFactory
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Optimized as ResourceGroupTagger
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Add test for resource group tagger
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Fix unexpected request failed in mock store
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Fix integration tests
Signed-off-by: mornyx <mornyx.z@gmail.com>
Co-authored-by: Wenxuan <breezewish@pingcap.com>
2021-11-14 19:11:14 -08:00
8a4ce38c2a
tikv: remove BeginWithOption method ( #370 )
...
* tikv: remove BeginWithOption method
Signed-off-by: Xu Qiaolun <jamesxql@gmail.com>
* reset the tidb version in integration test to latest tidb master
Signed-off-by: Xu Qiaolun <jamesxql@gmail.com>
2021-11-11 00:56:58 -08:00
6ac6a8daf2
Abort if the mismatching lock is from the current transaction when resolving locks ( #367 )
...
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2021-11-10 10:15:56 +08:00
9ec50224be
*: replace pingcap/errors with pkg/errors ( #357 )
...
Signed-off-by: disksing <i@disksing.com>
2021-11-01 11:59:52 +08:00
cef46d13cc
Clean up the temporary changes ( #360 )
...
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2021-11-01 10:25:52 +08:00
2fd3841894
Update the PD client to the latest version ( #352 )
...
* Update the PD client to the latest version
Signed-off-by: JmPotato <ghzpotato@gmail.com>
* Temporarily change the TiDB test branch
Signed-off-by: JmPotato <ghzpotato@gmail.com>
* Fix the client-go/integration_tests go.mod
Signed-off-by: JmPotato <ghzpotato@gmail.com>
* Fix the client-go/integration_tests go.mod again
Signed-off-by: JmPotato <ghzpotato@gmail.com>
* Fix the integration_tests
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2021-10-29 10:40:11 +00:00
2d145163d0
txnkv/transaction: remove use of errors.Trace ( #351 )
...
Signed-off-by: disksing <i@disksing.com>
2021-10-27 10:13:37 +08:00
61664cf55c
integration_tests: remove use of errors.Trace ( #327 )
...
Signed-off-by: disksing <i@disksing.com>
2021-10-13 06:58:44 +00:00
9921da23d5
*: remove parser dependency ( #324 )
...
Signed-off-by: disksing <i@disksing.com>
2021-10-12 00:54:00 +08:00
49c8dd23f1
error: remove use of terror.ErrResultUndetermined ( #323 )
...
Signed-off-by: disksing <i@disksing.com>
2021-10-11 16:31:57 +08:00
128ccbde43
Add read throughput metric for SLI ( #321 )
...
Signed-off-by: jyz0309 <45495947@qq.com>
2021-10-11 11:46:20 +08:00
ee5063fec3
Fix flaky TestSecondaryListInPrimaryLock ( #318 )
2021-09-29 13:45:23 +08:00
Hangjie Mo