e5f932ae27
txnkv: fix the issue that deleteRange cannot use nil as endkey ( #429 )
...
Signed-off-by: disksing <i@disksing.com>
2022-02-24 15:51:38 +08:00
f43cc3acc0
region_cache: more comments and minor refactor ( #427 )
...
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2022-02-23 16:53:24 +08:00
79b962a84d
integration: update tidb to master branch ( #426 )
...
Signed-off-by: disksing <i@disksing.com>
2022-02-22 11:34:36 +08:00
589cf79b2a
*: update etcd client to v3.5.2 ( #423 )
...
Signed-off-by: disksing <i@disksing.com>
2022-02-17 22:01:16 +08:00
b7a3ace8e6
txnkv: add shortcut to get global timestamp ( #395 )
...
Signed-off-by: disksing <i@disksing.com>
2022-02-11 12:40:35 +08:00
b5eb031edd
Support setting assertions and receiving assertion errors for Prewrite requests ( #311 )
...
* support set assertion in 2pc mutation
Signed-off-by: lysu <sulifx@gmail.com>
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Receive assertion fail errors from TiKV
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add test log
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Remove verbose log
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* update kvproto
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add metrics counter for assertions
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Address some comments
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Try to optimize assertion for pessimistic transactions
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix panic on optimistic transactions
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add InitCheckExistence method for LockCtx
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Support assertion level
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Check assertion level before doing assertion on client side
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Test bitoperations of menBUfferMutations.Push
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add test for assertion in tikv
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Support run assertion test with unistore
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix test
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix license
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix test
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* export DeleteKey
Signed-off-by: ekexium <ekexium@gmail.com>
* Renaming DeleteKey
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* fix build
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Address comments
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Avoid panic when running with old version of TiKV; Add schema check on fast assertion
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add test for fast assertion
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add test for pessimistic lock check existence
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Test assertion takes no effect if amending is enabled
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add HasAssertUnknown function
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add comments
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Cleanup locks after assertion fail
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* update tidb dependency
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix panic in TestIllegalTSO
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Address comments
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add comments
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Update dependency to tidb
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix test
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: lysu <sulifx@gmail.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: ekexium <ekexium@gmail.com>
2022-02-10 15:31:32 +08:00
cea0c4c6e6
update tidb version ( #419 )
...
Signed-off-by: lemonhx <lemonhx@lemonhx.tech>
2022-02-09 09:41:21 +08:00
50bafbb1e9
internal/retry: return the longest-sleeping type on backoff timeout ( #416 )
...
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2022-01-13 11:19:47 +08:00
d228150997
implement pd's global config ( #405 )
...
* update kvproto and pd, implement global config mock api
Signed-off-by: lemonhx <lemonhx@lemonhx.tech>
* update tidb version
Signed-off-by: lemonhx <lemonhx@lemonhx.tech>
* update pd version to pass tikv integration test
Signed-off-by: lemonhx <lemonhx@lemonhx.tech>
2022-01-06 20:00:26 -08:00
c24a5ba915
rawkv: Added back `ScanOption` from `v1` but with a more standard Golang pattern ( #402 )
...
* rawkv: Added back `ScanOption` from `v1` but with a more standard Golang pattern
This enables specifying:
- KeyOnly
- Cf
#### Notes
This could also be used to remove the `ReverseScan` version and `ScanReverse` option could be used. It could be argue that `ReverseScan` is more discoverable. Happy to remove if it's decided that `ScanReverse` is discoverable enough.
Signed-off-by: Matthieu Vachon <matt@streamingfast.io>
* Fixed linting issues
Signed-off-by: Matthieu Vachon <matt@streamingfast.io>
Co-authored-by: Matthieu Vachon <matt@streamingfast.io>
2022-01-06 18:06:34 -08:00
13298f12fb
rawkv: split BatchPut and BatchPutTTL ( #414 )
...
Signed-off-by: disksing <i@disksing.com>
2022-01-06 02:46:37 -08:00
fe2def20bb
fix RawBatchPutRequest forward compatibility ( #403 )
...
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
2022-01-05 22:53:06 -08:00
d2f0290d01
docs: make it explicit that DeleteRange deletes [start, end) ( #413 )
...
Signed-off-by: Yik San Chan <evan.chanyiksan@gmail.com>
2022-01-04 15:45:29 +08:00
dd263ab9f1
integration_tests: speed up TestCommitOnTiKVDiskFullOpt ( #411 )
...
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2022-01-04 14:58:47 +08:00
62d6b4a2e8
txnkv: set TiKV RC for weak-consistency transactions ( #407 )
...
* add tikv-rc support
Signed-off-by: you06 <you1474600@gmail.com>
* add test
Signed-off-by: you06 <you1474600@gmail.com>
* format code
Signed-off-by: you06 <you1474600@gmail.com>
* address comment
Signed-off-by: you06 <you1474600@gmail.com>
* address comment
Signed-off-by: you06 <you1474600@gmail.com>
* update tidb && address comment
Signed-off-by: you06 <you1474600@gmail.com>
* update test log
Signed-off-by: you06 <you1474600@gmail.com>
2021-12-29 13:16:14 +08:00
3b10001094
Add miss register for TiKVUnsafeDestroyRangeFailuresCounterVec ( #406 )
...
Signed-off-by: Jiahao Huang <july2993@gmail.com>
2021-12-28 11:31:51 +08:00
300275dee6
fix data race and panic when exiting ( #396 )
...
* fix the data race when exiting
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
* remove error and change log level
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
* add warn log
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
Co-authored-by: Yilin Chen <sticnarf@gmail.com>
2021-12-23 14:21:59 +08:00
e9de5625c4
txn: change IsUnnecessaryKeyValue interface to report error for unexpected paths ( #390 )
...
* change IsUnnecessaryKeyValue interface to report error for unexpected situations
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
* update integrated tests go mod
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
Co-authored-by: disksing <i@disksing.com>
2021-12-20 20:12:11 -08:00
02f89e38ec
metrics: make batch client requests more accurate ( #397 )
...
Signed-off-by: Yu Shuaipeng <jackysp@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2021-12-20 20:05:26 -08:00
6165dbaa95
introduce RPC interceptor mechanism ( #389 )
...
* Add interceptor mechanism for tikv RPC
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Rename comment
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Modify comments
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Fix ineffectual assignment
Signed-off-by: mornyx <mornyx.z@gmail.com>
* add AddInterceptor for KVTxn and KVSnapshot
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Separate intercepor package
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Add comments
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Add order test
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Fix integration tests
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Fix integration tests
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Move interceptor call from client to client_collapse
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Add comments
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Fix comment
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Add client_interceptor
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Modify comment
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Add ut
Signed-off-by: mornyx <mornyx.z@gmail.com>
2021-12-18 13:03:06 +08:00
605f49d3ba
txnkv/transaction: add a kv option for cached table lock lease ( #392 )
...
Signed-off-by: tiancaiamao <tiancaiamao@gmail.com>
2021-12-14 01:37:15 -08:00
b147ced35a
client: skip update backward safets ( #393 )
...
Signed-off-by: yisaer <disxiaofei@163.com>
2021-12-12 23:51:51 -08:00
87c1c58064
move tikv.NewTxnClient to txnkv.NewClient ( #391 )
...
Signed-off-by: disksing <i@disksing.com>
2021-12-09 21:38:38 -08:00
c0e8766154
txnkv: decrease some max and base backoff time ( #388 )
...
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2021-12-06 15:29:23 +08:00
3a7675742e
txnkv: read through locks ( #380 )
...
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2021-12-01 16:35:10 +08:00
350b6ce9fb
Add an RemoveFromBuffer method for test ( #387 )
...
* export DeleteKey
Signed-off-by: ekexium <ekexium@gmail.com>
* rename DeleteKey to UnsafeRemoveRecord
Signed-off-by: ekexium <ekexium@gmail.com>
* rename the old DeleteKey
Signed-off-by: ekexium <ekexium@gmail.com>
2021-11-30 19:43:54 +08:00
b11da6307c
txnkv: add ResourceGroupTagger for PessimisticLockRequest ( #381 )
...
* Add ResourceGroupTagger for PessimisticLockRequest
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Fix circular dependency
Signed-off-by: mornyx <mornyx.z@gmail.com>
2021-11-18 23:41:39 +08:00
b0d9bb8821
Bump go version to 1.16 ( #379 )
...
* Revert "use ioutil.ReadFile to release dependency of Go 1.16 (#217 )"
This reverts commit aadf3cf627
2021-11-18 06:06:13 -08:00
e0bf24b24d
add newly inserted flag to optimize delete your write ( #378 )
...
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2021-11-15 21:23:32 -08:00
a3f1c41ac1
Fix a typo ( #376 )
...
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2021-11-15 15:10:40 +08:00
894037ac74
Print the Region key with a more readable format ( #375 )
...
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2021-11-14 22:08:58 -08:00
3b9f591c3f
txnkv: add callback for setting ResourceGroupTag ( #368 )
...
* Replace resourceGroupTag with resourceGroupTagFactory(firstKey)
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Fix npe
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Abstract ResourceGroupFactory
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Optimized as ResourceGroupTagger
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Add test for resource group tagger
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Fix unexpected request failed in mock store
Signed-off-by: mornyx <mornyx.z@gmail.com>
* Fix integration tests
Signed-off-by: mornyx <mornyx.z@gmail.com>
Co-authored-by: Wenxuan <breezewish@pingcap.com>
2021-11-14 19:11:14 -08:00
dd4bc91453
test: remove ticdc compatibility test ( #366 )
...
Signed-off-by: disksing <i@disksing.com>
2021-11-12 00:15:04 -08:00
8a4ce38c2a
tikv: remove BeginWithOption method ( #370 )
...
* tikv: remove BeginWithOption method
Signed-off-by: Xu Qiaolun <jamesxql@gmail.com>
* reset the tidb version in integration test to latest tidb master
Signed-off-by: Xu Qiaolun <jamesxql@gmail.com>
2021-11-11 00:56:58 -08:00
6ac6a8daf2
Abort if the mismatching lock is from the current transaction when resolving locks ( #367 )
...
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2021-11-10 10:15:56 +08:00
5ae005dac3
Use a interface method to update the transaction option ( #363 )
...
* txn: Use a interface method to update the transaction option
Signed-off-by: Xu Qiaolun <jamesxql@gmail.com>
* txn: merge Begin and BeginWithOption into one method
Signed-off-by: Xu Qiaolun <jamesxql@gmail.com>
2021-11-03 02:29:33 +00:00
b8cc5a319d
fix metrics error ( #365 )
...
Signed-off-by: yisaer <disxiaofei@163.com>
2021-11-02 12:05:33 +00:00
c0efee0618
errors: use As to check error type ( #361 )
2021-11-01 10:32:00 +00:00
5a13df80a6
Add thread safety explanation to RegoinCache's comment ( #362 )
...
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2021-11-01 14:43:36 +08:00
9ec50224be
*: replace pingcap/errors with pkg/errors ( #357 )
...
Signed-off-by: disksing <i@disksing.com>
2021-11-01 11:59:52 +08:00
cef46d13cc
Clean up the temporary changes ( #360 )
...
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2021-11-01 10:25:52 +08:00
2fd3841894
Update the PD client to the latest version ( #352 )
...
* Update the PD client to the latest version
Signed-off-by: JmPotato <ghzpotato@gmail.com>
* Temporarily change the TiDB test branch
Signed-off-by: JmPotato <ghzpotato@gmail.com>
* Fix the client-go/integration_tests go.mod
Signed-off-by: JmPotato <ghzpotato@gmail.com>
* Fix the client-go/integration_tests go.mod again
Signed-off-by: JmPotato <ghzpotato@gmail.com>
* Fix the integration_tests
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2021-10-29 10:40:11 +00:00
c425022782
*: remove use of errors.Trace ( #353 )
...
Signed-off-by: disksing <i@disksing.com>
2021-10-28 16:25:58 +08:00
796f5433f5
test: update config for compatibility test ( #355 )
...
Signed-off-by: disksing <i@disksing.com>
2021-10-27 18:30:01 +08:00
70c69a3fac
txnkv/txnsnapshot: remove errors.Trace usages ( #345 )
...
close #344
Signed-off-by: disksing <i@disksing.com>
2021-10-27 08:41:49 +00:00
5c06d9b19a
txnkv/rangetask: remove errors.Trace usages ( #349 )
...
close #346
Signed-off-by: disksing <i@disksing.com>
2021-10-27 08:36:00 +00:00
2d145163d0
txnkv/transaction: remove use of errors.Trace ( #351 )
...
Signed-off-by: disksing <i@disksing.com>
2021-10-27 10:13:37 +08:00
a5250aa7c4
txnkv/txnlock: remove errors.Trace usages ( #350 )
...
close #347
Signed-off-by: disksing <i@disksing.com>
2021-10-25 17:44:03 +08:00
b7594dbe6e
tikv: remove use of errors.Trace ( #340 )
...
Signed-off-by: feitian124 <feitian124@gmail.com>
2021-10-20 03:53:36 +00:00
a7d8ea1587
rawkv: remove use of errors.Trace ( #336 )
...
Signed-off-by: disksing <i@disksing.com>
2021-10-13 07:29:43 +00:00
disksing