Commit Graph

73 Commits

Author SHA1 Message Date
tiancaiamao 577843f1b9
internal/unionstore: avoid panic and add log for tidb issue/34307 (#482)
Signed-off-by: tiancaiamao <tiancaiamao@gmail.com>
2022-04-28 14:21:51 +08:00
disksing b3d61828e5
Revert "tikv:move split region request to pd (#459)" (#476) 2022-04-24 12:57:32 +08:00
cfzjywxk 7f6daad88a
print original error if the recv failure is injected (#474)
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2022-04-20 13:49:05 +08:00
tomato aeec0c030d
tikv:move split region request to pd (#459)
Signed-off-by: qidi1 <1083369179@qq.com>
2022-04-14 11:00:02 +08:00
disksing ec236b6435
fix linter warning (#470)
Signed-off-by: disksing <i@disksing.com>
2022-04-11 21:29:30 +08:00
Lei Zhao f73ec0e675
client: fix the race between connArray.Close() and connArray.Get() (#465)
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2022-04-06 17:12:03 +08:00
Lei Zhao 5b4040a95c
reconnect when meets store-not-match errors (#456)
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2022-03-24 17:30:51 +08:00
cfzjywxk f4eae62b7e
copy the needed fields for backoffer type (#453)
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2022-03-21 20:35:29 +08:00
MyonKeminta 5042c6f2aa
Return assertion failed error less prior to other kinds of errors (#448)
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2022-03-11 12:36:19 +08:00
Lei Zhao 7e34d88af3
region_cache: support buckets (#439)
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2022-03-09 13:52:39 +08:00
disksing 1aa72efa9b
mockstore: fix assertion (#446)
Signed-off-by: disksing <i@disksing.com>
2022-03-07 13:10:35 +08:00
Zak Zhao 8c3f29a55f
Add options parameters in API CompareAndSwap (#433)
Signed-off-by: joccau <zak.zhao@pingcap.com>
2022-03-03 13:09:17 +08:00
Zak Zhao d3c2456967
Add a columnFamily feature for client-go when use rawput in tikv (#425)
Signed-off-by: joccau <zak.zhao@pingcap.com>
2022-03-02 11:31:44 +08:00
disksing e5f932ae27
txnkv: fix the issue that deleteRange cannot use nil as endkey (#429)
Signed-off-by: disksing <i@disksing.com>
2022-02-24 15:51:38 +08:00
Lei Zhao f43cc3acc0
region_cache: more comments and minor refactor (#427)
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2022-02-23 16:53:24 +08:00
disksing 589cf79b2a
*: update etcd client to v3.5.2 (#423)
Signed-off-by: disksing <i@disksing.com>
2022-02-17 22:01:16 +08:00
MyonKeminta b5eb031edd
Support setting assertions and receiving assertion errors for Prewrite requests (#311)
* support set assertion in 2pc mutation

Signed-off-by: lysu <sulifx@gmail.com>
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Receive assertion fail errors from TiKV

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add test log

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Remove verbose log

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* update kvproto

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add metrics counter for assertions

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Address some comments

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Try to optimize assertion for pessimistic transactions

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Fix panic on optimistic transactions

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add InitCheckExistence method for LockCtx

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Support assertion level

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Check assertion level before doing assertion on client side

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Test bitoperations of menBUfferMutations.Push

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add test for assertion in tikv

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Support run assertion test with unistore

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Fix test

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Fix license

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Fix test

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* export DeleteKey

Signed-off-by: ekexium <ekexium@gmail.com>

* Renaming DeleteKey

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* fix build

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Address comments

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Avoid panic when running with old version of TiKV; Add schema check on fast assertion

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add test for fast assertion

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add test for pessimistic lock check existence

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Test assertion takes no effect if amending is enabled

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add HasAssertUnknown function

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add comments

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Cleanup locks after assertion fail

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* update tidb dependency

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Fix panic in TestIllegalTSO

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Address comments

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add comments

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Update dependency to tidb

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Fix test

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

Co-authored-by: lysu <sulifx@gmail.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: ekexium <ekexium@gmail.com>
2022-02-10 15:31:32 +08:00
Yilin Chen 50bafbb1e9
internal/retry: return the longest-sleeping type on backoff timeout (#416)
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2022-01-13 11:19:47 +08:00
LemonHX d228150997
implement pd's global config (#405)
* update kvproto and pd, implement global config mock api

Signed-off-by: lemonhx <lemonhx@lemonhx.tech>

* update tidb version

Signed-off-by: lemonhx <lemonhx@lemonhx.tech>

* update pd version to pass tikv integration test

Signed-off-by: lemonhx <lemonhx@lemonhx.tech>
2022-01-06 20:00:26 -08:00
Weizhen Wang 300275dee6
fix data race and panic when exiting (#396)
* fix the data race when exiting

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* remove error and change log level

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* add warn log

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

Co-authored-by: Yilin Chen <sticnarf@gmail.com>
2021-12-23 14:21:59 +08:00
Jack Yu 02f89e38ec
metrics: make batch client requests more accurate (#397)
Signed-off-by: Yu Shuaipeng <jackysp@gmail.com>

Co-authored-by: disksing <i@disksing.com>
2021-12-20 20:05:26 -08:00
Yexiang Zhang 6165dbaa95
introduce RPC interceptor mechanism (#389)
* Add interceptor mechanism for tikv RPC

Signed-off-by: mornyx <mornyx.z@gmail.com>

* Rename comment

Signed-off-by: mornyx <mornyx.z@gmail.com>

* Modify comments

Signed-off-by: mornyx <mornyx.z@gmail.com>

* Fix ineffectual assignment

Signed-off-by: mornyx <mornyx.z@gmail.com>

* add AddInterceptor for KVTxn and KVSnapshot

Signed-off-by: mornyx <mornyx.z@gmail.com>

* Separate intercepor package

Signed-off-by: mornyx <mornyx.z@gmail.com>

* Add comments

Signed-off-by: mornyx <mornyx.z@gmail.com>

* Add order test

Signed-off-by: mornyx <mornyx.z@gmail.com>

* Fix integration tests

Signed-off-by: mornyx <mornyx.z@gmail.com>

* Fix integration tests

Signed-off-by: mornyx <mornyx.z@gmail.com>

* Move interceptor call from client to client_collapse

Signed-off-by: mornyx <mornyx.z@gmail.com>

* Add comments

Signed-off-by: mornyx <mornyx.z@gmail.com>

* Fix comment

Signed-off-by: mornyx <mornyx.z@gmail.com>

* Add client_interceptor

Signed-off-by: mornyx <mornyx.z@gmail.com>

* Modify comment

Signed-off-by: mornyx <mornyx.z@gmail.com>

* Add ut

Signed-off-by: mornyx <mornyx.z@gmail.com>
2021-12-18 13:03:06 +08:00
Lei Zhao c0e8766154
txnkv: decrease some max and base backoff time (#388)
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2021-12-06 15:29:23 +08:00
Lei Zhao 3a7675742e
txnkv: read through locks (#380)
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2021-12-01 16:35:10 +08:00
Ziqian Qin 350b6ce9fb
Add an RemoveFromBuffer method for test (#387)
* export DeleteKey

Signed-off-by: ekexium <ekexium@gmail.com>

* rename DeleteKey to UnsafeRemoveRecord

Signed-off-by: ekexium <ekexium@gmail.com>

* rename the old DeleteKey

Signed-off-by: ekexium <ekexium@gmail.com>
2021-11-30 19:43:54 +08:00
MyonKeminta a3f1c41ac1
Fix a typo (#376)
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2021-11-15 15:10:40 +08:00
JmPotato 894037ac74
Print the Region key with a more readable format (#375)
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2021-11-14 22:08:58 -08:00
Song Gao b8cc5a319d
fix metrics error (#365)
Signed-off-by: yisaer <disxiaofei@163.com>
2021-11-02 12:05:33 +00:00
MyonKeminta 5a13df80a6
Add thread safety explanation to RegoinCache's comment (#362)
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2021-11-01 14:43:36 +08:00
disksing 9ec50224be
*: replace pingcap/errors with pkg/errors (#357)
Signed-off-by: disksing <i@disksing.com>
2021-11-01 11:59:52 +08:00
JmPotato 2fd3841894
Update the PD client to the latest version (#352)
* Update the PD client to the latest version

Signed-off-by: JmPotato <ghzpotato@gmail.com>

* Temporarily change the TiDB test branch

Signed-off-by: JmPotato <ghzpotato@gmail.com>

* Fix the client-go/integration_tests go.mod

Signed-off-by: JmPotato <ghzpotato@gmail.com>

* Fix the client-go/integration_tests go.mod again

Signed-off-by: JmPotato <ghzpotato@gmail.com>

* Fix the integration_tests

Signed-off-by: JmPotato <ghzpotato@gmail.com>
2021-10-29 10:40:11 +00:00
feitian124 b7594dbe6e
tikv: remove use of errors.Trace (#340)
Signed-off-by: feitian124 <feitian124@gmail.com>
2021-10-20 03:53:36 +00:00
disksing a7d8ea1587
rawkv: remove use of errors.Trace (#336)
Signed-off-by: disksing <i@disksing.com>
2021-10-13 07:29:43 +00:00
disksing ed3af2fc7f
internal/mockstore: remove use of errors.Trace (#334)
Signed-off-by: disksing <i@disksing.com>
2021-10-13 07:09:54 +00:00
disksing 3e9bd8b941
internal/locate: remove use of errors.Trace (#332)
Signed-off-by: disksing <i@disksing.com>
2021-10-11 17:05:36 +00:00
disksing b074cb9ad3
internal/client: remove use of errors.Trace (#329)
Signed-off-by: disksing <i@disksing.com>
2021-10-11 16:59:49 +00:00
disksing 49c8dd23f1
error: remove use of terror.ErrResultUndetermined (#323)
Signed-off-by: disksing <i@disksing.com>
2021-10-11 16:31:57 +08:00
disksing 97fac134af
error: replace usages of terror.Log (#322)
Signed-off-by: disksing <i@disksing.com>
2021-10-11 06:08:21 +00:00
you06 843a5378aa
add readable flag (#320)
Signed-off-by: you06 <you1474600@gmail.com>
2021-10-09 04:30:03 +00:00
Lei Zhao 3b672526bb
fix unknown region error metrics (#315)
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>

Co-authored-by: disksing <i@disksing.com>
2021-09-29 05:50:39 +00:00
daimashusheng 4f806a5442
batchput add ttl to every key (#298)
Signed-off-by: tangjk <tangjiankun1226@gmail.com>
2021-09-26 11:50:08 +00:00
Song Gao 3cc2459779
add label (#314)
Signed-off-by: yisaer <disxiaofei@163.com>
2021-09-26 18:06:28 +08:00
xufei f65172694b
add `skipSwitchPeerLog` in `OnSendFailForTiFlash` (#309)
Signed-off-by: xufei <xufeixw@mail.ustc.edu.cn>
2021-09-23 09:55:21 +00:00
Song Gao 6ca8098ae0
add warn log (#308)
Signed-off-by: yisaer <disxiaofei@163.com>
2021-09-18 15:13:19 +08:00
tier-cap f4a640e8e0
rechange to retry when tikv disk full (#302)
Signed-off-by: tier-cap <zhengxiaojin@pingcap.com>
2021-09-15 13:01:35 +08:00
Song Gao a8fa8acd44
rename txnScope as readReplicaScope (#305)
Signed-off-by: yisaer <disxiaofei@163.com>
2021-09-13 17:49:25 +08:00
Jack Yu d8891ee28d
internal/client: demoted annoying log (#303)
Signed-off-by: Shuaipeng Yu <jackysp@gmail.com>
2021-09-12 20:45:58 +08:00
JmPotato c7f8168472
client: fix some typos (#296)
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2021-09-02 14:01:52 +08:00
Lei Zhao 06c3868595
select replica for replica read requests using ReplicaSelector (#285)
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2021-09-02 02:10:36 +00:00
Yilin Chen 16d902a3c7
reduce write backoffs but don't count busy errors (#271)
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2021-08-24 09:05:36 +00:00