Commit Graph

492 Commits

Author SHA1 Message Date
crazycs 75d3f86f3b
unionstore: add checkpoint API to support TiDB savepoint feature (#490)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2022-05-30 13:58:57 +08:00
guo-shaoge 700cbe60d2
support find stores with tiflash_mpp label (#481)
Signed-off-by: guo-shaoge <shaoge1994@163.com>
Co-authored-by: Yilin Chen <sticnarf@gmail.com>
2022-05-23 11:22:53 +08:00
Yilin Chen de7ca289ac
Fix incorrect clear of resolving array (#507)
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2022-05-19 00:25:27 +08:00
Wenxuan 5d3195ce11
tiflash: Add TiFlash compact command (#504)
* Add TiFlash compact command

Signed-off-by: Wish <breezewish@outlook.com>

* Fix integration test go.mod

Signed-off-by: Wish <breezewish@outlook.com>

* Upgrade tidb dependency

Signed-off-by: Wish <breezewish@outlook.com>

* Use newer golang compiler

Signed-off-by: Wish <breezewish@outlook.com>
2022-05-17 21:31:43 +08:00
龙方淞 7ba562bc68
txn: record resolving locks (#473)
* record resolving locks

Signed-off-by: longfangsong <longfangsong@icloud.com>

* rename to ResolvingLock

Signed-off-by: longfangsong <longfangsong@icloud.com>

* Add test probe for resolving

Signed-off-by: longfangsong <longfangsong@icloud.com>

* refactor according to comments

Signed-off-by: longfangsong <longfangsong@icloud.com>

* Add  ResolveLocksDone for other call of ResolveLocks

Signed-off-by: longfangsong <longfangsong@icloud.com>

* Update txnkv/txnlock/lock_resolver.go

Co-authored-by: MyonKeminta <9948422+MyonKeminta@users.noreply.github.com>
Signed-off-by: longfangsong <longfangsong@icloud.com>

* Update to new design

Signed-off-by: longfangsong <longfangsong@icloud.com>

Co-authored-by: MyonKeminta <9948422+MyonKeminta@users.noreply.github.com>
Co-authored-by: Yilin Chen <sticnarf@gmail.com>
2022-05-17 11:13:16 +08:00
you06 79f010d806
metrics: add loading region cache duration (#502)
* add latency for loading region region

Signed-off-by: you06 <you1474600@gmail.com>

* rename "*ReginoMiss" to "*CacaheMiss"

Signed-off-by: you06 <you1474600@gmail.com>

* rename metrics

Signed-off-by: you06 <you1474600@gmail.com>
2022-05-16 15:21:22 +08:00
Spade A e007187e51
region_cache: Add comments for LocateBucket (#497)
* update

Signed-off-by: SpadeA-Tang <u6748471@anu.edu.au>

* update

Signed-off-by: SpadeA-Tang <u6748471@anu.edu.au>

* update

Signed-off-by: SpadeA-Tang <u6748471@anu.edu.au>
2022-05-16 11:52:21 +08:00
Ziqian Qin 190a4d190c
fix the vulnerability of atomicity in async commit (#492)
* fix the vulnerability of atomicity in async commit

Signed-off-by: ekexium <ekexium@gmail.com>

Revert "fix the vulnerability of atomicity in async commit"

This reverts commit b0b34c56168ba288e1619e66e626321365cb0921.

tidy up

Signed-off-by: ekexium <ekexium@gmail.com>

* add test

Signed-off-by: ekexium <ekexium@gmail.com>

* shorten the time of the test

Signed-off-by: ekexium <ekexium@gmail.com>

* fix test

Signed-off-by: ekexium <ekexium@gmail.com>

Co-authored-by: Yilin Chen <sticnarf@gmail.com>
2022-05-13 17:09:52 +08:00
Spade A 2be4a58dbc
region_cache: rename LocateBucketV2 to LocateBucket and let the old LocateBucket be the internal function of the new LocateBucket (#496)
Signed-off-by: SpadeA-Tang <u6748471@anu.edu.au>
2022-05-13 15:26:07 +08:00
Weizhen Wang ff5e35ac28
*: fix data race on the SetResourceGroupTagger (#491)
* *: fix data race on the SetResourceGroupTagger

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* *: fix data race on the SetResourceGroupTagger

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* *: fix data race on the SetResourceGroupTagger

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
2022-05-10 11:22:38 +08:00
Weizhen Wang 038b03552a
atomic PrewriteMaxBackoff (#488)
* atomic PrewriteMaxBackoff

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* PrewriteMaxBackoff use uint64

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

Co-authored-by: Yilin Chen <sticnarf@gmail.com>
2022-05-10 10:24:53 +08:00
Weizhen Wang cfe691debb
fix data race on the KVSnapshot.interceptor (#489)
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

Co-authored-by: Yilin Chen <sticnarf@gmail.com>
2022-05-09 17:23:19 +08:00
Connor a38ac96984
Add backoff for error recovery in progress (#485)
* add backoff for error recovery in progress

Signed-off-by: Connor1996 <zbk602423539@gmail.com>
2022-05-09 11:50:19 +08:00
Spade A 3705989fa1
Wrap locateBucket to handle with edges (#486)
Signed-off-by: SpadeA-Tang <u6748471@anu.edu.au>
2022-05-07 15:34:05 +08:00
xiongjiwei 3984ffee09
unionstore: make lock earlier (#484)
Signed-off-by: xiongjiwei <xiongjiwei1996@outlook.com>
2022-04-29 12:57:25 +08:00
tiancaiamao 577843f1b9
internal/unionstore: avoid panic and add log for tidb issue/34307 (#482)
Signed-off-by: tiancaiamao <tiancaiamao@gmail.com>
2022-04-28 14:21:51 +08:00
disksing b3d61828e5
Revert "tikv:move split region request to pd (#459)" (#476) 2022-04-24 12:57:32 +08:00
cfzjywxk 7f6daad88a
print original error if the recv failure is injected (#474)
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2022-04-20 13:49:05 +08:00
disksing 45f7e566b8
tikv: check nil response of split region (#472)
Signed-off-by: disksing <i@disksing.com>
2022-04-14 18:45:45 +08:00
tomato aeec0c030d
tikv:move split region request to pd (#459)
Signed-off-by: qidi1 <1083369179@qq.com>
2022-04-14 11:00:02 +08:00
Ziqian Qin e31ba21ae0
add a failpoint for sleep (#460)
Signed-off-by: ekexium <ekexium@gmail.com>

Co-authored-by: Yilin Chen <sticnarf@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2022-04-11 21:34:25 +08:00
disksing ec236b6435
fix linter warning (#470)
Signed-off-by: disksing <i@disksing.com>
2022-04-11 21:29:30 +08:00
Lei Zhao f73ec0e675
client: fix the race between connArray.Close() and connArray.Get() (#465)
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2022-04-06 17:12:03 +08:00
disksing c7fbfc2641
add comment for rawkv scans (#462)
Signed-off-by: disksing <i@disksing.com>
2022-04-06 15:43:15 +08:00
disksing cab40e7c82
fix compatibility test (#463) 2022-04-06 15:38:37 +08:00
Jack Yu 6bf6951325
use global variable instead of config (#458)
Signed-off-by: Jack Yu <jackysp@gmail.com>
2022-03-29 17:20:50 +08:00
Jack Yu 8489c3e8c3
config,txnkv: make txnCommitBatchSize adjustable by config (#457)
Signed-off-by: Jack Yu <jackysp@gmail.com>
2022-03-28 16:37:38 +08:00
Lei Zhao 5b4040a95c
reconnect when meets store-not-match errors (#456)
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2022-03-24 17:30:51 +08:00
cfzjywxk f4eae62b7e
copy the needed fields for backoffer type (#453)
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2022-03-21 20:35:29 +08:00
Ziqian Qin 33936824f6
fix the comment of TimeDetail (#451)
Signed-off-by: ekexium <ekexium@gmail.com>
2022-03-16 11:11:35 +08:00
MyonKeminta 5042c6f2aa
Return assertion failed error less prior to other kinds of errors (#448)
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2022-03-11 12:36:19 +08:00
龙方淞 cd7e7681c2
Update lock ttl when retry to pessimistic lock keys (#417)
Signed-off-by: longfangsong <longfangsong@icloud.com>
2022-03-10 16:10:47 +08:00
Lei Zhao 7e34d88af3
region_cache: support buckets (#439)
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2022-03-09 13:52:39 +08:00
cfzjywxk 079e2dce4e
txn: support read-consistency read with tso checking (#447)
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2022-03-08 10:31:03 +08:00
disksing 1aa72efa9b
mockstore: fix assertion (#446)
Signed-off-by: disksing <i@disksing.com>
2022-03-07 13:10:35 +08:00
disksing 7cbe10ea93
integration: try not to skip tests when run with tikv (#445)
Signed-off-by: disksing <i@disksing.com>
2022-03-07 11:27:20 +08:00
Zak Zhao 8c3f29a55f
Add options parameters in API CompareAndSwap (#433)
Signed-off-by: joccau <zak.zhao@pingcap.com>
2022-03-03 13:09:17 +08:00
Yilin Chen a6db0c9a3e
Fix incorrect LockNoWait value (#435)
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2022-03-02 20:03:17 +08:00
disksing 0214a9efa0
integration: replace some unistore with mockstore (#432)
Signed-off-by: disksing <i@disksing.com>
2022-03-02 16:36:25 +08:00
disksing cb9955362c
integration: use less tidb code (#431)
Signed-off-by: disksing <i@disksing.com>
2022-03-02 15:00:40 +08:00
Zak Zhao d3c2456967
Add a columnFamily feature for client-go when use rawput in tikv (#425)
Signed-off-by: joccau <zak.zhao@pingcap.com>
2022-03-02 11:31:44 +08:00
disksing df187fa79a
*: update readme (#430)
Signed-off-by: disksing <i@disksing.com>
2022-02-24 16:50:07 +08:00
disksing e5f932ae27
txnkv: fix the issue that deleteRange cannot use nil as endkey (#429)
Signed-off-by: disksing <i@disksing.com>
2022-02-24 15:51:38 +08:00
Lei Zhao f43cc3acc0
region_cache: more comments and minor refactor (#427)
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2022-02-23 16:53:24 +08:00
disksing 79b962a84d
integration: update tidb to master branch (#426)
Signed-off-by: disksing <i@disksing.com>
2022-02-22 11:34:36 +08:00
disksing 589cf79b2a
*: update etcd client to v3.5.2 (#423)
Signed-off-by: disksing <i@disksing.com>
2022-02-17 22:01:16 +08:00
disksing b7a3ace8e6
txnkv: add shortcut to get global timestamp (#395)
Signed-off-by: disksing <i@disksing.com>
2022-02-11 12:40:35 +08:00
MyonKeminta b5eb031edd
Support setting assertions and receiving assertion errors for Prewrite requests (#311)
* support set assertion in 2pc mutation

Signed-off-by: lysu <sulifx@gmail.com>
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Receive assertion fail errors from TiKV

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add test log

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Remove verbose log

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* update kvproto

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add metrics counter for assertions

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Address some comments

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Try to optimize assertion for pessimistic transactions

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Fix panic on optimistic transactions

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add InitCheckExistence method for LockCtx

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Support assertion level

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Check assertion level before doing assertion on client side

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Test bitoperations of menBUfferMutations.Push

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add test for assertion in tikv

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Support run assertion test with unistore

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Fix test

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Fix license

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Fix test

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* export DeleteKey

Signed-off-by: ekexium <ekexium@gmail.com>

* Renaming DeleteKey

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* fix build

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Address comments

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Avoid panic when running with old version of TiKV; Add schema check on fast assertion

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add test for fast assertion

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add test for pessimistic lock check existence

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Test assertion takes no effect if amending is enabled

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add HasAssertUnknown function

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add comments

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Cleanup locks after assertion fail

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* update tidb dependency

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Fix panic in TestIllegalTSO

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Address comments

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add comments

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Update dependency to tidb

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Fix test

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

Co-authored-by: lysu <sulifx@gmail.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: ekexium <ekexium@gmail.com>
2022-02-10 15:31:32 +08:00
LemonHX cea0c4c6e6
update tidb version (#419)
Signed-off-by: lemonhx <lemonhx@lemonhx.tech>
2022-02-09 09:41:21 +08:00
Yilin Chen 50bafbb1e9
internal/retry: return the longest-sleeping type on backoff timeout (#416)
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2022-01-13 11:19:47 +08:00