Commit Graph

750 Commits

Author SHA1 Message Date
ekexium 79a0fc59e4
Add a callback when MemDB grows (#520)
* implement the footprint chagne hook

Signed-off-by: ekexium <ekexium@fastmail.com>

* simplify the signature

Signed-off-by: ekexium <ekexium@fastmail.com>

* also call the callback when arena shrinks

Signed-off-by: ekexium <ekexium@fastmail.com>

* also callback on reset

Signed-off-by: ekexium <ekexium@fastmail.com>

Co-authored-by: disksing <i@disksing.com>
2022-06-30 15:19:23 +08:00
orion 947d923945
fix:move tikv.NewTxnClient to txnk.NewClient (#534)
Signed-off-by: 583373805 <583373805@qq.com>
2022-06-27 14:35:00 +08:00
you06 bb026bdad8
client: support requests with source label (#506)
* support request scope and source.

Signed-off-by: you06 <you1474600@gmail.com>

* update

Signed-off-by: you06 <you1474600@gmail.com>

* use counter for requests with too-many source

Signed-off-by: you06 <you1474600@gmail.com>

* refine resolve lock

Signed-off-by: you06 <you1474600@gmail.com>

* remove request source from resolve details

Signed-off-by: you06 <you1474600@gmail.com>

* address comment

Signed-off-by: you06 <you1474600@gmail.com>
2022-06-24 18:17:09 +08:00
haojinming 681fb6e537
[RawKV] support checksum (#519)
Signed-off-by: haojinming <jinming.hao@pingcap.com>

Co-authored-by: iosmanthus <dengliming@pingcap.com>
2022-06-22 16:08:35 +08:00
Jack Yu 98a4e2776e
transaction: update undetermined error log (#531)
* update undetermined error log

Signed-off-by: Jack Yu <jackysp@gmail.com>

* tiny change

Signed-off-by: Jack Yu <jackysp@gmail.com>
2022-06-20 10:56:30 +08:00
Yilin Chen be31f33ba0
Avoid sending requests to unhealthy leader (#503)
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2022-06-13 19:27:34 +08:00
Lei Zhao 2807409d49
client: fix nil dereference when closing conns (#514)
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>

Co-authored-by: Yilin Chen <sticnarf@gmail.com>
2022-05-31 16:17:49 +08:00
ekexium e69cd80e58
Preserve is_retry_request flag for prewrite when retrying with region errors (#513)
* add a test to verify the incorrect setting of is_retry_request

Signed-off-by: ekexium <ekexium@gmail.com>

* preserve the retry flag for prewrite

Signed-off-by: ekexium <ekexium@gmail.com>

* fix test

Signed-off-by: ekexium <ekexium@gmail.com>

* add more explanations

Signed-off-by: ekexium <ekexium@gmail.com>
2022-05-31 16:04:28 +08:00
crazycs 75d3f86f3b
unionstore: add checkpoint API to support TiDB savepoint feature (#490)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2022-05-30 13:58:57 +08:00
guo-shaoge 700cbe60d2
support find stores with tiflash_mpp label (#481)
Signed-off-by: guo-shaoge <shaoge1994@163.com>
Co-authored-by: Yilin Chen <sticnarf@gmail.com>
2022-05-23 11:22:53 +08:00
Yilin Chen de7ca289ac
Fix incorrect clear of resolving array (#507)
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2022-05-19 00:25:27 +08:00
Wenxuan 5d3195ce11
tiflash: Add TiFlash compact command (#504)
* Add TiFlash compact command

Signed-off-by: Wish <breezewish@outlook.com>

* Fix integration test go.mod

Signed-off-by: Wish <breezewish@outlook.com>

* Upgrade tidb dependency

Signed-off-by: Wish <breezewish@outlook.com>

* Use newer golang compiler

Signed-off-by: Wish <breezewish@outlook.com>
2022-05-17 21:31:43 +08:00
龙方淞 7ba562bc68
txn: record resolving locks (#473)
* record resolving locks

Signed-off-by: longfangsong <longfangsong@icloud.com>

* rename to ResolvingLock

Signed-off-by: longfangsong <longfangsong@icloud.com>

* Add test probe for resolving

Signed-off-by: longfangsong <longfangsong@icloud.com>

* refactor according to comments

Signed-off-by: longfangsong <longfangsong@icloud.com>

* Add  ResolveLocksDone for other call of ResolveLocks

Signed-off-by: longfangsong <longfangsong@icloud.com>

* Update txnkv/txnlock/lock_resolver.go

Co-authored-by: MyonKeminta <9948422+MyonKeminta@users.noreply.github.com>
Signed-off-by: longfangsong <longfangsong@icloud.com>

* Update to new design

Signed-off-by: longfangsong <longfangsong@icloud.com>

Co-authored-by: MyonKeminta <9948422+MyonKeminta@users.noreply.github.com>
Co-authored-by: Yilin Chen <sticnarf@gmail.com>
2022-05-17 11:13:16 +08:00
you06 79f010d806
metrics: add loading region cache duration (#502)
* add latency for loading region region

Signed-off-by: you06 <you1474600@gmail.com>

* rename "*ReginoMiss" to "*CacaheMiss"

Signed-off-by: you06 <you1474600@gmail.com>

* rename metrics

Signed-off-by: you06 <you1474600@gmail.com>
2022-05-16 15:21:22 +08:00
Spade A e007187e51
region_cache: Add comments for LocateBucket (#497)
* update

Signed-off-by: SpadeA-Tang <u6748471@anu.edu.au>

* update

Signed-off-by: SpadeA-Tang <u6748471@anu.edu.au>

* update

Signed-off-by: SpadeA-Tang <u6748471@anu.edu.au>
2022-05-16 11:52:21 +08:00
Ziqian Qin 190a4d190c
fix the vulnerability of atomicity in async commit (#492)
* fix the vulnerability of atomicity in async commit

Signed-off-by: ekexium <ekexium@gmail.com>

Revert "fix the vulnerability of atomicity in async commit"

This reverts commit b0b34c56168ba288e1619e66e626321365cb0921.

tidy up

Signed-off-by: ekexium <ekexium@gmail.com>

* add test

Signed-off-by: ekexium <ekexium@gmail.com>

* shorten the time of the test

Signed-off-by: ekexium <ekexium@gmail.com>

* fix test

Signed-off-by: ekexium <ekexium@gmail.com>

Co-authored-by: Yilin Chen <sticnarf@gmail.com>
2022-05-13 17:09:52 +08:00
Spade A 2be4a58dbc
region_cache: rename LocateBucketV2 to LocateBucket and let the old LocateBucket be the internal function of the new LocateBucket (#496)
Signed-off-by: SpadeA-Tang <u6748471@anu.edu.au>
2022-05-13 15:26:07 +08:00
Weizhen Wang ff5e35ac28
*: fix data race on the SetResourceGroupTagger (#491)
* *: fix data race on the SetResourceGroupTagger

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* *: fix data race on the SetResourceGroupTagger

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* *: fix data race on the SetResourceGroupTagger

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
2022-05-10 11:22:38 +08:00
Weizhen Wang 038b03552a
atomic PrewriteMaxBackoff (#488)
* atomic PrewriteMaxBackoff

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* PrewriteMaxBackoff use uint64

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

Co-authored-by: Yilin Chen <sticnarf@gmail.com>
2022-05-10 10:24:53 +08:00
Weizhen Wang cfe691debb
fix data race on the KVSnapshot.interceptor (#489)
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

Co-authored-by: Yilin Chen <sticnarf@gmail.com>
2022-05-09 17:23:19 +08:00
Connor a38ac96984
Add backoff for error recovery in progress (#485)
* add backoff for error recovery in progress

Signed-off-by: Connor1996 <zbk602423539@gmail.com>
2022-05-09 11:50:19 +08:00
Spade A 3705989fa1
Wrap locateBucket to handle with edges (#486)
Signed-off-by: SpadeA-Tang <u6748471@anu.edu.au>
2022-05-07 15:34:05 +08:00
xiongjiwei 3984ffee09
unionstore: make lock earlier (#484)
Signed-off-by: xiongjiwei <xiongjiwei1996@outlook.com>
2022-04-29 12:57:25 +08:00
tiancaiamao 577843f1b9
internal/unionstore: avoid panic and add log for tidb issue/34307 (#482)
Signed-off-by: tiancaiamao <tiancaiamao@gmail.com>
2022-04-28 14:21:51 +08:00
disksing b3d61828e5
Revert "tikv:move split region request to pd (#459)" (#476) 2022-04-24 12:57:32 +08:00
cfzjywxk 7f6daad88a
print original error if the recv failure is injected (#474)
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2022-04-20 13:49:05 +08:00
disksing 45f7e566b8
tikv: check nil response of split region (#472)
Signed-off-by: disksing <i@disksing.com>
2022-04-14 18:45:45 +08:00
tomato aeec0c030d
tikv:move split region request to pd (#459)
Signed-off-by: qidi1 <1083369179@qq.com>
2022-04-14 11:00:02 +08:00
Ziqian Qin e31ba21ae0
add a failpoint for sleep (#460)
Signed-off-by: ekexium <ekexium@gmail.com>

Co-authored-by: Yilin Chen <sticnarf@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2022-04-11 21:34:25 +08:00
disksing ec236b6435
fix linter warning (#470)
Signed-off-by: disksing <i@disksing.com>
2022-04-11 21:29:30 +08:00
Lei Zhao f73ec0e675
client: fix the race between connArray.Close() and connArray.Get() (#465)
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2022-04-06 17:12:03 +08:00
disksing c7fbfc2641
add comment for rawkv scans (#462)
Signed-off-by: disksing <i@disksing.com>
2022-04-06 15:43:15 +08:00
disksing cab40e7c82
fix compatibility test (#463) 2022-04-06 15:38:37 +08:00
Jack Yu 6bf6951325
use global variable instead of config (#458)
Signed-off-by: Jack Yu <jackysp@gmail.com>
2022-03-29 17:20:50 +08:00
Jack Yu 8489c3e8c3
config,txnkv: make txnCommitBatchSize adjustable by config (#457)
Signed-off-by: Jack Yu <jackysp@gmail.com>
2022-03-28 16:37:38 +08:00
Lei Zhao 5b4040a95c
reconnect when meets store-not-match errors (#456)
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2022-03-24 17:30:51 +08:00
cfzjywxk f4eae62b7e
copy the needed fields for backoffer type (#453)
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2022-03-21 20:35:29 +08:00
Ziqian Qin 33936824f6
fix the comment of TimeDetail (#451)
Signed-off-by: ekexium <ekexium@gmail.com>
2022-03-16 11:11:35 +08:00
MyonKeminta 5042c6f2aa
Return assertion failed error less prior to other kinds of errors (#448)
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2022-03-11 12:36:19 +08:00
龙方淞 cd7e7681c2
Update lock ttl when retry to pessimistic lock keys (#417)
Signed-off-by: longfangsong <longfangsong@icloud.com>
2022-03-10 16:10:47 +08:00
Lei Zhao 7e34d88af3
region_cache: support buckets (#439)
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2022-03-09 13:52:39 +08:00
cfzjywxk 079e2dce4e
txn: support read-consistency read with tso checking (#447)
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2022-03-08 10:31:03 +08:00
disksing 1aa72efa9b
mockstore: fix assertion (#446)
Signed-off-by: disksing <i@disksing.com>
2022-03-07 13:10:35 +08:00
disksing 7cbe10ea93
integration: try not to skip tests when run with tikv (#445)
Signed-off-by: disksing <i@disksing.com>
2022-03-07 11:27:20 +08:00
Zak Zhao 8c3f29a55f
Add options parameters in API CompareAndSwap (#433)
Signed-off-by: joccau <zak.zhao@pingcap.com>
2022-03-03 13:09:17 +08:00
Yilin Chen a6db0c9a3e
Fix incorrect LockNoWait value (#435)
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2022-03-02 20:03:17 +08:00
disksing 0214a9efa0
integration: replace some unistore with mockstore (#432)
Signed-off-by: disksing <i@disksing.com>
2022-03-02 16:36:25 +08:00
disksing cb9955362c
integration: use less tidb code (#431)
Signed-off-by: disksing <i@disksing.com>
2022-03-02 15:00:40 +08:00
Zak Zhao d3c2456967
Add a columnFamily feature for client-go when use rawput in tikv (#425)
Signed-off-by: joccau <zak.zhao@pingcap.com>
2022-03-02 11:31:44 +08:00
disksing df187fa79a
*: update readme (#430)
Signed-off-by: disksing <i@disksing.com>
2022-02-24 16:50:07 +08:00