51aab264f6
add gc options ( #828 )
...
Signed-off-by: weedge <weege007@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-07-14 12:08:47 +08:00
4ec212d5f2
*: fix stale read ops metric ( #878 ) ( #889 )
...
Signed-off-by: crazycs520 <crazycs520@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-07-14 11:03:10 +08:00
2f119351bd
*: add `SnapshotIterReverse` and make `iterReverse` supports `lowerBound` ( #883 )
...
Signed-off-by: Jason Mo <mohangjie1995@gmail.com>
2023-07-14 10:36:07 +08:00
51633ada95
region_cache: support check pending tiflash peer ( #821 )
...
Signed-off-by: guo-shaoge <shaoge1994@163.com>
Co-authored-by: disksing <i@disksing.com>
2023-07-13 14:08:45 +08:00
e540aa3b96
make cop request timeout a config paramter ( #865 )
...
* update
Signed-off-by: Spade A <u6748471@anu.edu.au>
* update
Signed-off-by: Spade A <u6748471@anu.edu.au>
* update
Signed-off-by: Spade A <u6748471@anu.edu.au>
* update
Signed-off-by: Spade A <u6748471@anu.edu.au>
---------
Signed-off-by: Spade A <u6748471@anu.edu.au>
2023-07-11 15:58:55 +08:00
5e3e38b270
format key in error message in method `scanRegions` ( #876 )
...
Signed-off-by: Chao Wang <cclcwangchao@hotmail.com>
2023-07-10 15:42:05 +08:00
32eb2b0f88
use '%d' instead of '%q' for some int values in error message ( #875 )
...
Signed-off-by: Chao Wang <cclcwangchao@hotmail.com>
2023-07-10 12:30:33 +08:00
178f6fa01a
add explicit request source type to label the external request like lightning/br ( #868 )
...
Signed-off-by: nolouch <nolouch@gmail.com>
2023-07-07 15:02:42 +08:00
c0cf773917
Fix the issue that primary pessimistic lock may be left not cleared after GC ( #866 )
...
* Fix the issue that primary pessimistic lock may be left not cleared after GC
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix mysteriously shown up thing that makes compilation failed
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix test effectiveness (forgot to set txn2 to pessimistic txn); add more strict checks
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Address comments
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
---------
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2023-07-04 15:17:05 +08:00
fbec023060
*: refine non-global stale-read request retry logic ( #863 )
...
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-07-03 12:12:02 +08:00
c764d7bc8f
client-go: add some key range info to error when PD returned no region ( #862 )
...
Signed-off-by: Chao Wang <cclcwangchao@hotmail.com>
2023-06-30 14:27:00 +08:00
04dc78e522
lock_resolver: let getTxnStatusFromLock return error when backoff timeout ( #847 )
...
Signed-off-by: zyguan <zhongyangguan@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-06-21 13:07:44 +08:00
864a5fc0c4
make ResourceControlInterceptor atomic ( #848 )
...
Signed-off-by: glorv <glorvs@163.com>
2023-06-21 11:10:26 +08:00
18b17d4b72
fix rpc interceptor data race ( #845 )
...
Signed-off-by: glorv <glorvs@163.com>
2023-06-18 22:18:18 -07:00
b32f340d06
impl resource manager get default resource group ( #839 )
...
Signed-off-by: Cabinfever_B <cabinfeveroier@gmail.com>
2023-06-15 09:18:45 -07:00
0b4b0ca00e
kvrpc: deduplicate chained intercept by name ( #832 )
...
* dedup chained interceptor
Signed-off-by: glorv <glorvs@163.com>
2023-06-13 20:21:06 -07:00
df58452fe1
client_batch: add test for auto re-connect idle connection when wait connection ready and fix ci ( #835 )
...
* client_batch: add test
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix ci
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix ci
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix ci
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* update go version
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix ci
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix ci lint
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix ci lint
Signed-off-by: crazycs520 <crazycs520@gmail.com>
---------
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-06-13 14:17:17 +08:00
5ddc523cfc
*: update pd client version ( #830 )
...
Signed-off-by: Cabinfever_B <cabinfeveroier@gmail.com>
2023-06-08 15:47:29 +08:00
cf07be2ba0
add const label for metrics ( #802 )
...
Signed-off-by: zeminzhou <zhouzemin@pingcap.com>
Co-authored-by: disksing <i@disksing.com>
2023-06-07 13:48:17 +08:00
28247160f4
PDHTTPClient: when meet GetStoreMinResolvedTS error just write in debug log ( #825 )
...
Signed-off-by: husharp <jinhao.hu@pingcap.com>
Co-authored-by: disksing <i@disksing.com>
2023-06-05 16:51:12 +08:00
27d0c27915
controller: add replica number ( #823 )
...
Signed-off-by: nolouch <nolouch@gmail.com>
2023-06-01 14:52:28 +08:00
11121c6913
Remove stale-read flag after resolving lock ( #792 )
...
* remove stale-read when key-is-locked
Signed-off-by: you06 <you1474600@gmail.com>
* disable follower read for batch get
Signed-off-by: you06 <you1474600@gmail.com>
* the stale-read flag may already set to false
Signed-off-by: you06 <you1474600@gmail.com>
* fix batchget
Signed-off-by: you06 <you1474600@gmail.com>
* Reset busy-threshold when stale read fallback to leader read
Signed-off-by: you06 <you1474600@gmail.com>
* address comment
Signed-off-by: you06 <you1474600@gmail.com>
* trigger CI
Signed-off-by: you06 <you1474600@gmail.com>
---------
Signed-off-by: you06 <you1474600@gmail.com>
2023-05-26 13:55:53 +08:00
d3c53d30ff
update dependency ( #816 )
...
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
2023-05-24 15:32:22 +08:00
1b28766936
PDHTTPClient: when meet GetStoreMinResolvedTS error just write in debug log ( #814 )
...
Signed-off-by: husharp <ihusharp@gmail.com>
2023-05-24 11:26:53 +08:00
893dd82957
[CodecV2] cache keyspaceID when creating codecV2 ( #812 )
2023-05-23 15:31:32 +08:00
d1e188a981
Do not skip TestBatchResolveLocks for unistore ( #807 )
...
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2023-05-18 19:48:00 +08:00
adb48afeef
pd http: support api to get store min resolved ts ( #793 )
...
Signed-off-by: husharp <ihusharp@gmail.com>
2023-05-12 11:43:16 +08:00
c946782286
Fallback to leader read when replica read meets flashback-in-progress error ( #796 )
...
* handle flashback error when follower read
Signed-off-by: you06 <you1474600@gmail.com>
* add test
Signed-off-by: you06 <you1474600@gmail.com>
* trigger CI
Signed-off-by: you06 <you1474600@gmail.com>
* fix panic
Signed-off-by: you06 <you1474600@gmail.com>
* trigger CI
Signed-off-by: you06 <you1474600@gmail.com>
* trigger CI
Signed-off-by: you06 <you1474600@gmail.com>
---------
Signed-off-by: you06 <you1474600@gmail.com>
2023-05-11 13:49:08 +08:00
2b0667c65c
lock_resolver: handle pessimistic locks in BatchResolveLocks ( #794 )
...
* lock_resolver: handle pessimistic locks in BatchResolveLocks
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add test but failed on unistore because unistore's ScanLock doesnt return lock type
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Address comments
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix test
Signed-off-by: zyguan <zhongyangguan@gmail.com>
* Fix golangci
Signed-off-by: zyguan <zhongyangguan@gmail.com>
---------
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Signed-off-by: zyguan <zhongyangguan@gmail.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2023-05-11 12:26:01 +08:00
5c324b7c1e
lock_resolver: support verifying primary for check_txn_status ( #777 )
...
* support verifying primary for check_txn_status
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* update kvproto
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* add more failpoint usages
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* update depencency and fix test
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Do not skip for unistore; refine logs
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Address comments
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
---------
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2023-05-08 16:18:26 +08:00
62cc95123c
Fix wrong resource group name for some requests ( #788 )
...
* fix wrong resource group name
Signed-off-by: Connor1996 <zbk602423539@gmail.com>
2023-04-28 19:03:56 +08:00
069dbc5b6c
fix TestRURuntimeStatsCleanUp ( #787 )
...
Signed-off-by: husharp <ihusharp@gmail.com>
2023-04-28 13:43:54 +08:00
36826f75ce
[master] encode store batch tasks ( #786 )
2023-04-27 19:54:53 +08:00
aee2f311a5
txn: fix goroutine leak ( #784 )
...
Signed-off-by: disksing <i@disksing.com>
2023-04-27 17:39:07 +08:00
c619a50474
add metrics for stale-read traffic ( #776 )
...
Signed-off-by: you06 <you1474600@gmail.com>
2023-04-27 14:55:46 +08:00
f64d5dd79b
update dco ( #731 )
...
Signed-off-by: Smityz <smityz@qq.com>
Co-authored-by: disksing <i@disksing.com>
2023-04-27 14:45:04 +08:00
44663b372a
doc(tikv/test_probe.go) fix case typo in comment. ( #778 )
...
Signed-off-by: Violin0622 <violin0622@outlook.com>
2023-04-26 15:50:49 +08:00
2be71b35ee
Add afterSendReqToRegion failpoint ( #780 )
...
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2023-04-26 15:50:11 +08:00
35c1ee47c4
Set resource group penalty ( #772 )
...
* Set resource group penalty
Signed-off-by: Connor1996 <zbk602423539@gmail.com>
2023-04-19 20:39:20 +08:00
a72e61dc64
log: print log if the assertion error is generated from client-go ( #771 )
...
Signed-off-by: ekexium <eke@fastmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-04-19 17:42:17 +08:00
dd6caa4c03
execdetails: add RRU/WRU interface of RURuntimeStats ( #769 )
...
Signed-off-by: nolouch <nolouch@gmail.com>
2023-04-19 16:57:01 +08:00
415713766f
avoid dataIsNotReady error while retrying stale read on the leader ( #765 )
...
* avoid dataIsNotReady error while retrying stale read on the leader
Signed-off-by: artem_danilov <artem_danilov@airbnb.com>
* move StaleRead flag reset to retry section
Signed-off-by: artem_danilov <artem_danilov@airbnb.com>
* move all logic to #next and allow retry on the leader
Signed-off-by: artem_danilov <artem_danilov@airbnb.com>
---------
Signed-off-by: artem_danilov <artem_danilov@airbnb.com>
Co-authored-by: artem_danilov <artem_danilov@airbnb.com>
2023-04-19 10:48:52 +08:00
92db9f7b15
Support specifying checking forUpdateTS in prewrite ( #756 )
...
* Support specifying checking forUpdateTS in prewrite
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix go mod in tests
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add test
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix test
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add successful cases to the test
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix test
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Update dependencies
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Check LockedWithConflictTS greater than requested ForUpdateTS
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
---------
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2023-04-17 14:53:28 +08:00
c853ddc68c
metrics: add txn ttl lifetime ( #766 )
...
Signed-off-by: Jack Yu <jackysp@gmail.com>
Co-authored-by: Shirly <AndreMouche@126.com>
2023-04-14 13:59:29 +08:00
67e56a956f
For KeyIsLocked error reported for timeout, if a lock is recently updated, don't try to resolve it. ( #758 )
...
* update client-go; format
Signed-off-by: ekexium <eke@fastmail.com>
* feat: do not resolve lock if duration_to_last_updated is short
Signed-off-by: ekexium <eke@fastmail.com>
* adjust the threshold to 1200ms to allow small deviation
Signed-off-by: ekexium <eke@fastmail.com>
* fix: don't treat it as WriteConflict, simply retry
Signed-off-by: ekexium <eke@fastmail.com>
* update kvproto
Signed-off-by: ekexium <eke@fastmail.com>
* set the threshold to 300ms
Signed-off-by: ekexium <eke@fastmail.com>
---------
Signed-off-by: ekexium <eke@fastmail.com>
2023-04-13 16:14:28 +08:00
f3e87039d8
Finer `is_retry_request` settings ( #763 )
...
* set is_retry_request only for requests that is possible to have undetermined errors
Signed-off-by: ekexium <eke@fastmail.com>
* rename tryTimes to retryTimes
Signed-off-by: ekexium <eke@fastmail.com>
---------
Signed-off-by: ekexium <eke@fastmail.com>
Co-authored-by: cfzjywxk <lsswxrxr@163.com>
2023-04-10 10:39:43 +08:00
1ec0ff5bf4
Support return TiFlash system table by grpc ( #759 )
...
Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>
2023-04-06 14:42:57 +08:00
4ac424aea1
refactor decoding buckets with new interface method: DecodeBucketKeys ( #760 )
...
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
2023-03-31 16:06:44 +08:00
6a92aeec92
fix api v2 decode of region bucket's keys ( #757 )
...
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
2023-03-31 11:07:45 +08:00
fd1b0552eb
upgrade pd client ( #755 )
...
Signed-off-by: Ryan Leung <rleungx@gmail.com>
2023-03-30 14:55:23 +08:00
weedge