Commit Graph

659 Commits

Author SHA1 Message Date
husharp 0930be96a5 remove ci
Signed-off-by: husharp <jinhao.hu@pingcap.com>
2023-08-02 18:40:29 +08:00
husharp 359295c3e0 refine variables name and modify tests
Signed-off-by: husharp <jinhao.hu@pingcap.com>
2023-08-02 15:40:15 +08:00
husharp c5bf330532 expand min-resolved-ts to support stores
Signed-off-by: husharp <jinhao.hu@pingcap.com>
2023-08-02 15:14:15 +08:00
crazycs 719e6456f7
use context logger as much as possible (#908)
* use context logger as much as possible

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-07-31 11:23:49 +08:00
crazycs 9f94221c2d
add more log for diagnose (#915)
* add more log for diagnose

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* add more log for diagnose

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* add more log

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* address comment

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-07-28 20:35:05 +08:00
Hu# 76d6d93e98
resource_manager: ignore ru metrics for background request (#872)
Signed-off-by: husharp <jinhao.hu@pingcap.com>
Co-authored-by: disksing <i@disksing.com>
2023-07-26 15:13:54 +08:00
crazycs d880eca9e1
fix unexpected slow query during GC running after stop 1 tikv-server (#899) (#909)
* fix unexpected slow query during GC running after stop 1 tikv-server

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix test

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-07-26 13:57:33 +08:00
disksing 1b093b4ec3
ci: update setup-go action (#904)
Signed-off-by: disksing <i@disksing.com>
2023-07-24 17:32:41 +08:00
you06 85fc8f3375
reload region cache when store is resolved from invalid status (#843)
Signed-off-by: you06 <you1474600@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-07-14 13:27:14 +08:00
weedge 51aab264f6
add gc options (#828)
Signed-off-by: weedge <weege007@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-07-14 12:08:47 +08:00
crazycs 4ec212d5f2
*: fix stale read ops metric (#878) (#889)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-07-14 11:03:10 +08:00
Hangjie Mo 2f119351bd
*: add `SnapshotIterReverse` and make `iterReverse` supports `lowerBound` (#883)
Signed-off-by: Jason Mo <mohangjie1995@gmail.com>
2023-07-14 10:36:07 +08:00
guo-shaoge 51633ada95
region_cache: support check pending tiflash peer (#821)
Signed-off-by: guo-shaoge <shaoge1994@163.com>
Co-authored-by: disksing <i@disksing.com>
2023-07-13 14:08:45 +08:00
Spade A e540aa3b96
make cop request timeout a config paramter (#865)
* update

Signed-off-by: Spade A <u6748471@anu.edu.au>

* update

Signed-off-by: Spade A <u6748471@anu.edu.au>

* update

Signed-off-by: Spade A <u6748471@anu.edu.au>

* update

Signed-off-by: Spade A <u6748471@anu.edu.au>

---------

Signed-off-by: Spade A <u6748471@anu.edu.au>
2023-07-11 15:58:55 +08:00
王超 5e3e38b270
format key in error message in method `scanRegions` (#876)
Signed-off-by: Chao Wang <cclcwangchao@hotmail.com>
2023-07-10 15:42:05 +08:00
王超 32eb2b0f88
use '%d' instead of '%q' for some int values in error message (#875)
Signed-off-by: Chao Wang <cclcwangchao@hotmail.com>
2023-07-10 12:30:33 +08:00
ShuNing 178f6fa01a
add explicit request source type to label the external request like lightning/br (#868)
Signed-off-by: nolouch <nolouch@gmail.com>
2023-07-07 15:02:42 +08:00
MyonKeminta c0cf773917
Fix the issue that primary pessimistic lock may be left not cleared after GC (#866)
* Fix the issue that primary pessimistic lock may be left not cleared after GC

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Fix mysteriously shown up thing that makes compilation failed

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Fix test effectiveness (forgot to set txn2 to pessimistic txn); add more strict checks

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Address comments

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

---------

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2023-07-04 15:17:05 +08:00
crazycs fbec023060
*: refine non-global stale-read request retry logic (#863)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-07-03 12:12:02 +08:00
王超 c764d7bc8f
client-go: add some key range info to error when PD returned no region (#862)
Signed-off-by: Chao Wang <cclcwangchao@hotmail.com>
2023-06-30 14:27:00 +08:00
zyguan 04dc78e522
lock_resolver: let getTxnStatusFromLock return error when backoff timeout (#847)
Signed-off-by: zyguan <zhongyangguan@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-06-21 13:07:44 +08:00
glorv 864a5fc0c4
make ResourceControlInterceptor atomic (#848)
Signed-off-by: glorv <glorvs@163.com>
2023-06-21 11:10:26 +08:00
glorv 18b17d4b72
fix rpc interceptor data race (#845)
Signed-off-by: glorv <glorvs@163.com>
2023-06-18 22:18:18 -07:00
Yongbo Jiang b32f340d06
impl resource manager get default resource group (#839)
Signed-off-by: Cabinfever_B <cabinfeveroier@gmail.com>
2023-06-15 09:18:45 -07:00
glorv 0b4b0ca00e
kvrpc: deduplicate chained intercept by name (#832)
* dedup chained interceptor

Signed-off-by: glorv <glorvs@163.com>
2023-06-13 20:21:06 -07:00
crazycs df58452fe1
client_batch: add test for auto re-connect idle connection when wait connection ready and fix ci (#835)
* client_batch: add test

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* update go version

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci lint

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci lint

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-06-13 14:17:17 +08:00
Yongbo Jiang 5ddc523cfc
*: update pd client version (#830)
Signed-off-by: Cabinfever_B <cabinfeveroier@gmail.com>
2023-06-08 15:47:29 +08:00
zzm cf07be2ba0
add const label for metrics (#802)
Signed-off-by: zeminzhou <zhouzemin@pingcap.com>
Co-authored-by: disksing <i@disksing.com>
2023-06-07 13:48:17 +08:00
Hu# 28247160f4
PDHTTPClient: when meet GetStoreMinResolvedTS error just write in debug log (#825)
Signed-off-by: husharp <jinhao.hu@pingcap.com>
Co-authored-by: disksing <i@disksing.com>
2023-06-05 16:51:12 +08:00
ShuNing 27d0c27915
controller: add replica number (#823)
Signed-off-by: nolouch <nolouch@gmail.com>
2023-06-01 14:52:28 +08:00
you06 11121c6913
Remove stale-read flag after resolving lock (#792)
* remove stale-read when key-is-locked

Signed-off-by: you06 <you1474600@gmail.com>

* disable follower read for batch get

Signed-off-by: you06 <you1474600@gmail.com>

* the stale-read flag may already set to false

Signed-off-by: you06 <you1474600@gmail.com>

* fix batchget

Signed-off-by: you06 <you1474600@gmail.com>

* Reset busy-threshold when stale read fallback to leader read

Signed-off-by: you06 <you1474600@gmail.com>

* address comment

Signed-off-by: you06 <you1474600@gmail.com>

* trigger CI

Signed-off-by: you06 <you1474600@gmail.com>

---------

Signed-off-by: you06 <you1474600@gmail.com>
2023-05-26 13:55:53 +08:00
Weizhen Wang d3c53d30ff
update dependency (#816)
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
2023-05-24 15:32:22 +08:00
Hu# 1b28766936
PDHTTPClient: when meet GetStoreMinResolvedTS error just write in debug log (#814)
Signed-off-by: husharp <ihusharp@gmail.com>
2023-05-24 11:26:53 +08:00
David 893dd82957
[CodecV2] cache keyspaceID when creating codecV2 (#812) 2023-05-23 15:31:32 +08:00
MyonKeminta d1e188a981
Do not skip TestBatchResolveLocks for unistore (#807)
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2023-05-18 19:48:00 +08:00
Hu# adb48afeef
pd http: support api to get store min resolved ts (#793)
Signed-off-by: husharp <ihusharp@gmail.com>
2023-05-12 11:43:16 +08:00
you06 c946782286
Fallback to leader read when replica read meets flashback-in-progress error (#796)
* handle flashback error when follower read

Signed-off-by: you06 <you1474600@gmail.com>

* add test

Signed-off-by: you06 <you1474600@gmail.com>

* trigger CI

Signed-off-by: you06 <you1474600@gmail.com>

* fix panic

Signed-off-by: you06 <you1474600@gmail.com>

* trigger CI

Signed-off-by: you06 <you1474600@gmail.com>

* trigger CI

Signed-off-by: you06 <you1474600@gmail.com>

---------

Signed-off-by: you06 <you1474600@gmail.com>
2023-05-11 13:49:08 +08:00
zyguan 2b0667c65c
lock_resolver: handle pessimistic locks in BatchResolveLocks (#794)
* lock_resolver: handle pessimistic locks in BatchResolveLocks

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add test but failed on unistore because unistore's ScanLock doesnt return lock type

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Address comments

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Fix test

Signed-off-by: zyguan <zhongyangguan@gmail.com>

* Fix golangci

Signed-off-by: zyguan <zhongyangguan@gmail.com>

---------

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Signed-off-by: zyguan <zhongyangguan@gmail.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2023-05-11 12:26:01 +08:00
MyonKeminta 5c324b7c1e
lock_resolver: support verifying primary for check_txn_status (#777)
* support verifying primary for check_txn_status

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* update kvproto

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* add more failpoint usages

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* update depencency and fix test

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Do not skip for unistore; refine logs

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Address comments

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

---------

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2023-05-08 16:18:26 +08:00
Connor 62cc95123c
Fix wrong resource group name for some requests (#788)
* fix wrong resource group name

Signed-off-by: Connor1996 <zbk602423539@gmail.com>
2023-04-28 19:03:56 +08:00
Hu# 069dbc5b6c
fix TestRURuntimeStatsCleanUp (#787)
Signed-off-by: husharp <ihusharp@gmail.com>
2023-04-28 13:43:54 +08:00
iosmanthus 36826f75ce
[master] encode store batch tasks (#786) 2023-04-27 19:54:53 +08:00
disksing aee2f311a5
txn: fix goroutine leak (#784)
Signed-off-by: disksing <i@disksing.com>
2023-04-27 17:39:07 +08:00
you06 c619a50474
add metrics for stale-read traffic (#776)
Signed-off-by: you06 <you1474600@gmail.com>
2023-04-27 14:55:46 +08:00
Smilencer f64d5dd79b
update dco (#731)
Signed-off-by: Smityz <smityz@qq.com>
Co-authored-by: disksing <i@disksing.com>
2023-04-27 14:45:04 +08:00
Violin 44663b372a
doc(tikv/test_probe.go) fix case typo in comment. (#778)
Signed-off-by: Violin0622 <violin0622@outlook.com>
2023-04-26 15:50:49 +08:00
MyonKeminta 2be71b35ee
Add afterSendReqToRegion failpoint (#780)
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2023-04-26 15:50:11 +08:00
Connor 35c1ee47c4
Set resource group penalty (#772)
* Set resource group penalty 

Signed-off-by: Connor1996 <zbk602423539@gmail.com>
2023-04-19 20:39:20 +08:00
ekexium a72e61dc64
log: print log if the assertion error is generated from client-go (#771)
Signed-off-by: ekexium <eke@fastmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-04-19 17:42:17 +08:00
ShuNing dd6caa4c03
execdetails: add RRU/WRU interface of RURuntimeStats (#769)
Signed-off-by: nolouch <nolouch@gmail.com>
2023-04-19 16:57:01 +08:00