Commit Graph

241 Commits

Author SHA1 Message Date
cfzjywxk 888cbb283e
add retry limit for excluded backoff type to avoid infinite retry (#1002)
* add retry limit for excluded backoff type to avoid infinite retry

Signed-off-by: cfzjywxk <lsswxrxr@163.com>

* change log

Signed-off-by: cfzjywxk <lsswxrxr@163.com>

---------

Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2023-10-18 11:23:56 +08:00
crazycs 2eaf68e0cd
Fix batch client batchSendLoop panic (#1021)
* init

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* add test

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine test

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* try to fix

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix test

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* address comment

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* address comment

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-10-17 15:44:06 +08:00
lucasliang e70513e671
bugfix: fix invalid nil pointer when trying to record Store.SlownessStat. (#1017)
* bugfix: fix invalid nil pointer when trying to record Store.SlownessStat.

Signed-off-by: lucasliang <nkcs_lykx@hotmail.com>

* Polish codes.

Signed-off-by: lucasliang <nkcs_lykx@hotmail.com>

* Polish comments.

Signed-off-by: lucasliang <nkcs_lykx@hotmail.com>

---------

Signed-off-by: lucasliang <nkcs_lykx@hotmail.com>
2023-10-16 12:02:43 +08:00
cfzjywxk 07432ef6c0
refactor the func name to make it clear (#1000)
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2023-10-10 14:18:02 +08:00
Hu# a05564b183
log: Enhanced log key output (#958)
Signed-off-by: husharp <jinhao.hu@pingcap.com>
Co-authored-by: disksing <i@disksing.com>
2023-10-07 14:22:57 +08:00
crazycs 1a44252779
*: add metrics for batch client (#996)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-10-07 11:46:05 +08:00
buffer 4c2ae43454
dco (#988)
Signed-off-by: bufferflies <1045931706@qq.com>
2023-09-26 13:16:11 +08:00
zyguan 44b0cf7aba
do not try leader if it's unreachable (#971)
* do not try leader if it's unreachable

Signed-off-by: zyguan <zhongyangguan@gmail.com>

* fix the flaky test

Signed-off-by: zyguan <zhongyangguan@gmail.com>

---------

Signed-off-by: zyguan <zhongyangguan@gmail.com>
2023-09-25 11:25:02 +08:00
crazycs be2b4c78a9
Revert "*: fix batch-client wait too long and add some metrics (#973)" (#984)
This reverts commit adb7db13c3.

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-09-19 11:15:11 +08:00
crazycs adb7db13c3
*: fix batch-client wait too long and add some metrics (#973)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-09-18 11:39:42 +08:00
crazycs 39084386b3
*: configurable kv_read_timeout should not affect write request (#978)
* *: configurable kv_read_timeout should not affect write request

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine test

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine logic

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-09-18 11:17:51 +08:00
crazycs 342301689f
*: fix issue of configure kv timeout not work when disable batch client (#980)
* *: fix issue of configure kv timeout not work when disable batch client

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine test

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* address comment

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-09-15 23:49:42 +08:00
crazycs 001735b0b5
*: try follower when stale read request timeout (#969)
* fix stalre read retry logic when got timeout error

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* add test

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix test

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* add log

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* add log

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-09-15 12:53:37 +08:00
buffer 79843ce227
Merge branch 'master' into add_log 2023-09-12 20:24:24 +08:00
you06 fb8e4c0eac
add region cache state test & fix some issues of replica selector (#910) (#942)
* add region cache state test & fix some issues of replica selector (#910)

Signed-off-by: you06 <you1474600@gmail.com>

remove duplicate code

Signed-off-by: you06 <you1474600@gmail.com>

* remove comment

Signed-off-by: you06 <you1474600@gmail.com>

* lint

Signed-off-by: you06 <you1474600@gmail.com>

* fix flaky test

Signed-off-by: you06 <you1474600@gmail.com>

---------

Signed-off-by: you06 <you1474600@gmail.com>
2023-09-12 12:36:53 +08:00
bufferflies 62a297ae74
add log
Signed-off-by: bufferflies <1045931706@qq.com>
2023-09-12 12:21:15 +08:00
bufferflies 3216af2cb1
add cancel reason
Signed-off-by: bufferflies <1045931706@qq.com>
2023-09-12 11:59:38 +08:00
crazycs520 ba3de39920 *: fix panic log
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-09-11 14:38:07 +08:00
you06 89493ff985
set the request source at the last section (#960)
Signed-off-by: you06 <you1474600@gmail.com>
2023-09-07 21:23:09 +08:00
buffer 5c9fcf3e85
metrics: add bucket version not match metrics (#957) 2023-08-30 04:09:50 -06:00
you06 295094e5b5
add retry info to request source (#953)
* add retry info to request source

Signed-off-by: you06 <you1474600@gmail.com>

* handle upper layer retry

Signed-off-by: you06 <you1474600@gmail.com>

* stabilize test

Signed-off-by: you06 <you1474600@gmail.com>

* retry in 3 dimension

Signed-off-by: you06 <you1474600@gmail.com>

* record and restore req.ReadType

Signed-off-by: you06 <you1474600@gmail.com>

---------

Signed-off-by: you06 <you1474600@gmail.com>
2023-08-29 08:28:46 +08:00
cfzjywxk fc88757771
log: group replica selector logging and split not leader errors (#929)
* group replica selector logging and split not leader errors

Signed-off-by: cfzjywxk <lsswxrxr@163.com>

* use atomic to read epoch

Signed-off-by: cfzjywxk <lsswxrxr@163.com>

---------

Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2023-08-24 16:00:22 +08:00
buffer ff39b4af09
error: handle bucket version not match (#918) 2023-08-22 03:25:20 -06:00
you06 1ea3d66418
use leader read when `tryFollower` is fallback from `accessKnownLeader` (#952)
* fix tryFollower

Signed-off-by: you06 <you1474600@gmail.com>

* address comment

Signed-off-by: you06 <you1474600@gmail.com>

---------

Signed-off-by: you06 <you1474600@gmail.com>
2023-08-22 14:45:13 +08:00
you06 a0ac170698
handle mismatch peer id (#935)
Signed-off-by: you06 <you1474600@gmail.com>
2023-08-14 15:27:20 +08:00
you06 44f5025f5a
fallback to follower when leader is busy (#916) (#923)
* fallback to follower when leader is busy

Signed-off-by: you06 <you1474600@gmail.com>
Co-authored-by: cfzjywxk <cfzjywxk@gmail.com>
Co-authored-by: cfzjywxk <lsswxrxr@163.com>
2023-08-11 21:36:47 +08:00
ShuNing 45894d9d36
[pick] resource_control: bypass some internal urgent request (#938)
* resource_control: bypass some internal urgent request (#884)

Signed-off-by: nolouch <nolouch@gmail.com>

* resourcecontrol: fix nil pointer (#900)

Signed-off-by: nolouch <nolouch@gmail.com>

---------

Signed-off-by: nolouch <nolouch@gmail.com>
2023-08-11 03:40:06 -06:00
crazycs 8a214402da
use tidb_kv_read_timeout as first kv request timeout (#919)
* support tidb_kv_read_timeout as first round kv request timeout

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* update comment

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine test

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-08-11 11:37:10 +08:00
crazycs 27f2ad0f3a
ci: update go version (#936)
* ci: update go version

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix test

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-08-10 22:05:00 +08:00
cfzjywxk a47e1c2537
Resume max retry time check for stale read retry with leader option(#903) (#911)
* Resume max retry time check for stale read retry with leader option

Signed-off-by: cfzjywxk <lsswxrxr@163.com>

* add cancel

Signed-off-by: cfzjywxk <lsswxrxr@163.com>

---------

Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2023-08-07 14:41:06 +08:00
crazycs 719e6456f7
use context logger as much as possible (#908)
* use context logger as much as possible

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-07-31 11:23:49 +08:00
crazycs 9f94221c2d
add more log for diagnose (#915)
* add more log for diagnose

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* add more log for diagnose

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* add more log

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* address comment

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-07-28 20:35:05 +08:00
Hu# 76d6d93e98
resource_manager: ignore ru metrics for background request (#872)
Signed-off-by: husharp <jinhao.hu@pingcap.com>
Co-authored-by: disksing <i@disksing.com>
2023-07-26 15:13:54 +08:00
crazycs d880eca9e1
fix unexpected slow query during GC running after stop 1 tikv-server (#899) (#909)
* fix unexpected slow query during GC running after stop 1 tikv-server

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix test

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-07-26 13:57:33 +08:00
you06 85fc8f3375
reload region cache when store is resolved from invalid status (#843)
Signed-off-by: you06 <you1474600@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-07-14 13:27:14 +08:00
crazycs 4ec212d5f2
*: fix stale read ops metric (#878) (#889)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-07-14 11:03:10 +08:00
Hangjie Mo 2f119351bd
*: add `SnapshotIterReverse` and make `iterReverse` supports `lowerBound` (#883)
Signed-off-by: Jason Mo <mohangjie1995@gmail.com>
2023-07-14 10:36:07 +08:00
guo-shaoge 51633ada95
region_cache: support check pending tiflash peer (#821)
Signed-off-by: guo-shaoge <shaoge1994@163.com>
Co-authored-by: disksing <i@disksing.com>
2023-07-13 14:08:45 +08:00
王超 5e3e38b270
format key in error message in method `scanRegions` (#876)
Signed-off-by: Chao Wang <cclcwangchao@hotmail.com>
2023-07-10 15:42:05 +08:00
王超 32eb2b0f88
use '%d' instead of '%q' for some int values in error message (#875)
Signed-off-by: Chao Wang <cclcwangchao@hotmail.com>
2023-07-10 12:30:33 +08:00
crazycs fbec023060
*: refine non-global stale-read request retry logic (#863)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-07-03 12:12:02 +08:00
王超 c764d7bc8f
client-go: add some key range info to error when PD returned no region (#862)
Signed-off-by: Chao Wang <cclcwangchao@hotmail.com>
2023-06-30 14:27:00 +08:00
glorv 864a5fc0c4
make ResourceControlInterceptor atomic (#848)
Signed-off-by: glorv <glorvs@163.com>
2023-06-21 11:10:26 +08:00
Yongbo Jiang b32f340d06
impl resource manager get default resource group (#839)
Signed-off-by: Cabinfever_B <cabinfeveroier@gmail.com>
2023-06-15 09:18:45 -07:00
glorv 0b4b0ca00e
kvrpc: deduplicate chained intercept by name (#832)
* dedup chained interceptor

Signed-off-by: glorv <glorvs@163.com>
2023-06-13 20:21:06 -07:00
crazycs df58452fe1
client_batch: add test for auto re-connect idle connection when wait connection ready and fix ci (#835)
* client_batch: add test

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* update go version

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci lint

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci lint

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-06-13 14:17:17 +08:00
Yongbo Jiang 5ddc523cfc
*: update pd client version (#830)
Signed-off-by: Cabinfever_B <cabinfeveroier@gmail.com>
2023-06-08 15:47:29 +08:00
ShuNing 27d0c27915
controller: add replica number (#823)
Signed-off-by: nolouch <nolouch@gmail.com>
2023-06-01 14:52:28 +08:00
Weizhen Wang d3c53d30ff
update dependency (#816)
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
2023-05-24 15:32:22 +08:00
David 893dd82957
[CodecV2] cache keyspaceID when creating codecV2 (#812) 2023-05-23 15:31:32 +08:00