7bce6ea4df
Pick connection handling improvements from tidb-cse-7.5 ( #1223 )
...
* close on canceled (#1121 )
Signed-off-by: Ping Yu <yuping@pingcap.com>
* Fix wait recvloop timeout (#1134 )
* wip
Signed-off-by: Ping Yu <yuping@pingcap.com>
* CloseAddr with ver
Signed-off-by: Ping Yu <yuping@pingcap.com>
* fix ErrConn
Signed-off-by: Ping Yu <yuping@pingcap.com>
* fix ut
Signed-off-by: Ping Yu <yuping@pingcap.com>
* cleanup
Signed-off-by: Ping Yu <yuping@pingcap.com>
---------
Signed-off-by: Ping Yu <yuping@pingcap.com>
* Use correct address for CloseAddr (#1140 )
* wip
Signed-off-by: Ping Yu <yuping@pingcap.com>
* CloseAddr with ver
Signed-off-by: Ping Yu <yuping@pingcap.com>
* fix ErrConn
Signed-off-by: Ping Yu <yuping@pingcap.com>
* fix ut
Signed-off-by: Ping Yu <yuping@pingcap.com>
* polish
Signed-off-by: Ping Yu <yuping@pingcap.com>
* polish
Signed-off-by: Ping Yu <yuping@pingcap.com>
* polish
Signed-off-by: Ping Yu <yuping@pingcap.com>
---------
Signed-off-by: Ping Yu <yuping@pingcap.com>
* rebase
Signed-off-by: Ping Yu <yuping@pingcap.com>
---------
Signed-off-by: Ping Yu <yuping@pingcap.com>
Co-authored-by: iosmanthus <dengliming@pingcap.com>
2024-03-14 16:30:36 +08:00
af4f9a9b6e
fix data race when collapsing ResolveLockRequest ( #1209 )
...
* fix data race when collapsing ResolveLockRequest
Signed-off-by: you06 <you1474600@gmail.com>
* comment
Signed-off-by: you06 <you1474600@gmail.com>
* sleep to wait goroutine finish
Signed-off-by: you06 <you1474600@gmail.com>
* update comment
Signed-off-by: you06 <you1474600@gmail.com>
---------
Signed-off-by: you06 <you1474600@gmail.com>
2024-03-08 13:24:15 +08:00
03bbadb277
Support receving health feedback ( #1153 )
...
* Register health feedback handler in batch client
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* update protocol
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Collect the health status and record to the stores
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Remove the filter which looks not necessary
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add metrics
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Fix checkAndUpdateStoreHealthStatus panicking
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add logs
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Merge SetHealthFeedbackHandler to Client
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Try another pattern: separated callback registry
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Try region cache eventListener pattern
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add tests
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Test receiving froim callback
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add tests to region cache
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Remove unnecessary debug log
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add comments
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* remove replace of tidb repo
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* fix build
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Update comments; fix lint
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Add the isSlow method of Store back
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* remove unused method for now to make lint happy
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
* Address comments
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
---------
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2024-02-28 19:10:32 +08:00
824302acd0
client: Cache tikv request in tidb client side ( #1098 )
...
* impl priority queue
Signed-off-by: bufferflies <1045931706@qq.com>
* replace priority queue
Signed-off-by: bufferflies <1045931706@qq.com>
* cache request in tidb side
Signed-off-by: bufferflies <1045931706@qq.com>
* fix gosimple
Signed-off-by: bufferflies <1045931706@qq.com>
* impl priority
Signed-off-by: bufferflies <1045931706@qq.com>
* pass ut
Signed-off-by: bufferflies <1045931706@qq.com>
* add
Signed-off-by: bufferflies <1045931706@qq.com>
* remove request if the request has been canceled
Signed-off-by: bufferflies <1045931706@qq.com>
* remove request if it has been canceled
Signed-off-by: bufferflies <1045931706@qq.com>
* add comment for cancel
Signed-off-by: bufferflies <1045931706@qq.com>
* not make the loop is busy
Signed-off-by: bufferflies <1045931706@qq.com>
* lint
Signed-off-by: bufferflies <1045931706@qq.com>
* revert busy loop
Signed-off-by: bufferflies <1045931706@qq.com>
* add unit test
Signed-off-by: bufferflies <1045931706@qq.com>
* not limit ehigh prioirty test
Signed-off-by: bufferflies <1045931706@qq.com>
* pass lint
Signed-off-by: bufferflies <1045931706@qq.com>
* support all
Signed-off-by: bufferflies <1045931706@qq.com>
* add comment
Signed-off-by: bufferflies <1045931706@qq.com>
* squash
Signed-off-by: bufferflies <1045931706@qq.com>
* revert all to All
Signed-off-by: bufferflies <1045931706@qq.com>
* remove index from entry
Signed-off-by: bufferflies <1045931706@qq.com>
* make fail reasons more clear
Signed-off-by: bufferflies <1045931706@qq.com>
---------
Signed-off-by: bufferflies <1045931706@qq.com>
2024-02-21 14:54:33 +08:00
70c148e84e
ErrQueryInterrupted with parameters ( #1124 )
...
* feat: ErrQueryInterrupted with parameters
Signed-off-by: ekexium <eke@fastmail.com>
* Revert "Revert "fix: check kill signal against 0 (#1102 )" (#1129 )"
This reverts commit 3480b5ed7c
2024-02-02 10:26:02 +08:00
f90605363e
support grpc's shard buffer pool ( #1132 )
...
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
2024-01-24 17:57:47 +08:00
3480b5ed7c
Revert "fix: check kill signal against 0 ( #1102 )" ( #1129 )
...
This reverts commit 057c479dd8
2024-01-23 13:54:05 +08:00
057c479dd8
fix: check kill signal against 0 ( #1102 )
...
* fix: check kill signal against 0, so that all kill signals will not be ignored.
Signed-off-by: ekexium <eke@fastmail.com>
* refactor: extract method checkKilled()
Signed-off-by: ekexium <eke@fastmail.com>
---------
Signed-off-by: ekexium <eke@fastmail.com>
Co-authored-by: cfzjywxk <lsswxrxr@163.com>
2024-01-10 15:48:27 +08:00
c7d29aafa7
client: replace array by priority queue to support cache queue ( #1095 )
...
* impl priority queue
Signed-off-by: bufferflies <1045931706@qq.com>
* replace priority queue
Signed-off-by: bufferflies <1045931706@qq.com>
* fix gosimple
Signed-off-by: bufferflies <1045931706@qq.com>
* remove chinese comment
Signed-off-by: bufferflies <1045931706@qq.com>
---------
Signed-off-by: bufferflies <1045931706@qq.com>
2024-01-03 15:32:51 +08:00
e80e9ca1fe
resource_control: add ru details in ExecDetails ( #1070 )
...
* collecting the RU information by pasing point through context.Value (#1032 )
Signed-off-by: zzm <zhouzemin@pingcap.com>
* add ruWaitDuration to RUDetails and update pd-client
Signed-off-by: glorv <glorvs@163.com>
---------
Signed-off-by: zzm <zhouzemin@pingcap.com>
Signed-off-by: glorv <glorvs@163.com>
Co-authored-by: zzm <zhouzemin@pingcap.com>
2023-12-04 15:40:48 +08:00
812a791ab3
ci: make golangci happy ( #1066 )
...
Signed-off-by: husharp <jinhao.hu@pingcap.com>
2023-11-21 15:05:35 +08:00
1c2351c281
resource_control: set override_priority with resource group priority by default ( #1060 )
...
* set override_priority with resource group priority
Signed-off-by: glorv <glorvs@163.com>
* update go.mod
Signed-off-by: glorv <glorvs@163.com>
* fix typo
Signed-off-by: glorv <glorvs@163.com>
* fix
Signed-off-by: glorv <glorvs@163.com>
---------
Signed-off-by: glorv <glorvs@163.com>
2023-11-16 13:17:30 +08:00
6ba909c4ad
config: enable user configuration for retry strategy. ( #1055 )
...
Signed-off-by: Smityz <smityz@qq.com>
Co-authored-by: disksing <i@disksing.com>
2023-11-14 14:54:10 +08:00
1362f1e875
Revert "*: add metrics for batch client ( #996 )" ( #1046 )
...
This reverts commit 1a44252779
2023-10-30 20:08:15 +08:00
2eaf68e0cd
Fix batch client batchSendLoop panic ( #1021 )
...
* init
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* add test
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* refine test
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* try to fix
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix test
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* refine
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* address comment
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* address comment
Signed-off-by: crazycs520 <crazycs520@gmail.com>
---------
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-10-17 15:44:06 +08:00
1a44252779
*: add metrics for batch client ( #996 )
...
Signed-off-by: crazycs520 <crazycs520@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-10-07 11:46:05 +08:00
be2b4c78a9
Revert "*: fix batch-client wait too long and add some metrics ( #973 )" ( #984 )
...
This reverts commit adb7db13c3
2023-09-19 11:15:11 +08:00
adb7db13c3
*: fix batch-client wait too long and add some metrics ( #973 )
...
Signed-off-by: crazycs520 <crazycs520@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-09-18 11:39:42 +08:00
342301689f
*: fix issue of configure kv timeout not work when disable batch client ( #980 )
...
* *: fix issue of configure kv timeout not work when disable batch client
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* refine test
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* address comment
Signed-off-by: crazycs520 <crazycs520@gmail.com>
---------
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-09-15 23:49:42 +08:00
62a297ae74
add log
...
Signed-off-by: bufferflies <1045931706@qq.com>
2023-09-12 12:21:15 +08:00
ba3de39920
*: fix panic log
...
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-09-11 14:38:07 +08:00
295094e5b5
add retry info to request source ( #953 )
...
* add retry info to request source
Signed-off-by: you06 <you1474600@gmail.com>
* handle upper layer retry
Signed-off-by: you06 <you1474600@gmail.com>
* stabilize test
Signed-off-by: you06 <you1474600@gmail.com>
* retry in 3 dimension
Signed-off-by: you06 <you1474600@gmail.com>
* record and restore req.ReadType
Signed-off-by: you06 <you1474600@gmail.com>
---------
Signed-off-by: you06 <you1474600@gmail.com>
2023-08-29 08:28:46 +08:00
45894d9d36
[pick] resource_control: bypass some internal urgent request ( #938 )
...
* resource_control: bypass some internal urgent request (#884 )
Signed-off-by: nolouch <nolouch@gmail.com>
* resourcecontrol: fix nil pointer (#900 )
Signed-off-by: nolouch <nolouch@gmail.com>
---------
Signed-off-by: nolouch <nolouch@gmail.com>
2023-08-11 03:40:06 -06:00
8a214402da
use tidb_kv_read_timeout as first kv request timeout ( #919 )
...
* support tidb_kv_read_timeout as first round kv request timeout
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix ci
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix ci
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix ci
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix ci
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix ci
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* update comment
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* refine test
Signed-off-by: crazycs520 <crazycs520@gmail.com>
---------
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-08-11 11:37:10 +08:00
27f2ad0f3a
ci: update go version ( #936 )
...
* ci: update go version
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix test
Signed-off-by: crazycs520 <crazycs520@gmail.com>
---------
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-08-10 22:05:00 +08:00
719e6456f7
use context logger as much as possible ( #908 )
...
* use context logger as much as possible
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* refine
Signed-off-by: crazycs520 <crazycs520@gmail.com>
---------
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-07-31 11:23:49 +08:00
76d6d93e98
resource_manager: ignore ru metrics for background request ( #872 )
...
Signed-off-by: husharp <jinhao.hu@pingcap.com>
Co-authored-by: disksing <i@disksing.com>
2023-07-26 15:13:54 +08:00
864a5fc0c4
make ResourceControlInterceptor atomic ( #848 )
...
Signed-off-by: glorv <glorvs@163.com>
2023-06-21 11:10:26 +08:00
0b4b0ca00e
kvrpc: deduplicate chained intercept by name ( #832 )
...
* dedup chained interceptor
Signed-off-by: glorv <glorvs@163.com>
2023-06-13 20:21:06 -07:00
df58452fe1
client_batch: add test for auto re-connect idle connection when wait connection ready and fix ci ( #835 )
...
* client_batch: add test
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix ci
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix ci
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix ci
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* update go version
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix ci
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix ci lint
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix ci lint
Signed-off-by: crazycs520 <crazycs520@gmail.com>
---------
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-06-13 14:17:17 +08:00
35c1ee47c4
Set resource group penalty ( #772 )
...
* Set resource group penalty
Signed-off-by: Connor1996 <zbk602423539@gmail.com>
2023-04-19 20:39:20 +08:00
d19741b3ed
internal: treat default resource group normally ( #708 )
...
Signed-off-by: BornChanger <dawn_catcher@126.com>
2023-03-16 16:06:03 +08:00
ad4d1554b3
resource_control: consider default as a normal group ( #741 )
...
Signed-off-by: nolouch <nolouch@gmail.com>
2023-03-16 15:56:37 +08:00
9d950905d7
Introduce the RURuntimeStats ( #732 )
...
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2023-03-16 10:19:36 +08:00
c9119d02ce
support time detail v2 ( #729 )
...
* support time detail v2
Signed-off-by: glorv <glorvs@163.com>
---------
Signed-off-by: glorv <glorvs@163.com>
Co-authored-by: Connor <zbk602423539@gmail.com>
2023-03-13 21:32:19 +08:00
bdd41058aa
metrics: seperate metrics with source scope for txn command ( #723 )
...
* seperate metrics with source scope
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
* fix async pessimistic rollback
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
* fix missing definition
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
---------
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2023-03-06 22:12:45 +08:00
e2da552702
*: Update pd client ( #722 )
...
Signed-off-by: Cabinfever_B <cabinfeveroier@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-02-28 17:15:02 +08:00
e0e6019f8a
attach keyspace_id to tikv/tiflash requests ( #682 )
2023-02-20 13:10:03 +08:00
9b3ecc1dca
*: update pd client ( #694 )
...
Signed-off-by: disksing <i@disksing.com>
2023-02-07 12:00:04 +08:00
35416c4c43
Add gRPC connection monitor and fix related bug ( #665 )
...
Signed-off-by: Smityz <smityz@qq.com>
Co-authored-by: disksing <i@disksing.com>
2023-01-31 16:28:48 +08:00
313152f32c
Simplify the code
...
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2023-01-20 10:03:23 +08:00
2a19c65068
Export the switch
...
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2023-01-19 17:18:56 +08:00
8553f26149
Fix the test
...
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2023-01-19 16:55:26 +08:00
08694efec4
Fix the check
...
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2023-01-19 16:31:47 +08:00
320af6501e
Introduce the switch
...
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2023-01-19 16:14:47 +08:00
494bebd702
Rename
...
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2023-01-19 11:50:30 +08:00
35b648cf98
Address the comments
...
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2023-01-18 20:15:50 +08:00
6ee294fedf
Introduce the resource control client
...
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2023-01-18 17:14:24 +08:00
f313ddf58d
reformat codec and add keyspace support ( #649 )
...
Signed-off-by: David <8039876+AmoebaProtozoa@users.noreply.github.com>
2023-01-10 15:15:33 +08:00
ce9203ef66
*: disable PermitWithoutStream to avoid too many pings ( #574 )
...
Signed-off-by: Jack Yu <jackysp@gmail.com>
2022-09-21 18:16:51 +08:00
Ping Yu