Commit Graph

196 Commits

Author SHA1 Message Date
crazycs df58452fe1
client_batch: add test for auto re-connect idle connection when wait connection ready and fix ci (#835)
* client_batch: add test

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* update go version

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci lint

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci lint

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-06-13 14:17:17 +08:00
Yongbo Jiang 5ddc523cfc
*: update pd client version (#830)
Signed-off-by: Cabinfever_B <cabinfeveroier@gmail.com>
2023-06-08 15:47:29 +08:00
ShuNing 27d0c27915
controller: add replica number (#823)
Signed-off-by: nolouch <nolouch@gmail.com>
2023-06-01 14:52:28 +08:00
Weizhen Wang d3c53d30ff
update dependency (#816)
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
2023-05-24 15:32:22 +08:00
David 893dd82957
[CodecV2] cache keyspaceID when creating codecV2 (#812) 2023-05-23 15:31:32 +08:00
Hu# adb48afeef
pd http: support api to get store min resolved ts (#793)
Signed-off-by: husharp <ihusharp@gmail.com>
2023-05-12 11:43:16 +08:00
you06 c946782286
Fallback to leader read when replica read meets flashback-in-progress error (#796)
* handle flashback error when follower read

Signed-off-by: you06 <you1474600@gmail.com>

* add test

Signed-off-by: you06 <you1474600@gmail.com>

* trigger CI

Signed-off-by: you06 <you1474600@gmail.com>

* fix panic

Signed-off-by: you06 <you1474600@gmail.com>

* trigger CI

Signed-off-by: you06 <you1474600@gmail.com>

* trigger CI

Signed-off-by: you06 <you1474600@gmail.com>

---------

Signed-off-by: you06 <you1474600@gmail.com>
2023-05-11 13:49:08 +08:00
iosmanthus 36826f75ce
[master] encode store batch tasks (#786) 2023-04-27 19:54:53 +08:00
you06 c619a50474
add metrics for stale-read traffic (#776)
Signed-off-by: you06 <you1474600@gmail.com>
2023-04-27 14:55:46 +08:00
Smilencer f64d5dd79b
update dco (#731)
Signed-off-by: Smityz <smityz@qq.com>
Co-authored-by: disksing <i@disksing.com>
2023-04-27 14:45:04 +08:00
MyonKeminta 2be71b35ee
Add afterSendReqToRegion failpoint (#780)
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2023-04-26 15:50:11 +08:00
Connor 35c1ee47c4
Set resource group penalty (#772)
* Set resource group penalty 

Signed-off-by: Connor1996 <zbk602423539@gmail.com>
2023-04-19 20:39:20 +08:00
Artem Danilov 415713766f
avoid dataIsNotReady error while retrying stale read on the leader (#765)
* avoid dataIsNotReady error while retrying stale read on the leader

Signed-off-by: artem_danilov <artem_danilov@airbnb.com>

* move StaleRead flag reset to retry section

Signed-off-by: artem_danilov <artem_danilov@airbnb.com>

* move all logic to #next and allow retry on the leader

Signed-off-by: artem_danilov <artem_danilov@airbnb.com>

---------

Signed-off-by: artem_danilov <artem_danilov@airbnb.com>
Co-authored-by: artem_danilov <artem_danilov@airbnb.com>
2023-04-19 10:48:52 +08:00
ekexium f3e87039d8
Finer `is_retry_request` settings (#763)
* set is_retry_request only for requests that is possible to have undetermined errors

Signed-off-by: ekexium <eke@fastmail.com>

* rename tryTimes to retryTimes

Signed-off-by: ekexium <eke@fastmail.com>

---------

Signed-off-by: ekexium <eke@fastmail.com>
Co-authored-by: cfzjywxk <lsswxrxr@163.com>
2023-04-10 10:39:43 +08:00
Lloyd-Pottiger 1ec0ff5bf4
Support return TiFlash system table by grpc (#759)
Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>
2023-04-06 14:42:57 +08:00
iosmanthus 4ac424aea1
refactor decoding buckets with new interface method: DecodeBucketKeys (#760)
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
2023-03-31 16:06:44 +08:00
iosmanthus 6a92aeec92
fix api v2 decode of region bucket's keys (#757)
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
2023-03-31 11:07:45 +08:00
Smilencer bb350d6ea8
fix data race (#736)
Signed-off-by: Smityz <smityz@qq.com>
Co-authored-by: disksing <i@disksing.com>
2023-03-27 16:10:11 +08:00
Daniël van Eeden f7e35b25be
Log request info for label warning (#744)
Signed-off-by: Daniël van Eeden <git@myname.nl>
Co-authored-by: disksing <i@disksing.com>
2023-03-27 14:51:16 +08:00
iosmanthus 2e8d7a2d8c
refine keyspace request encoding (#742) 2023-03-21 16:14:47 +08:00
you06 884a634378
compatible batch copr with load-based replica read (#739)
* compatible batch copr with load-based replica read

Signed-off-by: you06 <you1474600@gmail.com>

* handle batch cop when server is busy

Signed-off-by: you06 <you1474600@gmail.com>

debug

Signed-off-by: you06 <you1474600@gmail.com>

debug

Signed-off-by: you06 <you1474600@gmail.com>

debug

Signed-off-by: you06 <you1474600@gmail.com>

remove debug

Signed-off-by: you06 <you1474600@gmail.com>

* address comment

Signed-off-by: you06 <you1474600@gmail.com>

* ci

Signed-off-by: you06 <you1474600@gmail.com>

* ci

Signed-off-by: you06 <you1474600@gmail.com>

---------

Signed-off-by: you06 <you1474600@gmail.com>
2023-03-17 11:26:22 +08:00
BornChanger d19741b3ed
internal: treat default resource group normally (#708)
Signed-off-by: BornChanger <dawn_catcher@126.com>
2023-03-16 16:06:03 +08:00
ShuNing ad4d1554b3
resource_control: consider default as a normal group (#741)
Signed-off-by: nolouch <nolouch@gmail.com>
2023-03-16 15:56:37 +08:00
JmPotato 9d950905d7
Introduce the RURuntimeStats (#732)
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2023-03-16 10:19:36 +08:00
glorv c9119d02ce
support time detail v2 (#729)
* support time detail v2

Signed-off-by: glorv <glorvs@163.com>

---------

Signed-off-by: glorv <glorvs@163.com>
Co-authored-by: Connor <zbk602423539@gmail.com>
2023-03-13 21:32:19 +08:00
Lucas a7e3df4ab1
[Metrics] Supply extra metrics to monitor the flows under `prefer-leader` mode. (#716)
Signed-off-by: Lucasliang <nkcs_lykx@hotmail.com>
2023-03-13 18:08:39 +08:00
iosmanthus c21bf9396a
add api_version for mpp task meta (#738) 2023-03-13 15:07:26 +08:00
iosmanthus eb0bd61645
attach keyspace_id for manual compact request (#737) 2023-03-13 14:53:59 +08:00
MyonKeminta f555fdd2c9
txn: support force locking and lock only if exists be used together (#727)
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2023-03-09 18:08:32 +08:00
Yongbo Jiang df993878bd
*: update pd client (#734)
Signed-off-by: Cabinfever_B <cabinfeveroier@gmail.com>
2023-03-09 11:34:04 +08:00
guo-shaoge bd24a9e443
Merge branch 'master' into support_engine_role 2023-03-07 15:47:49 +08:00
you06 8a8ef35790
support non-block read region (#725)
Signed-off-by: you06 <you1474600@gmail.com>
2023-03-07 15:15:35 +08:00
cfzjywxk bdd41058aa
metrics: seperate metrics with source scope for txn command (#723)
* seperate metrics with source scope

Signed-off-by: cfzjywxk <lsswxrxr@163.com>

* fix async pessimistic rollback

Signed-off-by: cfzjywxk <lsswxrxr@163.com>

* fix missing definition

Signed-off-by: cfzjywxk <lsswxrxr@163.com>

---------

Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2023-03-06 22:12:45 +08:00
guo-shaoge 39cd84957f fix fmt
Signed-off-by: guo-shaoge <shaoge1994@163.com>
2023-03-06 18:05:17 +08:00
guo-shaoge 0d003d077b region_cache: support <engine_role, write> for disaggregated tiflash
Signed-off-by: guo-shaoge <shaoge1994@163.com>
2023-03-06 17:53:57 +08:00
Yongbo Jiang 3f7860f109
region_request: handle resource group error before Backoff (#719)
Signed-off-by: Cabinfever_B <cabinfeveroier@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-03-02 13:40:57 +08:00
Yongbo Jiang e2da552702
*: Update pd client (#722)
Signed-off-by: Cabinfever_B <cabinfeveroier@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-02-28 17:15:02 +08:00
iosmanthus 11d34cbd8a
fix attach api ctx error for unknown requests like StoreSafeTS (#720)
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
2023-02-28 13:47:31 +08:00
Yilin Chen a27994e5aa
Support load-based replica read (#675)
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2023-02-22 15:35:43 +08:00
iosmanthus e0e6019f8a
attach keyspace_id to tikv/tiflash requests (#682) 2023-02-20 13:10:03 +08:00
ShuNing b9d788cc4a
resource_contrl: change the log level (#700)
Signed-off-by: nolouch <nolouch@gmail.com>
2023-02-09 11:42:15 +08:00
JmPotato bdcfab8928
Consider the number of replicas when calculating RU (#684)
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2023-02-08 22:56:14 +08:00
glorv 29dfcc2729
fix the calculation of write request total write bytes (#691)
Signed-off-by: glorv <glorvs@163.com>
2023-02-07 17:07:54 +08:00
Lucas bce56a5831
ReadMode: introduce AutoFollowerRead mechanism by adding a new `ReadMode == PreferLeader` (#671)
Signed-off-by: lucasliang <nkcs_lykx@hotmail.com>
2023-02-07 16:42:52 +08:00
disksing 9b3ecc1dca
*: update pd client (#694)
Signed-off-by: disksing <i@disksing.com>
2023-02-07 12:00:04 +08:00
Hangjie Mo 56c521f109
internal: update `FlashbackInProgress` error msg (#692)
Signed-off-by: Hangjie Mo <mohangjie1995@gmail.com>
2023-02-06 17:34:59 +08:00
Wenxuan 3edbadb227
Increase consistent hash replicas to 200 for better balance (#688)
Signed-off-by: Wish <breezewish@outlook.com>
2023-02-06 11:19:46 +08:00
Hu# 8fd09cd88c
config support both path and names (#683)
Signed-off-by: HuSharp <jinhao.hu@pingcap.com>
2023-02-02 18:11:45 +08:00
Smilencer 35416c4c43
Add gRPC connection monitor and fix related bug (#665)
Signed-off-by: Smityz <smityz@qq.com>
Co-authored-by: disksing <i@disksing.com>
2023-01-31 16:28:48 +08:00
Yilin Chen 78470adc3d
Rewind after cacheGC reaches the end (#678)
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2023-01-30 15:45:29 +08:00