Commit Graph

253 Commits

Author SHA1 Message Date
zyguan 82ff387182
txnkv: fix the issue that batch-get error might be ignored (#1733)
Signed-off-by: zyguan <zhongyangguan@gmail.com>
2025-08-25 10:24:00 +00:00
you06 97cad411eb
metrcis: add replica read traffic metrics (#1717)
ref pingcap/tidb#62740

Signed-off-by: you06 <you1474600@gmail.com>
2025-08-25 03:37:58 +00:00
you06 a05a5382fb
region_cache: reload region cache when flag `needDelayedReloadReady` is set (#1738)
ref pingcap/tidb#62933

Signed-off-by: you06 <you1474600@gmail.com>
2025-08-21 08:12:08 +00:00
zyguan 017cde67a5
region_cache: allow only one inflight updating buckets for each region (#1723)
close tikv/client-go#1722

Signed-off-by: zyguan <zhongyangguan@gmail.com>
2025-07-30 15:55:16 +00:00
Hao W 31ecc42229
region cache: Preserve needReloadOnAccess Flag on Region Cache Reload Failure (#1715)
Signed-off-by: h-wang4 <h.wang4@airbnb.com>

Co-authored-by: h-wang4 <h.wang4@airbnb.com>
2025-07-23 01:49:56 +00:00
you06 6fbcc3dbc5
replica selector: do not send replica-read to leader (#1719)
close tikv/client-go#1718

Signed-off-by: you06 <you1474600@gmail.com>
2025-07-22 09:01:56 +00:00
you06 2f847d5b0f
region cache: limit key ranges sent to PD in one `BatchScanRegions` gRPC (#1712)
close tikv/client-go#1704

Signed-off-by: you06 <you1474600@gmail.com>
2025-07-11 05:07:48 +00:00
Lynn e60fec1b25
client: split large files and rename unclear fields (#1700)
Signed-off-by: Lynn <zimu_xia@126.com>
2025-07-10 04:19:15 +00:00
zyguan 557a4986e4
client: merge ClientAsync into Client (#1664)
Signed-off-by: zyguan <zhongyangguan@gmail.com>
2025-07-08 03:13:06 +00:00
you06 84e019eae5
region cache: do not invalidate the valid region cache when new region cache is loaded (#1698)
Signed-off-by: you06 <you1474600@gmail.com>
2025-07-07 06:38:42 +00:00
guo-shaoge 6aca9d27d6
region_cache: add ForceRefreshAllStores function (#1686)
Signed-off-by: guo-shaoge <shaoge1994@163.com>
2025-06-30 10:03:00 +00:00
zyguan b7e019d315
txnkv: prevent some actions from being interrupted by kill (#1665)
fix pingcap/tidb#61454

Signed-off-by: zyguan <zhongyangguan@gmail.com>
2025-06-27 07:41:09 +00:00
glorv 1430158810
resource_control: support collecting cross AZ traffic in ru consumption (#1669)
Signed-off-by: glorv <glorvs@163.com>
2025-06-25 21:28:54 +00:00
you06 9b1e2a6652
snapshot: set `ReplicaRead` to false when `ReplicaReadType` fallbacks to `ReplicaReadLeader` (#1663)
ref pingcap/tidb#61745

Signed-off-by: you06 <you1474600@gmail.com>
2025-06-18 01:59:54 +00:00
zyguan 96b6487fac
*: support async batch get (#1646)
ref tikv/client-go#1586

Signed-off-by: zyguan <zhongyangguan@gmail.com>
2025-06-16 02:21:36 +00:00
you06 924198a868
Fix stale read metrics (#1649)
close tikv/client-go#1648

Signed-off-by: you06 <you1474600@gmail.com>
2025-06-14 02:02:13 +00:00
lhy1024 e84f1a780f
update pd client for resource group and keyspace (#1645)
Signed-off-by: lhy1024 <admin@liudos.us>
2025-05-28 09:09:49 +00:00
zyguan ff15611bb9
locate: implement SendReqAsync for RegionRequestSender (#1618)
ref tikv/client-go#1586

Signed-off-by: zyguan <zhongyangguan@gmail.com>
2025-05-22 11:51:40 +00:00
王超 1880726302
txn: fix the implemention of undetermined error (#1644)
close tikv/client-go#1641

Signed-off-by: Chao Wang <cclcwangchao@hotmail.com>
2025-05-20 11:30:40 +00:00
王超 d1ec4b4f67
txn: handle undetermined error in client go (#1642)
close tikv/client-go#1641

Signed-off-by: Chao Wang <cclcwangchao@hotmail.com>
2025-05-20 07:00:04 +00:00
ekexium 8645f93e75
enable ts validation for normal read (#1619)
Signed-off-by: ekexium <eke@fastmail.com>
2025-04-25 08:56:04 +00:00
lhy1024 63af338ed2
pd: enable OutputMustContainAllKeyRange (#1632)
Signed-off-by: lhy1024 <admin@liudos.us>
2025-04-16 08:21:06 +00:00
tangenta e53096d518
support redact key in logs (#1612)
ref pingcap/tidb#59279

Signed-off-by: tangenta <tangenta@126.com>

Co-authored-by: you06 <you1474600@gmail.com>
2025-04-01 07:17:12 +00:00
ekexium 1d2500631f
Validate ts only for stale read (#1607)
ref pingcap/tidb#59402

Signed-off-by: ekexium <eke@fastmail.com>
2025-03-12 08:34:00 +00:00
zyguan 3a625aae18
locate: fix TestTiKVClientReadTimeout (#1601)
Signed-off-by: zyguan <zhongyangguan@gmail.com>
2025-03-04 06:14:34 +00:00
okJiang aa7301d4bc
pdclient: Add caller info to pd client (#1516)
ref tikv/pd#8593

Signed-off-by: okJiang <819421878@qq.com>
2025-03-04 01:42:09 +00:00
Ryan Leung ad47ad6fe1
locate: fix the default settings of circuit breaker (#1593)
ref tikv/pd#8678

Signed-off-by: Ryan Leung <rleungx@gmail.com>
2025-02-25 10:19:35 +00:00
zyguan 8f40417abd
locate: refactor RegionRequestSender.SendReqCtx (#1565)
Signed-off-by: zyguan <zhongyangguan@gmail.com>
2025-02-25 03:36:33 +00:00
you06 075b19f935
p-dml: resolve locks concurrently (#1584)
close tikv/client-go#1577

Signed-off-by: you06 <you1474600@gmail.com>
2025-02-19 01:46:31 +00:00
mittalrishabh ad5b9e27f3
retry stale read as stale if leader is not accessible (#1566)
Signed-off-by: rishabh_mittal <mittalrishabh@gmail.com>
2025-02-05 03:01:03 +00:00
zyguan 20764920b4
*: reduce overhead of codec client (#1555)
Signed-off-by: zyguan <zhongyangguan@gmail.com>
2025-01-17 03:47:01 +00:00
Artem Danilov be4b478c11
integrate circuitbreaker for region calls (#1543)
ref tikv/pd#8678

Signed-off-by: artem_danilov <artem_danilov@airbnb.com>

Co-authored-by: artem_danilov <artem_danilov@airbnb.com>
2025-01-15 04:06:13 +00:00
zyguan a348c17c6b
*: fix two minor bugs (#1553)
Signed-off-by: zyguan <zhongyangguan@gmail.com>
2025-01-13 03:38:31 +00:00
zyguan d3554347ae
region_cache: fix a potential data race on store.addr (#1545)
close tikv/client-go#1544

Signed-off-by: zyguan <zhongyangguan@gmail.com>
2025-01-13 03:36:19 +00:00
ekexium 2eba2f614b
Handle error invalid_max_ts_update (#1512)
ref tikv/tikv#17916

Signed-off-by: ekexium <eke@fastmail.com>
2025-01-07 06:25:19 +00:00
Shirly f2025c1297
region_request: tiny refactor - init function failpointSendReqResult (#1523)
Signed-off-by: AndreMouche <AndreMouche@126.com>
2025-01-02 09:55:21 +00:00
crazycs f2266d6bf2
*: Optimize executor runtime stats performance (#1532)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2024-12-25 04:06:45 +00:00
JmPotato ff126df68a
Upgrade the PD client to adopt the latest refactor (#1525)
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2024-12-20 05:23:27 +00:00
okJiang 2572ee4a7b
metrics: add StaleRegionFromPDCounter (#1530)
ref tikv/pd#7431

Signed-off-by: okJiang <819421878@qq.com>
2024-12-19 07:55:51 +00:00
ShuNing 0e4728cfaa
*: add the traffic statistic (#1505)
ref pingcap/tidb#57543

Signed-off-by: nolouch <nolouch@gmail.com>
2024-12-16 06:58:54 +00:00
MyonKeminta 06d7f4b923
Try to validate read ts for all RPC requests (#1513)
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2024-12-09 09:49:30 +00:00
mittalrishabh c65273eeb1
retry as stale read on replica (#1509)
Signed-off-by: rishabh_mittal <mittalrishabh@gmail.com>
2024-12-02 07:37:11 +00:00
cfzjywxk 691e80ae0e
region cache: retry scan or batch scan regions when returned region has no leader (#1480)
Signed-off-by: cfzjywxk <cfzjywxk@gmail.com>
2024-10-23 02:31:20 +00:00
ekexium 527f80a186
feat: Broadcast min_commit_ts for pipelined transactions (#1458)
Signed-off-by: ekexium <eke@fastmail.com>
2024-09-25 01:34:14 +00:00
crazycs e7894a7b27
config: change grpc-keepalive-timeout from uint to float64, for support millisecond timeout (#1461)
Signed-off-by: crazycs520 <crazycs520@gmail.com>

Co-authored-by: MyonKeminta <9948422+MyonKeminta@users.noreply.github.com>
2024-09-11 04:15:06 +00:00
you06 c810ed88fb
region_request: remove backoff for stale read (#1423)
* remove stale read backoff

Signed-off-by: you06 <you1474600@gmail.com>

* sort imports

Signed-off-by: you06 <you1474600@gmail.com>

---------

Signed-off-by: you06 <you1474600@gmail.com>
2024-08-15 10:09:19 +08:00
Shenghui Wu f0f57f28c4
region cache: batch find regions by key ranges from cache (#1410)
* try

add benchmark

Signed-off-by: wshwsh12 <793703860@qq.com>

* impl

Signed-off-by: wshwsh12 <793703860@qq.com>

* time

Signed-off-by: wshwsh12 <793703860@qq.com>

* fix ut

Signed-off-by: wshwsh12 <793703860@qq.com>

* address comments

Signed-off-by: wshwsh12 <793703860@qq.com>

* startkey

Signed-off-by: wshwsh12 <793703860@qq.com>

* add comments

Signed-off-by: wshwsh12 <793703860@qq.com>

---------

Signed-off-by: wshwsh12 <793703860@qq.com>
Co-authored-by: you06 <you1474600@gmail.com>
2024-08-09 15:36:57 +09:00
crazycs cd64e24de8
fix issue that store's liveness may incorrectly marked as unreachable when the store restarts with label changed (#1407)
* add test

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix ci

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2024-08-01 19:02:26 +08:00
crazycs eec8198343
refine region request debug log (#1408)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2024-07-31 17:42:29 +08:00
you06 d73cc1ed65
region cache: check if the pd returned regions covers the ranges (#1377)
* add reproduce test

Signed-off-by: you06 <you1474600@gmail.com>

* check if the pd returned regions covers the ranges

Signed-off-by: you06 <you1474600@gmail.com>

* handle limit

Signed-off-by: you06 <you1474600@gmail.com>

* fix lint

Signed-off-by: you06 <you1474600@gmail.com>

* add TODO for  func

Signed-off-by: you06 <you1474600@gmail.com>

* update tidb for integration test

Signed-off-by: you06 <you1474600@gmail.com>

* rename gap detection function

Signed-off-by: you06 <you1474600@gmail.com>

* address comment

Signed-off-by: you06 <you1474600@gmail.com>

* address comment

Signed-off-by: you06 <you1474600@gmail.com>

* add half bounded cases

Signed-off-by: you06 <you1474600@gmail.com>

---------

Signed-off-by: you06 <you1474600@gmail.com>
2024-07-03 17:58:01 +08:00