Commit Graph

293 Commits

Author SHA1 Message Date
zyguan 557a4986e4
client: merge ClientAsync into Client (#1664)
Signed-off-by: zyguan <zhongyangguan@gmail.com>
2025-07-08 03:13:06 +00:00
tiancaiamao c5c0ba231d
tikv: fix bug TxnSafePointCache has no data when tidb just startup (#1676)
Signed-off-by: tiancaiamao <tiancaiamao@gmail.com>
2025-07-03 12:31:24 +00:00
zyguan b7e019d315
txnkv: prevent some actions from being interrupted by kill (#1665)
fix pingcap/tidb#61454

Signed-off-by: zyguan <zhongyangguan@gmail.com>
2025-06-27 07:41:09 +00:00
glorv 1430158810
resource_control: support collecting cross AZ traffic in ru consumption (#1669)
Signed-off-by: glorv <glorvs@163.com>
2025-06-25 21:28:54 +00:00
you06 9b1e2a6652
snapshot: set `ReplicaRead` to false when `ReplicaReadType` fallbacks to `ReplicaReadLeader` (#1663)
ref pingcap/tidb#61745

Signed-off-by: you06 <you1474600@gmail.com>
2025-06-18 01:59:54 +00:00
ekexium 806e1891f2
ci: add next-gen integration tests (#1661)
Signed-off-by: ekexium <eke@fastmail.com>
2025-06-17 13:13:51 +00:00
yibin f75488ba72
Update kvproto dependancy and set keyspace name for rpc context (#1667)
close tikv/client-go#1668

Signed-off-by: yibin87 <huyibin@pingcap.com>
2025-06-17 10:47:51 +00:00
zyguan 96b6487fac
*: support async batch get (#1646)
ref tikv/client-go#1586

Signed-off-by: zyguan <zhongyangguan@gmail.com>
2025-06-16 02:21:36 +00:00
MyonKeminta 74c0a81150
Replace etcd safe point with txn safe point for read safety check (#1634)
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2025-06-09 07:39:40 +00:00
zyguan af9bd3c5d2
tests: bump tidb to fix integration tests (#1650)
Signed-off-by: zyguan <zhongyangguan@gmail.com>
2025-06-05 01:27:38 +00:00
lhy1024 e84f1a780f
update pd client for resource group and keyspace (#1645)
Signed-off-by: lhy1024 <admin@liudos.us>
2025-05-28 09:09:49 +00:00
王超 1880726302
txn: fix the implemention of undetermined error (#1644)
close tikv/client-go#1641

Signed-off-by: Chao Wang <cclcwangchao@hotmail.com>
2025-05-20 11:30:40 +00:00
王超 d1ec4b4f67
txn: handle undetermined error in client go (#1642)
close tikv/client-go#1641

Signed-off-by: Chao Wang <cclcwangchao@hotmail.com>
2025-05-20 07:00:04 +00:00
王超 2058fbc062
*: update kvproto version (#1636)
ref tikv/client-go#1631

Signed-off-by: Chao Wang <cclcwangchao@hotmail.com>
2025-05-06 05:25:04 +00:00
tangenta 2b8c6a7761
update integration_test/go.mod (#1624)
Signed-off-by: tangenta <tangenta@126.com>
2025-04-02 12:26:58 +00:00
tangenta e53096d518
support redact key in logs (#1612)
ref pingcap/tidb#59279

Signed-off-by: tangenta <tangenta@126.com>

Co-authored-by: you06 <you1474600@gmail.com>
2025-04-01 07:17:12 +00:00
disksing e3b8af59f4
update tidb for integration tests (#1621)
Signed-off-by: disksing <i@disksing.com>
2025-03-28 06:19:30 +00:00
disksing 599e671b3a
Update pd client (#1615)
Signed-off-by: disksing <i@disksing.com>
2025-03-19 14:08:00 +08:00
Ryan Leung 34130b733a
*: update pd client (#1605)
Signed-off-by: Ryan Leung <rleungx@gmail.com>
2025-03-11 02:15:13 +00:00
Ryan Leung a805ea84f3
*: bump pd client (#1575)
Signed-off-by: Ryan Leung <rleungx@gmail.com>
2025-02-14 06:40:15 +00:00
Ryan Leung ec9ad0fd70
*: bump pd client (#1567)
Signed-off-by: Ryan Leung <rleungx@gmail.com>
2025-02-07 06:53:27 +00:00
zyguan e85edd4206
client: refactor batch client send loop (#1564)
Signed-off-by: zyguan <zhongyangguan@gmail.com>
2025-01-24 06:43:32 +00:00
ekexium 405d444558
Allow setting concurrency for pipelined flush and resolveLocks (#1494)
Signed-off-by: ekexium <eke@fastmail.com>
2025-01-16 07:40:52 +00:00
Ryan Leung 23abf0a9c8
*: bump pd client (#1542)
Signed-off-by: Ryan Leung <rleungx@gmail.com>
2025-01-07 05:34:22 +00:00
crazycs 15c9cdb119
change ci reference to original tidb (#1540)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2024-12-30 03:58:15 +00:00
crazycs f2266d6bf2
*: Optimize executor runtime stats performance (#1532)
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2024-12-25 04:06:45 +00:00
JmPotato fd950fcf9f
Update the PD client to adopt tikv/pd#8943 (#1536)
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2024-12-23 07:08:48 +00:00
JmPotato ff126df68a
Upgrade the PD client to adopt the latest refactor (#1525)
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2024-12-20 05:23:27 +00:00
MyonKeminta 8e0275cc8d
Fix the problem that ttlManager may stop working if no need to lock after retry aggressive locking (#1522)
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2024-12-17 09:14:33 +00:00
MyonKeminta 06d7f4b923
Try to validate read ts for all RPC requests (#1513)
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2024-12-09 09:49:30 +00:00
Bin Zhang 89643b0e8c
Export commitTS of KVTxn (#1489)
Signed-off-by: Bin Zhang <b6g2021@gmail.com>
2024-11-27 07:15:26 +00:00
Neil Shen 245d2c39cc
go.mod: update kvproto (#1492)
Signed-off-by: Neil Shen <overvenus@gmail.com>
2024-11-15 06:51:08 +00:00
ShuNing 70049ae310
mod: update pd client (#1490)
Signed-off-by: nolouch <nolouch@gmail.com>
2024-11-11 09:02:27 +00:00
lance6716 8dfa86b5d1
dep: update github.com/dgryski/go-farm (#1476)
ref pingcap/tidb#56635

Signed-off-by: lance6716 <lance6716@gmail.com>
2024-10-15 06:50:14 +00:00
Weizhen Wang e30a3e6e3a
*: upgrade go1.23 (#1473)
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
2024-10-11 06:35:57 +00:00
ekexium 527f80a186
feat: Broadcast min_commit_ts for pipelined transactions (#1458)
Signed-off-by: ekexium <eke@fastmail.com>
2024-09-25 01:34:14 +00:00
YangKeao f0ea917499
transaction: add hook for async commit to track the life cycle of the async-commit goroutine and secondary lock cleanup goroutine (#1432)
Signed-off-by: Yang Keao <yangkeao@chunibyo.icu>
2024-09-04 09:21:32 +00:00
you06 d73cc1ed65
region cache: check if the pd returned regions covers the ranges (#1377)
* add reproduce test

Signed-off-by: you06 <you1474600@gmail.com>

* check if the pd returned regions covers the ranges

Signed-off-by: you06 <you1474600@gmail.com>

* handle limit

Signed-off-by: you06 <you1474600@gmail.com>

* fix lint

Signed-off-by: you06 <you1474600@gmail.com>

* add TODO for  func

Signed-off-by: you06 <you1474600@gmail.com>

* update tidb for integration test

Signed-off-by: you06 <you1474600@gmail.com>

* rename gap detection function

Signed-off-by: you06 <you1474600@gmail.com>

* address comment

Signed-off-by: you06 <you1474600@gmail.com>

* address comment

Signed-off-by: you06 <you1474600@gmail.com>

* add half bounded cases

Signed-off-by: you06 <you1474600@gmail.com>

---------

Signed-off-by: you06 <you1474600@gmail.com>
2024-07-03 17:58:01 +08:00
you06 14f3d2b5b7
region cache: add `BatchLocateKeyRanges` interface (#1367)
* add batch scan interface

Signed-off-by: you06 <you1474600@gmail.com>

fix bug

Signed-off-by: you06 <you1474600@gmail.com>

copy encoded ranges

Signed-off-by: you06 <you1474600@gmail.com>

fix panic

Signed-off-by: you06 <you1474600@gmail.com>

add batch scan region test

Signed-off-by: you06 <you1474600@gmail.com>

fix log

Signed-off-by: you06 <you1474600@gmail.com>

remove need-leader option

Signed-off-by: you06 <you1474600@gmail.com>

remove need-leader optino

Signed-off-by: you06 <you1474600@gmail.com>

add comment

Signed-off-by: you06 <you1474600@gmail.com>

deprecate ScanRegions

Signed-off-by: you06 <you1474600@gmail.com>

update kvproto & pd client

Signed-off-by: you06 <you1474600@gmail.com>

update go.mod

Signed-off-by: you06 <you1474600@gmail.com>

fix need leader

Signed-off-by: you06 <you1474600@gmail.com>

fix integration test

Signed-off-by: you06 <you1474600@gmail.com>

fix lint

Signed-off-by: you06 <you1474600@gmail.com>

export BatchLocateKeyRangesOpt

Signed-off-by: you06 <you1474600@gmail.com>

update integration test's tidb

Signed-off-by: you06 <you1474600@gmail.com>

refactor BatchLocateKeyRanges and add comments

Signed-off-by: you06 <you1474600@gmail.com>

* update tidb of integration test

Signed-off-by: you06 <you1474600@gmail.com>

* remove key in error since redact is not supported

Signed-off-by: you06 <you1474600@gmail.com>

* remove key in error since redact is not supported

Signed-off-by: you06 <you1474600@gmail.com>

* address comment

Signed-off-by: you06 <you1474600@gmail.com>

---------

Signed-off-by: you06 <you1474600@gmail.com>
2024-06-24 16:06:06 +08:00
yibin d4f0f4cf12
Revert "upgrade grpc 1.64 (#1346)" (#1369)
This reverts commit 1c06c5cbf5.

Signed-off-by: yibin <huyibin@pingcap.com>
2024-06-21 17:03:19 +08:00
JmPotato 156cebc2de
Update the PD client to adopt the latest fix/optimization (#1360)
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2024-06-04 12:57:05 +08:00
MyonKeminta 31a8ddab19
Support actively requesting update health feedback information by calling RPC to TiKV (#1287)
* Support actively requesting update health feedback information by calling RPC to TiKV

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Update kvproto; follow the protocol change; and add more comments

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Fix build

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Add integration tests

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* tune the frequency of active updating

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Update kvproto

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Fix test

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Revert changes to examples

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

* Remove unnecessary empty line

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>

---------

Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2024-05-27 14:36:27 +08:00
Weizhen Wang 1c06c5cbf5
upgrade grpc 1.64 (#1346)
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
2024-05-17 12:20:15 +08:00
you06 6cb0704fce
fail pipelined dml when max ttl exceeded (#1329)
Signed-off-by: you06 <you1474600@gmail.com>
Co-authored-by: ekexium <eke@fastmail.com>
2024-04-30 22:52:41 +08:00
JmPotato 52c232be3d
Update the PD client to adopt the latest optimization (#1326) 2024-04-30 16:32:54 +08:00
crazycs 31a502b9ba
improve region request log for diagnose (#1300)
* improve region request log for diagnose

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* rename struct

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine region error metric with store id label and add rpc error metric

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine comment

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine code

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* restrict log

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine code

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine log

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine code

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix test

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* address comment

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine log

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
2024-04-29 15:56:32 +08:00
Weizhen Wang 1e1fe07b05
*: upgrade grpc 1.63.2 (#1289)
Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
2024-04-26 10:56:09 +08:00
you06 0229f4077f
do not cache snapshot with version maxuint64 (#1320)
Signed-off-by: you06 <you1474600@gmail.com>
2024-04-24 13:23:42 +08:00
you06 edba2544d5
txn: abort pipelined dml when pk rollback (#1317)
* fail p-dml when ttl manager is closed

Signed-off-by: you06 <you1474600@gmail.com>

* close ttl manager when pk is rollbcked

Signed-off-by: you06 <you1474600@gmail.com>

* stablize test

Signed-off-by: you06 <you1474600@gmail.com>

* add test

Signed-off-by: you06 <you1474600@gmail.com>

* fix race

Signed-off-by: you06 <you1474600@gmail.com>

* fix leak in test

Signed-off-by: you06 <you1474600@gmail.com>

* remote testlog

Signed-off-by: you06 <you1474600@gmail.com>

* check error message

Signed-off-by: you06 <you1474600@gmail.com>

---------

Signed-off-by: you06 <you1474600@gmail.com>
2024-04-23 17:36:44 +08:00
you06 dcb9b95307
txn: cache result of snapshot.Get (#1278)
* also cache result of snapshot.Get

Signed-off-by: you06 <you1474600@gmail.com>

* fix test

Signed-off-by: you06 <you1474600@gmail.com>

fix test

Signed-off-by: you06 <you1474600@gmail.com>

* add Get cache test

Signed-off-by: you06 <you1474600@gmail.com>

* move RLock position

Signed-off-by: you06 <you1474600@gmail.com>

* remove comment

Signed-off-by: you06 <you1474600@gmail.com>

* address comment

Signed-off-by: you06 <you1474600@gmail.com>

---------

Signed-off-by: you06 <you1474600@gmail.com>
2024-04-13 16:45:31 +08:00