tikv
/
client-go
mirror of https://github.com/tikv/client-go.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
558 Commits 27 Branches 11 Tags 33 MiB
Commit Graph

69 Commits

Author SHA1 Message Date
buffer 4c2ae43454
dco (#988) 
Signed-off-by: bufferflies <1045931706@qq.com>
 2023-09-26 13:16:11 +08:00
you06 fb8e4c0eac
add region cache state test & fix some issues of replica selector (#910) (#942) 
* add region cache state test & fix some issues of replica selector (#910)

Signed-off-by: you06 <you1474600@gmail.com>

remove duplicate code

Signed-off-by: you06 <you1474600@gmail.com>

* remove comment

Signed-off-by: you06 <you1474600@gmail.com>

* lint

Signed-off-by: you06 <you1474600@gmail.com>

* fix flaky test

Signed-off-by: you06 <you1474600@gmail.com>

---------

Signed-off-by: you06 <you1474600@gmail.com>
 2023-09-12 12:36:53 +08:00
crazycs520 ba3de39920 *: fix panic log 
Signed-off-by: crazycs520 <crazycs520@gmail.com>
 2023-09-11 14:38:07 +08:00
buffer ff39b4af09
error: handle bucket version not match (#918) 2023-08-22 03:25:20 -06:00
you06 44f5025f5a
fallback to follower when leader is busy (#916) (#923) 
* fallback to follower when leader is busy

Signed-off-by: you06 <you1474600@gmail.com>
Co-authored-by: cfzjywxk <cfzjywxk@gmail.com>
Co-authored-by: cfzjywxk <lsswxrxr@163.com>
 2023-08-11 21:36:47 +08:00
crazycs 719e6456f7
use context logger as much as possible (#908) 
* use context logger as much as possible

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* refine

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
 2023-07-31 11:23:49 +08:00
crazycs 9f94221c2d
add more log for diagnose (#915) 
* add more log for diagnose

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* fix

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* add more log for diagnose

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* add more log

Signed-off-by: crazycs520 <crazycs520@gmail.com>

* address comment

Signed-off-by: crazycs520 <crazycs520@gmail.com>

---------

Signed-off-by: crazycs520 <crazycs520@gmail.com>
 2023-07-28 20:35:05 +08:00
you06 85fc8f3375
reload region cache when store is resolved from invalid status (#843) 
Signed-off-by: you06 <you1474600@gmail.com>
Co-authored-by: disksing <i@disksing.com>
 2023-07-14 13:27:14 +08:00
guo-shaoge 51633ada95
region_cache: support check pending tiflash peer (#821) 
Signed-off-by: guo-shaoge <shaoge1994@163.com>
Co-authored-by: disksing <i@disksing.com>
 2023-07-13 14:08:45 +08:00
王超 5e3e38b270
format key in error message in method `scanRegions` (#876) 
Signed-off-by: Chao Wang <cclcwangchao@hotmail.com>
 2023-07-10 15:42:05 +08:00
王超 32eb2b0f88
use '%d' instead of '%q' for some int values in error message (#875) 
Signed-off-by: Chao Wang <cclcwangchao@hotmail.com>
 2023-07-10 12:30:33 +08:00
王超 c764d7bc8f
client-go: add some key range info to error when PD returned no region (#862) 
Signed-off-by: Chao Wang <cclcwangchao@hotmail.com>
 2023-06-30 14:27:00 +08:00
Smilencer f64d5dd79b
update dco (#731) 
Signed-off-by: Smityz <smityz@qq.com>
Co-authored-by: disksing <i@disksing.com>
 2023-04-27 14:45:04 +08:00
Artem Danilov 415713766f
avoid dataIsNotReady error while retrying stale read on the leader (#765) 
* avoid dataIsNotReady error while retrying stale read on the leader

Signed-off-by: artem_danilov <artem_danilov@airbnb.com>

* move StaleRead flag reset to retry section

Signed-off-by: artem_danilov <artem_danilov@airbnb.com>

* move all logic to #next and allow retry on the leader

Signed-off-by: artem_danilov <artem_danilov@airbnb.com>

---------

Signed-off-by: artem_danilov <artem_danilov@airbnb.com>
Co-authored-by: artem_danilov <artem_danilov@airbnb.com>
 2023-04-19 10:48:52 +08:00
Smilencer bb350d6ea8
fix data race (#736) 
Signed-off-by: Smityz <smityz@qq.com>
Co-authored-by: disksing <i@disksing.com>
 2023-03-27 16:10:11 +08:00
you06 884a634378
compatible batch copr with load-based replica read (#739) 
* compatible batch copr with load-based replica read

Signed-off-by: you06 <you1474600@gmail.com>

* handle batch cop when server is busy

Signed-off-by: you06 <you1474600@gmail.com>

debug

Signed-off-by: you06 <you1474600@gmail.com>

debug

Signed-off-by: you06 <you1474600@gmail.com>

debug

Signed-off-by: you06 <you1474600@gmail.com>

remove debug

Signed-off-by: you06 <you1474600@gmail.com>

* address comment

Signed-off-by: you06 <you1474600@gmail.com>

* ci

Signed-off-by: you06 <you1474600@gmail.com>

* ci

Signed-off-by: you06 <you1474600@gmail.com>

---------

Signed-off-by: you06 <you1474600@gmail.com>
 2023-03-17 11:26:22 +08:00
Lucas a7e3df4ab1
[Metrics] Supply extra metrics to monitor the flows under `prefer-leader` mode. (#716) 
Signed-off-by: Lucasliang <nkcs_lykx@hotmail.com>
 2023-03-13 18:08:39 +08:00
guo-shaoge bd24a9e443
Merge branch 'master' into support_engine_role 2023-03-07 15:47:49 +08:00
you06 8a8ef35790
support non-block read region (#725) 
Signed-off-by: you06 <you1474600@gmail.com>
 2023-03-07 15:15:35 +08:00
guo-shaoge 39cd84957f fix fmt 
Signed-off-by: guo-shaoge <shaoge1994@163.com>
 2023-03-06 18:05:17 +08:00
guo-shaoge 0d003d077b region_cache: support <engine_role, write> for disaggregated tiflash 
Signed-off-by: guo-shaoge <shaoge1994@163.com>
 2023-03-06 17:53:57 +08:00
Yilin Chen a27994e5aa
Support load-based replica read (#675) 
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
 2023-02-22 15:35:43 +08:00
Lucas bce56a5831
ReadMode: introduce AutoFollowerRead mechanism by adding a new `ReadMode == PreferLeader` (#671) 
Signed-off-by: lucasliang <nkcs_lykx@hotmail.com>
 2023-02-07 16:42:52 +08:00
Wenxuan 3edbadb227
Increase consistent hash replicas to 200 for better balance (#688) 
Signed-off-by: Wish <breezewish@outlook.com>
 2023-02-06 11:19:46 +08:00
Yilin Chen 78470adc3d
Rewind after cacheGC reaches the end (#678) 
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
 2023-01-30 15:45:29 +08:00
Smilencer f2ff1ce65d
add tombstone check (#660) 
Signed-off-by: Smityz <smityz@qq.com>
Co-authored-by: disksing <i@disksing.com>
 2023-01-12 13:23:02 +08:00
Yilin Chen a2964b7151
Add a background region cache GC goroutine (#664) 
* Add a background region cache GC goroutine

Signed-off-by: Yilin Chen <sticnarf@gmail.com>

* Change interval to 1s and regionPerRound to 50

Signed-off-by: Yilin Chen <sticnarf@gmail.com>

Signed-off-by: Yilin Chen <sticnarf@gmail.com>
 2023-01-11 16:47:55 +08:00
David f313ddf58d
reformat codec and add keyspace support (#649) 
Signed-off-by: David <8039876+AmoebaProtozoa@users.noreply.github.com>
 2023-01-10 15:15:33 +08:00
Zwb c20405f345
support witness peers (#633) 
Signed-off-by: Wenbo Zhang <ethercflow@gmail.com>
 2023-01-09 20:53:19 +08:00
hehechen fe3536dd59
MinSafeTS support TiFlash (#642) 
Signed-off-by: hehechen <awd123456sss@gmail.com>
 2022-12-19 17:16:53 +08:00
guo-shaoge 0bf06e87bf update log 
Signed-off-by: guo-shaoge <shaoge1994@163.com>
 2022-12-18 13:57:23 +08:00
guo-shaoge 60119cdd7a fix errors.Errorf 
Signed-off-by: guo-shaoge <shaoge1994@163.com>
 2022-12-17 16:46:55 +08:00
guo-shaoge ffc2788663 region_cache: refine GetTiFlashComputeRPCContextByConsistentHash(for detect alive) 
Signed-off-by: guo-shaoge <shaoge1994@163.com>
 2022-12-17 16:41:11 +08:00
Chen Ding 50651d6bb5
precompute min safe ts (#622) 
Signed-off-by: hihihuhu <dingc05@gmail.com>
 2022-12-02 11:55:43 +08:00
guo-shaoge e76cd3e240
region_cache: only load UP tiflash_mpp store (#598) 
Signed-off-by: guo-shaoge <shaoge1994@163.com>
 2022-10-13 14:54:37 +08:00
xufei 33efe476e0
update comments (#590) 
Signed-off-by: xufei <xufeixw@mail.ustc.edu.cn>
 2022-09-23 14:17:03 +08:00
Jack Yu ce9203ef66
*: disable PermitWithoutStream to avoid too many pings (#574) 
Signed-off-by: Jack Yu <jackysp@gmail.com>
 2022-09-21 18:16:51 +08:00
Yilin Chen f2de03a066
Avoid data race at workTiFlashIdx (#586) 
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
 2022-09-19 10:56:34 +08:00
Ryan-Git 8c1802b0f6
feat(region_cache): sync leader store epoch when switchWorkLeaderToPeer (#573) 
Signed-off-by: renhongdi <ryan.hd.ren@gmail.com>
 2022-09-07 12:46:50 +08:00
Yilin Chen 025596b7a2
Clear intersecting regions in the cache when inserting a region (#566) 
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
 2022-08-15 17:47:24 +08:00
Weizhen Wang 86d51ba7eb
*: update google/btree to improve performance (#547) 
* *: update google/btree to improve performance

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>

* update ci

Signed-off-by: Weizhen Wang <wangweizhen@pingcap.com>
 2022-07-18 16:02:14 +08:00
iosmanthus 68cd1bc6c1
Introduce API v2 (#494) 
* introduce raw.Client with api v2

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* migrate rawkv test to api v2

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* git fire: refactoring the interface SplitRegion of CodecClientV2

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* go mod tidy

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* fix split region issue in CodecClientV2

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* rearrange imports

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* add version info for RegionCache

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* delay request encoding to RPCClient

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* prevent multiple encoding

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* wip: debugging retry logic

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* fix EpochNotMatch region decoding

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* remove txn request branch

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* copy request before encoding it

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* add gRPCDialOptions for rawkv.Client

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* fix api breaking change of raw.NewClient

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* address menglong's comments

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* go mod tidy

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* address comments and fix linter

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* fix api_test

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* fix TestScan

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* fix TestScan

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

* fix compatibility

Signed-off-by: iosmanthus <myosmanthustree@gmail.com>

Co-authored-by: Xiaoguang Sun <sunxiaoguang@users.noreply.github.com>
 2022-07-09 14:49:46 +08:00
Yilin Chen be31f33ba0
Avoid sending requests to unhealthy leader (#503) 
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
 2022-06-13 19:27:34 +08:00
guo-shaoge 700cbe60d2
support find stores with tiflash_mpp label (#481) 
Signed-off-by: guo-shaoge <shaoge1994@163.com>
Co-authored-by: Yilin Chen <sticnarf@gmail.com>
 2022-05-23 11:22:53 +08:00
you06 79f010d806
metrics: add loading region cache duration (#502) 
* add latency for loading region region

Signed-off-by: you06 <you1474600@gmail.com>

* rename "*ReginoMiss" to "*CacaheMiss"

Signed-off-by: you06 <you1474600@gmail.com>

* rename metrics

Signed-off-by: you06 <you1474600@gmail.com>
 2022-05-16 15:21:22 +08:00
Spade A e007187e51
region_cache: Add comments for LocateBucket (#497) 
* update

Signed-off-by: SpadeA-Tang <u6748471@anu.edu.au>

* update

Signed-off-by: SpadeA-Tang <u6748471@anu.edu.au>

* update

Signed-off-by: SpadeA-Tang <u6748471@anu.edu.au>
 2022-05-16 11:52:21 +08:00
Spade A 2be4a58dbc
region_cache: rename LocateBucketV2 to LocateBucket and let the old LocateBucket be the internal function of the new LocateBucket (#496) 
Signed-off-by: SpadeA-Tang <u6748471@anu.edu.au>
 2022-05-13 15:26:07 +08:00
Spade A 3705989fa1
Wrap locateBucket to handle with edges (#486) 
Signed-off-by: SpadeA-Tang <u6748471@anu.edu.au>
 2022-05-07 15:34:05 +08:00
disksing ec236b6435
fix linter warning (#470) 
Signed-off-by: disksing <i@disksing.com>
 2022-04-11 21:29:30 +08:00
Lei Zhao f73ec0e675
client: fix the race between connArray.Close() and connArray.Get() (#465) 
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
 2022-04-06 17:12:03 +08:00