9f94221c2d
add more log for diagnose ( #915 )
...
* add more log for diagnose
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* add more log for diagnose
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* add more log
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* address comment
Signed-off-by: crazycs520 <crazycs520@gmail.com>
---------
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-07-28 20:35:05 +08:00
d880eca9e1
fix unexpected slow query during GC running after stop 1 tikv-server ( #899 ) ( #909 )
...
* fix unexpected slow query during GC running after stop 1 tikv-server
Signed-off-by: crazycs520 <crazycs520@gmail.com>
* fix test
Signed-off-by: crazycs520 <crazycs520@gmail.com>
---------
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-07-26 13:57:33 +08:00
85fc8f3375
reload region cache when store is resolved from invalid status ( #843 )
...
Signed-off-by: you06 <you1474600@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-07-14 13:27:14 +08:00
4ec212d5f2
*: fix stale read ops metric ( #878 ) ( #889 )
...
Signed-off-by: crazycs520 <crazycs520@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-07-14 11:03:10 +08:00
fbec023060
*: refine non-global stale-read request retry logic ( #863 )
...
Signed-off-by: crazycs520 <crazycs520@gmail.com>
2023-07-03 12:12:02 +08:00
c946782286
Fallback to leader read when replica read meets flashback-in-progress error ( #796 )
...
* handle flashback error when follower read
Signed-off-by: you06 <you1474600@gmail.com>
* add test
Signed-off-by: you06 <you1474600@gmail.com>
* trigger CI
Signed-off-by: you06 <you1474600@gmail.com>
* fix panic
Signed-off-by: you06 <you1474600@gmail.com>
* trigger CI
Signed-off-by: you06 <you1474600@gmail.com>
* trigger CI
Signed-off-by: you06 <you1474600@gmail.com>
---------
Signed-off-by: you06 <you1474600@gmail.com>
2023-05-11 13:49:08 +08:00
c619a50474
add metrics for stale-read traffic ( #776 )
...
Signed-off-by: you06 <you1474600@gmail.com>
2023-04-27 14:55:46 +08:00
2be71b35ee
Add afterSendReqToRegion failpoint ( #780 )
...
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2023-04-26 15:50:11 +08:00
415713766f
avoid dataIsNotReady error while retrying stale read on the leader ( #765 )
...
* avoid dataIsNotReady error while retrying stale read on the leader
Signed-off-by: artem_danilov <artem_danilov@airbnb.com>
* move StaleRead flag reset to retry section
Signed-off-by: artem_danilov <artem_danilov@airbnb.com>
* move all logic to #next and allow retry on the leader
Signed-off-by: artem_danilov <artem_danilov@airbnb.com>
---------
Signed-off-by: artem_danilov <artem_danilov@airbnb.com>
Co-authored-by: artem_danilov <artem_danilov@airbnb.com>
2023-04-19 10:48:52 +08:00
f3e87039d8
Finer `is_retry_request` settings ( #763 )
...
* set is_retry_request only for requests that is possible to have undetermined errors
Signed-off-by: ekexium <eke@fastmail.com>
* rename tryTimes to retryTimes
Signed-off-by: ekexium <eke@fastmail.com>
---------
Signed-off-by: ekexium <eke@fastmail.com>
Co-authored-by: cfzjywxk <lsswxrxr@163.com>
2023-04-10 10:39:43 +08:00
f7e35b25be
Log request info for label warning ( #744 )
...
Signed-off-by: Daniël van Eeden <git@myname.nl>
Co-authored-by: disksing <i@disksing.com>
2023-03-27 14:51:16 +08:00
884a634378
compatible batch copr with load-based replica read ( #739 )
...
* compatible batch copr with load-based replica read
Signed-off-by: you06 <you1474600@gmail.com>
* handle batch cop when server is busy
Signed-off-by: you06 <you1474600@gmail.com>
debug
Signed-off-by: you06 <you1474600@gmail.com>
debug
Signed-off-by: you06 <you1474600@gmail.com>
debug
Signed-off-by: you06 <you1474600@gmail.com>
remove debug
Signed-off-by: you06 <you1474600@gmail.com>
* address comment
Signed-off-by: you06 <you1474600@gmail.com>
* ci
Signed-off-by: you06 <you1474600@gmail.com>
* ci
Signed-off-by: you06 <you1474600@gmail.com>
---------
Signed-off-by: you06 <you1474600@gmail.com>
2023-03-17 11:26:22 +08:00
a7e3df4ab1
[Metrics] Supply extra metrics to monitor the flows under `prefer-leader` mode. ( #716 )
...
Signed-off-by: Lucasliang <nkcs_lykx@hotmail.com>
2023-03-13 18:08:39 +08:00
bd24a9e443
Merge branch 'master' into support_engine_role
2023-03-07 15:47:49 +08:00
bdd41058aa
metrics: seperate metrics with source scope for txn command ( #723 )
...
* seperate metrics with source scope
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
* fix async pessimistic rollback
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
* fix missing definition
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
---------
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2023-03-06 22:12:45 +08:00
0d003d077b
region_cache: support <engine_role, write> for disaggregated tiflash
...
Signed-off-by: guo-shaoge <shaoge1994@163.com>
2023-03-06 17:53:57 +08:00
3f7860f109
region_request: handle resource group error before Backoff ( #719 )
...
Signed-off-by: Cabinfever_B <cabinfeveroier@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2023-03-02 13:40:57 +08:00
a27994e5aa
Support load-based replica read ( #675 )
...
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2023-02-22 15:35:43 +08:00
e0e6019f8a
attach keyspace_id to tikv/tiflash requests ( #682 )
2023-02-20 13:10:03 +08:00
bdcfab8928
Consider the number of replicas when calculating RU ( #684 )
...
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2023-02-08 22:56:14 +08:00
bce56a5831
ReadMode: introduce AutoFollowerRead mechanism by adding a new `ReadMode == PreferLeader` ( #671 )
...
Signed-off-by: lucasliang <nkcs_lykx@hotmail.com>
2023-02-07 16:42:52 +08:00
56c521f109
internal: update `FlashbackInProgress` error msg ( #692 )
...
Signed-off-by: Hangjie Mo <mohangjie1995@gmail.com>
2023-02-06 17:34:59 +08:00
1b1a805e61
Support learner replica read ( #643 )
...
Signed-off-by: Yang Zhang <yang.zhang@pingcap.com>
2023-01-11 14:37:06 +08:00
c59833429b
Bug fix: fix the Round-Robin algorithm when "ReadMode == ReplicaReadMixed". ( #663 )
...
Signed-off-by: Lucasliang <nkcs_lykx@hotmail.com>
2023-01-11 14:15:36 +08:00
f313ddf58d
reformat codec and add keyspace support ( #649 )
...
Signed-off-by: David <8039876+AmoebaProtozoa@users.noreply.github.com>
2023-01-10 15:15:33 +08:00
c20405f345
support witness peers ( #633 )
...
Signed-off-by: Wenbo Zhang <ethercflow@gmail.com>
2023-01-09 20:53:19 +08:00
ffc2788663
region_cache: refine GetTiFlashComputeRPCContextByConsistentHash(for detect alive)
...
Signed-off-by: guo-shaoge <shaoge1994@163.com>
2022-12-17 16:41:11 +08:00
5dc09b15e7
Add aggressive-locking mechanism and support locking with conflict ( #528 )
...
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2022-12-01 11:03:39 +08:00
91be9c6ce6
Introduce the FlashbackNotPrepared error ( #606 )
...
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2022-10-17 17:26:35 +08:00
e76cd3e240
region_cache: only load UP tiflash_mpp store ( #598 )
...
Signed-off-by: guo-shaoge <shaoge1994@163.com>
2022-10-13 14:54:37 +08:00
e425355a10
*: introduce the non-retryable error FlashbackInProgress ( #579 )
...
Signed-off-by: JmPotato <ghzpotato@gmail.com>
2022-09-06 14:28:21 +08:00
68cd1bc6c1
Introduce API v2 ( #494 )
...
* introduce raw.Client with api v2
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* migrate rawkv test to api v2
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* git fire: refactoring the interface SplitRegion of CodecClientV2
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* go mod tidy
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* fix split region issue in CodecClientV2
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* rearrange imports
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* add version info for RegionCache
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* delay request encoding to RPCClient
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* prevent multiple encoding
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* wip: debugging retry logic
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* fix EpochNotMatch region decoding
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* remove txn request branch
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* copy request before encoding it
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* add gRPCDialOptions for rawkv.Client
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* fix api breaking change of raw.NewClient
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* address menglong's comments
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* go mod tidy
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* address comments and fix linter
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* fix api_test
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* fix TestScan
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* fix TestScan
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
* fix compatibility
Signed-off-by: iosmanthus <myosmanthustree@gmail.com>
Co-authored-by: Xiaoguang Sun <sunxiaoguang@users.noreply.github.com>
2022-07-09 14:49:46 +08:00
be31f33ba0
Avoid sending requests to unhealthy leader ( #503 )
...
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2022-06-13 19:27:34 +08:00
e69cd80e58
Preserve is_retry_request flag for prewrite when retrying with region errors ( #513 )
...
* add a test to verify the incorrect setting of is_retry_request
Signed-off-by: ekexium <ekexium@gmail.com>
* preserve the retry flag for prewrite
Signed-off-by: ekexium <ekexium@gmail.com>
* fix test
Signed-off-by: ekexium <ekexium@gmail.com>
* add more explanations
Signed-off-by: ekexium <ekexium@gmail.com>
2022-05-31 16:04:28 +08:00
700cbe60d2
support find stores with tiflash_mpp label ( #481 )
...
Signed-off-by: guo-shaoge <shaoge1994@163.com>
Co-authored-by: Yilin Chen <sticnarf@gmail.com>
2022-05-23 11:22:53 +08:00
a38ac96984
Add backoff for error recovery in progress ( #485 )
...
* add backoff for error recovery in progress
Signed-off-by: Connor1996 <zbk602423539@gmail.com>
2022-05-09 11:50:19 +08:00
7f6daad88a
print original error if the recv failure is injected ( #474 )
...
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2022-04-20 13:49:05 +08:00
5b4040a95c
reconnect when meets store-not-match errors ( #456 )
...
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2022-03-24 17:30:51 +08:00
f4eae62b7e
copy the needed fields for backoffer type ( #453 )
...
Signed-off-by: cfzjywxk <lsswxrxr@163.com>
2022-03-21 20:35:29 +08:00
f43cc3acc0
region_cache: more comments and minor refactor ( #427 )
...
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2022-02-23 16:53:24 +08:00
3a7675742e
txnkv: read through locks ( #380 )
...
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2021-12-01 16:35:10 +08:00
a3f1c41ac1
Fix a typo ( #376 )
...
Signed-off-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
Co-authored-by: MyonKeminta <MyonKeminta@users.noreply.github.com>
2021-11-15 15:10:40 +08:00
9ec50224be
*: replace pingcap/errors with pkg/errors ( #357 )
...
Signed-off-by: disksing <i@disksing.com>
2021-11-01 11:59:52 +08:00
a7d8ea1587
rawkv: remove use of errors.Trace ( #336 )
...
Signed-off-by: disksing <i@disksing.com>
2021-10-13 07:29:43 +00:00
3e9bd8b941
internal/locate: remove use of errors.Trace ( #332 )
...
Signed-off-by: disksing <i@disksing.com>
2021-10-11 17:05:36 +00:00
3b672526bb
fix unknown region error metrics ( #315 )
...
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
Co-authored-by: disksing <i@disksing.com>
2021-09-29 05:50:39 +00:00
6ca8098ae0
add warn log ( #308 )
...
Signed-off-by: yisaer <disxiaofei@163.com>
2021-09-18 15:13:19 +08:00
f4a640e8e0
rechange to retry when tikv disk full ( #302 )
...
Signed-off-by: tier-cap <zhengxiaojin@pingcap.com>
2021-09-15 13:01:35 +08:00
06c3868595
select replica for replica read requests using ReplicaSelector ( #285 )
...
Signed-off-by: youjiali1995 <zlwgx1023@gmail.com>
2021-09-02 02:10:36 +00:00
b440ea2f58
select replica for forward requests using RegionRequestSender ( #264 )
...
Signed-off-by: Yilin Chen <sticnarf@gmail.com>
2021-08-16 19:27:02 +08:00
crazycs