Commit Graph

72 Commits

Author SHA1 Message Date
Gaius 3f7e48e005
feat: when peer disabled shared, scheduler will skip peer in filterCandidateParents (#3506)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-09-14 17:07:29 +08:00
Gaius f1dec253fc
feat: use context.Background for ScheduleCandidateParents to prevent stream breaking (#3485)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-09-06 11:18:37 +08:00
Gaius 2b2635c9c9
feat: add ScheduleDuration for recording duration of the scheduling (#3444)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-08-19 13:59:12 +08:00
Gaius a35517cc9a
feat: remove unused context and update api version (#3412)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-08-06 15:47:02 +08:00
Gaius 934ce3a2b5
feat: use content.Background() to avoid stream cancel by dfdaemon (#3402)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-07-30 14:53:21 +08:00
Gaius 77b88ad717
feat: send config of the seed peer cluster for load limit (#3370)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-07-09 22:10:44 +08:00
Chongzhi Deng 8153e57ed1
feat: scheduler detects peer survivability and clears offline peers' metadata (#3353)
feat: scheduler detects peer survivability and clears offline peers

1. The Host GC method will remove hosts that did not announce in time and their peers' metadata.
2. The scheduler Host GC interval is lowered in order to detect non-surviving hosts in time.
3. Add unit tests.

Signed-off-by: BruceAko <chongzhi@hust.edu.cn>
2024-07-04 13:46:35 +08:00
Gaius a5488768d7
feat: add cache peer to grpc api (#3334)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-06-18 18:11:16 +08:00
Gaius a370304de1
feat: update api protoc version to v2.0.118 (#3326)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-06-17 19:45:13 +08:00
Gaius 1ce0b3175c
feat: if host is seed client, set concurrentUploadLimit when dynconfig refreshes (#3320)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-06-13 15:11:27 +08:00
Gaius a260314a71
chore: update client version (#3267)
* chore: update client version

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: update client verison

Signed-off-by: Gaius <gaius.qi@gmail.com>

---------

Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-05-17 14:17:20 +08:00
Gaius 8237c94671
fix: DownloadPeerDuration observe cost by milliseconds (#3255)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-05-10 14:12:17 +08:00
Gaius 4abb179d5b
feat: support preheating by v2 grpc protocol (#3201)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-17 15:39:34 +08:00
Gaius 501a7be05b
feat: trigger download task by stream (#3200)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-17 10:26:34 +08:00
Gaius 0b1157bba8
feat: replace filters with filteredQueryParams (#3049)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-01-24 22:58:06 +08:00
Gaius e11666deb0
feat: change request header in response (#3038)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-01-22 16:19:16 +08:00
Gaius e03f8d8713
feat: output path should be empty, prevent seed peer copy file to output path (#3019)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-01-12 13:30:40 +08:00
Gaius dd03c97975
feat: prevent concurrent request to cause state switch failed (#3014)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-01-10 16:42:55 +08:00
Gaius 93df8f01d8
feat: add block parent to peer if peer reschedule in downloading (#3011)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-01-10 10:53:05 +08:00
Gaius 6586489210
feat: report bad parents and add bad parents to block parent set (#3010)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-01-10 10:26:48 +08:00
Gaius dce1890aa0
feat: change state set when trigger seed peer (#3003)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-01-09 10:33:23 +08:00
Gaius 70dd9b109d
feat: remove maxScheduleCount and optimize register in v2 (#3001)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-01-08 21:06:58 +08:00
Gaius 87f9fcc536
feat: remove object storage and model message (#2992)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-01-02 14:53:08 +08:00
Gaius 086cb62d01
feat: if seed peer download task, return NeedBackToSource directly (#2980)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-12-26 20:11:45 +08:00
Gaius 5989a4d4d3
fix: peer events state failed when register task (#2979)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-12-26 17:12:30 +08:00
Gaius ab896daf2a
feat: if trigger peer is seed peer, set NeedBackToSource flag true (#2972)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-12-26 11:01:25 +08:00
Gaius acdbc4b484
feat: remove register seed peer in announce peer (#2971)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-12-25 19:29:44 +08:00
Gaius 6b93ef8e5e
feat: trigger download by task id (#2970)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-12-25 17:37:12 +08:00
Gaius 5894095151
feat: support logging the range and header when registering a task (#2967)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-12-22 11:39:03 +08:00
Gaius 0c591e46a3
feat: optimize trigger download task return empty (#2958)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-12-19 18:41:32 +08:00
Gaius ec66fd1229
feat: implement trigger download task by seed peer in v2 (#2957)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-12-19 16:18:02 +08:00
Gaius 003376c6d3
feat: optimize parameters in seed peer DownloadTask (#2947)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-12-19 11:37:00 +08:00
Gaius 76530ae000
feat: add prefetch to trigger seed peer downloads entire task (#2929)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-12-07 20:02:28 +08:00
Gaius 81cfc72943
feat: optimize service v2 log print (#2922)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-12-06 16:30:59 +08:00
Gaius cfcfbc3c39
feat: optimize AnnouncePeer log and update api verison (#2921)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-12-06 10:26:27 +08:00
Gaius 64e9c0fd2a
feat: remove handleSyncPiecesFailedRequest when sync piece failed (#2906)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-11-30 14:39:57 +08:00
Gaius 18c28a7364
fix: digest and range validation in v2 (#2892)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-11-21 17:12:05 +08:00
Gaius 11829e35df
feat: update api version to v2.0.56 (#2891)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-11-21 14:02:24 +08:00
Gaius 79b4aabc40
feat: optimize piece download failed handler (#2883)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-11-14 22:40:51 +08:00
Gaius 4d4ea8dda9
feat: add reschedule handler for schduler v2 (#2882)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-11-14 22:20:02 +08:00
Gaius 86ce09f53a
feat: remove TinyTaskResponse and SmallTaskResponse message (#2881)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-11-14 15:07:24 +08:00
Gaius 5f4fe5753a
feat: implement ListSeedPeers feature in manager (#2865)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-11-08 20:45:03 +08:00
Gaius 6caf7246db
feat: use scheduler's cluster id in host resource (#2844)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-10-31 13:57:51 +08:00
Gaius 6addfdf8f4
feat: change DownloadPeerDuration metric type to summary (#2794)
feat: change DownloadPeerDuration metric to Summary

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-10-11 19:25:49 +08:00
Gaius 82a5b7bf6d
feat: add content-length label to DownloadPeerDuration metric (#2792)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-10-11 16:26:13 +08:00
Gaius b65c1019ed
feat: update api to v2.0.29 with optional (#2751)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-09-22 14:19:16 +08:00
Gaius 60080f2e98
fix: if network topology is nil, LeaveHost panic in scheduler (#2727)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-09-14 21:26:22 +08:00
dlut_xz 1a652e6594
feat: add InitProbedCount in AnnounceHost and DeleteHost in LeaveHost (#2722)
Signed-off-by: fcgxz2003 <834756128@qq.com>
2023-09-14 21:20:34 +08:00
Gaius fe28ba4c8e
feat: merge sync peer with peer table in manager (#2668)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-24 10:28:08 +08:00
Gaius f3b92900af
feat: peer announces scheduler cluster id to scheduler (#2652)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-21 22:00:05 +08:00