dragonflyoss
/
dragonfly
mirror of https://github.com/dragonflyoss/dragonfly.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,186 Commits 5 Branches 281 Tags 98 MiB
Commit Graph

443 Commits

Author SHA1 Message Date
Jim Ma c40cba5208
chore: release failed running piece (#3214) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2024-05-07 13:01:26 +08:00
Jim Ma 1e6f09d294
fix: client rpcserver subscriber hang (#3246) 
* fix: client rpcserver subscriber hang

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: optimize rpcserver subscriber logic

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: update comment

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: optimize isAllPiecesSent

Signed-off-by: Jim Ma <majinjing3@gmail.com>

---------

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2024-05-07 10:18:36 +08:00
Gaius 501a7be05b
feat: trigger download task by stream (#3200) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2024-04-17 10:26:34 +08:00
Jim Ma 35e8bac343
chore: update single piece storage (#3186) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2024-04-11 15:17:12 +08:00
Jim Ma 5cee9010bf
fix: single long task keepalive (#3184) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2024-04-10 22:27:17 +08:00
Jim Ma 48846e2ff6
feat: peer exchange (#3141) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2024-04-09 18:29:57 +08:00
Qi 44be646e45
fix: daemon reuse file fd leak (#3180) 2024-04-09 11:10:49 +08:00
Jim Ma fc53dcf980
feat: optimize reload storage (#3167) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2024-04-08 18:07:10 +08:00
Qi 405ed005bf
Improve the search order for localTaskStore array (#3166) 
Signed-off-by: Qi <37133148+aobt@users.noreply.github.com>
 2024-04-08 14:32:32 +08:00
Jim Ma f960bc01b7
fix: tunnel https (#3153) 
* fix: tunnel https

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: print error log

Signed-off-by: Jim Ma <majinjing3@gmail.com>

---------

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2024-04-08 10:47:58 +08:00
Jim Ma 8c9ff386b1
fix: tiny piece digest reader (#3164) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2024-04-02 14:23:12 +08:00
Jim Ma d18625b3e2
fix: parent peertask conductor race condition (#3154) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2024-03-29 15:44:08 +08:00
Jim Ma d4ac1cc856
chore: optimize log (#3151) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2024-03-28 10:26:34 +08:00
Qi 49ac8d52bd
fix index map in storage_manager (#3145) 
Signed-off-by: Qi <37133148+aobt@users.noreply.github.com>
 2024-03-25 21:07:57 +08:00
Jim Ma db3fa4fcaa
fix: storage buffer size (#3130) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2024-03-16 14:00:08 +08:00
Jim Ma fe033b0564
feat: storage write buffer size (#3127) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2024-03-15 17:51:10 +08:00
dabfdj bfe3091afb
feat: replace bitmap with bitset (#3023) 
Signed-off-by: dabfdj <jfh@outlook.hu>
 2024-02-26 16:16:09 +08:00
Gaius a7498d703c
feat: add leave host to dfdaemon (#3070) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2024-02-08 14:17:23 +08:00
dlut_xz 548e9f2627
chore: update api version to v2.0.83 (#3037) 
Signed-off-by: fcgxz2003 <834756128@qq.com>
 2024-01-22 16:01:03 +08:00
Jim Ma 5efac3afb3
feat: re-register when scheduler go away (#3016) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2024-01-12 11:13:48 +08:00
realityone dbe835ea26
only stop networkTopology when it is not nil (#2995) 2024-01-04 13:20:18 +08:00
Jim Ma 09b11a280a
chore: optimize stream task id (#2983) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-12-29 16:16:06 +08:00
Jim Ma e329bdbb39
feat: back to source with piece group(multiple pieces) (#2826) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-12-27 15:54:21 +08:00
Jim Ma 839e476ecb
chore: optimize sync pieces error report (#2925) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-12-14 11:23:15 +08:00
Gaius 67c36f62b3
feat: remove concurrent_piece_count in scheduler (#2942) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-12-12 16:39:16 +08:00
Gaius 3557eb5453
feat: add getObjectStorageMetadata to dfstore (#2869) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-11-09 15:28:47 +08:00
lixin18 6f50872dc0
Update objectstorage.go (#2854) 
instence --> instance
 2023-11-09 12:22:16 +08:00
Jim Ma 3dc2e468a2
chore: split concurrentDownloadSource (#2842) 2023-10-31 16:51:46 +08:00
Gaius 12fc630612
fix: if scheduler has no seed peer, return error in preheating (#2835) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-10-30 16:45:39 +08:00
Jim Ma ccacc3ec3a
feat: proxy graceful shutdown (#2802) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-10-18 13:47:56 +08:00
Gaius b71cbc94cf
feat: add comment about not checking object storage close (#2789) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-10-11 10:38:54 +08:00
Gaius 61f63e2e8f
fix: task length did not match range length (#2787) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-10-10 18:28:59 +08:00
Jim Ma 47c6cdd8cc
chore: optimize recursive download log (#2785) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-10-10 14:43:45 +08:00
Yong-An9 e847992c90
fixed close file twice issue when using dfstore upload large file (#2784) 
Co-authored-by: Yong.An <thomas.an@icloudsky.com>
 2023-10-10 11:35:09 +08:00
Gaius d275bfb302
feat: change error handle in object storage (#2777) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-10-10 10:43:22 +08:00
Sasha Melentyev eeea18b16e
chore(client/daemon): cleanup, and add noTLSConfig (#2783) 
chore(client/daemon): cleanup, and add noTLSConfig instead nil for better readable

Signed-off-by: Sasha Melentyev <sasha@melentyev.io>
 2023-10-10 10:42:53 +08:00
pbannykh c9c7100e77
fix: set download header log level debug (#2770) 
Signed-off-by: bannykh <bannykh@tochka.com>
 2023-10-08 10:56:34 +08:00
guangwu a3f2aae26c
chore: remove refs to deprecated io/ioutil (#2754) 
Signed-off-by: guoguangwu <guoguangwu@magic-shield.com>
 2023-09-26 10:09:57 +08:00
Jim Ma 9eb15b218d
fix: overhead gc when DiskGCThreshold not set (#2750) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-09-21 21:04:17 +08:00
Gaius 170a7f2186
feat: change file mode when export task from local in dfcache (#2701) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-09-05 19:59:11 +08:00
tan ding c29edd28fd
Fix issues in the objectstorage based on JuiceFS use cases. (#2648) 
Signed-off-by: XDTD <1355582364@qq.com>
 2023-08-30 11:20:00 +08:00
Gaius 85b446746f
feat: initialize object storage client in the New func (#2682) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-08-29 15:16:03 +08:00
Guangwen Feng a7f6320a7e
test: add unit test for PieceDownloader.Error (#2667) 
Signed-off-by: Guangwen Feng <fenggw-fnst@fujitsu.com>
 2023-08-24 10:31:08 +08:00
Gaius fe28ba4c8e
feat: merge sync peer with peer table in manager (#2668) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-08-24 10:28:08 +08:00
Gaius f3b92900af
feat: peer announces scheduler cluster id to scheduler (#2652) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-08-21 22:00:05 +08:00
Gaius 5b7ea5da2a
Revert "feat: replace fmt.Sprintf with net.JoinHostPort" (#2649) 
Revert "feat: replace fmt.Sprintf with net.JoinHostPort (#2642)"

This reverts commit a6863f9b19.
 2023-08-17 17:21:50 +08:00
Gaius a6863f9b19
feat: replace fmt.Sprintf with net.JoinHostPort (#2642) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-08-16 16:45:14 +08:00
Jim Ma 0eaf429c4e
chore: skip export to exist file (#2637) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-08-15 23:05:17 +08:00
Jim Ma 0e04a56177
chore: check task id (#2636) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-08-15 23:04:50 +08:00
Jim Ma 554b27c373
fix: add traffic (#2634) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-08-15 23:04:03 +08:00