Commit Graph

1907 Commits

Author SHA1 Message Date
Gaius 2543ecbc38
chore: update console submodule (#1755)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:02 +08:00
Gaius 14f88993ae
feat: peer will back-to-source when task switch state failed (#1754)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:02 +08:00
Gaius 61a6e545e5
feat: change FilterParentRangeLimit validation (#1752)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:02 +08:00
Gaius bbd418542e
feat: task state is TaskStateRunning can be registered (#1751)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:02 +08:00
Jim Ma 0bca9dd549
chore: update roundtrip log (#1750)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:02 +08:00
Gaius 27d8cf51db
feat: gin logger rotation (#1749)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:02 +08:00
Gaius 25384fc345
chore: update console submodule (#1748)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:02 +08:00
dependabot[bot] 5bd50dc303
chore(deps): bump github.com/casbin/gorm-adapter/v3 from 3.5.0 to 3.11.0 (#1745)
Bumps [github.com/casbin/gorm-adapter/v3](https://github.com/casbin/gorm-adapter) from 3.5.0 to 3.11.0.
- [Release notes](https://github.com/casbin/gorm-adapter/releases)
- [Changelog](https://github.com/casbin/gorm-adapter/blob/master/.releaserc.json)
- [Commits](https://github.com/casbin/gorm-adapter/compare/v3.5.0...v3.11.0)

---
updated-dependencies:
- dependency-name: github.com/casbin/gorm-adapter/v3
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:34:02 +08:00
dependabot[bot] 9048448668
chore(deps): bump github.com/schollz/progressbar/v3 from 3.8.7 to 3.11.0 (#1746)
Bumps [github.com/schollz/progressbar/v3](https://github.com/schollz/progressbar) from 3.8.7 to 3.11.0.
- [Release notes](https://github.com/schollz/progressbar/releases)
- [Commits](https://github.com/schollz/progressbar/compare/v3.8.7...v3.11.0)

---
updated-dependencies:
- dependency-name: github.com/schollz/progressbar/v3
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:34:02 +08:00
dependabot[bot] b9433f4fd1
chore(deps): bump go.opentelemetry.io/contrib/instrumentation/github.com/gin-gonic/gin/otelgin from 0.34.0 to 0.36.1 (#1744)
chore(deps): bump go.opentelemetry.io/contrib/instrumentation/github.com/gin-gonic/gin/otelgin

Bumps [go.opentelemetry.io/contrib/instrumentation/github.com/gin-gonic/gin/otelgin](https://github.com/gin-gonic/gin) from 0.34.0 to 0.36.1.
- [Release notes](https://github.com/gin-gonic/gin/releases)
- [Changelog](https://github.com/gin-gonic/gin/blob/master/CHANGELOG.md)
- [Commits](https://github.com/gin-gonic/gin/commits)

---
updated-dependencies:
- dependency-name: go.opentelemetry.io/contrib/instrumentation/github.com/gin-gonic/gin/otelgin
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:34:02 +08:00
dependabot[bot] 7bd00ea95b
chore(deps): bump gorm.io/driver/postgres from 1.3.10 to 1.4.4 (#1743)
Bumps [gorm.io/driver/postgres](https://github.com/go-gorm/postgres) from 1.3.10 to 1.4.4.
- [Release notes](https://github.com/go-gorm/postgres/releases)
- [Commits](https://github.com/go-gorm/postgres/compare/v1.3.10...v1.4.4)

---
updated-dependencies:
- dependency-name: gorm.io/driver/postgres
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:34:01 +08:00
dependabot[bot] f6ef26dee3
chore(deps): bump google.golang.org/grpc from 1.49.0 to 1.50.0 (#1742)
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.49.0 to 1.50.0.
- [Release notes](https://github.com/grpc/grpc-go/releases)
- [Commits](https://github.com/grpc/grpc-go/compare/v1.49.0...v1.50.0)

---
updated-dependencies:
- dependency-name: google.golang.org/grpc
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:34:01 +08:00
Gaius d7c7980fef
chore: change docker compose task ttl (#1741)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:01 +08:00
Gaius 036e6e56fb
feat: overwrite task url and url meta (#1740)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:01 +08:00
Jim Ma 2d46f6424a
feat: update source temporary error logic (#1739)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:01 +08:00
Jim Ma ef61df0027
chore: make lru cache safe (#1737)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:01 +08:00
Jim Ma 2419024739
feat: add seed peer back source traffic (#1738)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:01 +08:00
Gaius 4958967c0c
feat: http request content log (#1736)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:01 +08:00
Gaius 500f767073
feat: remove task and host gc ttl (#1735)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:01 +08:00
Gaius 74e3d75f37
feat: add http request log (#1734)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:00 +08:00
cuidajun c6119d6ce0
fix: backsource temporary error judgement (#1726)
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>

Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
2023-06-28 17:34:00 +08:00
Gaius 6b385cf8fb
fix: gorm can not update is_default field (#1731)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:00 +08:00
Gaius 04dabff01e
fix: content length is zero when task succeed (#1732)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:00 +08:00
Gaius 327cf4493e
feat: add TaskStateLeave to task (#1728)
Signed-off-by: Gaius <gaius.qi@gmail.com>

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:00 +08:00
Gaius 8a98a4ab9f
feat: searcher calculates cluster type (#1729)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:00 +08:00
Jim Ma c9bfe9eb08
feat: unregister failed task storage (#1717)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:00 +08:00
cuidajun 9dd9bc5c9f
chore: change disk usage debug log format to decimal (#1727)
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
2023-06-28 17:34:00 +08:00
dependabot[bot] 73d755847a
chore(deps): bump github.com/aws/aws-sdk-go from 1.44.95 to 1.44.114 (#1725)
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.44.95 to 1.44.114.
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.44.95...v1.44.114)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:00 +08:00
dependabot[bot] 5bf7fbe5f8
chore(deps): bump github.com/bits-and-blooms/bitset from 1.3.0 to 1.3.3 (#1722)
Bumps [github.com/bits-and-blooms/bitset](https://github.com/bits-and-blooms/bitset) from 1.3.0 to 1.3.3.
- [Release notes](https://github.com/bits-and-blooms/bitset/releases)
- [Commits](https://github.com/bits-and-blooms/bitset/compare/v1.3.0...v1.3.3)

---
updated-dependencies:
- dependency-name: github.com/bits-and-blooms/bitset
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:34:00 +08:00
dependabot[bot] b6cc512029
chore(deps): bump go.opentelemetry.io/otel/exporters/jaeger from 1.9.0 to 1.10.0 (#1720)
chore(deps): bump go.opentelemetry.io/otel/exporters/jaeger

Bumps [go.opentelemetry.io/otel/exporters/jaeger](https://github.com/open-telemetry/opentelemetry-go) from 1.9.0 to 1.10.0.
- [Release notes](https://github.com/open-telemetry/opentelemetry-go/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-go/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-go/compare/v1.9.0...v1.10.0)

---
updated-dependencies:
- dependency-name: go.opentelemetry.io/otel/exporters/jaeger
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:33:59 +08:00
dependabot[bot] 18d45a347c
chore(deps): bump go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc from 0.34.0 to 0.36.1 (#1719)
chore(deps): bump go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc

Bumps [go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc](https://github.com/open-telemetry/opentelemetry-go-contrib) from 0.34.0 to 0.36.1.
- [Release notes](https://github.com/open-telemetry/opentelemetry-go-contrib/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-go-contrib/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-go-contrib/compare/zpages/v0.34.0...zpages/v0.36.1)

---
updated-dependencies:
- dependency-name: go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:33:59 +08:00
dependabot[bot] a2302b25ee
chore(deps): bump github.com/appleboy/gin-jwt/v2 from 2.8.0 to 2.9.0 (#1718)
Bumps [github.com/appleboy/gin-jwt/v2](https://github.com/appleboy/gin-jwt) from 2.8.0 to 2.9.0.
- [Release notes](https://github.com/appleboy/gin-jwt/releases)
- [Commits](https://github.com/appleboy/gin-jwt/compare/v2.8.0...v2.9.0)

---
updated-dependencies:
- dependency-name: github.com/appleboy/gin-jwt/v2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:33:59 +08:00
Jim Ma 905f12f5f0
feat: oss get metadata (#1724)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:59 +08:00
Gaius 58f7bbbb9f
refactor: idgen pkg (#1715)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:59 +08:00
Jim Ma 491b309620
feat: support concurrent recursive download (#1714)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:59 +08:00
Gaius 9573d5a659
fix: docker compose config (#1713)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:59 +08:00
greenhandatsjtu bc8d623b3d
feat: add traffic shaper for download tasks (#1654)
Signed-off-by: greenhandatsjtu <sunhengke@sjtu.edu.cn>
2023-06-28 17:33:59 +08:00
Gaius 9f098362fb
refactor: pkg basic (#1712)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:58 +08:00
Gaius 71bb5cc4ed
feat: async create a record (#1711)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:58 +08:00
Gaius 7cc842d64d
test: remove test main (#1710)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:58 +08:00
zhaoshang fda6002aac
test: add test for daemon rpcserver (#1704)
Signed-off-by: zhaoshang <zhaoshangsjtu@linux.alibaba.com>
2023-06-28 17:33:58 +08:00
dependabot[bot] e2dc6997cd
chore(deps): bump github.com/onsi/ginkgo/v2 from 2.1.6 to 2.2.0 (#1705)
Bumps [github.com/onsi/ginkgo/v2](https://github.com/onsi/ginkgo) from 2.1.6 to 2.2.0.
- [Release notes](https://github.com/onsi/ginkgo/releases)
- [Changelog](https://github.com/onsi/ginkgo/blob/master/CHANGELOG.md)
- [Commits](https://github.com/onsi/ginkgo/compare/v2.1.6...v2.2.0)

---
updated-dependencies:
- dependency-name: github.com/onsi/ginkgo/v2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:33:58 +08:00
dependabot[bot] fe2d9979ae
chore(deps): bump google.golang.org/api from 0.94.0 to 0.97.0 (#1709)
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.94.0 to 0.97.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.94.0...v0.97.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:33:58 +08:00
dependabot[bot] 399ddc12a2
chore(deps): bump k8s.io/component-base from 0.25.0 to 0.25.2 (#1708)
Bumps [k8s.io/component-base](https://github.com/kubernetes/component-base) from 0.25.0 to 0.25.2.
- [Release notes](https://github.com/kubernetes/component-base/releases)
- [Commits](https://github.com/kubernetes/component-base/compare/v0.25.0...v0.25.2)

---
updated-dependencies:
- dependency-name: k8s.io/component-base
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:33:58 +08:00
dependabot[bot] 4da2140144
chore(deps): bump gorm.io/gorm from 1.23.9 to 1.23.10 (#1707)
Bumps [gorm.io/gorm](https://github.com/go-gorm/gorm) from 1.23.9 to 1.23.10.
- [Release notes](https://github.com/go-gorm/gorm/releases)
- [Commits](https://github.com/go-gorm/gorm/compare/v1.23.9...v1.23.10)

---
updated-dependencies:
- dependency-name: gorm.io/gorm
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:33:58 +08:00
dependabot[bot] 55ad7649b2
chore(deps): bump github.com/casbin/casbin/v2 from 2.55.0 to 2.55.1 (#1706)
Bumps [github.com/casbin/casbin/v2](https://github.com/casbin/casbin) from 2.55.0 to 2.55.1.
- [Release notes](https://github.com/casbin/casbin/releases)
- [Changelog](https://github.com/casbin/casbin/blob/master/.releaserc.json)
- [Commits](https://github.com/casbin/casbin/compare/v2.55.0...v2.55.1)

---
updated-dependencies:
- dependency-name: github.com/casbin/casbin/v2
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:33:58 +08:00
Gaius f99851fd03
feat: optimize storage log (#1703)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:58 +08:00
Jim Ma 1b1e9cace1
fix: hdfs not registered (#1702)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:57 +08:00
Gaius f354ee3861
refactor: manager and scheduler config (#1701)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:57 +08:00
Gaius 58bc4d0eea
chore: update api pkg (#1700)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:57 +08:00