Commit Graph

  • d5372f9eb7 feat(s3/lifecycle): apply cluster rate limit to walker dispatch (#9471) Chris Lu 2026-05-13 09:24:50 -07:00
  • 31c7996671 build(deps): bump github.com/go-git/go-billy/v5 from 5.8.0 to 5.9.0 (#9482) dependabot[bot] 2026-05-13 09:19:48 -07:00
  • 37e505b8fd refactor(s3/lifecycle): one meta-log subscription per dailyrun.Run pass (#9481) Chris Lu 2026-05-13 02:13:11 -07:00
  • b1d59b04a8 fix(s3/lifecycle): walker dispatch uses entry.Path for ABORT_MPU (#9477) Chris Lu 2026-05-13 00:19:05 -07:00
  • 7b8647e8bc fix(shell): loop s3.lifecycle.run-shard so CI workflow stays alive (#9476) Chris Lu 2026-05-12 19:19:46 -07:00
  • 4ce027c2f3 fix(shell): restore s3.lifecycle.run-shard for CI/integration-test compatibility (#9475) Chris Lu 2026-05-12 18:29:18 -07:00
  • ce5768fab1 feat(s3/lifecycle): operator-declared meta-log retention activates PromotedHash (#9473) Chris Lu 2026-05-12 18:26:52 -07:00
  • f51468cf73 Revert #9443 — heartbeat peer binding breaks hostname-based clusters (#9474) Chris Lu 2026-05-12 18:22:21 -07:00
  • 43a8c4fdca Revert #9440 — volume admin fail-closed gate breaks multi-host clusters (#9472) Chris Lu 2026-05-12 16:00:44 -07:00
  • f28c7ce6df master: bind heartbeat claims to the connecting peer (#9443) Chris Lu 2026-05-12 15:38:52 -07:00
  • 10cc06333b cluster: restrict Ping RPC to known peers of the requested type (#9445) Chris Lu 2026-05-12 13:00:52 -07:00
  • 5004b4e542 feat(s3/lifecycle): delete streaming algorithm path (Phase 5b) (#9466) Chris Lu 2026-05-12 12:54:52 -07:00
  • 745e864bda feat(s3/lifecycle): retire algorithm flag, daily_replay is the only path (Phase 5a) (#9465) Chris Lu 2026-05-12 12:39:37 -07:00
  • 2f682303fb fix(s3/lifecycle): align walker dispatch error label to RPC_ERROR (#9464) Chris Lu 2026-05-12 12:38:52 -07:00
  • 31a579d12a build(deps): bump github.com/rclone/rclone from 1.73.5 to 1.74.1 (#9455) dependabot[bot] 2026-05-12 12:37:36 -07:00
  • 2212cc8a5f shell: expose retention flags on mq.topic.configure (#9416) Parviz Miriyev 2026-05-12 23:37:09 +04:00
  • 89608e5499 chore(weed/util/log_buffer): remove unused functions (#9444) Lars Lehtonen 2026-05-12 12:36:16 -07:00
  • 21054b6c18 volume: fail closed in admin gRPC gate when no whitelist is configured (#9440) Chris Lu 2026-05-12 12:35:27 -07:00
  • 495632730c feat(s3/lifecycle): daily-replay observability — metrics + summary log (Phase 6) (#9462) Chris Lu 2026-05-12 12:15:20 -07:00
  • ed5fa1926d fix(s3/lifecycle): align walker dispatch error label to RPC_ERROR feat/phase4b-recovery-walker Chris Lu 2026-05-12 11:42:41 -07:00
  • f954781169 feat(s3/lifecycle): Phase 4b — daily walker for recovery and steady state (#9459) Chris Lu 2026-05-12 11:39:15 -07:00
  • 69da20bdae volume: gate FetchAndWriteNeedle behind admin auth and refuse internal endpoints (#9441) Chris Lu 2026-05-12 10:11:20 -07:00
  • 5e8f99f40a filer: require admin-signed JWT on the IAM gRPC service (#9442) Chris Lu 2026-05-12 10:11:08 -07:00
  • 05ed5c9ae8 filer: scope JWT allowed_prefixes to path components (#9439) Chris Lu 2026-05-12 10:10:48 -07:00
  • bd687a2d7a build(deps): bump google.golang.org/api from 0.274.0 to 0.278.0 (#9451) dependabot[bot] 2026-05-12 10:10:00 -07:00
  • fe0d533b9d build(deps): bump github.com/klauspost/compress from 1.18.5 to 1.18.6 (#9452) dependabot[bot] 2026-05-12 10:09:48 -07:00
  • 91957d6919 build(deps): bump cloud.google.com/go/kms from 1.30.0 to 1.31.0 (#9453) dependabot[bot] 2026-05-12 10:09:33 -07:00
  • fade4ce77d build(deps): bump github.com/rabbitmq/amqp091-go from 1.10.0 to 1.11.0 (#9454) dependabot[bot] 2026-05-12 10:09:19 -07:00
  • 18677a8430 fix(storage): refuse to load .vif-only entry as regular volume when .ecx exists (#9448) (#9461) Chris Lu 2026-05-12 09:30:42 -07:00
  • 87f29874c3 feat(s3/lifecycle): walker-side dispatch metrics in WalkerDispatcher Chris Lu 2026-05-12 00:21:27 -07:00
  • 468adfadad fix(s3/lifecycle): explicit stale-pointer fallback in versioned expansion Chris Lu 2026-05-12 00:05:07 -07:00
  • e396e20faa fix(s3/lifecycle): walker dispatcher nil-response guard + retention-comment Chris Lu 2026-05-11 23:59:14 -07:00
  • 01d0de6ede feat(s3/lifecycle): steady-state walker + drop unsupported-rule gate Chris Lu 2026-05-11 23:42:36 -07:00
  • 20f2b71a4a feat(s3/lifecycle): wire walker into executeDailyReplay Chris Lu 2026-05-11 23:17:29 -07:00
  • d221a64262 fix(ec): skip re-encode when EC shards already exist for the volume (#9448) (#9458) Chris Lu 2026-05-11 23:12:57 -07:00
  • e3c5f624b9 feat(s3/lifecycle): emit MPU init records from FilerListFunc Chris Lu 2026-05-11 23:11:54 -07:00
  • 2cc8a56f86 feat(s3/lifecycle): versioned-sibling expansion in FilerListFunc Chris Lu 2026-05-11 23:10:43 -07:00
  • 3fdfa8113f feat(s3/lifecycle): filer-backed ListFunc for the daily-run walker Chris Lu 2026-05-11 22:24:27 -07:00
  • bcef462b6c feat(s3/lifecycle): WalkBuckets composes ListFunc + Dispatcher per shard Chris Lu 2026-05-11 22:11:48 -07:00
  • d2b9f53edb feat(s3/lifecycle): wire Walker hook into runShard's recovery branch Chris Lu 2026-05-11 21:58:40 -07:00
  • b624b6edd1 feat(s3/lifecycle): WalkerDispatcher adapter for the daily-run walker Chris Lu 2026-05-11 21:51:45 -07:00
  • 2c4bd59281 feat(s3/lifecycle): plumb RetentionWindow into dailyrun.Config Chris Lu 2026-05-11 21:39:45 -07:00
  • 644664bbee feat(s3/lifecycle): swap daily_run to engine hash APIs (Phase 4a) (#9457) Chris Lu 2026-05-11 21:18:19 -07:00
  • 532b088262 fix(ec): preserve source disk type across EC encoding (#9423) (#9449) Chris Lu 2026-05-11 20:21:50 -07:00
  • d57015c995 Revert "chore(s3/lifecycle): trim verbose comments" feat/phase3-rate-limit-fresh Chris Lu 2026-05-11 19:27:55 -07:00
  • 11b98ee873 chore(s3/lifecycle): trim verbose comments Chris Lu 2026-05-11 19:22:39 -07:00
  • 884b0bcbfd feat(s3/lifecycle): cluster rate-limit allocation (Phase 3) (#9456) Chris Lu 2026-05-11 19:17:06 -07:00
  • 0b3d50444e feat(s3/lifecycle): drop Worker Count knob from admin config form Chris Lu 2026-05-11 19:15:13 -07:00
  • b85af3483e fix(s3/lifecycle): divide cluster budget by active workers, not all capable Chris Lu 2026-05-11 19:05:56 -07:00
  • c51db540cc feat(s3/lifecycle): cluster rate-limit allocation (Phase 3) Chris Lu 2026-05-11 18:16:51 -07:00
  • 91bcc910eb build(deps): bump actions/dependency-review-action from 4.9.0 to 5.0.0 (#9450) dependabot[bot] 2026-05-11 18:08:38 -07:00
  • 3f4cb6d2fb feat(s3/lifecycle/engine): daily-replay view surface (Phase 4 engine) (#9447) Chris Lu 2026-05-11 18:07:54 -07:00
  • 122ca7c020 feat(s3/lifecycle): daily-replay worker behind algorithm flag (Phase 2) (#9446) Chris Lu 2026-05-11 18:07:17 -07:00
  • b2d24dd54f volume: require admin auth on BatchDelete (#9438) Chris Lu 2026-05-11 13:50:48 -07:00
  • 2b21d19e4c volume: require admin auth on ReadAllNeedles and VolumeNeedleStatus (#9437) Chris Lu 2026-05-11 13:50:19 -07:00
  • 46bb70d93e feat(s3): stamp noncurrent_since on versioned demotions (#9431) Chris Lu 2026-05-11 13:41:33 -07:00
  • 6d12ebeefe fix(mount): fall through to filer when cached dir misses a tracked inode (#9436) Chris Lu 2026-05-11 11:50:37 -07:00
  • 514ba7a233 fix(master): route ec shard vids to NewEcVids on initial subscribe (#9435) Chris Lu 2026-05-11 10:56:26 -07:00
  • defe047e1a perf(volume): stream-count the gzip size when no Content-MD5 is set (#9433) Chris Lu 2026-05-11 10:56:11 -07:00
  • 6001d65206 perf(volume): stream-count the gzip size when no Content-MD5 is set (#9433) Chris Lu 2026-05-11 10:55:56 -07:00
  • a64483885c fix(pb): skip Unix-socket gRPC registration on Windows (#9430) (#9434) Chris Lu 2026-05-11 10:25:37 -07:00
  • ac65c6c2ca revert(volume): drop X-Seaweedfs-Original-Size hint (#9432) Chris Lu 2026-05-11 10:08:55 -07:00
  • b456628a7a ui(s3_lifecycle): plain-English labels for cadence fields Chris Lu 2026-05-10 23:46:12 -07:00
  • 8efa32258a feat(volume): X-Seaweedfs-Original-Size hint skips redundant gunzip (#9426) Chris Lu 2026-05-10 15:57:07 -07:00
  • 9a70bbfcc6 feat(s3api): full-chunk gzip pass-through skips volume-side decompress (#9427) Chris Lu 2026-05-10 14:55:59 -07:00
  • 4a04594826 feat(s3api): stream chunk copy via io.Pipe to cut peak working set (#9424) Chris Lu 2026-05-10 14:29:39 -07:00
  • 25cfeb3a2a feat(s3api): full-chunk gzip pass-through skips volume-side decompress stream-gzip-passthrough Chris Lu 2026-05-10 13:01:45 -07:00
  • 843e4b7cdb review: cancel source GET when destination POST fails Chris Lu 2026-05-10 13:53:18 -07:00
  • d8bbc1d855 fix: cap pool retention so chunk-copy buffers don't hoard memory (#9422) Chris Lu 2026-05-10 13:34:25 -07:00
  • f70f338e7f review: surface shouldRetry, add int32 guard, drop redundant drains Chris Lu 2026-05-10 13:30:22 -07:00
  • 6f2bf40d5a feat(s3api): stream chunk copy via io.Pipe to cut peak working set Chris Lu 2026-05-10 12:40:49 -07:00
  • c917110124 fix(volume): pre-size ParseUpload buffer to request ContentLength (#9421) Chris Lu 2026-05-10 12:08:24 -07:00
  • 926a8e9351 fix(s3api): cap copy-chunk receive buffer to avoid append-grow blowup (#9420) Chris Lu 2026-05-10 12:08:06 -07:00
  • 26c257bf40 fix: cap pool retention so chunk-copy buffers don't hoard memory Chris Lu 2026-05-10 11:58:38 -07:00
  • ca12934834 docs(s3/lifecycle): reflect shipped reader, obsolete Phase 6 (#9419) Chris Lu 2026-05-10 10:40:33 -07:00
  • 82648cca53 test(s3/lifecycle/engine): pin delay-group dedup across buckets (#9418) Chris Lu 2026-05-10 10:36:54 -07:00
  • 1b1d4aa814 refactor(s3/lifecycle): extract entryUsesMetadataOnlyDelete predicate (#9417) Chris Lu 2026-05-10 09:39:05 -07:00
  • c7b01c72b2 test(s3/lifecycle): integration coverage for versioning + filters (#9415) Chris Lu 2026-05-10 09:30:50 -07:00
  • 2840980c7d test(s3/lifecycle): final unit-test cleanup before integration suite (#9414) Chris Lu 2026-05-09 22:32:49 -07:00
  • b740e22e63 test(s3/lifecycle): bundle dispatcher + engine edge-case coverage (#9413) Chris Lu 2026-05-09 22:02:17 -07:00
  • ad77362be3 test(s3/lifecycle): bundle reader + scheduler helper coverage (#9412) Chris Lu 2026-05-09 22:02:09 -07:00
  • 7996dc1d67 test(s3/lifecycle): bundle dispatcher pipeline helper coverage (#9411) Chris Lu 2026-05-09 22:02:01 -07:00
  • ca95d33092 test(s3/lifecycle): bundle dispatcher + engine accessor coverage (#9410) Chris Lu 2026-05-09 22:01:54 -07:00
  • 65fcf2d740 test(s3/lifecycle): direct router + engine helper coverage lifecycle-router-engine-helpers Chris Lu 2026-05-09 20:51:52 -07:00
  • 0955d1aa08 test(s3/lifecycle): direct prefixMatches + filterAllows coverage (#9408) Chris Lu 2026-05-09 20:47:35 -07:00
  • edbe7ab140 test(s3/lifecycle): meta-log Event builder + monotonic clock fixture (#9406) Chris Lu 2026-05-09 20:47:27 -07:00
  • 9d20e71883 test(s3/lifecycle): cover worker handler lookupBucketsPath (#9407) Chris Lu 2026-05-09 20:41:09 -07:00
  • 1aa55f5bf9 test(s3/lifecycle): direct decideMode + RuleMode.String coverage (#9405) Chris Lu 2026-05-09 20:35:34 -07:00
  • 619cb39827 test(s3/lifecycle): pin Schedule edge cases beyond happy path (Phase 15 slice) (#9403) Chris Lu 2026-05-09 20:35:22 -07:00
  • 435ef7f94f test(s3/lifecycle): pin toProtoActionKind + toProtoIdentity converters (#9404) Chris Lu 2026-05-09 20:35:04 -07:00
  • 1350e681c9 test(s3/lifecycle): pin Pipeline.Run dependency + shard validation (Phase 15 slice) (#9402) Chris Lu 2026-05-09 20:34:51 -07:00
  • cb6e498e0b test(s3/lifecycle): pin Descriptor structural invariants (#9401) Chris Lu 2026-05-09 20:34:17 -07:00
  • 6f9668c20b test(s3/lifecycle): pin lifecycleDispatch validation early-returns (#9400) Chris Lu 2026-05-09 20:11:08 -07:00
  • af2a359e45 feat(s3/lifecycle): metadata_only_total Prometheus counter (#9399) Chris Lu 2026-05-09 20:02:26 -07:00
  • c0cf1417f1 test(s3/lifecycle): cover worker handler Execute validation paths (#9398) Chris Lu 2026-05-09 19:51:31 -07:00
  • 284d37c3b6 test(s3/lifecycle): cover InMemoryPersister deep-copy contract (#9397) Chris Lu 2026-05-09 19:47:16 -07:00
  • 62e04623ce test(s3/lifecycle): cover worker handler Detect + helpers (#9396) Chris Lu 2026-05-09 19:46:57 -07:00
  • 551e700e64 test(s3/lifecycle): cover scheduler configload surface (#9395) Chris Lu 2026-05-09 19:46:40 -07:00
  • 6021a88606 test(s3/lifecycle): cover CompareVersionIds tiebreak surface (#9394) Chris Lu 2026-05-09 19:03:31 -07:00
  • 7781eef429 test(s3/lifecycle): cover dispatcher filerSiblingLister surface (Phase 14 slice) (#9392) Chris Lu 2026-05-09 18:55:50 -07:00