Commit Graph

  • d713ab49f9 volume: validate replica targets and restrict gcs credentials in FetchAndWriteNeedle (#10755) Chris Lu 2026-08-13 23:33:01 -07:00
  • 9125b9c835 volume: extend the remote-endpoint guard to the azure backend (#10754) Chris Lu 2026-08-13 22:32:59 -07:00
  • 94f8e2caf9 EC: handle zero-sized shard files uniformly (moves, rebuilds, startup cleanup) (#10753) Chris Lu 2026-08-13 21:38:22 -07:00
  • 9386a25a4a feat(shell): parallelize volume balance moves (#10737) Konstantin Lebedev 2026-08-14 07:11:38 +05:00
  • 0de7ff5eb8 ci: run the gated redis store tests (#10746) Chris Lu 2026-08-13 13:36:31 -07:00
  • 0481f712b1 redis2: orphan cleanup existence checks must not read replicas (#10745) Chris Lu 2026-08-13 13:33:15 -07:00
  • ae2cc8225e rust volume: mirror the VolumeConsolidateIndex RPC from Go (#10752) Chris Lu 2026-08-13 13:30:58 -07:00
  • 7f27c572c4 log_buffer: end bounded reads that find the buffer empty (#10750) Chris Lu 2026-08-13 13:25:52 -07:00
  • 4f50c5b0d4 feat: throughput limits for replicate, EC shard, and worker-driven moves (#10749) Chris Lu 2026-08-13 13:22:58 -07:00
  • 7d0fff32db redis2: expire entries without destroying a concurrent recreate (#10744) Chris Lu 2026-08-13 13:18:31 -07:00
  • c0f33d599b rust volume: mirror Go volume server logic to gate the admin RPCs (#10748) Chris Lu 2026-08-13 13:17:23 -07:00
  • 4500bdf88e iceberg: accept lowercase parquet file format when planning compaction (#10751) Chris Lu 2026-08-13 13:16:07 -07:00
  • 76d3fd0e9d grpc: optional client_cert/client_key for outgoing mTLS connections (#10747) Chris Lu 2026-08-13 13:15:20 -07:00
  • abd36cbf92 redis2: harden the orphaned index member cleanup (#10743) Chris Lu 2026-08-13 13:08:26 -07:00
  • 4fb5d15019 redis: remove orphaned directory index members on listing (#10742) Chris Lu 2026-08-13 10:54:51 -07:00
  • f7ae2d4dd5 fix(redis2): remove orphaned directory index members on listing (#10735) Peter Dodd 2026-08-13 18:53:33 +01:00
  • 8714f42abf erasure_coding: share the EC shard teardown primitive (#10740) Chris Lu 2026-08-13 10:37:25 -07:00
  • 6408f32232 EC worker: clear stale/interrupted shards at task start and on failure (#10738) Chris Lu 2026-08-13 10:25:48 -07:00
  • fa48ce20fc shell: roll back a failed ec.encode instead of leaving readonly volumes and orphan shards (#10741) Chris Lu 2026-08-13 10:25:30 -07:00
  • db5a086d04 read cold remote objects straight from the origin while caching (#10731) Chris Lu 2026-08-12 23:00:10 -07:00
  • a0347ca545 test: assert EC shard identity and empty-view in multi-disk lifecycle tests (#10723) Chris Lu 2026-08-12 20:18:39 -07:00
  • 78e7e04377 plugin scheduler: drain started jobs past the window close instead of killing them (#10728) Chris Lu 2026-08-12 19:38:22 -07:00
  • 0799084e98 refactor: share volume and EC shard move logic between shell and workers (#10727) Chris Lu 2026-08-12 12:29:40 -07:00
  • c55ef964d9 docs: update example link (#10725) Александр Мелентьев 2026-08-12 16:57:25 +03:00
  • 96ef97a026 test: bound the payload-read HTTP client so a stalled server cannot hang the test ec-shell-multidisk-e2e Chris Lu 2026-08-11 22:46:26 -07:00
  • 2a513e71a4 test: drive ec.encode/balance/rebuild E2E with a byte-identical payload check (#10722) Chris Lu 2026-08-11 22:44:25 -07:00
  • 3dfe4bdaaa test: walk an EC volume through a multi-disk node's whole life (#10721) Chris Lu 2026-08-11 21:26:55 -07:00
  • 65114575eb mount: invalidate hot directory listings by section (#10712) Chris Lu 2026-08-11 21:11:18 -07:00
  • dfd247ea63 test: drive ec.encode/balance/rebuild E2E with a byte-identical payload check Chris Lu 2026-08-11 20:44:37 -07:00
  • a7d5443125 ec: confirm a surviving copy before deleting a duplicate EC shard (#10719) Chris Lu 2026-08-11 20:15:34 -07:00
  • 5b519489c1 remote_storage: build all S3-compatible clients through one constructor (#10720) Chris Lu 2026-08-11 19:06:12 -07:00
  • 980471c818 storage: count a volume's needles in uint32 (#10718) Chris Lu 2026-08-11 16:36:36 -07:00
  • 9fd7075bea filer: retry and surface metadata replay failures from peers (#10714) Peter Dodd 2026-08-11 20:36:22 +01:00
  • 5b145fe646 shell: send read jwt when downloading chunks in fs.mergeVolumes and fs.distributeChunks (#10717) Chris Lu 2026-08-11 11:57:53 -07:00
  • 01e97955f9 Helm: Add support for schedulerName (#10716) Cavus700 2026-08-11 14:55:20 +02:00
  • 340f9951ac admin: make paths relative (#10709) ruri 2026-08-10 22:31:55 -07:00
  • 790e8d3fd6 clickhouse catalog test: cover latest ClickHouse and catalog-side CREATE TABLE (#10707) Chris Lu 2026-08-10 20:04:33 -07:00
  • 0b5d1c0c64 format: restore the hls-ts sniff and assert adapter capabilities format-adapters Chris Lu 2026-08-10 20:03:58 -07:00
  • 56468c83e4 format: make Sniff an optional capability Chris Lu 2026-08-10 19:57:24 -07:00
  • bfe4b810bf filer: reject file sizes beyond int64 in the format paths Chris Lu 2026-08-10 19:28:43 -07:00
  • 618febdba5 filer: inline content disqualifies format views and repack Chris Lu 2026-08-10 19:23:09 -07:00
  • ed9d1eec64 filer: repack conflicts on every input to its output Chris Lu 2026-08-10 19:02:58 -07:00
  • 214d3599d3 windows mount: cache file data, resolved paths and attributes (#10703) Chris Lu 2026-08-10 18:46:18 -07:00
  • f07aabb39f filer: repack verifies the entry against the store at commit time Chris Lu 2026-08-10 18:45:49 -07:00
  • 17fe96e620 filer: fingerprint every read-relevant chunk field Chris Lu 2026-08-10 18:42:53 -07:00
  • 35e9f84334 filer: an unrepresentable remaining TTL means no volume TTL Chris Lu 2026-08-10 18:42:18 -07:00
  • 10b64686ba filer: repack chunk TTLs round up and follow the S3 expiry anchor Chris Lu 2026-08-10 18:25:03 -07:00
  • 045c834dcf filer: revalidate WORM under the commit lock Chris Lu 2026-08-10 18:23:34 -07:00
  • 318e1c64d6 filer: let repack handle S3-versioned entries Chris Lu 2026-08-10 17:32:37 -07:00
  • 2c84bb1161 filer: serialize HTTP entry commits on the entry lock Chris Lu 2026-08-10 17:27:03 -07:00
  • 61348b147b filer: derive a view-specific validator for format views Chris Lu 2026-08-10 17:23:46 -07:00
  • a7fec8004e filer: repack refuses versioned entries and keeps the remaining TTL Chris Lu 2026-08-10 17:23:14 -07:00
  • b65bcd4afa format: fix the hls-ts media-sequence decode bound Chris Lu 2026-08-10 17:22:54 -07:00
  • c6e1387f59 shell: multi-target fs.mergeVolumes and volume.mark -readonlyCanDelete (#10706) Chris Lu 2026-08-10 16:31:26 -07:00
  • 0b1f0cafee shell: keep the source readonly when the incomplete target copy cannot be deleted (#10705) Chris Lu 2026-08-10 12:56:45 -07:00
  • d4d8e097dd shell: volume.move cleans up when aborted after the copy phase (#10704) Chris Lu 2026-08-10 12:35:40 -07:00
  • 365d3e9e87 filer: TUS concatenation extension (#10702) Chris Lu 2026-08-10 12:32:45 -07:00
  • 89e6f9a16e shell: volume.delete and volume.move accept a -timeout (#10701) Chris Lu 2026-08-10 11:10:29 -07:00
  • 6d25ccc357 build(deps): bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.146.3 to 3.147.1 (#10694) dependabot[bot] 2026-08-10 11:07:51 -07:00
  • 3ff6ce3c69 build(deps): bump github.com/pierrec/lz4/v4 from 4.1.27 to 4.1.28 (#10695) dependabot[bot] 2026-08-10 11:07:43 -07:00
  • 2e86dcf725 build(deps): bump modernc.org/sqlite from 1.53.0 to 1.56.0 (#10696) dependabot[bot] 2026-08-10 11:07:30 -07:00
  • f25e415c7b build(deps): bump cloud.google.com/go/kms from 1.31.0 to 1.33.0 (#10697) dependabot[bot] 2026-08-10 11:07:21 -07:00
  • a9bf8d76a7 build(deps): bump github.com/aws/aws-sdk-go-v2/credentials from 1.19.32 to 1.19.34 (#10698) dependabot[bot] 2026-08-10 11:07:13 -07:00
  • 6dd83c823d build(deps): bump github/codeql-action from 4.37.4 to 4.37.6 (#10699) dependabot[bot] 2026-08-10 11:07:05 -07:00
  • 7c87d78ea2 s3: a key deleted after enabling versioning must leave the listing (#10684) Chris Lu 2026-08-10 11:04:06 -07:00
  • 753cb8cda8 master: stop copying the cluster to name it (#10700) Chris Lu 2026-08-10 11:02:09 -07:00
  • 5e9b7833ee topology: keep the volume map's values out of its slots (#10680) Chris Lu 2026-08-10 11:00:05 -07:00
  • 52d74df4d1 clients: stream the volume listings that ask for everything (#10679) Chris Lu 2026-08-10 09:51:08 -07:00
  • 46ce8cbe84 master: stream volume listings (#10676) Chris Lu 2026-08-10 09:41:00 -07:00
  • 79297b549e filer: tighten the format HTTP surface Chris Lu 2026-08-10 00:59:38 -07:00
  • 4c7e5afbfe format: bound the encoded adapter name symmetrically Chris Lu 2026-08-10 00:59:38 -07:00
  • 98f9e67b4d topology: provisional volume update must not erase the reported disk id (#10687) Chris Lu 2026-08-10 00:41:33 -07:00
  • 65b9ae7704 master: keep disk_id when registering volumes from incremental heartbeats (#10686) Chris Lu 2026-08-10 00:40:29 -07:00
  • 9cb7dc7204 filer: repack keeps the entry TTL and notifies subscribers Chris Lu 2026-08-10 00:31:16 -07:00
  • 77a2b1b378 format: compute interior chunk cuts lazily Chris Lu 2026-08-10 00:31:16 -07:00
  • 7387866fd6 filer: bound format chunk sizes when no maxMB is configured Chris Lu 2026-08-09 23:56:21 -07:00
  • 4bf126944f format: assert the chunk count in the align-clamp cutter test Chris Lu 2026-08-09 23:56:21 -07:00
  • 1737211ffa filer: keep every written chunk in the manifestization failure return Chris Lu 2026-08-09 23:56:21 -07:00
  • 00c5572e8c volume: decode IPv6 transition addresses in the remote-endpoint guard (#10683) Chris Lu 2026-08-09 23:22:13 -07:00
  • 3911e4c548 master: keep a racing registration out of a dying collection (#10677) Chris Lu 2026-08-09 22:20:34 -07:00
  • c8cc56be91 iceberg: route unprefixed requests to the first table bucket (#10675) Chris Lu 2026-08-09 22:20:13 -07:00
  • a2ff9cca27 master: let VolumeList ask for the volumes it wants (#10674) Chris Lu 2026-08-09 21:59:42 -07:00
  • e428b05224 test: let the vacuum shell session outlive the vacuum (#10682) Chris Lu 2026-08-09 21:59:25 -07:00
  • 4ee57f214c filer: wire format adapters into ingest, serving, and repack Chris Lu 2026-08-09 14:36:18 -07:00
  • 211bf4d2fe format: add parquet adapter cutting extents at row-group starts Chris Lu 2026-08-09 14:31:39 -07:00
  • deb8b9bef1 format: add hls-ts adapter for single-file MPEG-TS VOD assets Chris Lu 2026-08-09 14:30:56 -07:00
  • 53fe128511 format: add adapter registry mapping file structure to chunk extents Chris Lu 2026-08-09 14:29:27 -07:00
  • 6863412f4e filer: let the upload loop cut chunks at caller-chosen boundaries Chris Lu 2026-08-09 14:28:06 -07:00
  • f09e8345c6 storage: stop keeping the remote storage key on the master (#10672) Chris Lu 2026-08-09 12:43:31 -07:00
  • 0f7a64c596 storage: order VolumeInfo by alignment (#10669) Chris Lu 2026-08-09 09:41:50 -07:00
  • 7d6c55dedb topology: build the volume list without copying the volume map first (#10668) Chris Lu 2026-08-09 09:38:57 -07:00
  • e5dc98dcb2 ec.balance: add a -volumeIds filter (#10667) Chris Lu 2026-08-09 09:37:49 -07:00
  • 567052bfb6 s3: take bucket sizes from the master's summary (#10664) Chris Lu 2026-08-09 00:00:19 -07:00
  • 38db7e1493 storage: share the volume strings a cluster repeats (#10665) Chris Lu 2026-08-08 23:56:09 -07:00
  • 923d0bd20c iceberg: repair non-compliant manifests at commit (#10641) Chris Lu 2026-08-08 21:24:37 -07:00
  • 2d9ea0285c s3: add the RenameObject endpoint (#10659) Chris Lu 2026-08-08 21:24:30 -07:00
  • 67b0cc0706 topology: keep per-node volume state with the location it describes (#10654) Chris Lu 2026-08-08 20:56:08 -07:00
  • 2dc59c9b51 topology: track volume size only where writes can land (#10653) Chris Lu 2026-08-08 20:55:55 -07:00
  • 0dd33bd7ec s3api: fix ListObjectsV2 dropping objects under a partial prefix (#10656) hsdfat 2026-08-09 10:24:44 +07:00
  • a2ffc7aadf heartbeat: keep the master current through collection churn (#10657) Chris Lu 2026-08-08 20:23:10 -07:00