mirror of
https://github.com/rustfs/rustfs.git
synced 2026-09-06 12:09:12 +00:00
cxymds
df30dff1a7
* feat(storage): complete Snowball and capacity follow-ups * fix(ecstore): clarify V3 capacity gate guidance * fix(ecstore): keep target contention retryable * fix(ecstore): preserve typed target lock errors * fix(ecstore): harden decommission recovery * fix(ecstore): close decommission recovery races * fix(ecstore): fail closed on multipart cleanup gaps * fix(ecstore): model capacity mutation parameters * fix(ecstore): settle checkpoint capacity retries
37 lines
1.7 KiB
Markdown
37 lines
1.7 KiB
Markdown
# Snowball Auto-Extract Limits
|
|
|
|
RustFS accepts MinIO-compatible Snowball auto-extract uploads. Archive
|
|
members are streamed into objects while RustFS enforces entry-count, path,
|
|
PAX metadata, per-object, cumulative unpacked-size, and decoded-stream
|
|
limits.
|
|
|
|
## Size limits
|
|
|
|
The defaults remain compatible with the existing safety policy:
|
|
|
|
| Environment variable | Default | Hard maximum | Meaning |
|
|
| --- | ---: | ---: | --- |
|
|
| `RUSTFS_SNOWBALL_MAX_ENTRY_BYTES` | 1 GiB | 1 TiB | Maximum unpacked size of one archive member |
|
|
| `RUSTFS_SNOWBALL_MAX_UNPACKED_BYTES` | 10 GiB | 10 TiB | Maximum cumulative unpacked object bytes in one request |
|
|
|
|
Invalid values use the default. Zero is treated as one byte, values above the
|
|
hard maximum are clamped, and the per-entry limit is never allowed to exceed
|
|
the cumulative request limit. RustFS derives a separate decoded-stream limit
|
|
with bounded room for tar headers and PAX metadata; it cannot be disabled.
|
|
|
|
Increasing either limit raises the maximum work performed by one admitted
|
|
request. Snowball archive decoder admission remains globally bounded, so a
|
|
larger archive cannot create an unbounded number of concurrent decoders.
|
|
Restart RustFS after changing these environment variables.
|
|
|
|
## Small-member concurrency
|
|
|
|
For requests that set Snowball ignore-errors and do not use bucket quota
|
|
accounting, RustFS stages members up to 128 KiB and commits at most 16 at a
|
|
time. Requests that must stop on the first write error and quota-enabled
|
|
requests remain serial so their observable error and accounting behavior does
|
|
not change.
|
|
|
|
Set `RUSTFS_SNOWBALL_EXTRACT_MAX_INFLIGHT=1` to restore fully serial member
|
|
commits. Values are clamped to the range 1 through 16.
|