mirror of
https://github.com/rustfs/rustfs.git
synced 2026-08-05 21:07:43 +00:00
131 lines
5.5 KiB
Markdown
131 lines
5.5 KiB
Markdown
# Workload Admission Contracts
|
|
|
|
This document records the `rustfs/backlog#660` PR-05 and PR-07 scheduler
|
|
preservation and runtime workload-class contract slice.
|
|
|
|
## Preservation Coverage
|
|
|
|
The `rustfs-concurrency` tests pin the current reusable scheduler and
|
|
admission-facing behavior before later snapshot extraction:
|
|
|
|
- Worker slot over-release remains clamped by the configured worker limit.
|
|
- Scheduler default buffer and priority thresholds remain unchanged.
|
|
- Scheduler priority boundaries remain high below the high threshold, normal at
|
|
both thresholds, and low above the low threshold.
|
|
- Backpressure pipe metadata reads preserve buffer capacity and state without
|
|
mutating the manager state.
|
|
- `GetObjectQueueSnapshot` preserves saturated, over-available, and zero-total
|
|
permit semantics.
|
|
|
|
## Workload Class Contract
|
|
|
|
`WorkloadClass` defines the required future admission categories:
|
|
|
|
- Foreground read.
|
|
- Foreground write.
|
|
- Metadata.
|
|
- Scanner.
|
|
- Repair.
|
|
- Replication.
|
|
|
|
`AdmissionState`, `WorkloadAdmissionSnapshot`, and
|
|
`WorkloadAdmissionRegistrySnapshot` define read-only status shapes for later
|
|
runtime owners. They do not replace the current scheduler, request guard,
|
|
scanner, heal, replication, or ECStore placement behavior.
|
|
|
|
## Boundary Rules
|
|
|
|
- `rustfs-concurrency` owns this reusable contract surface.
|
|
- The contract does not depend on `rustfs-ecstore` or RustFS binary runtime
|
|
state.
|
|
- No scheduler decision logic, queue capacity, Tokio runtime default, scanner
|
|
admission, heal admission, replication admission, placement, membership, or
|
|
NUMA behavior changes are part of this slice.
|
|
|
|
## Set-Local Snapshot Extraction
|
|
|
|
The RustFS storage `ConcurrencyManager` now implements
|
|
`WorkloadAdmissionSnapshotProvider` for local foreground-read admission:
|
|
|
|
- `ForegroundRead` reports local disk-read permit usage through
|
|
`GetObjectQueueSnapshot`.
|
|
- `active` is the number of disk-read permits currently in use.
|
|
- `limit` is the configured maximum concurrent disk reads.
|
|
- `queued` remains `None` because the current semaphore does not expose waiter
|
|
counts.
|
|
- Scanner, repair, replication, foreground write, and metadata entries remain
|
|
`Unknown` until their owning runtime components expose read-only status.
|
|
|
|
This is an observation surface only. Permit acquisition, priority assignment,
|
|
buffer sizing, storage media detection, request guards, and queue behavior are
|
|
unchanged.
|
|
|
|
## Heal Repair Snapshot Extraction
|
|
|
|
The RustFS integration layer now exposes a read-only repair admission snapshot
|
|
from the heal runtime counters:
|
|
|
|
- `Repair` reports the current heal active task count.
|
|
- `queued` reports the current heal queue length.
|
|
- `limit` remains `None` because the configured heal queue and concurrency
|
|
limits live behind the async heal manager state.
|
|
- Other workload classes remain `Unknown` in this provider until their owning
|
|
runtime components expose read-only status.
|
|
|
|
This is an observation surface only. Heal request admission, queue capacity,
|
|
priority merge/drop policy, task scheduling, retry handling, and repair
|
|
behavior are unchanged.
|
|
|
|
## Replication Snapshot Extraction
|
|
|
|
The RustFS integration layer now exposes a read-only replication admission
|
|
snapshot from the existing replication pool and queue statistics:
|
|
|
|
- `Replication` reports active regular, large-object, and MRF worker counts.
|
|
- `queued` reports the current site replication queue count when queue stats
|
|
are immediately observable.
|
|
- `limit` remains `None` because replication worker limits remain owned by the
|
|
async replication pool and resize policy.
|
|
- If the replication runtime has not initialized, or queue stats are currently
|
|
locked, the snapshot reports `Unknown` instead of blocking or guessing.
|
|
|
|
This is an observation surface only. Replication admission, queue channel
|
|
capacity, worker resize behavior, MRF handling, target dispatch, and resync
|
|
behavior are unchanged.
|
|
|
|
## RustFS Runtime Owner Snapshot Extraction
|
|
|
|
The RustFS integration layer now extends the workload admission registry with
|
|
additional read-only owner mappings:
|
|
|
|
- `ForegroundRead` reuses the storage `ConcurrencyManager` disk-read permit
|
|
snapshot so the RustFS-level provider exposes the same active and limit
|
|
counts as the storage-local provider.
|
|
- `Scanner` reports the existing scanner active work-unit counter. When the
|
|
counter is zero, the snapshot remains `Unknown` because the current counter
|
|
cannot distinguish an idle scanner from a scanner that has not initialized.
|
|
- `Metadata` reports `Open` once the bucket metadata runtime handle is
|
|
available, and `Unknown` before initialization.
|
|
- `ForegroundWrite` remains `Unknown` until a write-specific admission owner
|
|
exposes a read-only surface.
|
|
|
|
This is an observation surface only. Disk-read permit acquisition, scanner
|
|
cycle scheduling, bucket metadata loading, metadata locks, object write paths,
|
|
and queue behavior are unchanged.
|
|
|
|
## Provider Composition Boundary
|
|
|
|
`WorkloadAdmissionRegistrySnapshot::overlay` composes provider-owned registry
|
|
snapshots without mutating runtime owners:
|
|
|
|
- The storage concurrency provider remains the source of truth for
|
|
`ForegroundRead`.
|
|
- The RustFS runtime owner provider overlays metadata, scanner, repair,
|
|
replication, and foreground-write status on top of the storage registry.
|
|
- Matching workload classes are replaced by the later provider snapshot; new
|
|
classes are appended without reordering existing unrelated entries.
|
|
|
|
This keeps the later controller/status layer consuming a single read-only
|
|
registry while preserving the existing storage, scanner, heal, replication, and
|
|
metadata ownership boundaries.
|