mirror of https://github.com/rustfs/rustfs.git synced 2026-07-28 00:58:59 +00:00

Files

T

Zhengchao An 073bc96756 fix(filemeta): compute header signature instead of hardcoding zero (#4343 )

The xl.meta version header `signature` was hardcoded to `[0,0,0,0]` on the
write path (`From<FileMetaVersion> for FileMetaVersionHeader`), and the
existing `get_signature` implementations only hashed `version_id` + `mod_time`
(+ `size`), so two versions that share a version_id and mod_time but differ in
body (e.g. a PutObjectTagging that reached only some disks) produced identical
headers. Such divergence was undetectable and unhealable in the strict merge
path (backlog#861, B12).

Compute a real signature over the full version body, mirroring MinIO's
`xlMetaV2Version.getSignature` semantics:

- Fill the signature on the write path via the `From` impl (covers
  add_version / set_idx / update_object_version).
- `MetaObject::get_signature` / `MetaDeleteMarker::get_signature` now clone the
  body, zero the per-disk `erasure_index`, fold `meta_user` / `meta_sys` in
  with order-independent hashes (msgpack map order is not stable across disks),
  marshal the rest and xxh64 it, then fold 64->32 bits. Empty vs all-empty
  PartETags are normalized alike.
- Invalid/bodyless versions return an `err` sentinel rather than all-zero, so
  they never collide with a real all-zero legacy signature.

Backward compatibility: the decode path preserves stored signature bytes, and
the normal (non-strict) merge path already zeroes signatures before grouping,
so existing all-zero xl.meta stays consistent across disks. Only strict
merge/heal compares signatures, where legacy data is uniformly zero (no split)
and genuine partial-write divergence is now correctly detected.

Adds unit tests covering: non-zero signature on write, erasure_index
independence, tag/metadata/size divergence detection, map-order independence,
PartETags normalization, delete-marker divergence, and the err sentinel.

2026-07-07 09:40:28 +08:00

benches

perf(metadata): drop per-object heap allocs in internal-key lookups (#4260 )

2026-07-04 22:14:07 +08:00

examples

feat(rio): rio_v2 is compatible with minio for storing data. (#3115 )

2026-06-08 11:59:14 +00:00

src

fix(filemeta): compute header signature instead of hardcoding zero (#4343 )

2026-07-07 09:40:28 +08:00

tests/fixtures

fix(filemeta): accept nil legacy pool metadata (#2459 )

2026-04-10 08:27:41 +08:00

Cargo.toml

test(property): add filemeta invariants (#3536 )

2026-06-18 00:36:55 +08:00

README.md

fix(sse). Resolving Nonce Overwriting Issues in Multi-Package Scenarios (#2582 )

2026-04-18 14:00:14 +00:00

README.md

RustFS FileMeta - File Metadata Management

Advanced file metadata management and indexing module for RustFS distributed object storage

📖 Documentation · 🐛 Bug Reports · 💬 Discussions

📖 Overview

RustFS FileMeta provides advanced file metadata management and indexing capabilities for the RustFS distributed object storage system. For the complete RustFS experience, please visit the main RustFS repository.

Quick Use

cargo run -p rustfs-filemeta --example dump_fileinfo -- "/path/to/file/xl.meta"

✨ Features

High-performance metadata storage and retrieval
Advanced indexing with full-text search capabilities
File attribute management and custom metadata
Version tracking and history management
Distributed metadata replication
Real-time metadata synchronization

📚 Documentation

For comprehensive documentation, examples, and usage guides, please visit the main RustFS repository.

📄 License

This project is licensed under the Apache License 2.0 - see the LICENSE file for details.