Key Features

⚡ Streaming-First Design

Optimized for single-pass read and write operations, making it ideal for network streams and large-scale data processing pipelines.

🛡️ Data Recoverability

Self-describing blocks and periodic checkpoints ensure data can be recovered even if the archive is truncated or partially corrupted.

🔧 Codec Polymorphism

Supports multiple compression algorithms (Zstd, LZ4, etc.) within a single archive, allowing block-level optimization based on data type.

🧩 Plugin Architecture

Third-party and proprietary compression algorithms integrate seamlessly through a well-defined plugin interface for closed-source extensions.

📇 Metadata-First Indexing

Centralized index for fast random access and efficient file listing without scanning the entire archive, enabling quick lookups.

🦀 Rust Implementation

High-performance, memory-safe reference implementation serving as the canonical reference for the Sixcy specification.

Architecture Components

Superblock

Fixed header with format version, metadata pointers, and container configuration.

Block

Minimal framing units for streaming and recovery, enabling single-pass processing.

Codec

Flexible codec containers with algorithm selection and compression parameters.

Recovery

Checksums and parity chunks for fast repair and data integrity validation.

Index

Lightweight indexes for seek operations, resume capability, and efficient navigation.

Performance Metrics

Real-world benchmarks using Silesia and Canterbury Corpus datasets

0
Avg Compression Ratio
0
MB/s Throughput
0
Max Compression (11.7x)

Silesia Corpus Results

File Original (MB) Compressed (MB) Ratio Compress (s) Decompress (s)
dickens9.73.52.77x0.0790.041
mozilla48.817.52.79x0.2620.125
nci32.02.711.76x0.0770.063
samba20.64.84.33x0.0870.052
webster39.511.63.41x0.2460.140
xml5.10.68.40x0.0260.020

Getting Started

Build from Source

Requires Rust toolchain. See Environmental_preparation.md for detailed setup instructions.

cargo build --release
./target/release/6cy --help

What's Included

  • .6cy container format implementation
  • Streaming I/O engine
  • Recovery logic
  • Standard codecs (Zstd, LZ4)
  • Plugin ABI for external codecs

Current Status

v0.1.x (Current)

Reference implementation for format validation, integration testing, and research. Not yet recommended for production use.

Ready to Explore 6cy?

Join the community and contribute to the future of high-performance container formats.

⭐ Star on GitHub Read Specification