A production deployment of Parseable handles over 100 million distinct time series generated by high-cardinality labels across resource metrics. Traditional time series databases struggle with this scale because they index and manage every series identity separately, requiring expensive operations to scan all matching series before aggregating results, even when only a small output is needed.
Vortex is an extensible columnar data format built in Rust that adapts to any data shape while maintaining performance and compression. Unlike fixed formats like Parquet, Vortex is self-describing and allows writers to define custom encodings, layouts, and types without requiring specification changes or new reader implementations for each language.
ProofFrame 0.7.1 is a Rust/Arrow data validation tool with WASM support that enables eleven schema-validation rules beyond standard schema constraints, including ordering, gaps, exclusivity, statistics, and conditional checks. The tool maintains backward compatibility with existing contracts.
Conviva's query engine replaced mmap with io_uring for reading Arrow IPC files from NVMe storage. Under concurrent load, mmap's shared kernel page cache caused severe contention, lock thrashing, and latency spikes (p95 from 30s to 150s+), which io_uring resolved by enabling explicit I/O control without implicit shared state.