Skip to content

File formats ​

Every file Mink serves is pinned by a specification in the repository, with conformance fixtures that tests check byte for byte.

SpecificationPins
file.mdA data file's path, Parquet bytes and statistics
records.mdHow Kafka record batches become a file's rows
decoding.mdHow Avro, Protobuf and JSON Schema payloads become typed columns
schema.mdTable schemas, type mappings, field ids and evolution
layout.mdTime partitioning, assembled files and manifest grouping
metadata.mdSnapshots, table metadata, manifest lists and manifests
statistics.mdThe Puffin statistics file with per-column distinct-value sketches

Fixtures live in conformance/fixtures/. Independent readers check them: DuckDB, PyIceberg, Apache DataSketches and a real Kafka broker.