Tech News
← Home  ·  All topics

Json Shredding

1 GoKawiil brief on this topic

DuckDB 2.0 adds VARIANT type that 'shreds' JSON for faster queries

DuckDB 2.0 introduces VARIANT as a native data type, replacing text-based JSON storage. The engine analyzes JSON fields during checkpointing and extracts consistent fields—like a field that is always a number or always text—into real typed columns, leaving only the inconsistent or rare fields in a binary remainder.