Field notes on modernizing scientific and industrial software.
A queue architecture for billion-row scientific time-series systems where late-arriving files, global metrics, and deterministic reprocessing make ingestion far more challenging than simple ETL.