Skip to content

Streaming Iceberg Nexmark observations

2,000,000 deterministic events; parallelism 4; four-bucket input/output tables. All times include streaming completion and final drain/commit.

Query State / mini-batch Variant Flink median [range], s StreamFusion median [range], s Median ratio
q9 memory-on exact 37.809 [37.809–37.809] 2.474 [2.474–2.474] 15.28×

Exact-query aggregates

Geometric means use every exact-query cell in each mode; labelled expression variants remain separate above. Throughput is nominal corpus events divided by median end-to-end time, including startup, checkpoints and drain.

State / mini-batch Queries Geomean ratio Flink corpus events/s, range StreamFusion corpus events/s, range
memory-on 1 15.28× 52,897–52,897 808,496–808,496

Raw samples, warmups, parity checks, plans, committed table locations and native/fallback task/file witnesses are retained in this artifact directory. PROCTIME q12 validates per-bidder count conservation and includes waiting for the final processing-time window.