Skip to content

Connectors

Kafka is the only connector StreamFusion considers production-grade today, across the native formats listed below. It's covered in depth in this section.

Parquet and ORC (stock Flink filesystem reads plus native sink encoding to any filesystem Flink supports), Delta Lake (path-based append and merge-on-read sinks), and Apache Paimon (streaming sources and append-only and primary-key table sinks, including fixed, dynamic, and postpone buckets, with Paimon's own compaction) also have native paths, but they have not seen the same production hardening as Kafka — treat them as experimental.

Formats

A format decodes or encodes the bytes on the wire; it's independent of which connector carries them (though not every connector supports every format — see each connector's page). StreamFusion ships a native implementation for:

Each optional format is its own streamfusion-* Maven artifact and native library, mirroring Flink's own connector/format module split — installing a format you don't use never pulls its native code into a connector you do, and each library exports only its own class's native entry points, so the JVM binds every core method to the core library alone. A missing format module is always a normal planner fallback to Flink's own decode/encode path, never a linkage failure. See Deployment for which JARs a given connector+format combination needs.