Connectors¶
Kafka is the only connector StreamFusion considers production-grade today, across the native formats listed below. It's covered in depth in this section.
Parquet and ORC (stock Flink filesystem reads plus native sink encoding to any filesystem Flink supports), Delta Lake (path-based append and merge-on-read sinks), and Apache Paimon (streaming sources and append-only and primary-key table sinks, including fixed, dynamic, and postpone buckets, with Paimon's own compaction) also have native paths, but they have not seen the same production hardening as Kafka — treat them as experimental.
Formats¶
A format decodes or encodes the bytes on the wire; it's independent of which connector carries them (though not every connector supports every format — see each connector's page). StreamFusion ships a native implementation for:
- JSON
- CSV
- Avro
- Avro Confluent (schema-registry-backed Avro)
- Protobuf
- Raw (the single-column passthrough format)
- CDC JSON (Debezium, OGG, Maxwell, and Canal's changelog envelopes)
Each optional format is its own streamfusion-* Maven artifact and native library, mirroring
Flink's own connector/format module split — installing a format you don't use never pulls its
native code into a connector you do, and each library exports only its own class's native entry
points, so the JVM binds every core method to the core library alone. A missing format module is always a normal planner fallback
to Flink's own decode/encode path, never a linkage failure. See Deployment for
which JARs a given connector+format combination needs.