
Ingest data from external Iceberg tables
RisingWave can continuously ingest data from append-only Iceberg tables. It monitors snapshots and automatically loads newly appended data, allowing you to consume the table as a live data stream. For details, see Ingest data from Iceberg tables. ExampleAd hoc analytics on Iceberg data
After the source is created, you can query it directly with SQL. RisingWave retrieves the current snapshot of the Iceberg table at query time.Continuous analytics with materialized views
For real-time, incremental analytics, create a materialized view on the Iceberg source. RisingWave automatically keeps the view up to date as new snapshots are committed to the Iceberg table.Deliver data to external Iceberg tables
RisingWave can deliver query results or materialized view outputs to Iceberg tables. The delivered data remains fully compatible with other Iceberg engines such as Spark, Trino, and DuckDB.- Supports
append-only
,upsert
, andforce-append-only
sink modes - Guarantees exactly-once delivery
- Optional file compaction for efficiency
Loading modes support
Use this matrix to understand current support for ingesting from and delivering to external Iceberg tables.Loading mode | Append-only | Mutable |
---|---|---|
One-time loading | Supported | Supported (both equality and position deletes) |
Periodic loading | Planned for a future release (v2.7) | Planned for a future release (v2.7) |
Continuous loading | Supported | No support (Iceberg CDC is immature) |