Learn how to create, manage, and query native Iceberg tables in RisingWave using the Iceberg table engine.
CREATE SINK
step to export data into Iceberg format. Data ingested or computed can land directly in these Iceberg tables.CREATE CONNECTION
.
The following examples show how to create an Iceberg connection using different catalog types.
partition_by
option when creating tables. Partitioning helps organize data for efficient storage and query performance.
The supported partition_by
formats and examples are as follows:
'column'
— single column
'column1,column2'
— multiple columns
'bucket(n, column), column2'
— bucket partitioning
'column1, truncate(n, column2)'
— truncate partitioning
partition_by
= 'c2,c3'
with PRIMARY KEY(c1, c2, c3)
will fail.WITH
clause:
Parameter | Description |
---|---|
enable_compaction | Whether to enable Iceberg compaction (true /false ). |
compaction_interval_sec | Interval (in seconds) between two compaction runs. Defaults to 3600 seconds. |
enable_snapshot_expiration | Whether to enable snapshot expiration. By default, it removes snapshots older than 5 days. |
barrier_interval_ms
and checkpoint_frequency
are system parameters that define the base checkpointing rate.
hosted_catalog = true
for quick development.