Learn how to stream data from RisingWave into existing Iceberg tables using the Iceberg sink connector.
gcs.credential
is base64-encoded credential key obtained from the GCS service account key JSON file. To get this JSON file, refer to the guides of GCS documentation. cat ~/Downloads/rwc-byoc-test-464bdd851bce.json | base64 -b 0 | pbcopy
, and then paste the output as the value for this parameter.RisingWave Type | Iceberg Type | Notes |
---|---|---|
BOOLEAN | boolean | |
SMALLINT | int | |
INT | int | |
BIGINT | long | |
REAL | float | |
DOUBLE PRECISION | double | |
VARCHAR | string | |
BYTEA | binary | |
DECIMAL(p,s) | decimal(p,s) | |
TIME | time | |
DATE | date | |
TIMESTAMP | timestamp | |
TIMESTAMPTZ | timestamptz | |
INTERVAL | string | Serialized as string |
JSONB | string | Serialized as JSON string |
ARRAY | list | |
STRUCT | struct | |
MAP | map |
Parameter | Description |
---|---|
connector | Must be 'iceberg' |
type | Sink mode: 'append-only' or 'upsert' |
database.name | Target Iceberg database name |
table.name | Target Iceberg table name |
Parameter | Description | Default |
---|---|---|
primary_key | Primary key for upsert sinks | None |
force_append_only | Force append-only mode from upsert source | false |
is_exactly_once | Enable exactly-once delivery | false |
commit_checkpoint_interval | Commit interval in checkpoints | 60 |
commit_retry_num | Number of commit retries | 8 |