Integrations
We aim to minimize the hassle of integrating RisingWave with your existing data stack. With that purpose in mind, we will try to support the mainstream data formats, tools, and as many systems as possible.
However, with limited resources, we cannot achieve this goal in a short period. If a connector or integration is crucial to you but has not been supported, please let us know in the RisingWave Slack workspace, or by clicking the thumb-up icon in the corresponding cell on this page. We will prioritize the development based on the number of requests for each system.
If you wish to receive notifications when a connector or integration is available, you can click the small bell icon to enter your email address.
For tools or integrations that you would like to use but are not listed in the tables below, you can submit a feature request, or let us know in the Slack workspace.
RisingWave can sink data to Kafka. This allows indirectly sinking data to any system that can ingest from Kafka. The tables below show the direct sink status:
"Available" means a direct sink connector exists for that system.
"Researching" means no direct sink yet, but the system can still be used if it can ingest from Kafka.
Message brokers or streaming services
Broker or streaming service | Source | Sink |
---|---|---|
Apache Kafka | Available. See Ingest from Kafka for details. | Available. See Sink to Kafka for details. |
Amazon MSK | Available. See Ingest from Amazon MSK for details. | |
Apache Pulsar | Available. See Ingest from Pulsar for details. | Available. See Sink to Pulsar for details. |
Confluent Cloud | Available. See Ingest from Confluent Cloud for details. | |
DataStax Astra Streaming | Available. See Ingest data from DataStax Astra Streaming for details. | Researching |
EMQX | Available. See Ingest from MQTT brokers for details. | Available. See Sink to MQTT brokers for details. |
Google Pub/Sub | Available. See Ingest from Google Pub/Sub for details. | In progress |
HiveMQ | Available. See Ingest from MQTT brokers for details. | Available. See Sink to MQTT brokers for details. |
Kinesis Data Streams | Available. See Ingest from Kinesis for details. | Available. See Sink to Kinesis for details. |
RabbitMQ | Researching | Researching |
Redpanda | Available. See Ingest from Redpanda for details. | Available. See Sink to Kafka for details. |
StreamNative Cloud | Available | Researching |
NATS / NATS JetStream | Available. See Ingest from NATS JetStream for details. | Available. See Sink to NATS for details. |
ETL/ELT and data integration
System | Availability | |
---|---|---|
Airbyte | Researching | |
Census | Researching | |
dbt | Available. For details, see Use dbt for data transformations. | |
Fivetran | Researching | |
Hightouch | Researching | |
Vector | Available. | |
migrate | Available. migrate is a powerful tool written in Go for managing database migrations. For details, see its introduction and tutorial. |
Query engines
System | Availability | |
---|---|---|
Apache Spark | Researching | |
AWS Athena | Researching | |
Presto | Available. See Presto documentation. | |
Trino | Available. See Trino documentation. | |
GraphQL | Available. See this blog for details: Query real-time data with GraphQL, Kafka and RisingWave streaming database. |
Databases
PostgreSQL
System | Source | Sink |
---|---|---|
Postgres | Available. See Ingest from PostgreSQL CDC for details. | Available. See Sink to PostgreSQL for details. |
AWS RDS (Postgres) | Available. See Ingest from PostgreSQL CDC for details. | Available. See Sink to PostgreSQL for details. |
AWS Aurora (Postgres) | In progress | Researching |
Citus Data | Available. See Ingest from Citus CDC. | Researching |
Neon | Available. See Ingest from Neon CDC. | Researching |
MySQL
System | Source | Sink |
---|---|---|
MySQL | Available. See Ingest from MySQL CDC for details. | Available. See Sink to MySQL. |
AWS RDS (MySQL) | Available. See Ingest from MySQL CDC for details. | Available. See Sink to MySQL. |
AWS Aurora (MySQL) | In progress | Researching |
Other databases
System | Source | Sink |
---|---|---|
Apache Druid | No plan | Researching |
Apache Pinot | No plan | Pinot supports ingesting data from Kafka, Pulsar, and Kinesis. To sink data from RisingWave to Pinot, you can use Kafka, Pulsar, or Kinesis as a sink, then ingest the data into Pinot. See Sink Changes from RisingWave Tables to Apache Pinot for a demo. |
AWS Redshift | No plan | Researching |
ClickHouse | No plan | Available. For details, see Sink to ClickHouse. |
CockroachDB | Researching | Available. For details, see Sink to CockroachDB. |
DataStax Astra DB & Apache Cassandra & ScyllaDB | Researching | Available. For details, see Sink to Cassandra or ScyllaDB. |
Db2 | Researching | Researching |
Elasticsearch | No plan | Available. Only versions 7.x and 8.x are supported. For details, see Sink to Elasticsearch. |
Greenplum | No plan | Researching |
Google BigQuery | No plan | Available. For details, see Sink to Google BigQuery. |
MongoDB | Available. For details, see CDC via event streaming systems. | Researching |
Oracle Database | Researching | Researching |
Redis | Researching | Available. For details, see Sink to Redis. |
Snowflake | No plan | Available. For details, see Sink data to Snowflake. |
SQL Server | Available. For details, see CDC via event streaming systems. | Researching |
StarRocks | No plan | Available. For details, see Sink data to StarRocks. |
TiDB | Available. For details, see CDC via event streaming systems. | Available. For details, see Sink to TiDB. |
Data lakes
System | Availability | |
---|---|---|
Delta Lake | Available. See Sink to Delta Lake | |
Apache Hudi | Researching | |
Apache Iceberg | Available. For details, see Sink to Apache Iceberg. |
BI and data analytic platforms
System | Availability | |
---|---|---|
Apache Superset | Available. See Visualize RisingWave data in Superset for details. | |
Beekeeper Studio | Available. See Connect Beekeeper Studio to RisingWave for details. | |
Bytebase | Available. See Supported databases for details. | |
Cube.js | Available. See the documentation of Cube for details. | |
DBeaver | Available. See Connect DBeaver to RisingWave for details. | |
Grafana | Available. See Visualize RisingWave data in Grafana for details. | |
Jupyter Notebook | Available. For this integration, you can use a PostgreSQL Python driver, such as psycopg2 , to connect to RisingWave. There is no difference from writing a normal python app. See Use RisingWave in your Python application for details. | |
Looker | Available. See Connect Looker to RisingWave for details. | |
Metabase | Available. See Connect Metabase to RisingWave for details. | |
Redash | Available | |
DataGrip | Researching | |
PgAdmin | Researching | |
Hex | Available. For this integration, you can directly use the PostgreSQL data connection of Hex. |
Other systems
System | Availability | |
---|---|---|
Alluxio | Researching | |
Datadog | Researching | |
Google Cloud Storage (GCS) | Available as source. For details, see Ingest from Google Cloud Storage. | |
Hasura | Researching | |
Liquibase | Researching | |
Supabase | Available. For details, see Empower Supabase with stream processing capabilities. |