Ingest data from WarpStream
You can ingest data from WarpStream, an Apache Kafka-compatible data streaming platform built directly on top of object storage, into RisingWave.
This guide will help you set up WarpStream, ingest data into RisingWave, and create and query a materialized view in RisingWave.
Set up WarpStream
Install WarpStream Agent
To interact with the WarpStream cluster, install the WarpStream Agent or CLI:
Create a Kafka topic and produce sample data
After the installation, run the following commands in the terminal:
- Initiate WarpStream playground:
- Generate a Kafka topic with fake click stream data:
Ingest data into RisingWave
Create a source
In RisingWave, create a source named “website_visits” to connect RisingWave to the WarpStream topic:
Create a materialized view
In RisingWave, create a materialized view that offers insights into user behavior on different pages for analyzing website traffic and engagement.
Query the materialized view
Let’s retrieve data from the created materialized view:
Expected result:
You have successfully ingested data from WarpStream into RisingWave, created a materialized view, and queried it in RisingWave.
Was this page helpful?