Release notes

This page summarizes changes in each version of RisingWave, including new features and important bug fixes.

v0.1.17

This version was released on February 28, 2023

Main changes

Administration

Adds a system catalog view rw_catalog.rw_ddl_progress, with which users can view the progress of a CREATE INDEX, CREATE SINK, or CREATE MATERIALIZED VIEW statement. #7914
Adds the pg_conversion and pg_enum system catalogs. #7964, #7706

SQL features

Adds the exp() function. #7971
Adds the pow() function. #7789
Adds support for displaying primary keys in EXPLAIN statements. #7590
Adds support for descending order in CREATE INDEX statements. #7822
Adds SHOW PARAMETERS and ALTER SYSTEM commands to display and update system parameters. #7882, #7913

Connectors

Adds a new parameter match_pattern to the S3 connector. With the new parameter, users can specify the pattern to filter files that they want to ingest from S3 buckets. For documentation updates, see Ingest data from S3 buckets. #7565
Adds the PostgreSQL CDC connector. Users can use this connector to ingest data and CDC events from PostgreSQL directly. For documentation updates, see Ingest data from PostgreSQL CDC. #6869, #7133
Adds the MySQL CDC connector. Users can use this connector to ingest data and CDC events from MySQL directly. For documentation updates, see Ingest data from MySQL CDC. #6689, #6345, #6481, #7133
Adds the JDBC sink connector, with which users can sink data to MySQL, PostgreSQL, or other databases that are compliant with JDBC. #6493
Add new parameters to the Kafka sink connector.
- force_append_only : Specifies whether to force a sink to be append-only. #7922
- use_transaction : Specifies whether to enable Kafka transactions or not. #7500
- SSL/SASL parameters: Specifies SSL encryption and SASL authentication settings. #7540

Assets

Run this version from Docker:
docker run -it --pull=always -p 4566:4566 -p 5691:5691 risingwavelabs/risingwave:v0.1.17 playground
Prebuilt library for Linux
Source code (zip)
Source code (tar.gz)

v0.1.16

This version was released on February 1, 2023.

Main changes

Administration

Adds support for aborting a query in local mode with Ctrl + C. #7444

SQL features

Adds support for the to_timestamp function. #7060
Adds support for the RETURNING clause in DML statements. #7094
Breaking change: Deprecates CREATE MATERIALIZED SOURCE . To create a materialized source, create a table and include the newly added connector settings. #7281, #7110
Adds support for the c and i flags in regex_match() and regex_matches() functions. #7135
Adds support for SHOW CREATE TABLE . You can use this statement to show the definition of a table. #7152
Adds support for the pg_stat_activity system catalog and several system functions. #7274
Adds the _rw_kafka_timestamp parameter to show the timestamps of Kafka messages. Users can now specify the scope of Kafka messages by timestamps. #7275, #7150
Adds support for displaying PostgreSQL and RisingWave versions in version(). #7314
Adds support for displaying internal tables using the SHOW INTERNAL TABLES statement. #7348
Adds support for SET VISIBILITY_MODE You can use this session variable to configure whether only checkpoint data is readable for batch query. #5850
Adds support for SET STREAMING_PARALLELISM . You can use this session variable to configure parallelism for streaming queries. #7370

Connectors

Adds support for generating array and struct data using the datagen connector. #7099
Adds the S3 source connector, with which users can ingest data in CSV format from S3 locations. For data ingestion from files, CSV is the only supported format and the files must be placed on S3. #6846

Assets

Run this version from Docker:
docker run -it --pull=always -p 4566:4566 -p 5691:5691 risingwavelabs/risingwave:v0.1.16 playground
Prebuilt library for Linux
Source code (zip)
Source code (tar.gz)

v0.1.15

This version was released on January 4, 2023.

Main changes

Installation and deployment

Parallelism and available memory of compute nodes are now command-line arguments and removed from the configuration file. #6767
The default barrier interval is set to 1 second. #6553
Adds support for meta store backup and recovery. #6737

SQL features

Adds support for SHOW CREATE MATERIALIZED VIEW and SHOW CREATE VIEW to show how materialized and non-materialized views are defined. #6921
Adds support for CREATE TABLE IF NOT EXISTS. #6643
A sink can be created from a SELECT query. #6648
Adds support for struct casting and comparison. #6552
Adds pg_catalog views and system functions. #6982
Adds support for CREATE TABLE AS. #6798
Ads the initial support for batch query on Kafka source. #6474
Adds support for SET QUERY_EPOCH to query historical data based on meta backup. #6840

Connectors

Improves the handling of schema errors for Avro and Protobuf data. #6821
Adds two options to the datagen connector to make it possible to generate increasing timestamp values. #6591

Observability

Adds metrics for the backup manager in Grafana. #6898
RisingWave Dashboard can now fetch data from Prometheus and visualize it in charts. #6602

Assets

Run this version from Docker:
docker run -it --pull=always -p 4566:4566 -p 5691:5691 risingwavelabs/risingwave:v0.1.15 playground
Prebuilt library for Linux
Source code (zip)
Source code (tar.gz)

v0.1.14

This version was released on December 1, 2022.

Main changes

SQL features

PRIMARY KEY constraint checks can be performed on materialized sources and tables but not on non-materialized sources. For tables or materialized sources that enabled PRIMARY KEY constraints, if you insert data to an existing key, the new data will overwrite the old data. #6320 #6435
Adds support for timestamp with time zone data type. You can use this data type in time window functions, and convert between it and timestamp (without time zone). #5855 #5910 #5968
Adds support for UNION and UNION ALL operators. #6363 #6397
Implements the rank() function to support a different mode of Top-N queries. #6383
Adds support for logical views (CREATE VIEW). #6023
Adds the data_trunc() function. #6365
Adds the system catalog schema. #6227
Displays error messages when users enter conflicting or redundant command options. #5933

Connectors

Adds support for the Maxwell Change Data Capture (CDC) format. #6057
Protobuf schema files can be loaded from Web locations in s3://, http://, or https:// formats. #6114 #5964
Adds support for Confluent Schema Registry for Kafka data in Avro and Protobuf formats. #6289
Adds two options to the Kinesis connector. Users can specify the startup mode and optionally the sequence number to start with. #6317

Assets

Run this version from Docker:
docker run -it --pull=always -p 4566:4566 -p 5691:5691 risingwavelabs/risingwave:v0.1.14 playground
Prebuilt library for Linux
Source code (zip)
Source code (tar.gz)

v0.1.13

This version was released on October 17, 2022.

Main changes

SQL features

SQL commands:
- Improves the formatting of response messages of EXPLAIN statements. #5541
SQL functions:
- to_char() now supports specifying output format in lowercase. #5032
  to_char(timestamp '2006-01-02 15:04:05', 'yyyy-mm-dd hh24:mi:ss') → 2006-01-02 15:04:05
- generate_series now supports negative steps. #5231
```
SELECT * FROM generate_series(5,1,-2);
generate_series 
-----------------
               5
               3
               1
(3 rows)
```
- Adds support for sum/min/max functions over interval-type data. #5105, #5549
- Adds support for array concatenation. #5060, #5345
- Adds support for specifying empty arrays. #5402
- Casting from array to varchar is now supported. #5081
  array[1,2]::varchar → {1,2}
- Casting from varchar to integer allows leading and trailing spaces. #5452
  ' 1 '::int → 1
Adds new system catalog and psql meta-commands. #5127, #5742
- \d: Lists all relations in the current database. (Materialized) sources are not supported yet.
- \dt: Lists all tables in the current database.
- \dm: Lists all materialized views in the current database.
- \di: Lists all indexes in the current database.
- pg_catalog.pg_index: Contains information about indexes.

Connectors

Nested columns are now supported for the datagen connector. #5550

Assets

Run this version from Docker:
docker run -it --pull=always -p 4566:4566 -p 5691:5691 risingwavelabs/risingwave:v0.1.13 playground
Prebuilt library for Linux
Source code (zip)
Source code (tar.gz)

v0.1.12

This version was released on September 7, 2022.

Main changes

SQL features

SQL commands:
- EXPLAIN now supports specifying options. Supported options: trace, verbose, and type. Unlike PostgreSQL, each option should be separated by a comma and wrapped by parentheses as a whole. #4730
- Adds support for ALTER USER. #4261
- CREATE/ALTER USER now has new options CREATEUSER and NOCREATEUSER, which specify whether or not the user has the privilege to create, alter, or drop other users. #4447
- Adds support for EXPLAIN CREATE SINK. #4430
SQL functions:
- Adds support for new system information functions: current_schema, current_schema(), and session_user. #4358
The pg_namespace catalog now has a new namespace column nspacl for storing access privileges. #4326

Connectors

Some connector parameters were renamed. The old parameter names are still functional but may be deprecated in the future. #4503
- Kafka & Redpanda
  - kafka.brokers -> properties.bootstrap.server
  - kafka.topic -> topic
  - kafka.scan.startup.mode -> scan.starup.mode
  - kafka.time.offset -> scan.startup.timestamp_millis
  - kafka.consumer.group -> consumer.group.id
- Kinesis
  - kinesis.stream.name -> stream
  - kinesis.stream.region -> aws.region
  - kinesis.endpoint -> endpoint
  - kinesis.credentials.access -> aws.credentials.access_key_id
  - kinesis.credentials.secret -> aws.credentials.secret_access_key
  - kinesis.credentials.session_token -> aws.credentials.session_token
  - kinesis.assumerole.arn -> aws.credentials.role.arn
  - kinesis.assumerole.external_id -> aws.credentials.role.external_id
- Pulsar
  - pulsar.topic -> topic
  - pulsar.admin.url -> admin.url
  - pulsar.service.url -> service.url
  - pulsar.scan.startup.mode -> scan.startup.mode
  - pulsar.time.offset -> scan.startup.timestamp_millis
The row format name, debezium json, for CDC stream sources, has been renamed to debezium_json. #4494

Configuration changes

The default batch query execution mode was changed from distributed to local. #4789

Assets

Run this version from Docker: docker run -it --pull=always -p 4566:4566 -p 5691:5691 ghcr.io/risingwavelabs/risingwave:v0.1.12 playground
Prebuilt library for Linux is not available in this release.
Source code (zip)
Source code (tar.gz)

v0.1.11

This version was released on July 29, 2022.

Main changes

SQL features

New SQL functions:
- overlay(): Replaces a substring. #3671
- generate_series(): Generates a series of values from the starting point to the ending point. #4030
- regexp_match(), regexp_matches(): Compares a string against a regular expression pattern and returns matched substrings. #3702 #4062
- string_agg (): Concatenates the values into a string. #3952 #4183
- current_database(): Returns the current database. #3650
New SQL commands:
- SHOW ALL: Lists all configuration parameters. Use SHOW parameter to show the value of a configuration parameter. #3694 #3664
- CREATE SINK: Sinks data to Kafka. #3923 #3682 #3674
- EXPLAIN TRACE: Traces each optimization stage of the optimizer. #3945
Support for lookup joins. Currently, lookup joins can only be performed in local query mode. To use lookup joins, users need to set the configuration parameter rw_batch_enable_lookup_join to true. #3859 #3763
An ORDER BY clause in the CREATE MATERIALIZED VIEW statement is allowed but not considered as part of the definition of the materialized view. It is only used in the initial creation of the materialized view. It is not used during refreshes. This is a behavior change due to the introduction of parallel table scans. #3670
Support for filter clauses on aggregate functions. #4114

Connectors

RisingWave can now sink data to Kafka topics in append-only mode and Debezium mode. #3923 #3682 #3674
Syntax change for CREATE SOURCE: A parameter name is no longer wrapped by single quotation marks. #3997. See the example:
- Old: CREATE SOURCE s1 WITH ( 'connector' = 'kafka', 'kafka.topic' = 'kafka_1_partition_topic', 'kafka.brokers' = '127.0.0.1:29092' ) ROW FORMAT json;
- New: CREATE SOURCE s WITH ( connector = 'kafka', kafka.topic = 'kafka_1_partition_topic', kafka.brokers = '127.0.0.1:29092' ) ROW FORMAT json;

Assets

Run this version from Docker:
run -it --pull=always -p 4566:4566 -p 5691:5691 ghcr.io/risingwavelabs/risingwave:v0.1.11 playground
Prebuilt library for Linux
Source code (zip)
Source code (tar.gz)

v0.1.10

This version was released on July 5, 2022.

Main changes

SQL features

SQL operators and functions

Support string concatenation operator ||. #3147
Support interval comparison. #3222
Support dividing intervals by integers, floats, or decimals. #3441
Intervals multiplying intervals by floats. #3641
Support more temporal operations. #3472
Support Common Table Expressions (CTEs) as input of time window functions. #3188
Add these new functions:
- concat() for concatenating strings #3091
- repeat() for repeating string #3148
- octet_length() and bit_length() for getting string length #3526
- Row() for constructing rows #2914 #3152
- pg_typeof() for getting data types of values #3494
- current_database() for getting the name of the current database in the session #3650
- approx_count_distinct() for distinct counting #3121
- unnest() for expanding nested tables to rows #3017
Support count(), min(), and max() functions on these data types: interval, timestamp, varchar, and date. #3069

SQL commands

Support EXPLAIN CREATE INDEX. #3229
Add cascade and restrict options in REVOKE commands. #3363
Expand the CREATE TABLE syntax to support creating append-only tables. #3058
Support the CREATE USER command and user authentication. #3074

Data types

Support implicit casts from single-quoted literals. #3487
Add string as an alias for data type varchar. #3094
Support string intervals. #3037

Database management

Add the default super user “postgres”. #3127
The default schema name is changed to “public” from “dev”. #3166

Connectors

Add random seed for the Datagen Source Connector. #3124

v0.1.17​

Main changes​

Administration​

SQL features​

Connectors​

Assets​

v0.1.16​

Main changes​

Administration​

SQL features​

Connectors​

Assets​

v0.1.15​

Main changes​

Installation and deployment​

SQL features​

Connectors​

Observability​

Assets​

v0.1.14​

Main changes​

SQL features​

Connectors​

Assets​

v0.1.13​

Main changes​

SQL features​

Connectors​

Assets​

v0.1.12​

Main changes​

SQL features​

Connectors​

Configuration changes​

Assets​

v0.1.11​

Main changes​

SQL features​

Connectors​

Assets​

v0.1.10​

Main changes​

SQL features​

SQL operators and functions​

SQL commands​

Data types​

Database management​

Connectors​

Assets​

Was this page helpful?

v0.1.17

Main changes

Administration

SQL features

Connectors

Assets

v0.1.16

Main changes

Administration

SQL features

Connectors

Assets

v0.1.15

Main changes

Installation and deployment

SQL features

Connectors

Observability

Assets

v0.1.14

Main changes

SQL features

Connectors

Assets

v0.1.13

Main changes

SQL features

Connectors

Assets

v0.1.12

Main changes

SQL features

Connectors

Configuration changes

Assets

v0.1.11

Main changes

SQL features

Connectors

Assets

v0.1.10

Main changes

SQL features

SQL operators and functions

SQL commands

Data types

Database management

Connectors

Assets