Syntax
alter_option depends on the operation you want to perform on the fragment.
Clauses
SET PARALLELISM
| Parameter or clause | Description |
|---|---|
| SET PARALLELISM | This clause controls the degree of parallelism for specific streaming fragments. This allows fine-grained control over fragment execution, enabling targeted scaling of individual fragments within a streaming job. |
| fragment_id | The ID of the fragment to modify. You can specify multiple fragment IDs separated by commas. To find fragment IDs, query the rw_fragment_parallelism system table. |
| parallelism_number | A fixed number (e.g., 1, 2, 3) that locks the fragment’s parallelism at that value. Setting it to 0 is equivalent to ADAPTIVE. |
| ADAPTIVE | Expands the fragment’s parallelism to all available units in the cluster. |
| DEFAULT | Resets the fragment’s parallelism to inherit from its parent streaming job’s parallelism setting. |
Example
SET BACKFILL_RATE_LIMIT
| Parameter or clause | Description |
|---|---|
| SET BACKFILL_RATE_LIMIT | This clause controls the rate limit for backfilling operations on the specified fragment. |
| fragment_id | The ID of the fragment to modify. Only a single fragment ID is supported for this operation. |
| rate_limit_number | The rate limit value in records per second. Set to 0 to pause backfilling. |
Example
See also
- System catalogs — View fragment information using
rw_fragment_parallelismandrw_fragments