Skip to main content

Syntax

alter_option depends on the operation you want to perform on the fragment.

Clauses

SET PARALLELISM

Parameter or clauseDescription
SET PARALLELISMThis clause controls the degree of parallelism for specific streaming fragments. This allows fine-grained control over fragment execution, enabling targeted scaling of individual fragments within a streaming job.
fragment_idThe ID of the fragment to modify. You can specify multiple fragment IDs separated by commas. To find fragment IDs, query the rw_fragment_parallelism system table.
parallelism_numberA fixed number (e.g., 1, 2, 3) that locks the fragment’s parallelism at that value. Setting it to 0 is equivalent to ADAPTIVE.
ADAPTIVEExpands the fragment’s parallelism to all available units in the cluster.
DEFAULTResets the fragment’s parallelism to inherit from its parent streaming job’s parallelism setting.
Example

SET BACKFILL_RATE_LIMIT

Parameter or clauseDescription
SET BACKFILL_RATE_LIMITThis clause controls the rate limit for backfilling operations on the specified fragment.
fragment_idThe ID of the fragment to modify. Only a single fragment ID is supported for this operation.
rate_limit_numberThe rate limit value in records per second. Set to 0 to pause backfilling.
Example

See also

  • System catalogs — View fragment information using rw_fragment_parallelism and rw_fragments