Yandex Cloud Data Streams Trigger icon

Yandex Cloud Data Streams Trigger

Polls Yandex Cloud Data Streams for new records

Yandex Cloud Data Streams Trigger

AI-generated

Summary

Poll Yandex Cloud Data Streams for new records from specified shards according to configurable scheduling and iterator options.

Inputs

  • streamName (required) — The name or full resource path of the data stream to listen to, selectable by list or by specifying the full path.
  • pollTimes — Optional times at which the node should poll for new records (e.g., every minute, hour, day, or a custom cron expression).
  • pollingOptions — Options controlling how to iterate shards, including iterator type (latest, trim horizon, specific timestamp), shard iteration strategy (all shards, round robin, or specific shard), max records per poll, and related parameters.
  • options — Additional options such as whether to parse record data as JSON automatically and whether to include record metadata (shard ID, sequence number, partition key, approximate arrival timestamp) in the output.

Output shape

a list of records each as a JSON object, where the record data is either raw or parsed JSON, optionally including metadata fields depending on settings

The trigger outputs an array of records retrieved from one or more shards per polling cycle. If no new records are found, the trigger returns null. Pagination is handled internally by maintaining shard iterators. Records are fetched up to the configured max records per poll per shard.

Links

Discussion