Skip to content

feat(transform): Add UtilityControl Transform for Generating Ctrl Messages#175

Merged
jshlbrd merged 3 commits intomainfrom
jshlbrd/feat/tf-util-ctrl
May 21, 2024
Merged

feat(transform): Add UtilityControl Transform for Generating Ctrl Messages#175
jshlbrd merged 3 commits intomainfrom
jshlbrd/feat/tf-util-ctrl

Conversation

@jshlbrd
Copy link
Contributor

@jshlbrd jshlbrd commented May 20, 2024

Description

  • Adds the utility_control transform for generating control (ctrl) messages
  • Updates aggregate transforms to skip empty results

Motivation and Context

This provides an option to manage how data flows through the system, which is otherwise impossible without creating or modifying the application code. Triggering ctrl messages is based on the amount of data passed through the system, which relies on the commonly used batching / aggregation methods.

This also fixes a bug where some aggregate transforms can create empty results.

How Has This Been Tested?

Added an example for the new transform.

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

  • My code follows the code style of this project.
  • My change requires a change to the documentation.
  • I have updated the documentation accordingly.

@jshlbrd jshlbrd marked this pull request as ready for review May 20, 2024 14:47
@jshlbrd jshlbrd requested a review from a team as a code owner May 20, 2024 14:47
@jshlbrd jshlbrd merged commit 93b64cd into main May 21, 2024
@jshlbrd jshlbrd deleted the jshlbrd/feat/tf-util-ctrl branch May 21, 2024 23:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants