Skip to content

[data] Set default actor pool scale up threshold to 1.75#59512

Merged
alexeykudinkin merged 3 commits intoray-project:masterfrom
iamjustinhsu:jhsu/lower-actor-util
Dec 19, 2025
Merged

[data] Set default actor pool scale up threshold to 1.75#59512
alexeykudinkin merged 3 commits intoray-project:masterfrom
iamjustinhsu:jhsu/lower-actor-util

Conversation

@iamjustinhsu
Copy link
Contributor

Description

Currently, we actor pool util is calculated as the following:

  • max_tasks_in_flight / (num_actors_running * max_concurrency)

Since max_tasks_in_flight_per_actor = 2 * max_concurrency and because The default value for scaling up RAY_DATA_DEFAULT_ACTOR_POOL_UTIL_UPSCALING_THRESHOLD is 2.0, the only way for the actor pool util to reach 200% is if the actor pool is fully saturated.

Related issues

None

Additional information

None

Signed-off-by: iamjustinhsu <jhsu@anyscale.com>
@iamjustinhsu iamjustinhsu requested a review from a team as a code owner December 17, 2025 19:39
Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request adjusts the default actor pool upscaling threshold from 2.0 to 1.75. As detailed in the description, this allows the actor pool to scale up before it is fully saturated, which should improve the responsiveness of autoscaling and help prevent performance bottlenecks. The change is a simple modification of a default value and is implemented correctly. The surrounding logic, including validation checks for this threshold, appears to handle this new default value appropriately. The change looks good.

@iamjustinhsu iamjustinhsu added the go add ONLY when ready to merge, run all tests label Dec 17, 2025
Signed-off-by: iamjustinhsu <jhsu@anyscale.com>
@alexeykudinkin alexeykudinkin enabled auto-merge (squash) December 17, 2025 23:55
@ray-gardener ray-gardener bot added the data Ray Data-related issues label Dec 18, 2025
Signed-off-by: iamjustinhsu <jhsu@anyscale.com>
@github-actions github-actions bot disabled auto-merge December 18, 2025 17:41
@alexeykudinkin alexeykudinkin merged commit 20aa3f6 into ray-project:master Dec 19, 2025
6 checks passed
@iamjustinhsu iamjustinhsu deleted the jhsu/lower-actor-util branch December 19, 2025 18:21
Yicheng-Lu-llll pushed a commit to Yicheng-Lu-llll/ray that referenced this pull request Dec 22, 2025
…#59512)

## Description
Currently, we actor pool util is calculated as the following:

- `max_tasks_in_flight / (num_actors_running * max_concurrency)`

Since `max_tasks_in_flight_per_actor = 2 * max_concurrency` and because
The default value for scaling up
`RAY_DATA_DEFAULT_ACTOR_POOL_UTIL_UPSCALING_THRESHOLD` is 2.0, the only
way for the actor pool util to reach 200% is if the actor pool is fully
saturated.

## Related issues
None

## Additional information
None

---------

Signed-off-by: iamjustinhsu <jhsu@anyscale.com>
lee1258561 pushed a commit to pinterest/ray that referenced this pull request Feb 3, 2026
…#59512)

## Description
Currently, we actor pool util is calculated as the following:

- `max_tasks_in_flight / (num_actors_running * max_concurrency)`

Since `max_tasks_in_flight_per_actor = 2 * max_concurrency` and because
The default value for scaling up
`RAY_DATA_DEFAULT_ACTOR_POOL_UTIL_UPSCALING_THRESHOLD` is 2.0, the only
way for the actor pool util to reach 200% is if the actor pool is fully
saturated.

## Related issues
None

## Additional information
None

---------

Signed-off-by: iamjustinhsu <jhsu@anyscale.com>
peterxcli pushed a commit to peterxcli/ray that referenced this pull request Feb 25, 2026
…#59512)

## Description
Currently, we actor pool util is calculated as the following:

- `max_tasks_in_flight / (num_actors_running * max_concurrency)`

Since `max_tasks_in_flight_per_actor = 2 * max_concurrency` and because
The default value for scaling up
`RAY_DATA_DEFAULT_ACTOR_POOL_UTIL_UPSCALING_THRESHOLD` is 2.0, the only
way for the actor pool util to reach 200% is if the actor pool is fully
saturated.

## Related issues
None

## Additional information
None

---------

Signed-off-by: iamjustinhsu <jhsu@anyscale.com>
Signed-off-by: peterxcli <peterxcli@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

data Ray Data-related issues go add ONLY when ready to merge, run all tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants