Skip to content

[Data] Support SaveMode for more write operations#57946

Merged
bveeramani merged 1 commit intoray-project:masterfrom
kyuds:data-save-mode
Oct 21, 2025
Merged

[Data] Support SaveMode for more write operations#57946
bveeramani merged 1 commit intoray-project:masterfrom
kyuds:data-save-mode

Conversation

@kyuds
Copy link
Member

@kyuds kyuds commented Oct 21, 2025

Description

See #57924

Related issues

Fixes #57924

Additional information

  • Verify by manual testing -> confirmed with example using write_numpy

Signed-off-by: kyuds <kyuseung1016@gmail.com>
@kyuds kyuds requested a review from a team as a code owner October 21, 2025 07:26
Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request correctly extends SaveMode support to write_tfrecords, write_webdataset, and write_numpy operations by passing the mode parameter to their respective datasinks. The implementation is straightforward and consistent with existing write operations in the dataset API. My main feedback is the lack of automated tests for this new functionality. While the PR description mentions manual verification, adding automated tests is crucial for long-term maintainability and to prevent regressions. I've added a specific comment regarding this.

@kyuds
Copy link
Member Author

kyuds commented Oct 21, 2025

@bveeramani PTAL! Thank you in advance!

@ray-gardener ray-gardener bot added data Ray Data-related issues community-contribution Contributed by the community labels Oct 21, 2025
@bveeramani bveeramani enabled auto-merge (squash) October 21, 2025 17:29
@github-actions github-actions bot added the go add ONLY when ready to merge, run all tests label Oct 21, 2025
@bveeramani bveeramani merged commit 48a8e79 into ray-project:master Oct 21, 2025
7 checks passed
@kyuds kyuds deleted the data-save-mode branch October 22, 2025 00:15
elliot-barn pushed a commit that referenced this pull request Oct 23, 2025
## Description

See  #57924

## Related issues
Fixes #57924

## Additional information
- [x] Verify by manual testing -> confirmed with example using
`write_numpy`

Signed-off-by: kyuds <kyuseung1016@gmail.com>
Signed-off-by: elliot-barn <elliot.barnwell@anyscale.com>
landscapepainter pushed a commit to landscapepainter/ray that referenced this pull request Nov 17, 2025
## Description

See  ray-project#57924

## Related issues
Fixes ray-project#57924

## Additional information
- [x] Verify by manual testing -> confirmed with example using
`write_numpy`

Signed-off-by: kyuds <kyuseung1016@gmail.com>
Aydin-ab pushed a commit to Aydin-ab/ray-aydin that referenced this pull request Nov 19, 2025
## Description

See  ray-project#57924

## Related issues
Fixes ray-project#57924

## Additional information
- [x] Verify by manual testing -> confirmed with example using
`write_numpy`

Signed-off-by: kyuds <kyuseung1016@gmail.com>
Signed-off-by: Aydin Abiar <aydin@anyscale.com>
Future-Outlier pushed a commit to Future-Outlier/ray that referenced this pull request Dec 7, 2025
## Description

See  ray-project#57924

## Related issues
Fixes ray-project#57924

## Additional information
- [x] Verify by manual testing -> confirmed with example using
`write_numpy`

Signed-off-by: kyuds <kyuseung1016@gmail.com>
Signed-off-by: Future-Outlier <eric901201@gmail.com>
Blaze-DSP pushed a commit to Blaze-DSP/ray that referenced this pull request Dec 18, 2025
## Description

See  ray-project#57924

## Related issues
Fixes ray-project#57924

## Additional information
- [x] Verify by manual testing -> confirmed with example using
`write_numpy`

Signed-off-by: kyuds <kyuseung1016@gmail.com>
peterxcli pushed a commit to peterxcli/ray that referenced this pull request Feb 25, 2026
## Description

See  ray-project#57924

## Related issues
Fixes ray-project#57924

## Additional information
- [x] Verify by manual testing -> confirmed with example using
`write_numpy`

Signed-off-by: kyuds <kyuseung1016@gmail.com>
Signed-off-by: peterxcli <peterxcli@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

community-contribution Contributed by the community data Ray Data-related issues go add ONLY when ready to merge, run all tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Data] SaveMode parameter non-functional in write_numpy(), write_webdataset(), and write_tfrecords()

2 participants