[feat](csv) Distribute CSV reads and writes - #543
Draft
kaka11chen wants to merge 1 commit into
Draft
kaka11chen wants to merge 1 commit into
kaka11chen wants to merge 1 commit into
Conversation
This was referenced Aug 22, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
compression, non-UTF-8 encodings,parallel = false,skip_rows, andstore_rejects); this change intentionally adds no compatibility path or local fallback.Related issue
N/A
Documentation impact
AstroVela/vane-website.The change extends the existing Ray runner implementation without adding a new public API. Its strict unsupported-option behavior is covered by tests and documented above.
Validation
VANE_NATIVE_BUILD_JOBS=8andSKBUILD_BUILD_DIR=$PWD/build/python-release.scripts/format workspace --from-ref upstream/main --checkgit diff --check upstream/mainserialize_nodes.cppinto a temporary directory and verified an exact diff against the checked-in generated source.scripts/run_installed_pytest.sh tests/fast/test_ray_relation_to_distributed_plan.py -q: 12 passed.scripts/run_installed_pytest.sh tests/fast/test_ray_e2e_serialization.py -q: 10 passed.scripts/run_installed_pytest.sh tests/fast/test_ray_result_contract.py -q: 224 passed.scripts/run_native_tests.sh "test/sql/copy/return_stats.test" -s: 332 assertions in 1 test case passed.scripts/run_release_tests.sh: passed; Ray shard 14 passed, 525 deselected.scripts/run_fast_tests.sh: non-Ray shard passed (5,972 passed, 622 skipped, 132 deselected, 7 xfailed, 1 xpassed); all new CSV Ray tests passed. The shared-Ray shard retained 15 unrelated generic Ray failures, and representative failures reproduced unchanged in a pristineupstream/mainworktree on the same host.Checklist
licenses and are recorded where required.
weights, or build artifacts are included.
and untrusted input have been considered.
changes passed relevant checks.
No new dependencies, copied code, model assets, or datasets are introduced.