Skip to content

Reduce the number of device allocations in the ORC writer #23433

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
rapids-bot merged 26 commits into from
Aug 12, 2026
+256 −97
Merged

Reduce the number of device allocations in the ORC writer #23433

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
c39becb
Reduce ORC writer device allocations via per-phase arenas
vuule Apr 30, 2026
b122f9f
Merge remote-tracking branch 'origin/main' into orc-writer-reduce-all…
vuule Jul 24, 2026
31ec8e2
Release the encoded arena as soon as the gather has consumed it
vuule Jul 27, 2026
681d9a4
Trim the arena comments now that the design is in the PR description
vuule Jul 27, 2026
3b57a99
Address review feedback on the encoded-data arenas
vuule Jul 27, 2026
e0f9dd9
Say why the arena regions are aligned, and check it
vuule Jul 27, 2026
fc05e8e
Cover the exactly-sized stream types in the uncompressed stripe test
vuule Jul 28, 2026
d905aef
Sweep compression in the decimal writer test instead of a new test
vuule Jul 28, 2026
9e7c5a0
Drop the pass-through float test as redundant
vuule Jul 28, 2026
d519992
Call the arena storage of a stripe stream an extent
vuule Jul 28, 2026
be3ca74
trim comments
vuule Jul 28, 2026
8bf6fb3
Replace transient_extents class with a flat vector viewed as host_2dspan
vuule Jul 28, 2026
6c57e10
misc cleanup
vuule Jul 28, 2026
18193b4
remove useless check
vuule Jul 28, 2026
82e424e
comment cleanup
vuule Jul 28, 2026
0b47b6b
Merge branch 'main' into orc-writer-reduce-allocations
vuule Jul 28, 2026
ff139af
Require the extent alignment to be a multiple of the codec alignment
vuule Jul 30, 2026
a86b485
Merge branch 'main' into orc-writer-reduce-allocations
vuule Jul 30, 2026
27724c0
Describe each stream extent with a struct instead of parallel vectors
vuule Aug 6, 2026
5cc2caa
dedup
vuule Aug 6, 2026
1151b23
bug fix
vuule Aug 7, 2026
d3905e5
zero size fix
vuule Aug 7, 2026
e9fb8b7
Merge branch 'main' into orc-writer-reduce-allocations
vuule Aug 7, 2026
0afac63
docs
vuule Aug 10, 2026
028b8d9
Merge branch 'main' into orc-writer-reduce-allocations
vuule Aug 10, 2026
0cb6f91
Merge branch 'main' into orc-writer-reduce-allocations
vuule Aug 11, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading