[WIP]Feature/warp tracing - #7
Open
frlai wants to merge 39 commits into
Open
Conversation
frlai
force-pushed
the
feature/warp_tracing
branch
from
June 26, 2026 17:56
67d95f1 to
b83ce24
Compare
frlai
force-pushed
the
feature/warp_tracing
branch
from
July 8, 2026 15:35
ffbc2a2 to
17f8bc8
Compare
frlai
force-pushed
the
feature/warp_tracing
branch
from
July 20, 2026 23:58
5537959 to
cb014d7
Compare
…alls to warp functions
…matic i/o detection for node based operators
…utomatic used output detection and masking
…be registered as part of onnx and torchscript via the script path, export to onnx seems to work
…doesn't support jit-trace, onnx-torchscript or jit-script.
…aph capture into the onnx file
updated input signature to use Tensor[] inputs, str runtime_metadata, Tensor bundle. all metadata will be stored inside runtime_metadata. this includes the mask and i/o configs todo: need to prune runtime_metadata for uneeded fields.
Squashed from two_pass_apic_capture: - implements two pass tracing - force ptx sm 75 - updated to use single pass, refactored code ownership
…on and broadened support for automatic reentry validation
…ion inside the warp op
…stricter hierarchy, fixed bug with seg fault on reentry because loss of buffer creation ownership still need to fix bug with incorrect number of i/o at the boundry
…orch reuse cuda memory so torch memory creation functions sill trip the cupti oracle
…eaned up strcuture for warp_op state detection
…rrors still remaining
frlai
force-pushed
the
feature/warp_tracing
branch
from
July 26, 2026 18:39
a2b56d6 to
3dafdbf
Compare
…twined node tracing self-seperate automatically
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds experimental NVIDIA Warp tracing/export support to LEAPP, including explicit
annotate.warp_op(...)regions, automatic Warp segment detection, APIC capture replay, and ONNX/ExportedProgram export support through aleapp::warp_runnercustom operator.Details
leapp::warp_runnerand lowers it tocom.nvidia.warp::WrpRunnerfor ONNX exports.InferenceManagersmoke-test guidance.Notes
onnxruntime-gpu, CUDA EP availability, andLEAPP_WARP_ONNX_CUSTOM_OP_LIBRARYpointing at a custom op built against the same ONNX Runtime version in the environment.