onnx bench rework#18
Conversation
ab53bd6 to
13a165f
Compare
there were 2 onnx benches: * new one, uses criterion and various models * old one, used for onnx models profiling Those 2 guys had some shared logic, which is moved into `benchmarks/onnx-models/src/lib.rs`
13a165f to
b9f5ade
Compare
|
/bench |
ONNX CPU benchmarkGitHub-hosted runner signal, advisory only. Base and head are compared within the same architecture job.
Head op/kernel summary
Missing paired result(s): aarch64/gemm_relu_256x512x512, aarch64/mobilenet_v3_small_224, aarch64/resnet18_224, aarch64/small_conv_relu_64, aarch64/small_dw_pw_64, aarch64/small_gemm_relu_1x128, aarch64/small_residual_conv_64, aarch64/winograd_3x3_20x20_c256, aarch64/winograd_3x3_80x80_c64, aarch64/yolo11n_bus_640, aarch64/yolov8n_bus_640, x86_64/gemm_relu_256x512x512, x86_64/mobilenet_v3_small_224, x86_64/resnet18_224, x86_64/small_conv_relu_64, x86_64/small_dw_pw_64, x86_64/small_gemm_relu_1x128, x86_64/small_residual_conv_64, x86_64/winograd_3x3_20x20_c256, x86_64/winograd_3x3_80x80_c64, x86_64/yolo11n_bus_640, x86_64/yolov8n_bus_640 Raw JSON artifacts include per-run min/p50/avg/p95/p99, optimized node counts, graph-cost summaries, yscv CPU dispatch report, and per-node runner profile summaries. |
|
ig we need to merge this for bench to work |
there were 2 onnx benches:
Those 2 guys had some shared logic, which has been moved into
benchmarks/onnx-models/src/lib.rsupdated CI as well
New commands to run benches: