Feature Description
support vllm inference for the rotation + mxfp4 quantized model
Motivation and Use Case
support vllm inference for the rotation + mxfp4 quantized model
Alternatives Considered
No response
Definition of Done
No response
Additional Context
No response
Feature Description
support vllm inference for the rotation + mxfp4 quantized model
Motivation and Use Case
support vllm inference for the rotation + mxfp4 quantized model
Alternatives Considered
No response
Definition of Done
No response
Additional Context
No response