Problem Description
low_gpu_mem_usage not supported in AutoRoundModifier, maybe other args missing as well. Please enhance the feature gap.
Some model quantize will be OOM on XPU without this config.
Reproduction Steps
low_gpu_mem_usage=True
Environment Information
No response
Error Logs
Additional Context
No response
Problem Description
low_gpu_mem_usagenot supported inAutoRoundModifier, maybe other args missing as well. Please enhance the feature gap.Some model quantize will be OOM on XPU without this config.
Reproduction Steps
low_gpu_mem_usage=True
Environment Information
No response
Error Logs
Additional Context
No response