Skip to content

[Feature gap][LLMC]: missing args #1855

Description

@chensuyue

Problem Description

low_gpu_mem_usage not supported in AutoRoundModifier, maybe other args missing as well. Please enhance the feature gap.
Some model quantize will be OOM on XPU without this config.

Reproduction Steps

low_gpu_mem_usage=True

Environment Information

No response

Error Logs

Additional Context

No response

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions