Skip to content

refine customized dataset code #1093

Description

@wenhuach21

1 If the user’s dataset does not contain enough sequences of the target length, sequences shorter than the target should be padded.

2 The attention_mask should be part of the dataset, not an attribute of AutoRound.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions