https://github.com/OpenLMLab/OpenChineseLLaMA/blob/main/tools/llama_colossalai.py#L1111C6-L1111C6 这里附近,需要加上对inv_freq的映射,否则转出的模型会出现如下错误: <img width="1213" alt="image" src="https://github.com/OpenLMLab/OpenChineseLLaMA/assets/12124621/05ce48ff-51e7-4c14-ae60-1f2efeca4beb">
https://github.com/OpenLMLab/OpenChineseLLaMA/blob/main/tools/llama_colossalai.py#L1111C6-L1111C6

这里附近,需要加上对inv_freq的映射,否则转出的模型会出现如下错误: