convert a tencentpretrain llama model to huggingface?

[jamestch]

How to convert a tencentpretrain llama model to huggingface? can u share the script?
Thanks a lot!

[baketbek]

你有找到这个方法吗

[csho]

去scripts/ 文件夹下找convert_tencentpretrain_to_llama.py，用这个转换。
python convert_tencentpretrain_to_llama.py --input_model_path 输入模型路径/input_model.bin --output_model_path 输出模型路径/pytorch_model.bin --layers_num 32
7B的模型层数是32

[bmfire1]

https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/convert_llama_weights_to_hf.py