[nlp] RuntimeError: Llama is supposed to be a BPE model!报错解决

本文主要是介绍[nlp] RuntimeError: Llama is supposed to be a BPE model!报错解决，希望对大家解决编程问题提供一定的参考价值，需要的开发者们随着小编来一起学习吧！

# tokenizer = AutoTokenizer.from_pretrained(BASE_MODEL)

改成这个legacy=False, use_fast=False：

tokenizer = AutoTokenizer.from_pretrained(BASE_MODEL, legacy=False, use_fast=False)

这篇关于[nlp] RuntimeError: Llama is supposed to be a BPE model!报错解决的文章就介绍到这儿，希望我们推荐的文章对编程师们有所帮助！

---