This message was deleted.
# ask-for-helps
Slackbot
08/25/2023, 10:01 PMThis message was deleted.
c
Chaoyu
08/25/2023, 10:26 PMAh this is due to missing the required hugging face token for downloading the model
Chaoyu
08/25/2023, 10:26 PMThere was a bug in the error handing of this case
Chaoyu
08/25/2023, 10:27 PMYou will need to login huggingface hub cli and request access llama 2 access first, and then the command should run
y
Yiqing Wang
08/25/2023, 10:28 PMOh I see. One more question, it returns the following error for
TheBloke/Llama-2-13B-chat-GPTQ Copy code
self.quantization_config.to_dict()
AttributeError: 'NoneType' object has no attribute 'to_dict'Yiqing Wang
08/25/2023, 10:29 PMDo we know how to resolve this? I saw from some chats that this model is supported. Not sure if we need to install anything more?
a
Aaron Pham
08/25/2023, 10:39 PMI will need to update the gptq branch to the new api from transformers
Aaron Pham
08/25/2023, 10:39 PMWill work on this later td
y
Yiqing Wang
08/25/2023, 10:39 PMOh I see, thanks!
2 Views