From bcfafd9a0b58a5ed069a2b9e73efb61f61d4e8b4 Mon Sep 17 00:00:00 2001 From: Hamid Shojanazeri <hamid.nazeri2010@gmail.com> Date: Tue, 29 Aug 2023 23:44:44 +0000 Subject: [PATCH] adding notes how to get the HF models --- README.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/README.md b/README.md index be2b4bec..8fbba0f6 100644 --- a/README.md +++ b/README.md @@ -46,6 +46,10 @@ pip install -r requirements.txt **Please note that the above requirements.txt will install PyTorch 2.0.1 version, in case you want to run FSDP + PEFT, please make sure to install PyTorch nightlies.** +# Where to find the models? + +You can find llama v2 models on HuggingFace hub [here](https://huggingface.co/meta-llama), where models with `hf` in the name are already converted to HuggingFace checkpoints so no further conversion is needed. The conversion step below is only for original model weights from Meta that are hosted on HuggingFace model hub as well. + # Model conversion to Hugging Face The recipes and notebooks in this folder are using the Llama 2 model definition provided by Hugging Face's transformers library. -- GitLab