From 3f2fb9167ec606780f200116c8b5237b550cda67 Mon Sep 17 00:00:00 2001 From: Hamid Shojanazeri <hamid.nazeri2010@gmail.com> Date: Mon, 28 Aug 2023 16:25:18 +0000 Subject: [PATCH] adding notes to model not supporting infilling --- docs/inference.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/inference.md b/docs/inference.md index 813e829d..ce56a2e8 100644 --- a/docs/inference.md +++ b/docs/inference.md @@ -50,7 +50,7 @@ python inference/chat_completion.py --model_name "PATH/TO/MODEL/7B/" --prompt_fi ``` **Code Llama** -Code llama was recently released with three flavors, base-model that support multiple programming languages, Python fine-tuned model and an instruction fine-tuned and aligned variation of Code Llama, please read more [here](https://ai.meta.com/blog/code-llama-large-language-model-coding/). Also note that the Python fine-tuned model is not training on infilling objective, hence can not be used for this use-case. +Code llama was recently released with three flavors, base-model that support multiple programming languages, Python fine-tuned model and an instruction fine-tuned and aligned variation of Code Llama, please read more [here](https://ai.meta.com/blog/code-llama-large-language-model-coding/). Also note that the Python fine-tuned model and 34B models are not trained on infilling objective, hence can not be used for this use-case. Find the scripts to run Code Llama [here](../inference/code-llama/), where there are two examples of running code completion and infilling. -- GitLab