Skip to content
Snippets Groups Projects
Commit 07991603 authored by sekyonda's avatar sekyonda
Browse files

Update inference.md

parent eb2ed73b
No related branches found
No related tags found
No related merge requests found
......@@ -31,7 +31,7 @@ inference/samsum_prompt.txt
The inference folder also includes a chat completion example, that adds built-in safety features in fine-tuned models to the prompt tokens. To run the example:
```bash
python chat_completion.py --model_name "PATH/TO/MODEL/7B/" --prompt_file chats.json --quantization --use_auditnlg
python inference/chat_completion.py --model_name "PATH/TO/MODEL/7B/" --prompt_file chats.json --quantization --use_auditnlg
```
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment