From 54269639de7a35ac2f7edceb255af7bacd8bc523 Mon Sep 17 00:00:00 2001
From: Himanshu Shukla <himanshushukla.shukla3@gmail.com>
Date: Tue, 19 Nov 2024 12:21:00 +0530
Subject: [PATCH] added inference instructions in README for easy inferencing
---
recipes/quickstart/inference/local_inference/README.md | 5 +----
1 file changed, 1 insertion(+), 4 deletions(-)
diff --git a/recipes/quickstart/inference/local_inference/README.md b/recipes/quickstart/inference/local_inference/README.md
index 3a1b0590..8e27304a 100644
--- a/recipes/quickstart/inference/local_inference/README.md
+++ b/recipes/quickstart/inference/local_inference/README.md
@@ -13,7 +13,7 @@
### Features in
`multi_modal_infer.py`
-All functionality has been consolidated into a single file with three main modes:
+All functionality has been consolidated into a single file with three main modes, use `huggingface-cli login`:
### Steps to run are given below:
1. **Basic Inference**
```bash
@@ -21,14 +21,12 @@ python multi_modal_infer.py \
--image_path "path/to/image.jpg" \
--prompt_text "Describe this image" \
--model_name "meta-llama/Llama-3.2-11B-Vision-Instruct" \
- --hf_token "your_token"
```
2. **Gradio UI Mode**
```bash
python multi_modal_infer.py \
--model_name "meta-llama/Llama-3.2-11B-Vision-Instruct" \
- --hf_token "your_token" \
--gradio_ui
```
@@ -38,7 +36,6 @@ python multi_modal_infer.py \
--image_path "path/to/image.jpg" \
--prompt_text "Describe this image" \
--model_name "meta-llama/Llama-3.2-11B-Vision-Instruct" \
- --hf_token "your_token" \
--finetuning_path "path/to/lora/weights"
```
--
GitLab