Skip to content
Snippets Groups Projects
Commit 54269639 authored by Himanshu Shukla's avatar Himanshu Shukla
Browse files

added inference instructions in README for easy inferencing

parent 3ba4b64e
No related branches found
No related tags found
No related merge requests found
...@@ -13,7 +13,7 @@ ...@@ -13,7 +13,7 @@
### Features in ### Features in
`multi_modal_infer.py` `multi_modal_infer.py`
All functionality has been consolidated into a single file with three main modes: All functionality has been consolidated into a single file with three main modes, use `huggingface-cli login`:
### Steps to run are given below: ### Steps to run are given below:
1. **Basic Inference** 1. **Basic Inference**
```bash ```bash
...@@ -21,14 +21,12 @@ python multi_modal_infer.py \ ...@@ -21,14 +21,12 @@ python multi_modal_infer.py \
--image_path "path/to/image.jpg" \ --image_path "path/to/image.jpg" \
--prompt_text "Describe this image" \ --prompt_text "Describe this image" \
--model_name "meta-llama/Llama-3.2-11B-Vision-Instruct" \ --model_name "meta-llama/Llama-3.2-11B-Vision-Instruct" \
--hf_token "your_token"
``` ```
2. **Gradio UI Mode** 2. **Gradio UI Mode**
```bash ```bash
python multi_modal_infer.py \ python multi_modal_infer.py \
--model_name "meta-llama/Llama-3.2-11B-Vision-Instruct" \ --model_name "meta-llama/Llama-3.2-11B-Vision-Instruct" \
--hf_token "your_token" \
--gradio_ui --gradio_ui
``` ```
...@@ -38,7 +36,6 @@ python multi_modal_infer.py \ ...@@ -38,7 +36,6 @@ python multi_modal_infer.py \
--image_path "path/to/image.jpg" \ --image_path "path/to/image.jpg" \
--prompt_text "Describe this image" \ --prompt_text "Describe this image" \
--model_name "meta-llama/Llama-3.2-11B-Vision-Instruct" \ --model_name "meta-llama/Llama-3.2-11B-Vision-Instruct" \
--hf_token "your_token" \
--finetuning_path "path/to/lora/weights" --finetuning_path "path/to/lora/weights"
``` ```
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment