Skip to content
Snippets Groups Projects
Unverified Commit 88cc4192 authored by Haotian Zhang's avatar Haotian Zhang Committed by GitHub
Browse files

[WIP] Update MM docs with image to image retrieval and new models (#9144)


Update MM docs

Co-authored-by: default avatarhaotian zhang <haotianzhang@haotians-MacBook-Pro-3.local>
parent 01b59e48
Branches
Tags
No related merge requests found
......@@ -125,6 +125,8 @@ These notebooks serve as examples how to leverage and integrate Multi-Modal LLM
| [Fuyu-8B](/examples/multi_modal/replicate_multi_modal.ipynb)<br>(replicate) | ✅ | 🛑 | 🛑 | ✅ |
| [ImageBind<br>](https://imagebind.metademolab.com/)[To integrate] | 🛑 | 🛑 | ✅ | 🛑 |
| [MiniGPT-4<br>](/examples/multi_modal/replicate_multi_modal.ipynb) | ✅ | 🛑 | 🛑 | ✅ |
| [CogVLM<br>](https://github.com/THUDM/CogVLM)[To integrate] | ✅ | 🛑 | 🛑 | ✅ |
| [Qwen-VL<br>](https://arxiv.org/abs/2308.12966)[To integrate] | ✅ | 🛑 | 🛑 | ✅ |
### Multi Modal Vector Stores
......
......@@ -23,6 +23,7 @@ maxdepth: 1
---
/examples/multi_modal/gpt4v_multi_modal_retrieval.ipynb
Multi-modal retrieval with CLIP </examples/multi_modal/multi_modal_retrieval.ipynb>
Image to Image Retrieval </examples/multi_modal/image_to_image_retrieval.ipynb>
```
### Retrieval-Augmented Image Captioning
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment