Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

Llama Recipes
- Activity
- Members
- Labels
- Issues
- Issue boards
- Milestones
- Iterations
- Wiki
- Environments
- Terraform modules
- Incidents
- Service Desk

Snippets Groups Projects

2828fd02

Commit 2828fd02 authored 9 months ago by Chester Hu Committed by Suraj Subramanian 9 months ago

Downloads
- Patches
- Plain Diff

Update on-prem vllm scripts and readme

parent 9c8cad25

No related branches found

No related tags found

No related merge requests found

Changes 4

Hide whitespace changes

Inline Side-by-side

Showing

recipes/benchmarks/inference_throughput/on-prem/README.md 2 additions, 0 deletions

recipes/benchmarks/inference_throughput/on-prem/README.md
recipes/benchmarks/inference_throughput/on-prem/vllm/chat_vllm_benchmark.py 1 addition, 2 deletions

.../inference_throughput/on-prem/vllm/chat_vllm_benchmark.py
recipes/benchmarks/inference_throughput/on-prem/vllm/parameters.json 1 addition, 1 deletion

...chmarks/inference_throughput/on-prem/vllm/parameters.json
recipes/benchmarks/inference_throughput/on-prem/vllm/pretrained_vllm_benchmark.py 1 addition, 1 deletion

...ence_throughput/on-prem/vllm/pretrained_vllm_benchmark.py

with 5 additions and 4 deletions

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment

Strive to be the person your dogs believe you are