This example demonstrates how to deploy LLMs with dstack and vllm.
See the full tutorial at dstack.ai/examples/vllm.
This repository was archived by the owner on Aug 4, 2024. It is now read-only.
| Name | Name | Last commit date | ||
|---|---|---|---|---|
parent directory.. | ||||
This example demonstrates how to deploy LLMs with dstack and vllm.
See the full tutorial at dstack.ai/examples/vllm.