vllm-server
Deploy and manage vLLM for high-throughput LLM inference. Configure continuous batching, tensor parallelism, quantization, and OpenAI-compatible API endpoints for production LLM serving.
| Field | Value |
|---|---|
| Owner | sickn33 |
| Curator | Thomas Cherickal |
| Source | sickn33/agentic-awesome-skills |
| Repo stars | 49,710 |
| License | MIT |
| Repo last push | 2026-11-14 |
Links
- Roles: llm-engineer
- Source repo: sickn33/agentic-awesome-skills
- Same repo: advanced-evaluation, agent-evals, agent-evaluation, agent-evaluation-reporting, agent-observability, huggingface-lora-space-builder, llm-fine-tuning, trl-training
- Registry seed skills for this role: llm-engineer seed skills