Datadog Dashboards

Dashboards

2 results
Filters apply instantly
NamePopularityAuthorQualityModified
LLM Simulation - vLLM Serving Overviewllmvllmsimulation

vLLM serving overview: first-token and inter-token latency, throughput, queue depth, KV cache, prefix-cache reuse and a TTFT error budget, every panel by (model_name). V1 metric names; several panels need the llm:* recording rules.

0
0
ChrisAdkinGood
GPU Simulation - DCGM Overviewgpudcgmsimulation

NVIDIA GPU overview from DCGM metrics: utilisation, framebuffer memory, temperature and power, one series per GPU. Works against a real dcgm-exporter unchanged; temperature and power ship as recording rules.

0
0
ChrisAdkinGood