Datadog Dashboards

vLLM Dashboard

Good 970 downloads0 views0 commentsRevision 1Created Converted from Grafana dashboard #25043 by mmontes11
How to import

In Datadog: Dashboards → New Dashboard → ⚙ Configure → Import dashboard JSON → paste this JSON.

Reactions

https://github.com/vllm-project/production-stack/blob/main/helm/dashboards/vllm-dashboard.json

vLLM Dashboard

Conversion quality

Good 97

Share of panels whose queries were translated without loss. Partial and unsupported panels keep the original PromQL in a note widget.

  • Native0
  • OpenMetrics14
  • Partial1
  • Unsupported0

Metrics without a native Datadog mapping

These metric names were kept in OpenMetrics naming. Adjust them if you collect with a native Datadog integration.

vllm:gpu_cache_usage_perc ×2vllm:healthy_pods_totalvllm:e2e_request_latency_seconds_sumvllm:e2e_request_latency_seconds_countvllm:e2e_request_latency_seconds_bucketvllm:current_qpsvllm:time_per_output_token_seconds_sumvllm:time_per_output_token_seconds_countvllm:time_to_first_token_seconds_bucketvllm:num_requests_runningvllm:num_requests_waitingvllm:gpu_prefix_cache_hits_totalvllm:gpu_prefix_cache_queries_totalvllm:num_requests_swappedrouter_cpu_usage_percentrouter_memory_usage_percentrouter_disk_usage_percent
Integrationsvllm_healthy_podsvllm_e2e_request_latency_secondsvllm_time_per_output_token_secondsvllm_time_to_first_token_secondsvllm_gpu_prefix_cache_hitsvllm_gpu_prefix_cache_queries

Revisions

  • Revision 1Converted from grafana.com revision 1Download JSON

Rate this dashboard

Sign in to rate.

0 comments

No comments yet.