Datadog Dashboards

KServe vLLM

Fair 720 downloads0 views0 commentsRevision 1Created Converted from Grafana dashboard #23856 by tessadpl
How to import

In Datadog: Dashboards → New Dashboard → ⚙ Configure → Import dashboard JSON → paste this JSON.

Reactions

Custom KServe dahsboard to use with vLLM backend. All the metrics used start by "vllm:".

Conversion quality

Fair 72

Share of panels whose queries were translated without loss. Partial and unsupported panels keep the original PromQL in a note widget.

  • Native0
  • OpenMetrics7
  • Partial9
  • Unsupported0

Metrics without a native Datadog mapping

These metric names were kept in OpenMetrics naming. Adjust them if you collect with a native Datadog integration.

vllm:e2e_request_latency_seconds_bucket ×6vllm:request_prefill_time_seconds_bucket ×6vllm:time_to_first_token_seconds_bucket ×6vllm:request_queue_time_seconds_bucket ×6vllm:time_per_output_token_seconds_bucket ×3vllm:gpu_cache_usage_percvllm:num_requests_runningvllm:num_requests_waitingvllm:time_per_output_token_seconds_countvllm:request_generation_tokens_countvllm:request_max_num_generation_tokens_sumvllm:request_max_num_generation_tokens_countvllm:request_success_totalvllm:request_inference_time_seconds_count
Integrationsvllm_time_per_output_token_secondsvllm_request_generation_tokensvllm_request_max_num_generation_tokensvllm_request_successvllm_request_inference_time_seconds

Revisions

  • Revision 1Converted from grafana.com revision 1Download JSON

Rate this dashboard

Sign in to rate.

0 comments

No comments yet.