llama.cpp Monitoring

Good 900 downloads0 views0 commentsRevision 1Created Jul 25, 2026Converted from Grafana dashboard #25591 by Paulo Castro

How to import

In Datadog: Dashboards → New Dashboard → ⚙ Configure → Import dashboard JSON → paste this JSON.

Reactions

llama.cpp LLM server metrics

Conversion quality

Good 90

Share of panels whose queries were translated without loss. Partial and unsupported panels keep the original PromQL in a note widget.

Native0
OpenMetrics17
Partial4
Unsupported0

Metrics without a native Datadog mapping

These metric names were kept in OpenMetrics naming. Adjust them if you collect with a native Datadog integration.

llamacpp:tokens_predicted_total ×4llamacpp:prompt_seconds_total ×3llamacpp:prompt_tokens_total ×3llamacpp:tokens_predicted_seconds_total ×3llamacpp:n_decode_total ×3llamacpp:requests_processing ×2llamacpp:requests_deferred ×2llamacpp:prompt_tokens_seconds ×2llamacpp:predicted_tokens_seconds ×2llamacpp:n_busy_slots_per_decode ×2llamacpp:n_tokens_max

Tagsllama.cpp llamacpp inference llm web servers

Integrationsllamacpp_prompt_seconds llamacpp_prompt_tokens llamacpp_tokens_predicted_seconds llamacpp_tokens_predicted llamacpp_n_decode

Revisions

Revision 1Sep 3, 2026, 5:33 AMConverted from grafana.com revision 1Download JSON

Rate this dashboard

0 comments

No comments yet.