Skip to main content
GET
/
v1
/
metrics
/
live
Get Live Metrics
curl --request GET \
  --url https://api.example.com/v1/metrics/live
{
  "tokens_per_second": 123,
  "time_to_first_token": 123,
  "requests_per_second": 123,
  "total_tflops": 123
}

Response

200 - application/json

Successful Response

tokens_per_second
number | null
required

Tokens per second

time_to_first_token
number | null
required

Time to first token in seconds

requests_per_second
number | null
required

Requests per second

total_tflops
number | null
required

Total TFLOPS