Skip to main content
The TypeScript SDK and docs are currently in beta. Report issues on GitHub.
Information about a specific model endpoint

Example Usage

Fields

FieldTypeRequiredDescriptionExample
contextLengthnumber:heavy_check_mark:N/A
latencyLast30mmodels.PercentileStats:heavy_check_mark:Latency percentiles in milliseconds over the last 30 minutes. Latency measures time to first token. Only visible when authenticated with an API key or cookie; returns null for unauthenticated requests.{"p50": 25.5,"p75": 35.2,"p90": 48.7,"p99": 85.3}
maxCompletionTokensnumber:heavy_check_mark:N/A
maxPromptTokensnumber:heavy_check_mark:N/A
modelIdstring:heavy_check_mark:The unique identifier for the model (permaslug)openai/gpt-4
modelNamestring:heavy_check_mark:N/A
namestring:heavy_check_mark:N/A
pricingmodels.Pricing:heavy_check_mark:N/A
providerNamemodels.ProviderName:heavy_check_mark:N/AOpenAI
quantizationmodels.PublicEndpointQuantization:heavy_check_mark:N/Afp16
statusmodels.EndpointStatus:heavy_minus_sign:N/A0
supportedParametersmodels.Parameter[]:heavy_check_mark:N/A
supportsImplicitCachingboolean:heavy_check_mark:N/A
tagstring:heavy_check_mark:N/A
throughputLast30mmodels.PercentileStats:heavy_check_mark:N/A{"p50": 25.5,"p75": 35.2,"p90": 48.7,"p99": 85.3}
uptimeLast1dnumber:heavy_check_mark:Uptime percentage over the last 1 day, calculated as successful requests / (successful + error requests) * 100. Rate-limited requests are excluded. Returns null if insufficient data.
uptimeLast30mnumber:heavy_check_mark:N/A
uptimeLast5mnumber:heavy_check_mark:Uptime percentage over the last 5 minutes, calculated as successful requests / (successful + error requests) * 100. Rate-limited requests are excluded. Returns null if insufficient data.