Skip to main content
GET
Deploy Llm Presets

Authorizations

Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Headers

xi-api-key
string | null
x-api-key
string | null

Query Parameters

hf_repo_id
string
required
gpu
enum<string> | null
Available options:
L4-24GB,
L40S-48GB,
A100-80GB,
H100-80GB,
H200-141GB,
B200-180GB,
B300-270GB,
RTXPRO6000-96GB,
other
engine
string | null
source
string | null

Response

Successful Response

id
string
required

Preset id.

gpu_configs
string[]
required

Allowed Nx configs.

source
string
default:deepinfra

Config source.

engine
string
default:vllm

Inference engine.

standard_args
StandardArgs · object

Engine tuning knobs.

extra_args
string[] | null

Raw engine flags; vLLM recipes only.

label
string
default:""

Short display name (e.g. "Throughput-optimized").