LoRA Adapters

​

Prerequisites

1. A LoRA adapter model hosted on Hugging Face
2. A base model that supports LoRA at DeepInfra (see supported base models in the upload form)
3. A Hugging Face token if your LoRA adapter is private
4. A DeepInfra account and API key

​

Deploy a LoRA model

1. Go to Dashboard
2. Click New Deployment
3. Click the LoRA Model tab
4. Fill in the form:
   • LoRA model name — name used to reference this deployment
   • Hugging Face Model Name — path to your LoRA adapter on Hugging Face
   • Hugging Face Token — optional, required for private repos

​

Example

1. Go to Dashboard → New Deployment → LoRA Model
2. Fill in:
   • LoRA model name: asdf/lora-example
   • Hugging Face Model Name: askardeepinfra/llama-3.1-8B-rank-32-example-lora
3. Click Upload

​

Inference

curl "https://api.deepinfra.com/v1/openai/chat/completions" \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $DEEPINFRA_API_KEY" \
  -d '{
      "model": "asdf/lora-example",
      "messages": [
        {
          "role": "user",
          "content": "Hello!"
        }
      ]
    }'