Skip to main content
The Models page manages Base Models, which are the starting point for training, and LoRA Models, which are checkpoints produced by training runs and can be deployed through Osmosis inference.

Base Models

Base models are imported from Hugging Face and used as the starting point for training on Osmosis.

Default Base Models

New workspaces include these default base models:
The Models page in your workspace is the source of truth for the base models available there.
If Add Model is visible on the Models page, you can use it to import a Hugging Face model repository that you can access.

List Base Models

The base model list shows model name, creation date, and creator.

LoRA Models

LoRA models are trained checkpoints produced by training runs. The Models page lists them separately from base models and shows training run, checkpoint step, training reward, creation date, and deployment status when inference deployment is available for your account.

Inspect LoRA Models

List LoRA models:
Show details for a single LoRA model:
Model details include the base model, training run, checkpoint step, training reward, Hugging Face publish status, and deployment status when deployment info is available. From the detail page, you can publish the model to Hugging Face, download its artifacts, rename it, or delete it. Undeploy an active LoRA model before renaming or deleting it. Deleted models and their artifacts are retained for 30 days before permanent deletion. List base models and LoRA models side by side:
When deployment info is available, the LoRA section also shows the workspace’s deployment-quota summary (for example, 2 of 5 inference deployments used).

Deploy a LoRA Model

After a training run finishes, list its LoRA models to find one to deploy:
Deploy a LoRA model by name:
Deploying an inactive LoRA model reactivates it. Deploying an already-active LoRA model is a no-op.

Call the Inference Endpoint

Deployed LoRA models are served through the OpenAI-compatible chat completions endpoint:
Use your Osmosis API key and the canonical model value from the model detail page or osmosis model info. The model value has the form <base_model_path>:<lora-model-name>.
If inference deployment is not available for your account, deployment status, deployment quota, and endpoint snippets may be hidden.

Undeploy

To transition a LoRA model’s deployment to inactive:
The LoRA model remains in the training run history; undeploy only transitions the serving deployment to inactive. undeploy is idempotent — calling it on an already-inactive model is a no-op. If an active evaluation run or benchmark run is using the model, Osmosis prevents undeployment until the run finishes.

Requirements

  • Run model commands from the workspace directory so the CLI can resolve the connected workspace from Git origin.
  • The LoRA model must belong to a training run in the same workspace.
  • Inference deployment must be available for your account. Deploying models also requires workspace billing to be in good standing — for self-serve workspaces, a valid payment method on file.
  • GitHub setup must be healthy before training runs can produce new LoRA models.

Next Steps

Training Runs

Submit training runs and inspect their LoRA models.

Command Reference

Review model and deployment commands and options.
Last modified on August 10, 2026