Base Models
Base models are imported from Hugging Face and used as the starting point for training on Osmosis.Default Base Models
New workspaces include these default base models:The Models page in your workspace is the source of truth for the base models available there.
List Base Models
LoRA Models
LoRA models are trained checkpoints produced by training runs. The Models page lists them separately from base models and shows training run, checkpoint step, training reward, creation date, and deployment status when inference deployment is available for your account.Inspect LoRA Models
List LoRA models:2 of 5 inference deployments used).
Deploy a LoRA Model
After a training run finishes, list its LoRA models to find one to deploy:Call the Inference Endpoint
Deployed LoRA models are served through the OpenAI-compatible chat completions endpoint:model value from the model detail page or osmosis model info. The model value has the form <base_model_path>:<lora-model-name>.
If inference deployment is not available for your account, deployment status, deployment quota, and endpoint snippets may be hidden.
Undeploy
To transition a LoRA model’s deployment to inactive:undeploy only transitions the serving deployment to inactive. undeploy is idempotent — calling it on an already-inactive model is a no-op.
If an active evaluation run or benchmark run is using the model, Osmosis prevents undeployment until the run finishes.
Requirements
- Run model commands from the workspace directory so the CLI can resolve the connected workspace from Git
origin. - The LoRA model must belong to a training run in the same workspace.
- Inference deployment must be available for your account. Deploying models also requires workspace billing to be in good standing — for self-serve workspaces, a valid payment method on file.
- GitHub setup must be healthy before training runs can produce new LoRA models.
Next Steps
Training Runs
Submit training runs and inspect their LoRA models.
Command Reference
Review model and deployment commands and options.