Required Directories
The CLI expects these directories to exist:| Path | Purpose |
|---|---|
rollouts/ | Rollout code, one subdirectory per rollout |
configs/training/ | Training run TOML files for osmosis train submit |
configs/eval/ | Evaluation run TOML files for osmosis eval submit |
data/ | Local datasets used by osmosis dataset upload |
rollouts/
The directory where your AgentWorkflow and Grader code lives. Each rollout is a subdirectory containing an entrypoint file (typically main.py) that defines the agent workflow and grading logic.
configs/
Configuration files for the two CLI operations: training and evaluation.
| Subdirectory | Purpose | Reference |
|---|---|---|
configs/training/ | Training run configs for osmosis train submit | Training Config |
configs/eval/ | Evaluation run configs for osmosis eval submit | Evaluation Config |
configs/training/default.toml template and rollout-specific evaluation configs named configs/eval/<rollout-name>.toml are pre-populated with required fields and commented-out optional settings. See Configuration Files for the full TOML schema reference.
data/
Directory for local dataset files. Upload them to the platform with osmosis dataset upload, then reference the uploaded dataset by name from your training and evaluation configs.
pyproject.toml
Standard Python project configuration for the workspace repository. Individual rollouts can also have their own rollouts/<name>/pyproject.toml files for rollout-specific dependencies.
pyproject.toml
AGENTS.md & CLAUDE.md
Instruction files for AI coding assistants. AGENTS.md provides general guidance for any AI assistant (GitHub Copilot, Cursor, etc.), while CLAUDE.md contains Claude Code-specific instructions.
Both files describe the workspace structure, conventions, and Osmosis-specific patterns so your AI assistant can effectively help you write rollout code.
Generated Runtime State
The CLI may create local runtime files under.osmosis/, such as exported metrics. Treat those as local state, not source code.
Next Steps
Workspace Repository
Learn how the CLI resolves the connected workspace.
Configuration Files
Review training and evaluation TOML schemas.