MLflow
MLflow is a app in the osFoundry community catalog. Open-source platform for the machine learning + LLM lifecycle — track experiments (params, metrics, artifacts), log model versions in the registry, deploy to a serving endpoint, log every LLM prompt + response with token cost + latency. Standard tool across ML + GenAI teams; the LLM tracing UI ranks alongside Langfuse / Helicone for prompt observability. SQLite backend default; artifacts to /data/artifacts.
Details
- Workspace: osfoundry
- Category: AI
- Pricing: Free
- Access: Community
Features
- Experiment tracking — params, metrics, artifacts versioned per run, full diff/compare UI
- LLM tracing — auto-capture prompts + responses + token cost from LangChain / LlamaIndex / OpenAI / Anthropic
- Model registry with versions + stages (Staging / Production / Archived) + transition history
- SQLite backend bundled — zero-config self-hosting for solo + small team use
- Standard Python / R / Java / REST APIs — works from any ML or LLM framework
- 20 GB volume for artifacts (models, plots, datasets) — expandable
Documentation
# MLflow
## Track your first run
Set your client to point at the public URL:
```python
import mlflow
mlflow.set_tracking_uri('https://<your-public-url>')
mlflow.set_experiment('my-first-experiment')
with mlflow.start_run():
mlflow.log_param('learning_rate', 0.01)
mlflow.log_metric('accuracy', 0.92)
mlflow.log_artifact('model.pkl')
```
Open the web UI — the run appears under 'my-first-experiment'.
## LLM tracing
The Tracing UI (added in MLflow 2.14+) auto-captures every prompt + response + tool call + token count from LangChain, LlamaIndex, OpenAI SDK, Anthropic SDK, and DSPy:
```python
import mlflow
mlflow.openai.autolog() # or langchain.autolog() / llama_index.autolog() / ...
```
Every call shows up in the Trace tab with the full request/response, token cost, latency, errors. The 'Compare' view lets you diff prompt variants side-by-side.
## Model registry
**Models → Register Model** from any run that logged a model. Versioned, with stages (Staging / Production / Archived) and transition workflows.
## Serving
The registered models can be served via `mlflow models serve -m models:/my-model/Production` from your own infra. The tracking server itself doesn't serve inference — it's the catalog.
## Storage
SQLite at `/data/mlflow.db` for metadata; artifacts at `/data/artifacts/`. 20 GB volume. For team-scale use, switch the backend store to Postgres via `MLFLOW_BACKEND_STORE_URI` env.
How to use MLflow in osFoundry
Install MLflow into your workspace in one click, then fork it in osStudio to customise the prompts, tools, or configuration for your stack. Anyone in your workspace can pick up where you left off.
Other apps from the community
- CRM — Customer relationship management with contacts, deals, and pipeline tracking.
- Kanban Board — Drag-and-drop task board with swimlanes, labels, and team assignments.
- Helpdesk — Ticket triage and customer support inbox with SLA tracking.
- Page Builder — Block-based page editor with publishing to public URLs.
- Website Builder — Multi-page site builder with CMS, templates, and custom domains.
- Storefront — E-commerce storefront with product catalog, cart, and checkout.