Installation¶
Requirements¶
- Python 3.10+
- Smolagents >= 1.0.0
- Datasets, HuggingFace Hub
- OpenTelemetry SDK (auto-installed)
- genai-otel-instrument (auto-installed)
- duckduckgo-search (auto-installed)
Option 1: Install from PyPI¶
Option 2: Install from source (recommended for development)¶
-
Clone the repository:
-
Create and activate a virtual environment:
-
Install in editable mode:
Optional Dependencies¶
GPU Metrics¶
For GPU metrics collection when using local models (--provider=transformers or --provider=ollama):
Note
GPU metrics are enabled by default for local models (transformers, ollama). Use --disable-gpu-metrics to opt out.
OpenSearch Export¶
For exporting evaluation results, traces, and metrics to OpenSearch:
This installs opensearch-py>=2.4.0. See Output Formats for usage.
Command-Line Entry Points¶
Installing SMOLTRACE provides three CLI commands:
| Command | Purpose |
|---|---|
smoltrace-eval |
Run agent evaluations (see Running Evaluations) |
smoltrace-cleanup |
Manage and delete old evaluation datasets (see Dataset Management) |
smoltrace-copy-datasets |
Copy standard benchmark and task datasets to your account (see Dataset Management) |
Next Steps¶
- Quickstart — Run your first evaluation.
- Configuration — Set up environment variables and datasets.