cli

CLI Reference

llem provides four commands and a version flag.

llem run [CONFIG] [OPTIONS]   # run an experiment or study
llem config [OPTIONS]         # show environment and configuration status
llem doctor [OPTIONS]         # verify Docker images match the host toolchain
llem report-gaps [OPTIONS]    # propose invariants corpus entries from runtime feedback
llem --version                # print version and exit

llem run

Run an LLM efficiency experiment

Arguments:

Argument	Type	Required	Description
config	path	no	Path to the experiment or study YAML config

Options:

Flag	Short	Type	Default	Description
--output	-o	str		Output directory for results
--dry-run		flag	false	Validate config and estimate VRAM without running
--quiet	-q	flag	false	Suppress progress bars
--verbose	-v	int	0	Increase verbosity (-v=INFO, -vv=DEBUG)
--skip-preflight		flag	false	Skip Docker pre-flight checks (GPU visibility, CUDA/driver compatibility)
--resume		flag	false	Resume most recent interrupted study
--resume-dir		path		Resume a specific study directory
--no-lock		flag	false	Disable GPU lock files (advanced)

llem config

Show environment and configuration status

Options:

Flag	Short	Type	Default	Description
--verbose	-v	int	0	Increase verbosity (-v=INFO, -vv=DEBUG)

llem doctor

Verify Docker images match the host ExperimentConfig schema

llem report-gaps

Propose invariants corpus entries from runtime observations

Options:

Flag	Short	Type	Default	Description
--source		str	runtime-warnings	Feedback source to scan. Only 'runtime-warnings' is wired in this release.
--study-dir		path		Study directory to scan. Repeat the flag to pass multiple.
--engine		str		Filter: only propose rules for this engine (transformers/vllm/tensorrt).
--out		path		Output path for proposed YAML fragments (one YAML document per gap, separated by '---').
--include-exceptions		flag	false	Also propose rules from runtime exceptions. Disabled by default; exceptions ship through a different review path.
--verbose	-v	int	0	Increase verbosity (-v=INFO, -vv=DEBUG)

llem study

Write and prepare study files (llem run stays the executor).