Configuration Schema

View as Markdown

This page lists every field on AuditConfig and its four sub-models. Defaults match the pydantic definitions in nemo_auditor.entities; the NeMo Platform entity store validates writes against these schemas.

AuditConfig

FieldTypeDefaultDescription
namestrrequiredUnique configuration name within the workspace.
workspacestrrequiredWorkspace the configuration is persisted in.
description`str \None`None
systemAuditSystemDatadefaultsGarak runtime knobs — see below.
runAuditRunDatadefaultsPer-probe generation settings — see below.
pluginsAuditPluginsDatadefaultsProbe and detector selection — see below.
reportingAuditReportDatadefaultsReport file layout — see below.

The entity store also adds the standard NemoEntity fields on retrieval: id, entity_type ("auditor_audit_config"), created_at, updated_at, and project.

AuditSystemData

Controls garak’s process-level behavior.

FieldTypeDefaultDescription
verboseint (0–1)0Garak verbosity level. 0 for normal output, 1 for verbose.
narrow_outputboolFalseWhen True, garak narrows its terminal output. Useful for log scraping.
parallel_requestsboolFalseEnable parallel request dispatch to the target.
parallel_attempts`bool \int`False
liteboolTrueRun only fast probe variants. Recommended for iterative development. Set to False to include slower, more thorough probes.
show_zboolFalseShow garak’s z-score column in reports.
enable_experimentalboolFalseAllow probes marked experimental to run.

AuditSystemData rejects unknown fields (model_config = ConfigDict(extra="forbid")).

AuditRunData

Controls how each probe is executed.

FieldTypeDefaultDescription
seed`int \None`None
deprefixboolTrueStrip prompt prefixes from responses before detection.
eval_thresholdfloat (0–1)0.5Detector score threshold above which a response is flagged as a hit.
generationsint (≥1)5Generations per probe. Lower for fast iteration; raise for statistical confidence.
probe_tags`str \None`None
user_agentstr"garak/{version} (LLM vulnerability scanner https://garak.ai)"HTTP User-Agent garak sends. The {version} placeholder is substituted at runtime.

AuditPluginsData

Controls probe, detector, generator, buff, and harness selection.

FieldTypeDefaultDescription
model_type`str \None`None
model_name`str \None`None
probe_specstr"all"Comma-separated probe selection. See Selecting Probes.
detector_specstr"auto"Detector selection — "auto" lets each probe pick its detectors.
extended_detectorsboolFalseEnable garak’s extended detector set.
buff_spec`str \None`None
buffs_include_original_promptboolFalseWhen buffs are active, also send the original prompt.
buff_max`str \None`None
detectorsdict[str, ModuleConfig]{}Per-detector configuration overrides.
generatorsdict[str, ModuleConfig]{}Per-generator configuration overrides. Normally set on the target instead.
buffsdict[str, ModuleConfig]{}Per-buff configuration overrides.
harnessesdict[str, ModuleConfig]{}Per-harness configuration overrides.
probesdict[str, ModuleConfig]{}Per-probe configuration overrides.

AuditReportData

Controls where reports land and how they are summarized.

FieldTypeDefaultDescription
report_prefixstr"run1"Filename prefix for the produced reports. report_prefix="quick-scan" yields quick-scan.report.jsonl, quick-scan.report.html, and quick-scan.hitlog.jsonl.
taxonomy`str \None`None
report_dirstr"garak_runs"Sub-directory of $XDG_DATA_HOME/garak/ where garak writes its raw output. The plugin then copies the produced files into the local results sink.
show_100_pass_modulesboolTrueInclude 100%-pass modules in the report summary. Set to False to hide them for a tighter “failures only” view.