v0.14.0

[jmartin-tech]

What's Changed

New features

• feature: support JSON config as well as YAML by @patriciapampanelli in feature: support JSON config as well as YAML #1490
• feature: remove --generate_autodan CLI option by @sinhaabhiraj0 in feature: remove --generate_autodan CLI option #1521
• expand items in report entry_type:eval by @leondz in expand items in report entry_type:eval #1547
• reporting: tier biased security aggregate by @leondz in reporting: tier biased security aggregate #1329
• feature: Report Generator refactor by @otavionvidia in feature: Report Generator refactor #1573
• feature: Add detector evaluation doc and benchmark results by @patriciapampanelli in Add detector evaluation doc and benchmark results #1597
• task: calibration data updates winter 2026 by @jmartin-tech in task: calibration data updates winter 2026 #1599

Notice: Breaking changes in this release

• Modified format of eval and digest entires in JSONL report
  See "Run analysis" documentation for more details of compatibility expectations.
• Fully redesigned HTML reports
• Removal of --generate_autodan cli option

Improved plugins

• Fix atkgen verbose output displaying incorrect conversation turns by @snehalvartak in Fix atkgen verbose output displaying incorrect conversation turns #1542
• generator: relax constraint to specify valid openai model name by @leondz in generator: relax constraint to specify valid openai model name #1557
• generators: check message count requested matches message count generated by @leondz in generators: check message count requested matches message count generated #1558
• fix: JavaScript detector regex improvement by @erickgalinkin in fix: JavaScript detector regex improvement #1588

Documentation

• docs: add guardion ai / promptintel to project by @leondz in docs: add guardion ai / promptintel to project #1530
• docs: add brief stubs for garak.analyze content by @leondz in docs: add brief stubs for garak.analyze content #1569

Tuning & fixes

• Make GoogleTranslator multiprocessing-safe by @motlaharsh0909-lgtm in Make GoogleTranslator multiprocessing-safe #1543
• Fix: improved unsafe pickle strategy by @jmartin-tech in Fix: improved unsafe pickle strategy #1545
• track which detector is reporting invalid pkg entry; only report once by @leondz in track which detector is reporting invalid pkg entry; only report once #1556
• arch: Remove many builtin configs by @leondz in arch: Remove many builtin configs #1555
• update: rm deprecated gpt-3.5 model from defaults by @leondz in update: rm deprecated gpt-3.5 model from defaults #1552
• task: update openai library to 2.x by @jmartin-tech in task: update openai library to 2.x #1550
• test: isolate _config in all tests by @jmartin-tech in test: isolate _config in all tests #1549
• update LangChain generator for 1.x library support by @jmartin-tech in update LangChain generator for 1.x library support #1551
• add license to docs footer by @leondz in add license to docs footer #1572
• guard for None content as response from target by @jmartin-tech in guard for None content as response from target #1574
• fix: 100% pass rate should not give 'elevated risk' for relative scores by @leondz in fix: 100% pass rate should not give 'elevated risk' for relative scores #1579
• Move generation output cardinality check into Generator.generate() by @leondz in Move generation output cardinality check into Generator.generate() #1578
• calling as_dict() on default instantiated Attempt now doesn't raise TypeError by @leondz in calling as_dict() on default instantiated Attempt now doesn't raise TypeError #1590
• task: remove fschat by @erickgalinkin in task: remove fschat #1567
• task: report test tweaks and dependency lock updates by @otavionvidia in task: report test tweaks and dependency lock updates #1593
• Task: transformers 5 support by @jmartin-tech in Task: transformers 5 support #1582
• task: exclude files not needed in distributed package by @jmartin-tech in task: exclude files not needed in distributed package #1601
• reporting: factor up defcon calculation by @leondz in reporting: factor up defcon calculation #1581
• rm jinja2 direct dependency requirement by @leondz in rm jinja2 direct dependency requirement #1596
• task: update huggingface config pattern by @jmartin-tech in task: update huggingface config pattern #1602
• reporting: stabilise tbsa hashes by @leondz in reporting: stabilise tbsa hashes #1603

New Contributors

• @snehalvartak made their first contribution in Fix atkgen verbose output displaying incorrect conversation turns #1542
• @sinhaabhiraj0 made their first contribution in feature: remove --generate_autodan CLI option #1521
• @motlaharsh0909-lgtm made their first contribution in Make GoogleTranslator multiprocessing-safe #1543
• @otavionvidia made their first contribution in feature: Report Generator refactor #1573

Full Changelog: v0.13.3...v0.14.0

---

This discussion was created from the release v0.14.0.