garak Reviews

garak Description

Garak checks to see if we can make an LLM fail in a manner that we don't like. Garak checks for hallucinations, data leakage and prompt injection, misinformation generation, toxicity, jailbreaks and other weaknesses. We love developing garak and are always looking to add new features. Garak is a command line tool. It's developed for Linux and OSX. You can download it from PyPI. The standard pip versions of garak are updated periodically. Garak has its dependencies. You can install garak within its own Conda environment. Garak needs to know which model to scan. By default, it will use all the probes that it knows to scan the model using the vulnerability detectors suggested by each probe. Garak will print progress bars for each probe as it generates. Once the generation has been completed, a row will be displayed evaluating each probe's results for each detector.