README.md
January 15, 2026 ยท View on GitHub
Red Teaming python-framework for testing chatbots and GenAI systems
Install ๐
pip install llamator==3.5.0
Documentation ๐
Documentation Link: https://LLAMATOR-Core.github.io/llamator
Guides โถ๏ธ
Examples ๐ก
- ๐ RAG bot testing via REST API
- ๐งโโ๏ธ Gandalf web bot testing via Selenium
- ๐ฌ Telegram bot testing via Telethon
- ๐ฑ WhatsApp bot testing via Selenium
- ๐ LangChain client testing with custom attack
- ๐ท Vision Model testing via LangChain
- ๐ Running LLAMATOR in Docker
Supported Clients ๐ ๏ธ
- ๐ All LangChain clients
- ๐ง OpenAI-like API
- โ๏ธ Custom Class (Telegram, WhatsApp, Selenium, etc.)
Unique Features ๐
- ๏ธ๐ก Support for custom attacks and datasets from the user
- ๐ Large selection of attacks on LLMs, RAGs, Agents, VLMs in English and Russian
- ๐ก Custom configuration of chat clients
- ๐ History of attack requests and responses in Excel and CSV format
- ๐ Test report document in DOCX format
OWASP Classification ๐
- ๐ LLM01: Prompt Injection and Jailbreaks
- ๐ต๏ธโโ๏ธ LLM07: System Prompt Leakage
- ๐คฅ LLM09: Misinformation
- ๐ธ LLM10: Unbounded Consumption
Community ๐
- ๐ฌ Telegram Chat โ LLAMATOR | AI Red Team Community
- ๐ค Supported by AI Talent Hub and ITMO University
Contacts ๐ฌ
โ๏ธ Email: team@llamator.org
Enterprise Version ๐ข
โก๏ธComing Soonโก๏ธ
License ๐
ยฉ Roman Neronov, Timur Nizamov, Nikita Ivanov
This project is licensed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license. See the LICENSE file for details.
