TextGen WebUI: Guardrails and Fix Patterns
March 6, 2026 · View on GitHub
🧭 Quick Return to Map
You are in a sub-page of LocalDeploy_Inference.
To reorient, go back here:
- LocalDeploy_Inference — on-prem deployment and model inference
- WFGY Global Fix Map — main Emergency Room, 300+ structured fixes
- WFGY Problem Map 1.0 — 16 reproducible failure modes
Think of this page as a desk within a ward.
If you need the full triage and all prescriptions, return to the Emergency Room lobby.
A stabilization guide for oobabooga/text-generation-webui (TextGen WebUI). This tool is popular for local or Docker-based inference but often drifts under plugins, extensions, or mixed model backends. Use this page to detect and repair instability without changing infra.
Open these first
- Architecture & recovery: RAG Architecture & Recovery
- Retrieval knobs: Retrieval Playbook
- Trace schema: retrieval-traceability.md
- Ordering & warm-up fixes: bootstrap-ordering.md, deployment-deadlock.md, predeploy-collapse.md
- Embedding check: embedding-vs-semantic.md
Core acceptance
- ΔS(question, retrieved) ≤ 0.45
- Coverage ≥ 0.70 to target snippet
- λ remains convergent across 3 paraphrases and 2 seeds
- Stable across UI plugins (no flip-flops when toggling extensions)
Typical WebUI breakpoints and fix
| Symptom | Likely cause | Fix |
|---|---|---|
| Runs fine in notebook, but WebUI returns divergent outputs | Extension modifies prompt schema | data-contracts.md, retrieval-traceability.md |
| Citations missing when using API mode | WebUI truncates field names | retrieval-traceability.md |
| ΔS > 0.60 only when multiple users connect | Concurrency split in worker threads | context-drift.md, entropy-collapse.md |
| JSON schema output fails with extensions | UI prompt injection / malformed tools | prompt-injection.md, logic-collapse.md |
| First run after model load unstable | Race in init hooks | bootstrap-ordering.md |
Fix in 60 seconds
- Warm-up: Always run a dummy inference after model load. Log
INDEX_HASH. - Schema lock: Enforce
snippet_id,tokens,offsetsin every response. - λ probe: Run 3 paraphrases, 2 seeds. Clamp with BBAM if divergent.
- Trace logging: Save ΔS and λ per extension toggle.
- Verify: Replay dataset with and without extensions enabled. ΔS ≤ 0.45 required.
Copy-paste diagnostic prompt
I am running text-generation-webui with {extensions_list}.
Question: "{user_question}"
Please return:
- ΔS vs retrieved snippet
- λ across paraphrases
- Citations preserved? (yes/no)
- If ΔS ≥ 0.60, point to minimal WFGY module to apply
🔗 Quick-Start Downloads (60 sec)
| Tool | Link | 3-Step Setup |
|---|---|---|
| WFGY 1.0 PDF | Engine Paper | 1️⃣ Download · 2️⃣ Upload to your LLM · 3️⃣ Ask “Answer using WFGY + <your question>” |
| TXT OS (plain-text OS) | TXTOS.txt | 1️⃣ Download · 2️⃣ Paste into any LLM chat · 3️⃣ Type “hello world” — OS boots instantly |
Explore More
| Layer | Page | What it’s for |
|---|---|---|
| ⭐ Proof | WFGY Recognition Map | External citations, integrations, and ecosystem proof |
| ⚙️ Engine | WFGY 1.0 | Original PDF tension engine and early logic sketch (legacy reference) |
| ⚙️ Engine | WFGY 2.0 | Production tension kernel for RAG and agent systems |
| ⚙️ Engine | WFGY 3.0 | TXT based Singularity tension engine (131 S class set) |
| 🗺️ Map | Problem Map 1.0 | Flagship 16 problem RAG failure taxonomy and fix map |
| 🗺️ Map | Problem Map 2.0 | Global Debug Card for RAG and agent pipeline diagnosis |
| 🗺️ Map | Problem Map 3.0 | Global AI troubleshooting atlas and failure pattern map |
| 🧰 App | TXT OS | .txt semantic OS with fast bootstrap |
| 🧰 App | Blah Blah Blah | Abstract and paradox Q&A built on TXT OS |
| 🧰 App | Blur Blur Blur | Text to image generation with semantic control |
| 🏡 Onboarding | Starter Village | Guided entry point for new users |
If this repository helped, starring it improves discovery so more builders can find the docs and tools.
