πŸ›οΈ Consilium

January 26, 2026 Β· View on GitHub

Consilium Logo

A quiver of methods for seeking truth through AI councils.
v1.2.0

Query multiple AI models simultaneously. Compare, debate, verify, refine, and synthesize their responses.

⚑ Skip to Install · Docker

Consilium Forum Mode

πŸ“Š More Screenshots

Analytics Dashboard

Track model performance, costs, and usage patterns.

Analytics Dashboard

Evaluation Panel

See detailed rankings, scores by criteria, and AI-generated analysis.

Evaluation Panel

Philosophy β€’ The Quiver β€’ Quick Start β€’ Docker β€’ Configuration


🎯 Philosophy

The Core Insight

There is no single method that reliably produces truth.

But there are appropriate methods for different kinds of questions.

Consilium (Latin for "council" or "deliberation") is an epistemological framework instantiated in software. Different questions require different methods of inquiry. Each mode is an "arrow" in your quiver, designed for a specific epistemic target.

Why Multiple Models?

No single AI has all the answers. Each LLM has different training data, reasoning approaches, and blind spots. What one model gets wrong, another might get right.

ChallengeHow Consilium Helps
AI hallucinationsCross-check answers across multiple models (Veritas mode)
Model biasAnonymous deliberation removes reputation bias (Consensus, Arbitrium)
Finding the right modelBlind preference voting reveals true preferences (Arbitrium)
Complex decisionsStructured debate surfaces all arguments (Debate, Elenchus)
Quality outputSequential refinement polishes content (Limatura)
Comprehensive answersSynthesize insights from multiple sources (Synthesis)

Methodological Pluralism

This is methodological pluralism β€” the philosophical position that different domains of inquiry require different approaches:

Question TypeMethodConsilium Mode
Factual claimsVerificationVeritas
Complex trade-offsDialecticDebate
Bias reductionDeliberationConsensus, Arbitrium
Quality assessmentCross-examinationAnalysis, Elenchus
Capability testingEmpiricismPeira
Comprehensive coverageIntegrationSynthesis
Quality improvementIterationLimatura

🏹 The Quiver (12 Modes)

Consilium provides 12 distinct modes β€” each an arrow designed for a different target:

Mode Overview

ModeShortcutPurposeWhen to Use
ForumCtrl+1Compare & JudgeGeneral questions, find best answer
DebateCtrl+2Round-Robin DiscussionComplex topics with trade-offs
ConsensusCtrl+3Anonymous DeliberationBias-reduced conclusions
AnalysisCtrl+4Multi-Judge CritiqueDeep evaluation of one answer
SynthesisCtrl+5Combine into OneComprehensive coverage needed
AnalyticsCtrl+6Performance StatsReview usage and costs
PeiraCtrl+7Capability TestingBenchmark model abilities
ElenchusCtrl+8Adversarial Red TeamStress-test code/ideas
VersusCtrl+9Local vs CommercialCompare local to cloud models
ArbitriumCtrl+0Blind Preference VoteDiscover true preferences
VeritasCtrl+-Fact Check & VerifyDetect hallucinations
LimaturaCtrl+=Iterative PolishRefine through multiple passes
PromptingCtrl+GPrompting GuideLearn effective prompting techniques

πŸ“– Detailed Mode Guide

1. Forum Mode (Ctrl+1)

Latin: "forum" β€” public place of discussion

All selected models answer your question simultaneously, then an AI judge ranks them.

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                    YOUR QUESTION                        β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β–Ό               β–Ό               β–Ό
   β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”
   β”‚ Model A β”‚    β”‚ Model B β”‚    β”‚ Model C β”‚
   β””β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”˜
        β”‚              β”‚              β”‚
        β–Ό              β–Ό              β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚      SIDE-BY-SIDE COMPARISON                            β”‚
β”‚   + Blind Evaluation (judges see "Response A" not names)β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Best for: General questions, comparing writing styles, finding the best model for your use case

Features:

  • Real-time streaming responses
  • Blind evaluation (prevents model reputation bias)
  • Follow-up questions with context
  • Auto-evaluation ranks responses when complete

2. Debate Mode (Ctrl+2)

Latin: "debattuere" β€” to fight, contend

A structured multi-round discussion where models build on each other's ideas.

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                    YOUR TOPIC                           β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ ROUND 1                                                 β”‚
β”‚ Model A β†’ Model B β†’ Model C (sees all previous)         β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ ROUND 2                                                 β”‚
β”‚ Model A β†’ Model B β†’ Model C (builds on Round 1)         β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚           AUTOMATIC CONSENSUS SUMMARY                   β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Best for: Complex topics with trade-offs, controversial questions, exploring all sides

How to use:

  1. Select 2+ Participants
  2. Set number of Rounds (1-5)
  3. Models discuss round-robin, building on previous responses
  4. Automatic Consensus Summary generated at the end

3. Consensus Mode (Ctrl+3)

Latin: "consensus" β€” agreement, harmony

Models deliberate anonymously over multiple rounds to find where they agree.

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                    YOUR QUESTION                        β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ ROUND 0 - INITIAL POSITIONS                             β”‚
β”‚ Each model answers independently                        β”‚
β”‚ Responses anonymized: Position A, B, C, D...            β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ ROUNDS 1-3 - DELIBERATION                               β”‚
β”‚ Each model sees ALL anonymized positions                β”‚
β”‚ (but NOT who said what - prevents bias)                 β”‚
β”‚ Task: Consider others, identify agreements/disputes,    β”‚
β”‚       refine position, move toward consensus            β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ FINAL - ARBITER SYNTHESIS                               β”‚
β”‚ βœ… Consensus answer (if agreement reached)              β”‚
β”‚ OR                                                      β”‚
β”‚ πŸ“Š Summary: What they agree on + What remains disputed  β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Best for: Reducing model bias, finding fundamental agreements, cross-validated answers

Key difference from Debate: Models don't know who said what during deliberation, preventing "I agree with GPT because it's GPT" bias.


4. Analysis Mode (Ctrl+4)

Greek: "analusis" β€” breaking up, investigation

One model answers, multiple analysts evaluate the response from different perspectives.

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                    YOUR QUESTION                        β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚              ANSWERER MODEL RESPONDS                    β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β–Ό               β–Ό               β–Ό
   β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”   β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”   β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
   β”‚ Analyst 1β”‚   β”‚ Analyst 2β”‚   β”‚ Analyst 3β”‚
   β”‚ Evaluatesβ”‚   β”‚ Evaluatesβ”‚   β”‚ Evaluatesβ”‚
   β””β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”˜   β””β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”˜   β””β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”˜
        β”‚              β”‚              β”‚
        β–Ό              β–Ό              β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚    MULTI-PERSPECTIVE EVALUATION & SCORING               β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Best for: Deep critique, understanding strengths/weaknesses, academic review


5. Synthesis Mode (Ctrl+5)

Greek: "sunthesis" β€” putting together

Multiple models answer, one synthesizer combines the best parts into a unified response.

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                    YOUR QUESTION                        β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β–Ό               β–Ό               β–Ό
   β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”    β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”
   β”‚ Source 1β”‚    β”‚ Source 2β”‚    β”‚ Source 3β”‚
   β”‚ Answers β”‚    β”‚ Answers β”‚    β”‚ Answers β”‚
   β””β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”˜    β””β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”˜
        β”‚              β”‚              β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                       β–Ό
         β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
         β”‚   SYNTHESIZER MODEL     β”‚
         β”‚ Combines all responses  β”‚
         β”‚  into unified answer    β”‚
         β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Best for: Research requiring comprehensive coverage, combining expertise, unified summaries


6. Peira Mode (Ctrl+7)

Greek: "πΡῖρα" (peira) β€” trial, experiment, test

Systematically test what models can and cannot do with structured benchmarks.

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚              SELECT TEST CATEGORY                       β”‚
β”‚  [Coding] [Math] [Reasoning] [Knowledge] [Creative]     β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚              SELECT MODELS TO TEST                      β”‚
β”‚  β–‘ Claude Sonnet 4.5    β–‘ GPT-5.2    β–‘ Gemini 3 Pro     β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚              STRUCTURED TEST BATTERY                    β”‚
β”‚  Each model receives identical test prompts             β”‚
β”‚  for fair comparison                                    β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚              CAPABILITY REPORT                          β”‚
β”‚  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”   β”‚
β”‚  β”‚ Model          β”‚ Score β”‚ Speed β”‚ Style        β”‚   β”‚
β”‚  β”‚ Claude Sonnet  β”‚  92%  β”‚ 45t/s β”‚ Detailed     β”‚   β”‚
β”‚  β”‚ GPT-5.2        β”‚  89%  β”‚ 52t/s β”‚ Concise      β”‚   β”‚
β”‚  β”‚ Gemini 3 Pro   β”‚  87%  β”‚ 61t/s β”‚ Structured   β”‚   β”‚
β”‚  β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜   β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Test Categories:

  • Coding: Algorithm implementation, debugging, code review
  • Math/Logic: Arithmetic, word problems, proofs, puzzles
  • Reasoning: Syllogisms, analogies, causal reasoning
  • Knowledge: Trivia, history, science, current events
  • Creativity: Storytelling, poetry, brainstorming

Unique Value: This is the only mode where the question is fundamentally about the models themselves, not the world.


7. Elenchus Mode (Ctrl+8)

Greek: "ἔλΡγχος" (elenchus) β€” cross-examination, refutation (Socrates' method)

Stress-test ideas, code, or plans by having models attack them.

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚         YOUR CONTENT TO BE CHALLENGED                   β”‚
β”‚    (code, argument, plan, proposal, idea)               β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β–Ό                               β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”               β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚   DEFENDER    β”‚               β”‚  CHALLENGERS  β”‚
β”‚  (1 model)    β”‚   βš”οΈ VS βš”οΈ    β”‚  (1+ models)  β”‚
β”‚ Defends the   β”‚               β”‚ Attack/find   β”‚
β”‚   content     β”‚               β”‚    flaws      β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”˜               β””β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”˜
        β”‚                               β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ ROUND 1: Challengers attack                             β”‚
β”‚ ROUND 2: Defender responds                              β”‚
β”‚ ROUND 3: Challengers counter                            β”‚
β”‚ ...                                                     β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚              ARBITER VERDICT (optional)                 β”‚
β”‚  β€’ Vulnerabilities found                                β”‚
β”‚  β€’ Defenses successful                                  β”‚
β”‚  β€’ Final assessment                                     β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Use Cases:

  • Security Review: "Find vulnerabilities in this code"
  • Argument Testing: "What's wrong with this reasoning?"
  • Business Plans: "What could go wrong with this strategy?"
  • Risk Assessment: "Why shouldn't I do this?"

Unique Value: Systematic adversarial testing. Truth survives challenge.


8. Versus Mode (Ctrl+9)

Latin: "versus" β€” against, turned toward

Compare your local models against commercial frontier models with blind evaluation.

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                    YOUR PROMPT                          β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β–Ό                               β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”   β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚   LOCAL COUNCIL       β”‚   β”‚  COMMERCIAL COUNCIL   β”‚
β”‚  β€’ llama3.3:70b       β”‚   β”‚  β€’ Claude Sonnet 4.5  β”‚
β”‚  β€’ qwen2.5:32b        β”‚   β”‚  β€’ GPT-5.2            β”‚
β”‚  β€’ deepseek-r1:14b    β”‚   β”‚  β€’ Gemini 3 Pro       β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜   β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
            β”‚                           β”‚
            β–Ό                           β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”   β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚   SYNTHESIZE into     β”‚   β”‚   SYNTHESIZE into     β”‚
β”‚   one council answer  β”‚   β”‚   one council answer  β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜   β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
            β”‚                           β”‚
            β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚              BLIND JUDGE EVALUATION                     β”‚
β”‚  (Compares councils AND local vs each individual model) β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚              RESULTS & INSIGHTS                         β”‚
β”‚  πŸ† Winner: [Local Council/Commercial Council]          β”‚
β”‚  πŸ’° Cost: Local \$0 vs Commercial $X.XX                  β”‚
β”‚  πŸ“Š Savings if local wins: $X.XX saved!                 β”‚
β”‚                                                         β”‚
β”‚  🎯 Local Council vs Individual Models:                 β”‚
β”‚  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”                    β”‚
β”‚  β”‚   βœ…   β”‚  β”‚   ❌   β”‚  β”‚   🀝   β”‚                    β”‚
β”‚  β”‚ Claude β”‚  β”‚ GPT-5  β”‚  β”‚ Gemini β”‚                    β”‚
β”‚  β””β”€β”€β”€β”€β”€β”€β”€β”€β”˜  β””β”€β”€β”€β”€β”€β”€β”€β”€β”˜  β””β”€β”€β”€β”€β”€β”€β”€β”€β”˜                    β”‚
β”‚  βœ… = Local council beats model                        β”‚
β”‚  ❌ = Model beats local council                        β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

How It Works:

  1. Both councils answer your question (models run serially for quality)
  2. Each council synthesizes individual responses into one unified answer
  3. Judge compares synthesized answers (Council A vs B) β€” blind, fair
  4. Judge also compares local synthesis vs each individual commercial model
  5. Results show: winner, cost saved, and whether your council beats frontier models individually

Best for: Testing if local models can replace paid APIs, finding which tasks locals handle well

Unique Value: Two levels of insight:

  • "Is my local council as good as commercial?" (synthesis vs synthesis)
  • "Can my local council beat individual frontier models?" (teamwork vs individuals)

9. Arbitrium Mode (Ctrl+0)

Latin: "arbitrium" β€” judgment, decision, free will

Discover your true preferences without model reputation bias.

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                    YOUR QUESTION                        β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β–Ό                               β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”   β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚     RESPONSE A        β”‚   β”‚     RESPONSE B        β”‚
β”‚   (Model hidden)      β”‚   β”‚   (Model hidden)      β”‚
β”‚                       β”‚   β”‚                       β”‚
β”‚   [Full response      β”‚   β”‚   [Full response      β”‚
β”‚    displayed here]    β”‚   β”‚    displayed here]    β”‚
β”‚                       β”‚   β”‚                       β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜   β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
            β”‚                           β”‚
            β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚           WHICH DO YOU PREFER?                          β”‚
β”‚      [Vote A]              [Vote B]                     β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚ (after voting)
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚           REVEAL: You chose Claude Sonnet 4.5!          β”‚
β”‚   Your preference data feeds into personal analytics    β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Features:

  • Blind by default β€” no peeking at model names
  • Reveal after voting β€” see which model you actually preferred
  • Preference tracking β€” builds personal model rankings over time
  • Arena-style data β€” similar to LMSYS Chatbot Arena, but personal

Unique Value: Removes reputation bias. You might discover you prefer different models than you thought!


10. Veritas Mode (Ctrl+-)

Latin: "veritas" β€” truth

Detect hallucinations and verify factual claims through cross-model consensus.

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚         CLAIM OR QUESTION TO VERIFY                     β”‚
β”‚   "The Great Wall of China is visible from space"       β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
        β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
        β–Ό               β–Ό               β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚  VERIFIER 1   β”‚ β”‚  VERIFIER 2   β”‚ β”‚  VERIFIER 3   β”‚
β”‚ Claude Sonnet β”‚ β”‚    GPT-5.2    β”‚ β”‚  Gemini Pro   β”‚
β”‚               β”‚ β”‚               β”‚ β”‚               β”‚
β”‚ Verdict: FALSEβ”‚ β”‚ Verdict: FALSEβ”‚ β”‚ Verdict: FALSEβ”‚
β”‚ Confidence:95%β”‚ β”‚ Confidence:92%β”‚ β”‚ Confidence:88%β”‚
β”‚ Citations: βœ“  β”‚ β”‚ Citations: βœ“  β”‚ β”‚ Citations: βœ“  β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
        β”‚               β”‚               β”‚
        β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”Όβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚              ANALYZER SYNTHESIS                         β”‚
β”‚  ────────────────────────────────────────────────────  β”‚
β”‚  OVERALL VERDICT: FALSE                                 β”‚
β”‚  CONFIDENCE: 92%                                        β”‚
β”‚                                                         β”‚
β”‚  CONSENSUS FACTS:                                       β”‚
β”‚  βœ… All models agree the claim is false                 β”‚
β”‚  βœ… Cited NASA astronaut testimonies                    β”‚
β”‚  βœ… Referenced physics of human vision                  β”‚
β”‚                                                         β”‚
β”‚  KEY EVIDENCE:                                          β”‚
β”‚  β€’ Wall is ~30ft wide, not visible at orbital altitude  β”‚
β”‚  β€’ Myth debunked by multiple astronauts                 β”‚
β”‚                                                         β”‚
β”‚  DISPUTED: None                                         β”‚
β”‚  UNSUPPORTED: None                                      β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Three Verification Methods:

MethodDescriptionBest For
🧠 Memory OnlyUses model training data only. "If unknown, say so."Testing model knowledge without external sources
🌐 Shared ResearchOne search, all models get same resultsFair comparison with consistent evidence
πŸ” Independent ResearchEach model searches independentlySeeing how models approach verification differently

Independent Research - Source Comparison: When using Independent Research mode, Veritas compares sources found by different models:

  • Common Sources: URLs found by multiple models (high confidence)
  • Unique Sources: URLs only one model found (may reveal blind spots)
  • Search Queries: See what each model searched for

Verification Flow:

  1. Select verification method (Memory Only / Shared Research / Independent Research)
  2. Enter claim or question to verify
  3. Multiple verifier models independently assess truthfulness with citations
  4. Analyzer model synthesizes final report
  5. Report shows: consensus facts, disputed claims, confidence levels

Best for: Fact-checking before publishing, detecting hallucinations, verifying information

Unique Value: Structured hallucination detection with flexible research options. Trust but verify.


11. Limatura Mode (Ctrl+=)

Latin: "limatura" β€” filing, polishing, refinement

Polish and improve output through sequential model passes.

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                CONTENT TO POLISH                        β”‚
β”‚        (code, text, email, document)                    β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚   V0: ORIGINAL (Model A creates initial response)       β”‚
β”‚   "Here is my first draft of the email..."              β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚   V1: FIRST REFINEMENT (Model B improves V0)            β”‚
β”‚   "Here is the improved version with clearer..."        β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚   V2: SECOND REFINEMENT (Model C improves V1)           β”‚
β”‚   "Here is the polished final version..."               β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚              VERSION COMPARISON                         β”‚
β”‚  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”   β”‚
β”‚  β”‚ V0 (Original)  β”‚ V1 (Refined)  β”‚ V2 (Polished) β”‚   β”‚
β”‚  β”‚ [View]         β”‚ [View]        β”‚ [View] β˜…      β”‚   β”‚
β”‚  β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜   β”‚
β”‚  Current: V2 by Model C                                 β”‚
β”‚  [Copy Final] [Continue Refining]                       β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Refinement Types:

  • General improvement: "Make this better"
  • Style refinement: "Make this more concise/formal/casual"
  • Code refinement: "Optimize and clean this code"
  • Custom instruction: User-defined refinement criteria

Best for: Code optimization, document drafting, email refinement, creative writing polish

Unique Value: Sequential improvement, not just comparison. Each model builds on the last.


12. Prompting Guide (Ctrl+G)

Purpose: Learn and apply effective prompting techniques

A comprehensive guide to crafting effective AI prompts with 8 proven formulas.

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚              PROMPTING GUIDE                            β”‚
β”‚                                                         β”‚
β”‚  πŸ“‹ 8 PROVEN FORMULAS:                                 β”‚
β”‚                                                         β”‚
β”‚  1. RTCF - Role, Task, Context, Format                 β”‚
β”‚  2. CREATE - Character, Request, Examples...           β”‚
β”‚  3. RISEN - Role, Instructions, Steps, End Goal...     β”‚
β”‚  4. Chain-of-Thought - Step-by-step reasoning          β”‚
β”‚  5. Few-Shot Learning - Input/output examples          β”‚
β”‚  6. STAR - Situation, Task, Action, Result             β”‚
β”‚  7. Code Generation - Language, Requirements...        β”‚
β”‚  8. Self-Critique - Generate, critique, improve        β”‚
β”‚                                                         β”‚
β”‚  Each formula includes:                                 β”‚
β”‚  β€’ Component breakdown                                  β”‚
β”‚  β€’ Real-world examples                                  β”‚
β”‚  β€’ Best use cases                                       β”‚
β”‚  β€’ One-click copy                                       β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Available Formulas:

FormulaComponentsBest For
RTCFRole + Task + Context + FormatGeneral structured prompts
CREATECharacter + Request + Examples + Adjustments + Type + ExtrasDetailed specifications
RISENRole + Instructions + Steps + End Goal + NarrowingMulti-step tasks
Chain-of-ThoughtStep-by-step reasoningComplex reasoning problems
Few-ShotInput β†’ Output examplesPattern learning
STARSituation + Task + Action + ResultProblem-solving narratives
Code GenerationLanguage + Requirements + Standards + Edge CasesProgramming tasks
Self-CritiqueGenerate β†’ Critique β†’ ImproveQuality iteration

Best for: Learning prompt engineering, improving query quality, teaching prompting techniques

Unique Value: Reference guide for effective prompting, always available with Ctrl+G.


πŸ“Š Question Type Matrix

Use this table to choose the right mode for your question:

Question TypeRecommended ModeWhy
"What is X?" (Factual)Forum or VeritasForum for comparison; Veritas for accuracy
"What's the best X?" (Opinion)Consensus or ArbitriumConsensus reduces bias; Arbitrium reveals preference
Creative writingForum or LimaturaForum for variety; Limatura for polish
Coding/TechnicalForum or ElenchusForum for solutions; Elenchus for security review
Controversial/EthicalDebateModels engage with counterarguments
"Should I do X?" (Decision)Consensus or ElenchusConsensus for recommendation; Elenchus for risks
Research/ComprehensiveSynthesis + VeritasSynthesis for coverage; Veritas for accuracy
Security ReviewElenchusAdversarial testing finds vulnerabilities
Model BenchmarkingPeiraStructured capability testing
Quick ComparisonArbitriumFast blind preference voting
Quality PolishLimaturaIterative improvement chain
Hallucination CheckVeritasCross-model fact verification
Local vs CloudVersusData-driven cost/quality comparison

✨ Features

🎯 Core Capabilities

  • Multi-Model Comparison β€” Query multiple LLMs simultaneously
  • Streaming Responses β€” Real-time output from all models
  • Blind Evaluation β€” Anonymized judging prevents bias
  • URL Content Fetching β€” Include webpage content in prompts
  • Session Management β€” Save, tag, search, reload sessions
  • Export Options β€” JSON, Markdown, CSV

πŸ”§ Advanced Features

  • Knowledge Base (RAG) β€” Upload documents for context-aware responses
  • Vision Support β€” Upload images for multi-model analysis
  • Research Mode (SearXNG) β€” Web search before querying models
  • Conversation Continuity β€” Follow-up questions with context
  • Prompt Templates β€” Reusable prompts with variables
  • Cost Tracking β€” Estimated API costs per response
  • Model Analytics β€” Track which models win evaluations
  • Pin/Favorite Responses β€” Star great responses
  • Keyboard Shortcuts β€” Full keyboard navigation
  • Local Model Support β€” Ollama and LM Studio integration
  • Dark/Light Themes β€” Beautiful UI in both modes
  • Model Sync β€” Fetch latest models from OpenRouter API
  • Benchmark Sync β€” Update benchmark scores from HuggingFace Leaderboard
  • Prompting Guide β€” Learn effective prompting techniques

πŸš€ Quick Start

Prerequisites

πŸ’‘ Why OpenRouter? One API key = access to 25+ models (OpenAI, Anthropic, Google, xAI, Mistral, and more). Pay-as-you-go pricing.

Installation

# Clone the repository
git clone https://github.com/lafintiger/Consilium.git
cd Consilium

# Install backend dependencies
cd backend
npm install

# Configure environment
cp ../env.example.txt .env
# Edit .env and add your OPENROUTER_API_KEY

# Start backend
npm run dev

# In a new terminal, install and start frontend
cd frontend
npm install
npm run dev

Access the App


🐳 Docker

# Copy and configure environment
cp env.example.txt .env
# Edit .env with your API keys

# Build and start
docker compose up -d

# View logs
docker compose logs -f

# Stop
docker compose down

Updating to Latest Version

git pull
docker compose down
docker compose build --no-cache
docker compose up -d

⌨️ Keyboard Shortcuts

ShortcutAction
Ctrl+1Forum mode
Ctrl+2Debate mode
Ctrl+3Consensus mode
Ctrl+4Analysis mode
Ctrl+5Synthesis mode
Ctrl+6Analytics dashboard
Ctrl+7Peira (capability testing)
Ctrl+8Elenchus (red team)
Ctrl+9Versus (local vs commercial)
Ctrl+0Arbitrium (blind voting)
Ctrl+-Veritas (fact check)
Ctrl+=Limatura (iterative polish)
Ctrl+GPrompting Guide
Ctrl+RToggle Research mode

βš™οΈ Configuration

Environment Variables

Copy env.example.txt to .env in the backend folder:

# Required
OPENROUTER_API_KEY=sk-or-v1-your-key-here

# Optional - Local Models
OLLAMA_URL=http://localhost:11434
LMSTUDIO_URL=http://localhost:1234

# Optional - Research Mode
SEARXNG_URL=http://localhost:4000

# Performance
LOCAL_MODELS_SEQUENTIAL=true  # Run local models one at a time

Available Models

Consilium supports 25+ models via OpenRouter:

ProviderModels
AnthropicClaude Sonnet 4.5, Opus 4.5, Haiku 4.5
OpenAIGPT-5.2, GPT-5.2 Pro, GPT-5.1, o3
GoogleGemini 3 Pro, Gemini 2.5 Pro/Flash
xAIGrok 4, Grok 4 Fast, Grok 3
DeepSeekDeepSeek V3.2, V3.2 Speciale
MistralMistral Large 3, Devstral 2
LocalAny Ollama/LM Studio model

🏠 Local Models

Ollama Setup

# Install Ollama
curl -fsSL https://ollama.ai/install.sh | sh

# Pull models
ollama pull llama3.3
ollama pull qwen2.5:32b
ollama pull deepseek-r1:14b

# Start Ollama server
ollama serve

Consilium automatically detects running Ollama models.

Docker + Local Models

ScenarioOLLAMA_URL
Both nativehttp://localhost:11434
Consilium in Docker, Ollama nativehttp://host.docker.internal:11434

πŸ“ Project Structure

Consilium/
β”œβ”€β”€ backend/                 # Express.js API server
β”‚   β”œβ”€β”€ src/
β”‚   β”‚   β”œβ”€β”€ index.js        # Server entry point
β”‚   β”‚   β”œβ”€β”€ config/         # Model configs, benchmarks
β”‚   β”‚   β”œβ”€β”€ db/             # SQLite database
β”‚   β”‚   └── routes/         # API endpoints
β”‚   └── package.json
β”‚
β”œβ”€β”€ frontend/               # React + Vite + Tailwind
β”‚   β”œβ”€β”€ src/
β”‚   β”‚   β”œβ”€β”€ components/     # React components
β”‚   β”‚   β”œβ”€β”€ constants/      # Mode definitions
β”‚   β”‚   β”œβ”€β”€ stores/         # Zustand state
β”‚   β”‚   └── types/          # TypeScript definitions
β”‚   └── package.json
β”‚
β”œβ”€β”€ docker-compose.yml
β”œβ”€β”€ DEVELOPER_GUIDE.md     # Developer guide
└── README.md              # This file

πŸ“š Knowledge Base (RAG)

Consilium includes a built-in Retrieval Augmented Generation (RAG) system that lets you upload documents and have AI models answer questions using your own content.

How It Works

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                 KNOWLEDGE BASE WORKFLOW                      β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ 1. UPLOAD DOCUMENTS                                          β”‚
β”‚    β€’ Click Database icon (πŸ—„οΈ) in header                      β”‚
β”‚    β€’ Create collections: "Tech Docs", "Research", etc.       β”‚
β”‚    β€’ Upload PDFs, Word docs, text files, Markdown            β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ 2. AUTOMATIC PROCESSING (Background)                         β”‚
β”‚    β€’ Parse document β†’ Extract text                           β”‚
β”‚    β€’ Chunk text β†’ Smart segmentation (~500 tokens each)      β”‚
β”‚    β€’ Generate embeddings β†’ Ollama qwen3-embedding:8b         β”‚
β”‚    β€’ Store in SQLite database                                β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ 3. QUERY WITH KNOWLEDGE                                      β”‚
β”‚    β€’ Toggle "Knowledge" button in prompt input               β”‚
β”‚    β€’ Select specific collection or "All Collections"         β”‚
β”‚    β€’ Ask your question                                       β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ 4. SEMANTIC SEARCH & AUGMENTATION                            β”‚
β”‚    β€’ Your question β†’ Embedded β†’ Compare to chunks            β”‚
β”‚    β€’ Top 5 most relevant chunks retrieved                    β”‚
β”‚    β€’ Chunks added as context to your prompt                  β”‚
β”‚    β€’ All models receive the augmented prompt                 β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
                        β”‚
                        β–Ό
β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ 5. VIEW SOURCES                                              β”‚
β”‚    β€’ "Knowledge Base Sources" panel shows retrieved chunks   β”‚
β”‚    β€’ Document name, collection, similarity score             β”‚
β”‚    β€’ Preview of the chunk content                            β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Supported Document Types

TypeExtensionNotes
PDF.pdfText extraction via pdf-parse
Word.docxModern Word format via mammoth
Text.txtPlain text files
Markdown.mdMarkdown files

Knowledge Collections

Organize your documents into themed collections:

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚ πŸ“‚ Collections                                               β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
β”‚ πŸ₯ Medical Research      β”‚ 12 docs β”‚ 342 chunks            β”‚
β”‚ πŸ’» Tech Documentation    β”‚ 8 docs  β”‚ 215 chunks            β”‚
β”‚ πŸ“‹ Company Policies      β”‚ 5 docs  β”‚ 89 chunks             β”‚
β”‚ πŸ“– General               β”‚ 3 docs  β”‚ 47 chunks             β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
  • Create collections with custom names, colors, and descriptions
  • Filter searches to specific collections or search all
  • Move documents between collections as needed
  • Delete collections without losing documents (they go to "uncategorized")

Requirements for Knowledge Base

  1. Ollama must be running with an embedding model:

    # Install the embedding model
    ollama pull qwen3-embedding:8b
    
    # Start Ollama server
    ollama serve
    
  2. Status Check: The Knowledge Panel shows embedding model status

    • βœ… Green = Ready to process documents
    • ❌ Red = Embedding model not available

Configuration

Environment VariableDefaultDescription
EMBEDDING_MODELqwen3-embedding:8bOllama embedding model to use
KNOWLEDGE_TOP_K5Max chunks to retrieve per query
KNOWLEDGE_MIN_SIMILARITY0.3Minimum similarity threshold
KNOWLEDGE_MAX_TOKENS8000Max tokens for context

Use Cases

ScenarioHow to Use
Company Q&A BotUpload policy docs β†’ Ask questions about procedures
Research AssistantUpload papers β†’ Ask for summaries and connections
Documentation SearchUpload tech docs β†’ Query specific APIs or features
Study HelperUpload course materials β†’ Ask practice questions
Legal ResearchUpload contracts β†’ Query for specific clauses

Combined with Other Features

Knowledge Base works alongside other Consilium features:

CombinationResult
Knowledge + ForumMultiple models answer using your documents
Knowledge + VeritasFact-check claims against your own sources
Knowledge + SynthesisCombine document insights from multiple models
Knowledge + ResearchUse both your docs AND web search

πŸ“œ License

Polyform Noncommercial 1.0.0 β€” See LICENSE for details.

Use CaseAllowed
Educators & Studentsβœ… Free
Personal/Hobby Useβœ… Free
Non-profit Organizationsβœ… Free
Researchβœ… Free
Commercial Use❌ Contact for license

πŸ™ Acknowledgments


🏹 A quiver of methods for seeking truth

Built with 🧠 β€” Seeking Truth Through AI Councils