USB-Uncensored-LLM โšก

July 4, 2026 ยท View on GitHub

Important

This repository (USB-Uncensored-LLM ) is deprecated and is no longer actively maintained.

All active development, features, and bug fixes (including the Windows crash/access violation fixes) have moved to:

๐Ÿ‘‰ Uncensored-Local-Studio

Please visit the new repository to download the latest version, report issues, and follow the project's development.

USB-Uncensored-LLM โšก

USB-Uncensored-LLM is a fully air-gapped, zero-dependency, plug-and-play Local AI environment designed to run seamlessly from your local hard drive or a portable USB/SSD. It bypasses complex installations natively executing large language models directly on your hardware with no internet required.

With a unified architecture, you can initialize your AI models once and choose to keep them on your system or carry them with you across Windows, macOS, and Linux PCs.

๐ŸŽฅ Watch the Setup & Demo Video: https://youtu.be/60PSXsoXc8A

USB-Uncensored-LLM Setup & Demo

๐Ÿš€ Core Features

  • Zero Dependency Setup: Ships with portable Python and isolated engine binaries. No system permissions, registry edits, or package managers required.
  • Cross-Platform Interoperability: Uses a intelligent Shared volume system โ€” download your 5GB+ AI models once, and use them natively on Windows, macOS, and Linux without duplication.
  • Censorship Free: Integrates cutting-edge ablative and heretic fine-tuned models for completely unfiltered interactions.
  • Network Proxied UI: The custom Python HTTP server instantly serves a blazing-fast dark mode UI. You can access the AI from your phone or tablet on the same WiFi network without complex CORS configuration.
  • Hardware Accelerated: Uses a custom-compiled Ollama engine under the hood, natively capitalizing on AVX CPU instructions, NVIDIA CUDA, or Apple Metal GPU accelerators dynamically when plugged into different host machines.

๐Ÿ’ป System Requirements

Before preparing your drive, ensure you have:

  • Storage: A USB 3.0+ flash drive or SSD with an absolute minimum of 8 GB free space (16 GB is highly recommended).
  • RAM: The host computer should have at least 8 GB of system memory to run the 2B/4B models, and 16 GB of memory to fluidly run the 9B/12B models.

๐Ÿ“‚ Folder Architecture

The project is structured to strictly isolate operating system executables while securely unifying heavy model weights to save precious portable storage capacity.

[Portable USB Drive]
 โ”œโ”€โ”€ ๐Ÿ“ Android    # Native Android (Termux) installers & launchers
 โ”œโ”€โ”€ ๐Ÿ“ Linux      # Native Ubuntu/Debian offline installers & launchers
 โ”œโ”€โ”€ ๐Ÿ“ Mac        # Native macOS offline installers & launchers
 โ”œโ”€โ”€ ๐Ÿ“ Windows    # Native Windows offline automatic UI menus
 โ””โ”€โ”€ ๐Ÿ“ Shared     # Unified Data System
      โ”œโ”€โ”€ ๐Ÿ“ bin         (Holds isolated executables: ollama-windows.exe, ollama-darwin...)
      โ”œโ”€โ”€ ๐Ÿ“ chat_data   (Houses cross-platform persistent conversation history)
      โ”œโ”€โ”€ ๐Ÿ“ models      (HuggingFace GGUF Weights & local database mapping)
      โ””โ”€โ”€ ๐Ÿ“ python      (Isolated portable python environment)

๐Ÿง  Curated AI Model Library

This USB ships with a curated installer for the highest-quality, locally operable uncensored models available on the open-source market today:

  1. Gemma 2 2B Abliterated (~1.6 GB): Recommended for all. Extremely fast, incredibly smart for its size, with safety alignment vectors mathematically purged.
  2. Gemma 4 E4B Ultra Uncensored Heretic (~5.34 GB): A "heretic" fine-tune that aggressively forces compliance to all user queries regardless of content or legality.
  3. Qwen 3.5 9B Uncensored Aggressive (~5.2 GB): A much larger, incredibly competent reasoning model with a strict adherence to raw, unbiased answers.
  4. Custom Models: The installer supports downloading any .gguf weight directly from HuggingFace natively into the USB's engine.

โš™๏ธ Quick Start Guide

Step 1: Initialize the Engine

Depending on the computer you are currently plugged into, navigate into the respective Operating System folder and double-click/run the install script.

  • Windows: Double-click Windows/install.bat
  • macOS: Open Terminal, drag in Mac/install.command, and press Enter.
  • Linux: Run bash Linux/install.sh
  • Android: Open Termux, run bash Android/install.sh (see Android section below)

Note: Initializing simply downloads the tiny 50MB execution engine specific to that computer to the Shared/bin folder.

Step 2: Download AI Models

It is highly recommended to run the model download phase via a Windows PC (Windows/install.bat), which provides an interactive, terminal-based catalog to easily select and download highly curated, uncensored GGUF Models. (If you do not have a Windows PC, simply download your .gguf weights from HuggingFace and place them into the Shared/models folder manually).

Step 3: Launch

Open the respective OS folder and run the start script:

  • Windows: Windows/start-fast-chat.bat
  • macOS: Mac/start.command
  • Linux: bash Linux/start.sh
  • Android: bash Android/start.sh (in Termux)

The engine will spin up securely in the background, and your default web browser will automatically open the locally-served Chat UI.


๐Ÿ  Local Disk Installation

While this project is optimized for USB portability, it works beautifully as a lightweight local AI setup on your primary computer.

How to Install Locally:

  1. Download/Clone this repository to a folder on your C:\ or D:\ drive.
  2. Navigate to the Windows (or Mac/Linux) folder.
  3. Run install.bat and choose your desired models.
  4. The system will download everything into that local folder.
  5. Run start-fast-chat.bat to begin.

Benefit: Running from an internal SSD is significantly faster than a USB drive, resulting in near-instant AI model loading!


๐Ÿ“ฑ Android Native (Termux)

Run the AI engine directly on your Android phone or tablet โ€” no PC required!

Requirements

  • Termux installed from F-Droid (NOT the Play Store โ€” it's outdated)
  • 6 GB+ RAM (8 GB+ recommended). Only the 2B model runs well on 6 GB devices.
  • WiFi or mobile data for initial setup (downloading engine + models)
  • ARM64 processor (virtually all modern Android phones/tablets)

Setup

  1. Copy the USB-Uncensored-LLM folder to your Android device (via USB OTG, file transfer, or git clone)
  2. Open Termux and navigate to the project folder
  3. Run: bash Android/install.sh
  4. Select your model (Gemma 2 2B recommended for most Android devices)
  5. Wait for downloads to complete โ€” keep Termux in the foreground!

Launch

bash Android/start.sh

The AI engine starts and Chrome opens automatically with the chat UI.

Android Performance Tips

  • Run termux-wake-lock before starting โ€” prevents Android from killing the process
  • Keep Termux in the foreground for best performance
  • Close other apps to free RAM for the AI model
  • Use the 2B model on devices with less than 12 GB RAM
  • Plug in your charger โ€” LLM inference drains battery fast
  • Expect ~3-10 tokens/sec on the 2B model (vs 30-50+ on a PC with GPU)

๐Ÿ“ฑ LAN Mobile Access

If you want to use the Heavyweight AI from your phone while lounging on the couch:

  1. Ensure your PC running the start script and your phone are on the exact same WiFi network.
  2. The terminal window will automatically detect your host machine and display a Network Access IP Address (e.g., http://192.168.1.15:3333).
  3. Simply type that URL into your mobile browser (Safari/Chrome). The custom Python server perfectly routes mobile queries directly to the USB! (Note: If pages do not load, ensure Windows Firewall allows incoming connections on port 3333).

๐Ÿ› ๏ธ Troubleshooting

  • The script instantly closes on Windows: You likely have the legacy Windows App Execution Aliases turned on, which tricks the OS. Run the script via a command prompt, or right-click the .bat file and "Run as Administrator".
  • "Ollama Engine Not Found": You attempted to run the start script before the install script downloaded the base software for your specific OS. Run your OS's installer!
  • Slow Generation Speeds: Your model is too large for your host PC's RAM. Re-run install.bat and select the Gemma 2 2B Abliterated model, which runs rapidly even on older machines.

Disclaimer: USB-Uncensored-LLM is built for uncompromising computational freedom. By utilizing ablative models, the system will not moralize, lecture, or refuse your prompts. Please use responsibly.

USB-Uncensored-LLM