PocketBase Docs Scraper for LLMs
October 15, 2025 · View on GitHub
# Clone the repository
git clone https://github.com/magooney-loon/pb-llm
cd pb-llm
# Run the scraper
go run cmd/main.go
PocketBase Documentation Scraper for LLM Usage
=============================================
DESCRIPTION:
Scrapes PocketBase documentation and automatically generates 4 variations:
• Full - Complete documentation with all extensions
• Go-only - Go extensions only (backend development)
• JS-only - JavaScript extensions only (frontend development)
• Core-only - Core PocketBase without any extensions
Each variation is generated in ultra-compact LLM-optimized and plain text formats.
USAGE:
go run cmd/main.go [OPTIONS]
OPTIONS:
-help
Show this help message
OUTPUT FORMATS:
• .llm.md - Ultra-compact LLM format for maximum token efficiency
• .txt - Plain text format for general use
FEATURES:
🤖 LLM-optimized output format
📊 Token counting and estimation
📈 Context window usage analysis
🔧 AI training dataset structure
📝 Comprehensive LLM usage statistics
📄 Plain text backup format
🎯 Automatic generation of all variations
📦 Pick exactly what you need
OUTPUT (4 variations × 2 formats = 8 documentation files):
• pocketbase_docs_full.llm.md/.txt - Complete documentation
• pocketbase_docs_go.llm.md/.txt - Go extensions only
• pocketbase_docs_js.llm.md/.txt - JavaScript extensions only
• pocketbase_docs_core.llm.md/.txt - Core PocketBase only
• summary_*.txt - Individual statistics for each variation
EXAMPLE:
go run cmd/main.go # Generates all 4 variations
All files saved in timestamped docs/session_YYYY-MM-DD_HH-MM-SS.mmm/ directory