Awesome Context AI [](https://awesome.re)
June 3, 2026 ยท View on GitHub
A curated list of tools, frameworks, and resources for building AI applications with rich context from screen recordings, audio, activity tracking, and personal data.
The future of AI is context-aware. These tools help you build AI that understands what you've seen, heard, said, and done.
Contents
- Screen & Activity Recording
- Memory & Context Systems
- AI Frameworks with Context Support
- MCP Servers (Model Context Protocol)
- Personal Knowledge Management
- OCR & Text Extraction
- Audio Transcription
- Context for Coding
- Research & Papers
- Building with Context
Screen & Activity Recording
Tools that capture your digital activity for AI-powered recall and search.
Open Source
| Tool | Platform | Description | Stars |
|---|---|---|---|
| Screenpipe | macOS, Windows, Linux | 24/7 local screen & mic recording; indexes accessibility text, OCR, and transcripts for AI search and agents. Works with Ollama. |  |
| Pensieve | macOS, Windows, Linux | Passive screenshot recording with OCR and semantic search, runs fully local |  |
| OpenRecall | macOS, Windows, Linux | Privacy-first alternative to Windows Recall |  |
| Windrecorder | Windows | Memory search app with OCR and image description |  |
| OpenRewind | macOS (Apple Silicon) | Open source Rewind alternative |  |
| OpenReLife | Cross-platform | Fork of OpenRecall with UX focus |  |
Commercial
| Tool | Description |
|---|---|
| Limitless | Personalized AI from everything you've seen, said, or heard. Formerly Rewind.ai; acquired by Meta (Dec 2025), with the Rewind desktop app being wound down |
| Microsoft Recall | Windows feature that takes periodic snapshots for AI-powered search |
Memory & Context Systems
Frameworks for adding persistent memory to AI agents.
| Tool | Description | Stars |
|---|---|---|
| Mem0 | Memory layer for AI agents with LangChain/LlamaIndex integration |  |
| Letta | Stateful agents with long-term memory, the productized successor to MemGPT |  |
| Zep | Long-term memory for AI assistants |  |
| Graphiti | Real-time, temporally-aware knowledge graphs for agent memory |  |
| Cognee | Memory and knowledge-graph layer for AI agents and RAG |  |
| LangMem | Long-term memory for LangChain agents |  |
AI Frameworks with Context Support
Major frameworks that support rich context and RAG.
| Framework | Context Features | Stars |
|---|---|---|
| LangChain | Memory modules, retrievers, document loaders |  |
| LlamaIndex | 300+ data connectors, knowledge graphs |  |
| Haystack | Document stores, retrievers, pipelines |  |
| Semantic Kernel | Memory, planners, plugins |  |
| AutoGen | Multi-agent conversations with context |  |
MCP Servers (Model Context Protocol)
The Model Context Protocol standardizes how AI models access external context.
Official & Curated Lists
- modelcontextprotocol/servers - Official MCP servers
- wong2/awesome-mcp-servers - Community curated list
- appcypher/awesome-mcp-servers - Another curated list
Context-Relevant MCP Servers
| Server | Description |
|---|---|
| Memory | Knowledge graph-based persistent memory |
| Filesystem | Secure local file operations |
| Screenpipe MCP | Access screen recordings and transcripts |
| Browser | Browser automation and context |
Personal Knowledge Management
Tools for organizing and querying personal knowledge.
| Tool | Description | Stars |
|---|---|---|
| Obsidian | Knowledge base on local markdown files | N/A (closed) |
| Logseq | Privacy-first, open-source knowledge base |  |
| SiYuan | Privacy-first, local-first PKM with block-level editing |  |
| Khoj | AI personal assistant for your digital brain |  |
| AnythingLLM | All-in-one desktop app to chat with your docs, fully local option |  |
| Quivr | Your GenAI second brain |  |
| PrivateGPT | Chat with your documents privately |  |
OCR & Text Extraction
Extract text from screens, documents, and images.
| Tool | Platform | Description | Stars |
|---|---|---|---|
| Tesseract | Cross-platform | The definitive open source OCR engine |  |
| Surya | Cross-platform | Modern OCR with layout and reading-order detection in 90+ languages |  |
| Marker | Cross-platform | Convert PDFs and images to clean markdown/JSON |  |
| olmOCR | Cross-platform | Toolkit for converting PDFs and documents to text with VLMs |  |
| EasyOCR | Cross-platform | Ready-to-use OCR with 80+ languages |  |
| PaddleOCR | Cross-platform | Multilingual OCR toolkit |  |
| docTR | Cross-platform | Document text recognition |  |
| Apple Vision | macOS/iOS | Native high-quality OCR | N/A |
| Windows OCR | Windows | Native Windows OCR API | N/A |
Audio Transcription
Convert speech to searchable text.
| Tool | Description | Stars |
|---|---|---|
| Whisper | OpenAI's speech recognition model |  |
| whisper.cpp | High-performance C++ port of Whisper |  |
| faster-whisper | 4x faster Whisper with CTranslate2 |  |
| WhisperX | Whisper with word-level timestamps and speaker diarization |  |
| Parakeet (NVIDIA NeMo) | Fast, accurate ASR models that top open ASR leaderboards | N/A (model) |
| Moonshine | Fast on-device speech recognition for edge and real-time use |  |
| speaches | OpenAI-compatible local STT/TTS server (formerly faster-whisper-server) |  |
| Vosk | Offline speech recognition |  |
Context for Coding
AI coding assistants that use project, codebase, and screen context.
| Tool | Context Features | Stars |
|---|---|---|
| Claude Code | Anthropic's agentic coding CLI with full-repo context |  |
| Cline | Autonomous coding agent in VS Code with codebase context |  |
| OpenHands | Open platform for AI software-engineering agents (formerly OpenDevin) |  |
| Continue | Codebase context, custom context providers |  |
| Aider | Git-aware AI pair programming |  |
| Tabby | Self-hosted AI coding assistant |  |
| Cursor | Full codebase indexing | N/A (closed) |
Research & Papers
Academic work on context-aware AI systems.
- Generative Agents: Interactive Simulacra of Human Behavior - Stanford's paper on agents with memory
- MemGPT: Towards LLMs as Operating Systems - Memory management for LLMs
- Voyager: An Open-Ended Embodied Agent - Lifelong learning agent with memory
- Reflexion: Language Agents with Verbal Reinforcement Learning - Self-reflection for agents
Building with Context
Tutorials & Guides
- Building a Second Brain with AI - Tiago Forte's methodology
- Context Engineering - Best practices for context
Integration Examples
- Screenpipe pipes - Reference automations that consume screen and audio context
- Screenpipe docs - Build apps and agents on top of screen context
- Screenpipe TypeScript SDK - Query screen recordings, audio, and UI elements from JS/TS
Contributing
Contributions welcome! Please read the contribution guidelines first.
License
