Resources

December 4, 2025 ยท View on GitHub

Agents

1. Agentic Tools & Frameworks

Latest Framework Updates (2025):

  • OpenAI Agents SDK (March 2025): Minimalist Python framework for multi-agent workflows with robust tracing
  • LangChain v1.0 (2025): Standard tool calling architecture, provider-agnostic design
  • LangGraph v1.0 (2025): Node-based architecture for multi-agent systems with structured state management
  • Anthropic Claude Skills: New API for building agents with Claude
  • Model Context Protocol (MCP): Standard protocol for connecting AI models to external data sources and tools

2. Agents System Design

3. Learning Resources

3.5. Evaluation & Testing Tools (2025)

  • Evaluation Platforms
    • Maxim AI: End-to-end evaluation platform for AI agents
    • Langfuse: Open-source observability and evaluation for LLM applications
    • Comet Opik: AI agent evaluation and monitoring
    • Arize: ML observability platform with agent evaluation
    • Evidently AI: AI agent benchmarks and testing frameworks
  • Benchmarks
    • Web Agent Benchmarks: Evaluate agents' web navigation and interaction capabilities
    • OS Agent Benchmarks: Test agents in operating system environments
    • Tool-Using Agent Benchmarks: Assess agents' proficiency with external tools
    • Multi-Agent Benchmarks: Evaluate collaborative agent systems

4. Applications & Examples

5. Additional Resources

6. Recent Developments (2025)