AI Agent Tools Directory — Tracing, Evaluation & Frameworks

Popular categories

High-traffic selection hubs for agent tracing and evaluation tooling.

Agent Evaluation

Best AI Agent Evaluation Platforms in 2026

Compare agent evaluation platforms and software for tool-use regressions, trace-linked evals, cost, and latency before agents reach users.

View tools in category

Browse category

Agent Tracing

7 Best Agent Tracing Tools (LangSmith, Langfuse, Phoenix)

Compare agent tracing tools for inspectable runs: prompts, tool calls, retrieved context, errors, retries, cost, and latency.

View tools in category

Browse category

50 tools indexed A–Z

All Agent Memory Agentic RAG MCP Servers Agent Frameworks Agent Evaluation Agent Tracing

Tool	Categories	Type
AgnoLightweight agent framework with a clear path from SDK to production API.	Categories Agent Frameworks	TypeOpen source
Arcade.devMCP runtime with authorization, permission, and production-grade tool execution.	Categories MCP Servers	TypeOpen source
Arize PhoenixOpen-source LLM and agent tracing with built-in evaluation.	Categories Agent TracingAgent Evaluation	TypeOpen source
BraintrustEvaluation-first platform for logging, scoring, and comparing agent runs.	Categories Agent TracingAgent Evaluation	TypeManaged
browser-useBrowser automation agents for complex web tasks and skill-based workflows.	Categories Agent Frameworks	TypeOpen source
Browserbase StagehandNatural-language browser automation backed by production cloud browsers.	Categories Agent Frameworks	TypeOpen source
ByteRoverPortable memory with pre-compressed extraction and knowledge trees.	Categories Agent Memory	TypeOpen source
ChromaOpen-source embedding database for AI applications.	Categories Agentic RAG	TypeOpen source
Cloudflare Agents SDKDeploy agents at the edge on Cloudflare Workers.	Categories Agent Frameworks	TypeOpen source
coder_evalSandboxed, reproducible evaluation framework for coding agents and their skills.	Categories Agent Evaluation	TypeOpen source
ComposioConnect agents to 1000+ SaaS tools with managed auth and tool registry.	Categories MCP Servers	TypeOpen source
CrewAIRole-based multi-agent workflow framework.	Categories Agent Frameworks	TypeOpen source
DeepEvalLLM and agent evaluation framework that feels like unit testing with pytest.	Categories Agent Evaluation	TypeOpen source
E2BCloud sandbox for agents that write code, execute commands, and handle files.	Categories Agent Frameworks	TypeOpen source
EverOSLocal-first memory operating system with Markdown as the source of truth.	Categories Agent Memory	TypeOpen source
ExaSearch engine built for AIs—live web retrieval for research agents.	Categories Agentic RAG	TypeManaged
GalileoEnterprise GenAI evaluation, observability, and protection platform.	Categories Agent Tracing	TypeManaged
Google Agent Development KitGoogle's open-source agent framework with multi-agent, A2A protocol, and production deployment.	Categories Agent Frameworks	TypeOpen source
Guardrails AIOutput validation, structural constraints, and real-time corrections for LLMs.	Categories Agent Evaluation	TypeOpen source
HaystackAgentic RAG and retrieval pipeline framework for production NLP.	Categories Agentic RAG	TypeOpen source
HeliconeOpen-source AI gateway and LLM observability with proxy-based tracing.	Categories Agent Tracing	TypeOpen source
HindsightKnowledge graph memory with cross-memory synthesis.	Categories Agent Memory	TypeOpen source
HolographicHolographic Reduced Representations memory with trust scoring.	Categories Agent Memory	TypeOpen source
HonchoDialectical user modeling memory for stateful agents.	Categories Agent Memory	TypeOpen source
LangfuseOpen-source LLM engineering platform for tracing, evals, and prompt workflows.	Categories Agent TracingAgent Evaluation	TypeOpen source
LangGraphStateful graph orchestration for controllable agents.	Categories Agent FrameworksAgent MemoryAgent Tracing	TypeOpen source
LangSmithTracing, evaluation, and debugging for LLM applications.	Categories Agent EvaluationAgent Tracing	TypeManaged
LangWatchAgent observability with tracing, analytics, and simulation-style testing.	Categories Agent TracingAgent Evaluation	TypeOpen source
LettaStateful agents with long-term memory and context engineering.	Categories Agent Memory	TypeOpen source
LlamaIndexData and retrieval framework for LLM and agent apps.	Categories Agentic RAGAgent MemoryAgent Frameworks	TypeOpen source
MastraTypeScript-first agent framework with workflows, observability, and RAG.	Categories Agent Frameworks	TypeOpen source
Mem0Long-term memory layer for agents and assistants.	Categories Agent Memory	TypeOpen source
Microsoft AutoGenFramework for multi-agent conversations and collaboration.	Categories Agent Frameworks	TypeOpen source
Model Context ProtocolOpen protocol for connecting agents to tools and context.	Categories MCP Servers	TypeOpen source
Nowledge MemLocal-first personal knowledge layer across Cursor, Claude Code, and other AI tools.	Categories Agent Memory	TypeManaged
OpenAI Agents SDKA lightweight SDK for agents, tools, handoffs, and traces.	Categories Agent FrameworksAgent EvaluationAgent Tracing	TypeOpen source
OpenHandsOpen-source software engineering agent for code, files, and terminals.	Categories Agent Frameworks	TypeOpen source
OpenVikingFilesystem-paradigm context database for agent memory.	Categories Agent Memory	TypeOpen source
PAXMProvider-neutral memory adapter for coding agents, with local SQLite and MCP.	Categories Agent Memory	TypeOpen source
PineconeManaged vector database for production RAG and search.	Categories Agentic RAG	TypeManaged
Portkey AI GatewayProduction LLM gateway with routing, guardrails, MCP support, and observability.	Categories Agent EvaluationAgent Tracing	TypeOpen source
PromptfooLocal-first LLM evaluation and red teaming CLI for agent safety testing.	Categories Agent Evaluation	TypeOpen source
Pydantic AIType-safe agent framework for Python with structured output validation.	Categories Agent Frameworks	TypeOpen source
QdrantOpen-source vector database and search engine.	Categories Agentic RAG	TypeOpen source
RagasEvaluation library for RAG and agentic RAG pipelines—retrieval quality, faithfulness, and grounding.	Categories Agent Evaluation	TypeOpen source
RetainDBHybrid retrieval memory with quality filtering for coding agents.	Categories Agent Memory	TypeOpen source
Strands AgentsAWS-native agent SDK for tool use and deployment.	Categories Agent Frameworks	TypeOpen source
TraceloopOpenTelemetry-native observability for LLM and agent workloads.	Categories Agent Tracing	TypeOpen source
Weights & Biases WeaveOpen-source toolkit for tracing, evaluating, and iterating on LLM apps.	Categories Agent TracingAgent Evaluation	TypeOpen source
ZepTemporal knowledge graph memory for agents.	Categories Agent Memory	TypeOpen source