AI Agent Tools Directory — Tracing, Evaluation & Frameworks

Popular categories

High-traffic selection hubs for agent tracing and evaluation tooling.

Agent Evaluation

Best AI Agent Evaluation Platforms in 2026

Compare agent evaluation platforms and software for tool-use regressions, trace-linked evals, cost, and latency before agents reach users.

View tools in category

Browse category

Agent Tracing

7 Best Agent Tracing Tools (LangSmith, Langfuse, Phoenix)

Compare agent tracing tools for inspectable runs: prompts, tool calls, retrieved context, errors, retries, cost, and latency.

View tools in category

Browse category

13 tools tagged with Agent Evaluation

All Agent Memory Agentic RAG MCP Servers Agent Frameworks Agent Evaluation Agent Tracing

Tool	Categories	Type
Arize PhoenixOpen-source LLM and agent tracing with built-in evaluation.	Categories Agent TracingAgent Evaluation	TypeOpen source
BraintrustEvaluation-first platform for logging, scoring, and comparing agent runs.	Categories Agent TracingAgent Evaluation	TypeManaged
coder_evalSandboxed, reproducible evaluation framework for coding agents and their skills.	Categories Agent Evaluation	TypeOpen source
DeepEvalLLM and agent evaluation framework that feels like unit testing with pytest.	Categories Agent Evaluation	TypeOpen source
Guardrails AIOutput validation, structural constraints, and real-time corrections for LLMs.	Categories Agent Evaluation	TypeOpen source
LangfuseOpen-source LLM engineering platform for tracing, evals, and prompt workflows.	Categories Agent TracingAgent Evaluation	TypeOpen source
LangSmithTracing, evaluation, and debugging for LLM applications.	Categories Agent EvaluationAgent Tracing	TypeManaged
LangWatchAgent observability with tracing, analytics, and simulation-style testing.	Categories Agent TracingAgent Evaluation	TypeOpen source
OpenAI Agents SDKA lightweight SDK for agents, tools, handoffs, and traces.	Categories Agent FrameworksAgent EvaluationAgent Tracing	TypeOpen source
Portkey AI GatewayProduction LLM gateway with routing, guardrails, MCP support, and observability.	Categories Agent EvaluationAgent Tracing	TypeOpen source
PromptfooLocal-first LLM evaluation and red teaming CLI for agent safety testing.	Categories Agent Evaluation	TypeOpen source
RagasEvaluation library for RAG and agentic RAG pipelines—retrieval quality, faithfulness, and grounding.	Categories Agent Evaluation	TypeOpen source
Weights & Biases WeaveOpen-source toolkit for tracing, evaluating, and iterating on LLM apps.	Categories Agent TracingAgent Evaluation	TypeOpen source