AI Evaluation Tools

Reference-free evaluation framework specifically for RAG pipelines.

Open-source LLM evaluation framework with 50+ metrics and CI integration.

AI evaluation and observability platform for testing prompts, models, and agents in production.

Open-source LLM engineering platform for tracing, evals, and analytics.

ML and LLM observability platform for monitoring, evaluation, and drift detection.

Open framework for evaluating LLMs and model outputs with customizable benchmarks.

Evaluation and tracking for LLM apps — feedback functions and experiment logging.

CLI tool for testing and evaluating LLM outputs with red-teaming support.

Cloud platform for LLM evaluation, regression testing, and monitoring built on DeepEval.

Framework for programming — not prompting — language models.

Automated evaluation and scoring platform for LLM outputs and safety.

Open-source observability for LLMs, embeddings, and retrieval.