The LLM Evaluation Framework for TypeScript

Next generation LLM evaluation framework powered by Vitest.

Core - Next generation LLM evaluation framework powered by Vitest.

LLM evaluation framework with batch processing and data sources

Privacy-conscious OpenTelemetry traces, metrics, and optional LLM evaluation for Pi

Command line interface for Viteval - Next generation LLM evaluation framework powered by Vitest.

EvalGuard core — LLM evaluation, security testing, firewall, gateway, and monitoring engine. Runtime dep of @evalguard/sdk and @evalguard/cli.

Automated LLM evaluation pipeline generator

A general-purpose LLM evaluation framework with dataset loading, scoring, run persistence, model comparison, and console reporting.

Code-first LLM evaluation & red-teaming framework

LLM Evaluation Framework

Scaffold a ready-to-run Playwright + TypeScript test framework: AI Judge for LLM evaluation, layered API testing, lazy session auth, and full tooling (ESLint, Prettier, husky, commitlint)

Fitness scoring and LLM evaluation for functional TypeScript codebases using the functype ecosystem

Comprehensive feedback collection and LLM evaluation platform for Node.js - human-in-the-loop annotation, automated evaluation pipelines, preference dataset generation

HTML report generation for ArtemisKit LLM evaluation toolkit

Core runner, evaluators, and storage for ArtemisKit LLM evaluation toolkit

Anthropic Claude adapter for ArtemisKit LLM evaluation toolkit

Command-line interface for ArtemisKit LLM evaluation toolkit

Red-team adversarial security testing for ArtemisKit LLM evaluation toolkit

Distributed LLM evaluation at scale