Jest plugin with LLM-as-a-Judge matchers basing on G-Eval, B-Eval, and LLM-Rubric

Eval-gated autonomy: deterministic rules + LLM rubric + an N-clean-runs gate that decides when an AI agent has earned unattended runs.

Jest plugin with LLM-as-a-Judge matchers basing on G-Eval, B-Eval, and LLM-Rubric

Rubric Scoring Interaction

Complex Rubric Scoring Interaction

A [pie][pie]choice component.

LLM-as-judge completion plugin for tagma-sdk pipelines

Governed structured-output LLM pipeline: rate limit → spend caps (per-user + global circuit breaker) → cache → provider-chain failover → Zod validation → usage logging → LLM-judge, with a deterministic mock provider for CI.

Rulvar evals: eval cases, golden outputs, rubric and judge graders, matrix sweeps, canary fingerprint.

Offline trust certificate for your codebase — scores tests, secrets, isolation, claim-vs-reality, and CI discipline; especially useful for AI-written code. Supports JS/TS, Python, Go, Rust, Java, Ruby, PHP, C#, C/C++ and more — see README for the full lan

Reusable cognitive operation factories for llm-ports: classify, score, draft, summarize, extract, plan, analyze. Configure once at definition time, call many times.

Provider-neutral LLM service interface for the DeepSeek Harness

Harness-backed AI testing on top of Vitest.

Provider-routed LLM request retry policy for the DeepSeek Harness

pi-ai-backed DeepSeek adapter for the DeepSeek Harness LLM seam (design-verification twin of dsh-llm-deepseek)

DeepSeek chat-completions adapter for the DeepSeek Harness LLM seam

LLM eval & testing toolkit

AI/LLM judge matchers for Playwright — toPassRubric/toScoreAtLeast/toMatchImage over Ollama, OpenAI-compatible endpoints (OpenAI/OpenRouter/NVIDIA/Groq/…), and native Claude

Hardware accelerated language model chats on browsers

Typescript bindings for langchain