Opt-in content policy guardrail for AgentOS — detects violations and rewrites or blocks output via LLM judge

Standalone package: max-mode parallel reasoning with judge selection + 18 markdown compose skills + plugin health diagnostics.

MCP server for judge-java — Claude Code integration

Open Judge Toolkit.

a simple online judge

A standalone library for AI agent regression testing using LLM-as-judge evaluation

Semantic conflict adjudication for Credence: declarative conflict families, cached verdicts, optional LLM.

The Judge Protocol - Thread identity, intent verification, and blockchain anchoring

Testing utilities for nestjs-adk: TestAgent, scripted engine/models, Vitest matchers and LLM-as-judge.

LLM agent + LLM-as-Judge + Human-in-the-Loop review + learning loop, as an embeddable library

MCP server exposing the Omega-API geometric judge as one tool.

Refine an Agent Skill via the skill-forge judge -> hitl loop, in a sandboxed Docker container.

Eval framework for the Graphorin framework. Ships scorer libraries (`code/` exact-match, regex, JSON path, predicates; `llm/` LLM-judge; `prebuilt/` toxicity / factuality / helpfulness), dataset loaders (JSONL, CSV, from-traces, generic iterable), reporte

Dockerised regression-test framework for OpenClaw workspaces: bus, scenario driver, judge, Compose stack.

problem solving offline judge CLI

The entity and its 4 axes — shape, role, lifecycle, boundary. One judge, edge-safe.

Find the best search API for your agent. Same query, same model, same judge, swap only the retrieval provider: Firecrawl, Tavily, Exa, Bright Data, keyless baseline.

Shared TypeScript LLM inference layer: schema-constrained completion across Anthropic, OpenAI-compatible, Claude CLI, and in-process local llama.cpp providers, with caching, cost accounting, and an LLM-as-judge ensemble.

Scores AI-generated UI for genericness ("slop") using an LLM-judge rubric. Composable RuleSource plugin architecture, --json mode for CI/agent gates, and a documented library API alongside the CLI.

The official Sphere Online Judge (SPOJ) adapter for Developer Profile Kit. This package fetches and normalizes SPOJ user statistics, ranks, and points.