11,559 packages matching “eval-harness”

eval-harness

v0.2.18 · 1 month ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Evaluation harness for configurable runner work packages

5Downloads across all versions in the last 7 days, from the official npm downloads API.UNLICENSEDLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.2.18 (the latest release), from the OSV.dev database.

@plaited/agent-eval-harness

v1.0.1 · 1 month ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

General-purpose eval harness for running trials against CLI agents

26Downloads across all versions in the last 7 days, from the official npm downloads API.ISCLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v1.0.1 (the latest release), from the OSV.dev database.

@accelerate-data/promptfoo-eval-harness

v1.7.2 · 8 days ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Promptfoo + OpenCode eval harness for agent behavior. Owns model/tier policy, provider wiring, package discovery, state export, and artifact guards. Consumers own eval YAML, prompts, fixtures, and assertions.

480Downloads across all versions in the last 7 days, from the official npm downloads API.Elastic-2.0License declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v1.7.2 (the latest release), from the OSV.dev database.

lastlight-evals

v0.9.16 · 1 hour ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Eval harness for Last Light workflows — drives the real production workflows against a mocked GitHub and grades deterministically (SWE-bench compatible).

2.2KDownloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.9.16 (the latest release), from the OSV.dev database.

@tonyclaw/eval-harness-win32-x64

v0.2.19 · 1 month ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Windows x64 native binary for @tonyclaw/eval-harness

2Downloads across all versions in the last 7 days, from the official npm downloads API.UNLICENSEDLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.2.19 (the latest release), from the OSV.dev database.

@agent-relay/evals

v11.4.1 · 3 days ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Agent Relay eval harness — scenario runner, broker harness, and scoring utilities for testing relay-connected agents

585Downloads across all versions in the last 7 days, from the official npm downloads API.Apache-2.0License declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v11.4.1 (the latest release), from the OSV.dev database.

@reaatech/agent-eval-harness-mcp-server

v0.1.2 · 1 month ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Three-layer MCP tool server (judge, suite, gate) for agent-eval-harness

41Downloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.1.2 (the latest release), from the OSV.dev database.

@elisym/eval

v0.2.0 · 1 month ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Eval harness for payment-enabled AI agents - deterministic assertions over traces and ledgers

10Downloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.2.0 (the latest release), from the OSV.dev database.

langdrift

v0.4.0 · 1 month ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Locale-aware eval harness for AI agent behavior

13Downloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.4.0 (the latest release), from the OSV.dev database.

@reaatech/agent-eval-harness-judge

v0.2.0 · 1 month ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Provider-agnostic LLM-as-judge with calibration and consensus for agent-eval-harness

4Downloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.2.0 (the latest release), from the OSV.dev database.

@reaatech/agent-eval-harness-suite

v0.1.2 · 1 month ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Orchestrated evaluation suite runner with results aggregation for agent-eval-harness

3Downloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.1.2 (the latest release), from the OSV.dev database.

@looprun-ai/eval

v0.16.0 · 17 minutes ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

looprun eval harness: run a generated subject's cases against a model target (governed or ungoverned variant), dump per-case traces for the LLM judge, fold verdicts, and certify against the bar.

829Downloads across all versions in the last 7 days, from the official npm downloads API.Apache-2.0License declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.16.0 (the latest release), from the OSV.dev database.

crewhaus

v0.5.1 · 1 day ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

CrewHaus — the meta-harness compiler for AI agents. Compile one crewhaus.yaml spec into a CLI agent, channel bot, RAG pipeline, multi-agent crew, eval harness, voice or browser agent, and more.

54Downloads across all versions in the last 7 days, from the official npm downloads API.Apache-2.0License declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.5.1 (the latest release), from the OSV.dev database.

@odla-ai/ai

v0.14.0 · 7 hours ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

One general-purpose interface for AI inference across Anthropic (Claude), OpenAI, and Google (Gemini) — text, image, and audio — plus a tool-use agent engine and eval harness for Node 20+ and Cloudflare Workers.

1.5KDownloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.14.0 (the latest release), from the OSV.dev database.

@reaatech/agent-eval-harness-gate

v0.1.2 · 1 month ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

CI regression gates, threshold checks, and JUnit/GitHub integration for agent-eval-harness

6Downloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.1.2 (the latest release), from the OSV.dev database.

undetermini

v0.2.4 · 28 days ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Eval harness for non-deterministic (LLM) code — subjects, variants (provider × model × reasoning), weighted-assertion scoring, trial cache, SQLite runs, CLI + TUI.

7Downloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.2.4 (the latest release), from the OSV.dev database.

@bondarewicz/dreamteam

v1.4.1 · 9 days ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Dream Team — a Claude Code agent roster with a cross-provider, schema-enforced eval harness (Claude, Ollama, Codex). Bun-only.

285Downloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v1.4.1 (the latest release), from the OSV.dev database.

@bhaskarauthor/eval-harness

v0.1.0-alpha.1 · 26 days ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Lightweight eval harness for prompt/agent regression tests in CI for product teams

4Downloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.1.0-alpha.1 (the latest release), from the OSV.dev database.

@reaatech/agent-eval-harness-observability

v0.1.1 · 1 month ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

OpenTelemetry observability (tracing, metrics, logging, dashboards) for agent-eval-harness

3Downloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.1.1 (the latest release), from the OSV.dev database.

@reaatech/agent-eval-harness-types

v0.1.0 · 3 months ago

100
0-100 score computed by this site from verifiable signals only: known OSV.dev advisories affecting this exact version, how recently it was published, and the repository's OpenSSF Scorecard.

Shared domain types and Zod schemas for agent-eval-harness

3Downloads across all versions in the last 7 days, from the official npm downloads API.MITLicense declared in the package manifest.

No known vulnerabilities

Known vulnerabilities affecting v0.1.0 (the latest release), from the OSV.dev database.
1 / 50Next