Capability-based compiler/runner for reproducible agent scenarios
-
Updated
May 22, 2026 - Rust
Capability-based compiler/runner for reproducible agent scenarios
A Multi-Agent System (MAS) evaluation framework using PydanticAI that generates and evaluates scientific paper reviews through a three-tiered assessment approach: traditional metrics, LLM-as-a-Judge, and graph-based complexity analysis.
Deterministic offline ComtradeBench judge for evaluating agent robustness under pagination, retries, duplicates, page drift, and totals traps.
Business Process AI Worker · τ²-Bench #1 globally (3/3, 100%) · CRMArenaPro Run 8 · Reflexive Agent Architecture
Fault-injecting OpenEnv training environment for vibe-coded SaaS incidents. 30 scenarios grounded in 2025-26 production failures. Drop-in OpenClaw-RL pool server. Claude Code skill included.
Code translator green agent (Judge) of an agent-as-a-judge programming languages translation.
Baseline purple agent for the ComtradeBench benchmark: UN Comtrade tool-use under adversarial API conditions.
AI-powered clinical triage simulation using Manchester Triage System (MTS). OpenEnv Challenge 2026 entry with A2A protocol support.
Leaderboard infrastructure for the ComtradeBench / AgentBeats agent-evaluation benchmark: task definitions, submission flow, and scoring.
A2A green-agent orchestrator for evaluating agents on the AppWorld benchmark, built on the AgentBeats SDK
Add a description, image, and links to the agentbeats topic page so that developers can more easily learn about it.
To associate your repository with the agentbeats topic, visit your repo's landing page and select "manage topics."