跳转到主要内容
AgentCompass 的 benchmark reference 按字母序统一排列。能力维度不再作为侧边栏分类,而是作为 tag 标注在每个 benchmark 上,因为同一个 benchmark 可能同时覆盖多个能力方向。 当前公开 reference 覆盖 21 个 benchmark 条目。
BenchmarkTags常见执行形态
browsecompDeep Research, Web Browsing, Judge-Scoredlocal with judge
browsecomp_zhDeep Research, Web Browsing, Chinese, Judge-Scoredlocal with judge
deepsearchqaDeep Research, Search QA, Judge-Scoredlocal with judge
frontierscienceDeep Research, Science, Judge-Scoredlocal with judge
gaiaDeep Research, Tool Use, File Reasoning, General Assistantlocal with judge
gdpval_acProductivity, Long-Horizon, Judge-Scoredremote environment
hleDeep Research, Reasoning, Judge-Scoredlocal with judge
hle_verifiedDeep Research, Reasoning, Verified, Judge-Scoredlocal with judge
pinchbenchProductivity, OpenClaw, Agentic Codingremote environment
researchclawbenchDeep Research, Scientific Research, Workspace, Agentic Codinglocal or remote workspace
scicodeAgentic Coding, Scientific Coding, Tool Uselocal
screenspotGUI Grounding, Visionlocal
sgi_deep_researchDeep Research, Scientific Research, Judge-Scoredlocal with judge
skillsbenchTerminal, Skills, Productivity, Agentic Codingremote environment
swebench_multilingualAgentic Coding, Repository Repair, Multilingualremote environment
swebench_proAgentic Coding, Repository Repair, Long-Horizonremote environment
swebench_verifiedAgentic Coding, Repository Repair, Verifiedremote environment
terminal_bench_2Terminal, Tool Useremote environment
terminal_bench_2_1Terminal, Tool Useremote environment
terminal_bench_2_verifiedTerminal, Tool Use, Verifiedremote environment
wildclawbenchProductivity, OpenClaw, Long-Horizon, Tool Usecontainer workspace