Browsing:

comet-ml

TypeScript SDK patterns for Opik. Use when working in sdks/typescript.

huggingface

Add and manage evaluation results in Hugging Face model cards. Supports extracting eval tables from README content, importing scores from Artificial Analysis API, and running custom model evaluations

BudEcosystem

Bud AI Foundry - A comprehensive inference stack for compound AI deployment, optimization and scaling. Bud Stack provides intelligent infrastructure automation, performance optimization, and seamless

oaknational

A collection of tools for working with the Oak Open Curriculum Data, including a published MCP server

oimiragieo

LLM-as-judge evaluation framework with 5-dimension rubric (accuracy, groundedness, coherence, completeness, helpfulness) for scoring AI-generated content quality with weighted composite scores and evi

mshraditya

Evaluation is a process of assessing agent systems using different approaches than traditional software

MFD3000

Guide evaluation of healthcare AI systems with domain-specific safety criteria, clinical accuracy rubrics, and score interpretation. Use when building or reviewing health/medical AI evaluations.

METR

Debug stuck Hawk/Inspect AI evaluations. Use when user mentions stuck eval, eval not progressing, eval hanging, samples not completing, eval set frozen, runner stuck, 500 errors in eval, retry loop, e

affaan-m

eval-harness is a formal evaluation framework implementing eval-driven development principles for Claude Code sessions

affaan-m

Use when auditing Claude skills and commands for quality. Supports Quick Scan (changed skills only) and Full Stocktake modes with sequential subagent batch evaluation.

benchflow-ai

Framework for creating high fidelity and complex RL environments and evaluation tasks

langwatch

Generate and verify E2E tests for a feature. Explores live app, creates test plan, generates tests, runs and fixes until passing.