evaluating-code-models

Evaluates code generation models across HumanEval, MBPP, MultiPL-E, and 15+ benchmarks with pass@k metrics. Use when benchmarking code models, comparing coding abilities, testing multi-language support, or measuring code generation quality. Industry standard from BigCode Project used by HuggingFace

By orchestra-research · 761 installs

npx skills add orchestra-research/ai-research-skills --skill evaluating-code-models

Source repository · Upstream listing