🔎 CRUXEval Sample Explorer 🔎

CRUXEval is a benchmark complementary to HumanEval and MBPP measuring code reasoning, understanding, and execution capabilities!


   
def f(str, char):
    base = char * (str.count(char) + 1)
    return str.removesuffix(base)
assert f('mnmnj krupa...##!@#!@#$$@##', '@') == 'mnmnj krupa...##!@#!@#$$@##'
CRUXEval-I
assert f(??) == 'mnmnj krupa...##!@#!@#$$@##'

CRUXEval-O
assert f('mnmnj krupa...##!@#!@#$$@##', '@') == ??