CRUXEval Sample Explorer

model: temp:

def f(text, chars):
    num_applies = 2
    extra_chars = ''
    for i in range(num_applies):
        extra_chars += chars
        text = text.replace(extra_chars, '')
    return text
assert f('zbzquiuqnmfkx', 'mk') == 'zbzquiuqnmfkx'

CRUXEval-I assert f(??) == 'zbzquiuqnmfkx'

CRUXEval-O assert f('zbzquiuqnmfkx', 'mk') == ??

🔎 CRUXEval Sample Explorer 🔎

CRUXEval is a benchmark complementary to HumanEval and MBPP measuring code reasoning, understanding, and execution capabilities!