CRUXEval Sample Explorer

model: temp:

def f(text, res):
    for c in '*\n"':
        text = text.replace(c, '!' + str(res))
    if text.startswith('!'):
        text = text[len(str(res)):]
    return text
assert f('"Leap and the net will appear', 123) == '3Leap and the net will appear'

CRUXEval-I assert f(??) == '3Leap and the net will appear'

CRUXEval-O assert f('"Leap and the net will appear', 123) == ??

🔎 CRUXEval Sample Explorer 🔎

CRUXEval is a benchmark complementary to HumanEval and MBPP measuring code reasoning, understanding, and execution capabilities!