CRUXEval Sample Explorer

model: temp:

def f(pattern, items):
    result = []
    for text in items:
        pos = text.rfind(pattern)
        if pos >= 0:
            result.append(pos)

    return result
assert f(" B ", [" bBb ", " BaB ", " bB", " bBbB ", " bbb"]) == []

CRUXEval-I assert f(??) == []

CRUXEval-O assert f(" B ", [" bBb ", " BaB ", " bB", " bBbB ", " bbb"]) == ??

🔎 CRUXEval Sample Explorer 🔎

CRUXEval is a benchmark complementary to HumanEval and MBPP measuring code reasoning, understanding, and execution capabilities!