CRUXEval Sample Explorer

model: temp:

def f(alphabet, s):
    a = [x for x in alphabet if x.upper() in s]
    if s.upper() == s:
        a.append('all_uppercased')
    return a
assert f('abcdefghijklmnopqrstuvwxyz', "uppercased # % ^ @ ! vz.") == []

CRUXEval-I assert f(??) == []

CRUXEval-O assert f('abcdefghijklmnopqrstuvwxyz', "uppercased # % ^ @ ! vz.") == ??

🔎 CRUXEval Sample Explorer 🔎

CRUXEval is a benchmark complementary to HumanEval and MBPP measuring code reasoning, understanding, and execution capabilities!