🔎 CRUXEval Sample Explorer 🔎

CRUXEval is a benchmark complementary to HumanEval and MBPP measuring code reasoning, understanding, and execution capabilities!

Homepage Paper Code HF Dataset Leaderboard

    
def f(text):
    odd = ''
    even = ''
    for i, c in enumerate(text):
        if i % 2 == 0:
            even += c
        else:
            odd += c
    return even + odd.lower()
assert f('Mammoth') == 'Mmohamt'
CRUXEval-I 
assert f(??) == 'Mmohamt'
 

            		
          

          

            
              CRUXEval-O
              
assert f('Mammoth') == ??

              

              

            		
          

        

      


      
      

      

        
        
        
        

          129 / 800
        

      


      
      

        The site is inspired by and based on
        Minerva sample explorer and
        Llemma. Thanks!