🔎 CRUXEval Sample Explorer 🔎

CRUXEval is a benchmark complementary to HumanEval and MBPP measuring code reasoning, understanding, and execution capabilities!

Homepage Paper Code HF Dataset Leaderboard

    
def f(text):
    a = 0
    if text[0] in text[1:]:
        a += 1
    for i in range(0, len(text)-1):
        if text[i] in text[i+1:]:
            a += 1
    return a
assert f("3eeeeeeoopppppppw14film3oee3") == 18
CRUXEval-I 
assert f(??) == 18
 

            		
          

          

            
              CRUXEval-O
              
assert f("3eeeeeeoopppppppw14film3oee3") == ??

              

              

            		
          

        

      


      
      

      

        
        
        
        

          641 / 800
        

      


      
      

        The site is inspired by and based on
        Minerva sample explorer and
        Llemma. Thanks!