🔎 CRUXEval Sample Explorer 🔎

CRUXEval is a benchmark complementary to HumanEval and MBPP measuring code reasoning, understanding, and execution capabilities!

Homepage Paper Code HF Dataset Leaderboard

    
def f(nums):
    count = len(nums)
    for i in range(count-1, 0, -2):
        nums.insert(i, nums.pop(0) + nums.pop(0))
    return nums
assert f([-5, 3, -2, -3, -1, 3, 5]) == [5, -2, 2, -5]
CRUXEval-I 
assert f(??) == [5, -2, 2, -5]
 

            		
          

          

            
              CRUXEval-O
              
assert f([-5, 3, -2, -3, -1, 3, 5]) == ??

              

              

            		
          

        

      


      
      

      

        
        
        
        

          445 / 800
        

      


      
      

        The site is inspired by and based on
        Minerva sample explorer and
        Llemma. Thanks!