claude-3-opus-20240229claude-3-sonnet-20240229deepseek-coder-33b-instructclaude-3-haiku-20240307bigcode--starcoder2-15b-instruct-v0.1opencodeinterpreter-ds-6.7bwizardcoder-34bHuggingFaceH4--starchat2-15b-v0.1CohereForAI--c4ai-command-r-plusmixtral-8x22b-instruct-v0.1mistral-large-latestdeepseek-coder-6.7b-basecodegemma-7b-itdatabricks--dbrx-instructcode-llama-multi-34bcodegemma-7bphi-2code-llama-13bmixtral-8x7b-instructwizardcoder-7bgemma-1.1-7b-itcodegemma-2bcodegen-16bstarcoder2-3bgemma-7bmistral-7bxdan-l1-chatcodegen-2bsolar-10.7b-instructgemma-7b-itMbpp/235Mbpp/603Mbpp/125Mbpp/749Mbpp/631Mbpp/745Mbpp/67Mbpp/748Mbpp/739Mbpp/809Mbpp/410Mbpp/722Mbpp/801Mbpp/731Mbpp/4Mbpp/777Mbpp/69Mbpp/781Mbpp/637Mbpp/791Mbpp/240Mbpp/108Mbpp/223Mbpp/409Mbpp/767Mbpp/788Mbpp/732Mbpp/803Mbpp/172Mbpp/65Mbpp/389Mbpp/726Mbpp/413Mbpp/94Mbpp/70Mbpp/600Mbpp/127Mbpp/565Mbpp/262Mbpp/766Mbpp/412Mbpp/733Mbpp/161Mbpp/282Mbpp/587Mbpp/118Mbpp/458Mbpp/88
00.20.40.60.81pass1_exmodelexample_id