GPT-4O-2024-05-13GPT-4-Turbo-1106Claude-3-OpusWCoder-33B-V1.1Gemini-Pro-1.5 (April) (n=1)Eurux-8x22b-NCA (n=1)Claude-3-SonnetMixtral-8x22B-InsClaude-3-HaikuClaude-2MagiCoderS-DS-6.7BOC-DS-6.7BLLama3-70b-BaseDSCoder-6.7b-InsPhind-34B-V2DSCoder-6.7b-BaseSmaug-2-72BLLama3-8b-InsQwen-1.5-72B-ChatCodeGemma-7b-BaseCodeLlama-34b-BaseCllama-13b-InsCllama-34b-InsStarCoder2-7bCllama-7b-InsCodeLlama-13b-BaseDSCoder-1.3b-BaseCodeLlama-7b-BaseOC-DS-1.3B1899_D3025319232283298abc302_fabc307_cabc310_fabc314_fabc321_dabc325_dabc329_fabc336_dabc341_e27573166abc310_dabc342_c3203abc313_cabc341_c3213abc343_dabc304_e2878abc313_a2811abc323_c2870abc309_babc319_d3324abc310_b3018abc334_b2882abc313_b277932421873_Babc303_babc329_dabc341_aabc307_b2755abc342_babc319_babc304_babc310_a32512800abc322_babc322_aabc327_c3093abc328_aabc312_aabc320_a
00.20.40.60.81pass1_exmodelexample_id