safim: by examples

Home   Doc/Code

Not solved by any model

There are 2863 examples not solved by any model. Solving some of these can be a good signal that your model is indeed better than leading models if these are good problems.
block_completion_000014, block_completion_000038, block_completion_000059, block_completion_000062, block_completion_000077, block_completion_000165, block_completion_000175, block_completion_000208, block_completion_000231, block_completion_000252, block_completion_000268, block_completion_000270, block_completion_000275, block_completion_000312, block_completion_000313, block_completion_000315, block_completion_000318, block_completion_000323, block_completion_000329, block_completion_000345, block_completion_000364, block_completion_000365, block_completion_000366, block_completion_000367, block_completion_000369, block_completion_000370, block_completion_000371, block_completion_000373, block_completion_000375, block_completion_000376, block_completion_000378, block_completion_000379, block_completion_000380, block_completion_000382, block_completion_000384, block_completion_000387, block_completion_000390, block_completion_000392, block_completion_000393, block_completion_000395, block_completion_000398, block_completion_000400, block_completion_000405, block_completion_000409, block_completion_000410, block_completion_000412, block_completion_000413, block_completion_000415, block_completion_000436, block_completion_000437, block_completion_000439, block_completion_000441, block_completion_000445, block_completion_000446, block_completion_000448, block_completion_000449, block_completion_000450, block_completion_000456, block_completion_000457, block_completion_000463, block_completion_000467, block_completion_000473, block_completion_000475, block_completion_000481, block_completion_000484, block_completion_000486, block_completion_000515, block_completion_000527, block_completion_000528, block_completion_000534, block_completion_000535, block_completion_000554, block_completion_000579, block_completion_000580, block_completion_000587, block_completion_000595, block_completion_000597, block_completion_000598, block_completion_000599, block_completion_000603, block_completion_000604, block_completion_000605, block_completion_000606, block_completion_000610, block_completion_000614, block_completion_000620, block_completion_000636, block_completion_000640, block_completion_000653, block_completion_000661, block_completion_000670, block_completion_000676, block_completion_000678, block_completion_000681, block_completion_000684, block_completion_000689, block_completion_000706, block_completion_000726, block_completion_000741, block_completion_000783, block_completion_000784, block_completion_000788, block_completion_000795, block_completion_000800, block_completion_000808, block_completion_000820, block_completion_000834, block_completion_000842, block_completion_000847, block_completion_000849, block_completion_000854, block_completion_000855, block_completion_000860, block_completion_000861, block_completion_000863, block_completion_000865, block_completion_000919, block_completion_000923, block_completion_000924, block_completion_000927, block_completion_000929, block_completion_000930, block_completion_000940, block_completion_000941, block_completion_000943, block_completion_000964, block_completion_000968, block_completion_000974, block_completion_000985, block_completion_001006, block_completion_001014, block_completion_001016, block_completion_001018, block_completion_001021, block_completion_001022, block_completion_001025, block_completion_001034, block_completion_001037, block_completion_001042, block_completion_001045, block_completion_001046, block_completion_001052, block_completion_001058, block_completion_001060, block_completion_001061, block_completion_001063, block_completion_001066, block_completion_001071, block_completion_001082, block_completion_001091, block_completion_001092, block_completion_001097, block_completion_001099, block_completion_001101, block_completion_001108, block_completion_001111, block_completion_001113, block_completion_001114, block_completion_001117, block_completion_001127, block_completion_001130, block_completion_001133, block_completion_001140, block_completion_001142, block_completion_001145, block_completion_001146, block_completion_001148, block_completion_001154, block_completion_001156, block_completion_001158, block_completion_001182, block_completion_001185, block_completion_001186, block_completion_001202, block_completion_001268, block_completion_001270, block_completion_001271, block_completion_001274, block_completion_001275, block_completion_001280, block_completion_001287, block_completion_001295, block_completion_001297, block_completion_001301, block_completion_001319, block_completion_001320, block_completion_001322, block_completion_001323, block_completion_001325, block_completion_001326, block_completion_001327, block_completion_001337, block_completion_001339, block_completion_001343, block_completion_001344, block_completion_001349, block_completion_001351, block_completion_001356, block_completion_001359, block_completion_001366, block_completion_001368, block_completion_001384, block_completion_001386, block_completion_001397, block_completion_001413, block_completion_001415, block_completion_001416, block_completion_001419, block_completion_001420, block_completion_001430, block_completion_001434, block_completion_001436, block_completion_001437, block_completion_001439, block_completion_001443, block_completion_001444, block_completion_001445, block_completion_001455, block_completion_001457, block_completion_001489, block_completion_001495, block_completion_001503, block_completion_001544, block_completion_001545, block_completion_001547, block_completion_001549, block_completion_001553, block_completion_001563, block_completion_001568, block_completion_001569, block_completion_001570, block_completion_001571, block_completion_001574, block_completion_001577, block_completion_001578, block_completion_001581, block_completion_001583, block_completion_001587, block_completion_001590, block_completion_001599, block_completion_001604, block_completion_001607, block_completion_001610, block_completion_001611, block_completion_001612, block_completion_001614, block_completion_001620, block_completion_001624, block_completion_001629, block_completion_001631, block_completion_001632, block_completion_001634, block_completion_001635, block_completion_001639, block_completion_001640, block_completion_001642, block_completion_001643, block_completion_001645, block_completion_001648, block_completion_001651, block_completion_001653, block_completion_001658, block_completion_001661, block_completion_001662, block_completion_001663, block_completion_001664, block_completion_001665, block_completion_001666, block_completion_001669, block_completion_001670, block_completion_001673, block_completion_001674, block_completion_001681, block_completion_001682, block_completion_001683, block_completion_001685, block_completion_001687, block_completion_001689, block_completion_001691, block_completion_001692, block_completion_001694, block_completion_001718, block_completion_001725, block_completion_001734, block_completion_001745, block_completion_001746, block_completion_001747, block_completion_001748, block_completion_001749, block_completion_001754, block_completion_001757, block_completion_001760, block_completion_001761, block_completion_001762, block_completion_001763, block_completion_001764, block_completion_001769, block_completion_001770, block_completion_001772, block_completion_001776, block_completion_001780, block_completion_001784, block_completion_001787, block_completion_001788, block_completion_001790, block_completion_001798, block_completion_001800, block_completion_001802, block_completion_001817, block_completion_001818, block_completion_001820, block_completion_001821, block_completion_001825, block_completion_001826, block_completion_001829, block_completion_001831, block_completion_001832, block_completion_001833, block_completion_001872, block_completion_001881, block_completion_001882, block_completion_001883, block_completion_001885, block_completion_001886, block_completion_001887, block_completion_001888, block_completion_001891, block_completion_001899, block_completion_001902, block_completion_001906, block_completion_001907, block_completion_001908, block_completion_001909, block_completion_001911, block_completion_001912, block_completion_001916, block_completion_001922, block_completion_001937, block_completion_001959, block_completion_001965, block_completion_001969, block_completion_001991, block_completion_001993, block_completion_001995, block_completion_001996, block_completion_001997, block_completion_001998, block_completion_002000, block_completion_002001, block_completion_002005, block_completion_002009, block_completion_002011, block_completion_002012, block_completion_002014, block_completion_002015, block_completion_002016, block_completion_002018, block_completion_002019, block_completion_002026, block_completion_002032, block_completion_002076, block_completion_002077, block_completion_002079, block_completion_002083, block_completion_002084, block_completion_002085, block_completion_002086, block_completion_002092, block_completion_002094, block_completion_002095, block_completion_002099, block_completion_002107, block_completion_002108, block_completion_002110, block_completion_002112, block_completion_002113, block_completion_002115, block_completion_002116, block_completion_002119, block_completion_002120, block_completion_002121, block_completion_002122, block_completion_002124, block_completion_002126, block_completion_002131, block_completion_002140, block_completion_002141, block_completion_002142, block_completion_002145, block_completion_002148, block_completion_002155, block_completion_002159, block_completion_002166, block_completion_002167, block_completion_002173, block_completion_002174, block_completion_002175, block_completion_002177, block_completion_002178, block_completion_002179, block_completion_002182, block_completion_002186, block_completion_002187, block_completion_002206, block_completion_002208, block_completion_002209, block_completion_002210, block_completion_002211, block_completion_002252, block_completion_002260, block_completion_002271, block_completion_002300, block_completion_002314, block_completion_002341, block_completion_002342, block_completion_002348, block_completion_002349, block_completion_002362, block_completion_002378, block_completion_002380, block_completion_002381, block_completion_002382, block_completion_002388, block_completion_002393, block_completion_002399, block_completion_002400, block_completion_002405, block_completion_002407, block_completion_002408, block_completion_002426, block_completion_002436, block_completion_002439, block_completion_002440, block_completion_002446, block_completion_002455, block_completion_002461, block_completion_002463, block_completion_002466, block_completion_002470, block_completion_002485, block_completion_002495, block_completion_002497, block_completion_002499, block_completion_002500, block_completion_002502, block_completion_002503, block_completion_002504, block_completion_002505, block_completion_002507, block_completion_002508, block_completion_002520, block_completion_002529, block_completion_002555, block_completion_002560, block_completion_002567, block_completion_002569, block_completion_002570, block_completion_002572, block_completion_002573, block_completion_002579, block_completion_002580, block_completion_002583, block_completion_002584, block_completion_002585, block_completion_002587, block_completion_002609, block_completion_002615, block_completion_002619, block_completion_002623, block_completion_002627, block_completion_002629, block_completion_002634, block_completion_002635, block_completion_002636, block_completion_002637, block_completion_002638, block_completion_002639, block_completion_002640, block_completion_002641, block_completion_002642, block_completion_002643, block_completion_002648, block_completion_002649, block_completion_002653, block_completion_002665, block_completion_002666, block_completion_002669, block_completion_002674, block_completion_002677, block_completion_002681, block_completion_002695, block_completion_002697, block_completion_002701, block_completion_002703, block_completion_002705, block_completion_002709, block_completion_002710, block_completion_002711, block_completion_002713, block_completion_002717, block_completion_002718, block_completion_002727, block_completion_002728, block_completion_002730, block_completion_002745, block_completion_002746, block_completion_002748, block_completion_002749, block_completion_002750, block_completion_002751, block_completion_002753, block_completion_002772, block_completion_002775, block_completion_002780, block_completion_002781, block_completion_002784, block_completion_002792, block_completion_002801, block_completion_002828, block_completion_002829, block_completion_002832, block_completion_002833, block_completion_002836, block_completion_002838, block_completion_002840, block_completion_002845, block_completion_002846, block_completion_002848, block_completion_002852, block_completion_002856, block_completion_002857, block_completion_002858, block_completion_002859, block_completion_002864, block_completion_002866, block_completion_002868, block_completion_002869, block_completion_002872, block_completion_002874, block_completion_002877, block_completion_002879, block_completion_002884, block_completion_002888, block_completion_002895, block_completion_002897, block_completion_002900, block_completion_002904, block_completion_002907, block_completion_002911, block_completion_002913, block_completion_002915, block_completion_002917, block_completion_002920, block_completion_002922, block_completion_002924, block_completion_002943, block_completion_002946, block_completion_002965, block_completion_002970, block_completion_002971, block_completion_002972, block_completion_002978, block_completion_002982, block_completion_002986, block_completion_003001, block_completion_003002, block_completion_003004, block_completion_003007, block_completion_003008, block_completion_003009, block_completion_003010, block_completion_003024, block_completion_003027, block_completion_003030, block_completion_003034, block_completion_003038, block_completion_003041, block_completion_003043, block_completion_003048, block_completion_003051, block_completion_003054, block_completion_003057, block_completion_003062, block_completion_003068, block_completion_003069, block_completion_003070, block_completion_003072, block_completion_003082, block_completion_003083, block_completion_003087, block_completion_003088, block_completion_003094, block_completion_003103, block_completion_003106, block_completion_003107, block_completion_003109, block_completion_003110, block_completion_003111, block_completion_003115, block_completion_003116, block_completion_003117, block_completion_003138, block_completion_003147, block_completion_003148, block_completion_003150, block_completion_003154, block_completion_003157, block_completion_003167, block_completion_003168, block_completion_003172, block_completion_003175, block_completion_003179, block_completion_003180, block_completion_003182, block_completion_003183, block_completion_003184, block_completion_003187, block_completion_003189, block_completion_003191, block_completion_003192, block_completion_003193, block_completion_003194, block_completion_003196, block_completion_003203, block_completion_003205, block_completion_003206, block_completion_003213, block_completion_003214, block_completion_003217, block_completion_003219, block_completion_003221, block_completion_003227, block_completion_003231, block_completion_003233, block_completion_003234, block_completion_003257, block_completion_003277, block_completion_003278, block_completion_003280, block_completion_003283, block_completion_003286, block_completion_003290, block_completion_003291, block_completion_003297, block_completion_003299, block_completion_003300, block_completion_003301, block_completion_003303, block_completion_003305, block_completion_003309, block_completion_003310, block_completion_003311, block_completion_003312, block_completion_003313, block_completion_003315, block_completion_003316, block_completion_003317, block_completion_003318, block_completion_003323, block_completion_003325, block_completion_003327, block_completion_003328, block_completion_003329, block_completion_003330, block_completion_003332, block_completion_003333, block_completion_003335, block_completion_003336, block_completion_003341, block_completion_003352, block_completion_003354, block_completion_003355, block_completion_003356, block_completion_003361, block_completion_003386, block_completion_003387, block_completion_003389, block_completion_003391, block_completion_003392, block_completion_003399, block_completion_003401, block_completion_003404, block_completion_003408, block_completion_003409, block_completion_003412, block_completion_003413, block_completion_003415, block_completion_003416, block_completion_003417, block_completion_003418, block_completion_003421, block_completion_003423, block_completion_003425, block_completion_003426, block_completion_003427, block_completion_003428, block_completion_003431, block_completion_003432, block_completion_003433, block_completion_003434, block_completion_003435, block_completion_003437, block_completion_003439, block_completion_003441, block_completion_003444, block_completion_003446, block_completion_003449, block_completion_003453, block_completion_003455, block_completion_003456, block_completion_003457, block_completion_003458, block_completion_003465, block_completion_003468, block_completion_003470, block_completion_003472, block_completion_003474, block_completion_003476, block_completion_003479, block_completion_003480, block_completion_003481, block_completion_003482, block_completion_003484, block_completion_003485, block_completion_003489, block_completion_003509, block_completion_003515, block_completion_003522, block_completion_003525, block_completion_003526, block_completion_003527, block_completion_003531, block_completion_003535, block_completion_003537, block_completion_003538, block_completion_003544, block_completion_003551, block_completion_003552, block_completion_003554, block_completion_003555, block_completion_003556, block_completion_003560, block_completion_003561, block_completion_003563, block_completion_003565, block_completion_003566, block_completion_003567, block_completion_003568, block_completion_003571, block_completion_003573, block_completion_003575, block_completion_003578, block_completion_003580, block_completion_003583, block_completion_003586, block_completion_003587, block_completion_003588, block_completion_003589, block_completion_003590, block_completion_003591, block_completion_003596, block_completion_003598, block_completion_003607, block_completion_003609, block_completion_003614, block_completion_003616, block_completion_003619, block_completion_003627, block_completion_003632, block_completion_003634, block_completion_003636, block_completion_003637, block_completion_003638, block_completion_003641, block_completion_003642, block_completion_003646, block_completion_003647, block_completion_003648, block_completion_003653, block_completion_003655, block_completion_003656, block_completion_003657, block_completion_003658, block_completion_003659, block_completion_003662, block_completion_003665, block_completion_003678, block_completion_003680, block_completion_003693, block_completion_003695, block_completion_003696, block_completion_003698, block_completion_003699, block_completion_003700, block_completion_003701, block_completion_003702, block_completion_003703, block_completion_003705, block_completion_003714, block_completion_003715, block_completion_003748, block_completion_003750, block_completion_003751, block_completion_003753, block_completion_003770, block_completion_003781, block_completion_003782, block_completion_003783, block_completion_003785, block_completion_003786, block_completion_003800, block_completion_003801, block_completion_003805, block_completion_003809, block_completion_003811, block_completion_003812, block_completion_003813, block_completion_003817, block_completion_003820, block_completion_003821, block_completion_003822, block_completion_003824, block_completion_003831, block_completion_003832, block_completion_003833, block_completion_003834, block_completion_003839, block_completion_003842, block_completion_003843, block_completion_003846, block_completion_003847, block_completion_003850, block_completion_003852, block_completion_003853, block_completion_003856, block_completion_003858, block_completion_003863, block_completion_003866, block_completion_003869, block_completion_003872, block_completion_003876, block_completion_003882, block_completion_003885, block_completion_003886, block_completion_003889, block_completion_003897, block_completion_003898, block_completion_003900, block_completion_003906, block_completion_003926, block_completion_003943, block_completion_003954, block_completion_003963, block_completion_003971, block_completion_003973, block_completion_003974, block_completion_003975, block_completion_003977, block_completion_003980, block_completion_003981, block_completion_003983, block_completion_003988, block_completion_003989, block_completion_003991, block_completion_003994, block_completion_004024, block_completion_004038, block_completion_004049, block_completion_004050, block_completion_004052, block_completion_004053, block_completion_004066, block_completion_004073, block_completion_004077, block_completion_004096, block_completion_004098, block_completion_004099, block_completion_004100, block_completion_004101, block_completion_004102, block_completion_004103, block_completion_004104, block_completion_004108, block_completion_004109, block_completion_004110, block_completion_004113, block_completion_004114, block_completion_004117, block_completion_004122, block_completion_004126, block_completion_004134, block_completion_004142, block_completion_004144, block_completion_004150, block_completion_004156, block_completion_004164, block_completion_004167, block_completion_004186, block_completion_004187, block_completion_004191, block_completion_004192, block_completion_004193, block_completion_004194, block_completion_004196, block_completion_004198, block_completion_004201, block_completion_004207, block_completion_004209, block_completion_004210, block_completion_004212, block_completion_004213, block_completion_004214, block_completion_004216, block_completion_004218, block_completion_004219, block_completion_004220, block_completion_004221, block_completion_004222, block_completion_004224, block_completion_004225, block_completion_004226, block_completion_004227, block_completion_004228, block_completion_004231, block_completion_004233, block_completion_004234, block_completion_004235, block_completion_004237, block_completion_004239, block_completion_004246, block_completion_004247, block_completion_004254, block_completion_004264, block_completion_004265, block_completion_004268, block_completion_004271, block_completion_004273, block_completion_004275, block_completion_004277, block_completion_004278, block_completion_004279, block_completion_004280, block_completion_004281, block_completion_004283, block_completion_004284, block_completion_004291, block_completion_004305, block_completion_004321, block_completion_004325, block_completion_004330, block_completion_004341, block_completion_004352, block_completion_004353, block_completion_004361, block_completion_004373, block_completion_004379, block_completion_004385, block_completion_004387, block_completion_004388, block_completion_004393, block_completion_004400, block_completion_004405, block_completion_004406, block_completion_004409, block_completion_004413, block_completion_004417, block_completion_004420, block_completion_004422, block_completion_004429, block_completion_004439, block_completion_004440, block_completion_004443, block_completion_004444, block_completion_004446, block_completion_004448, block_completion_004449, block_completion_004450, block_completion_004451, block_completion_004452, block_completion_004453, block_completion_004454, block_completion_004455, block_completion_004456, block_completion_004460, block_completion_004462, block_completion_004468, block_completion_004469, block_completion_004479, block_completion_004485, block_completion_004494, block_completion_004531, block_completion_004535, block_completion_004536, block_completion_004537, block_completion_004542, block_completion_004543, block_completion_004547, block_completion_004553, block_completion_004554, block_completion_004556, block_completion_004561, block_completion_004567, block_completion_004592, block_completion_004595, block_completion_004598, block_completion_004611, block_completion_004615, block_completion_004616, block_completion_004618, block_completion_004619, block_completion_004620, block_completion_004623, block_completion_004624, block_completion_004628, block_completion_004629, block_completion_004637, block_completion_004647, block_completion_004651, block_completion_004660, block_completion_004662, block_completion_004668, block_completion_004669, block_completion_004672, block_completion_004678, block_completion_004679, block_completion_004681, block_completion_004689, block_completion_004697, block_completion_004702, block_completion_004705, block_completion_004708, block_completion_004712, block_completion_004714, block_completion_004718, block_completion_004719, block_completion_004722, block_completion_004723, block_completion_004724, block_completion_004726, block_completion_004729, block_completion_004730, block_completion_004738, block_completion_004739, block_completion_004740, block_completion_004741, block_completion_004743, block_completion_004744, block_completion_004747, block_completion_004748, block_completion_004749, block_completion_004753, block_completion_004759, block_completion_004774, block_completion_004801, block_completion_004822, block_completion_004826, block_completion_004828, block_completion_004830, block_completion_004832, block_completion_004838, block_completion_004841, block_completion_004847, block_completion_004849, block_completion_004853, block_completion_004855, block_completion_004861, block_completion_004862, block_completion_004864, block_completion_004865, block_completion_004866, block_completion_004867, block_completion_004868, block_completion_004869, block_completion_004871, block_completion_004873, block_completion_004879, block_completion_004886, block_completion_004896, block_completion_004905, block_completion_004906, block_completion_004917, block_completion_004921, block_completion_004938, block_completion_004942, block_completion_004943, block_completion_004944, block_completion_004945, block_completion_004946, block_completion_004949, block_completion_004952, block_completion_004962, block_completion_004977, block_completion_004982, block_completion_004987, block_completion_004988, block_completion_004990, block_completion_004991, block_completion_004999, block_completion_005001, block_completion_005004, block_completion_005010, block_completion_005017, block_completion_005021, block_completion_005022, block_completion_005023, block_completion_005025, block_completion_005026, block_completion_005028, block_completion_005030, block_completion_005036, block_completion_005043, block_completion_005050, block_completion_005058, block_completion_005062, block_completion_005067, block_completion_005072, block_completion_005073, block_completion_005074, block_completion_005076, block_completion_005078, block_completion_005085, block_completion_005086, block_completion_005088, block_completion_005090, block_completion_005091, block_completion_005093, block_completion_005098, block_completion_005099, block_completion_005105, block_completion_005110, block_completion_005112, block_completion_005114, block_completion_005115, block_completion_005117, block_completion_005118, block_completion_005121, block_completion_005123, block_completion_005126, block_completion_005127, block_completion_005128, block_completion_005129, block_completion_005133, block_completion_005135, block_completion_005138, block_completion_005139, block_completion_005140, block_completion_005142, block_completion_005143, block_completion_005144, block_completion_005150, block_completion_005151, block_completion_005153, block_completion_005156, block_completion_005158, block_completion_005160, block_completion_005164, block_completion_005165, block_completion_005168, block_completion_005179, block_completion_005182, block_completion_005191, block_completion_005192, block_completion_005196, block_completion_005197, block_completion_005199, block_completion_005202, block_completion_005204, block_completion_005207, block_completion_005210, block_completion_005219, block_completion_005220, block_completion_005221, block_completion_005222, block_completion_005224, block_completion_005227, block_completion_005231, block_completion_005232, block_completion_005233, block_completion_005236, block_completion_005237, block_completion_005238, block_completion_005239, block_completion_005240, block_completion_005241, block_completion_005242, block_completion_005243, block_completion_005244, block_completion_005246, block_completion_005248, block_completion_005249, block_completion_005250, block_completion_005253, block_completion_005254, block_completion_005256, block_completion_005258, block_completion_005259, block_completion_005261, block_completion_005263, block_completion_005264, block_completion_005265, block_completion_005266, block_completion_005268, block_completion_005269, block_completion_005270, block_completion_005271, block_completion_005273, block_completion_005274, block_completion_005278, block_completion_005282, block_completion_005287, block_completion_005291, block_completion_005295, block_completion_005300, block_completion_005305, block_completion_005313, block_completion_005315, block_completion_005329, block_completion_005336, block_completion_005341, block_completion_005350, block_completion_005352, block_completion_005353, block_completion_005355, block_completion_005356, block_completion_005363, block_completion_005370, block_completion_005371, block_completion_005374, block_completion_005376, block_completion_005379, block_completion_005381, block_completion_005384, block_completion_005385, block_completion_005386, block_completion_005387, block_completion_005388, block_completion_005389, block_completion_005390, block_completion_005398, block_completion_005399, block_completion_005404, block_completion_005406, block_completion_005410, block_completion_005412, block_completion_005414, block_completion_005415, block_completion_005418, block_completion_005426, block_completion_005429, block_completion_005430, block_completion_005432, block_completion_005434, block_completion_005435, block_completion_005439, block_completion_005448, block_completion_005454, block_completion_005457, block_completion_005460, block_completion_005461, block_completion_005463, block_completion_005465, block_completion_005468, block_completion_005472, block_completion_005476, block_completion_005478, block_completion_005500, block_completion_005517, block_completion_005519, block_completion_005520, block_completion_005525, block_completion_005526, block_completion_005527, block_completion_005538, block_completion_005540, block_completion_005541, block_completion_005542, block_completion_005547, block_completion_005548, block_completion_005549, block_completion_005550, block_completion_005560, block_completion_005569, block_completion_005599, block_completion_005601, block_completion_005602, block_completion_005604, block_completion_005608, block_completion_005616, block_completion_005618, block_completion_005623, block_completion_005628, block_completion_005650, block_completion_005658, block_completion_005660, block_completion_005677, block_completion_005684, block_completion_005713, block_completion_005724, block_completion_005729, block_completion_005733, block_completion_005735, block_completion_005737, block_completion_005778, block_completion_005787, block_completion_005807, block_completion_005814, block_completion_005818, block_completion_005833, block_completion_005850, block_completion_005882, block_completion_005896, block_completion_005897, block_completion_005899, block_completion_005900, block_completion_005902, block_completion_005904, block_completion_005905, block_completion_005906, block_completion_005908, block_completion_005909, block_completion_005916, block_completion_005918, block_completion_005922, block_completion_005937, block_completion_005945, block_completion_005947, block_completion_005957, block_completion_005961, block_completion_005965, block_completion_005966, block_completion_005967, block_completion_005968, block_completion_005969, block_completion_005970, block_completion_005973, block_completion_005974, block_completion_005976, block_completion_005978, block_completion_005979, block_completion_005980, block_completion_005985, block_completion_005988, block_completion_005989, block_completion_005990, block_completion_005991, block_completion_005992, block_completion_005993, block_completion_005994, block_completion_005995, block_completion_005996, block_completion_005997, block_completion_005998, block_completion_005999, block_completion_006002, block_completion_006005, block_completion_006011, block_completion_006013, block_completion_006016, block_completion_006020, block_completion_006030, block_completion_006036, block_completion_006038, block_completion_006040, block_completion_006050, block_completion_006051, block_completion_006054, block_completion_006055, block_completion_006056, block_completion_006057, block_completion_006058, block_completion_006059, block_completion_006062, block_completion_006068, block_completion_006069, block_completion_006070, block_completion_006072, block_completion_006087, block_completion_006092, block_completion_006111, block_completion_006120, block_completion_006121, block_completion_006124, block_completion_006133, block_completion_006134, block_completion_006137, block_completion_006141, block_completion_006142, block_completion_006143, block_completion_006144, block_completion_006147, block_completion_006149, block_completion_006151, block_completion_006153, block_completion_006155, block_completion_006157, block_completion_006158, block_completion_006161, block_completion_006164, block_completion_006174, block_completion_006177, block_completion_006181, block_completion_006182, block_completion_006184, block_completion_006185, block_completion_006190, block_completion_006193, block_completion_006195, block_completion_006196, block_completion_006197, block_completion_006203, block_completion_006204, block_completion_006213, block_completion_006215, block_completion_006217, block_completion_006219, block_completion_006222, block_completion_006224, block_completion_006241, block_completion_006243, block_completion_006245, block_completion_006246, block_completion_006250, block_completion_006280, block_completion_006285, block_completion_006287, block_completion_006303, block_completion_006314, block_completion_006319, block_completion_006349, block_completion_006351, block_completion_006353, block_completion_006356, block_completion_006364, block_completion_006369, block_completion_006380, block_completion_006385, block_completion_006387, block_completion_006388, block_completion_006390, block_completion_006392, block_completion_006393, block_completion_006398, block_completion_006399, block_completion_006402, block_completion_006409, block_completion_006413, block_completion_006426, block_completion_006428, block_completion_006429, block_completion_006431, block_completion_006432, block_completion_006440, block_completion_006441, block_completion_006442, block_completion_006443, block_completion_006444, block_completion_006445, block_completion_006447, block_completion_006448, block_completion_006449, block_completion_006451, block_completion_006452, block_completion_006454, block_completion_006455, block_completion_006458, block_completion_006459, block_completion_006460, block_completion_006461, block_completion_006475, block_completion_006478, block_completion_006482, block_completion_006502, block_completion_006506, block_completion_006509, block_completion_006515, block_completion_006518, block_completion_006519, block_completion_006520, block_completion_006521, block_completion_006528, block_completion_006529, block_completion_006531, block_completion_006547, block_completion_006549, block_completion_006555, block_completion_006563, block_completion_006564, block_completion_006569, block_completion_006574, block_completion_006575, block_completion_006579, block_completion_006581, block_completion_006586, block_completion_006596, block_completion_006597, block_completion_006598, block_completion_006602, block_completion_006604, block_completion_006606, block_completion_006607, block_completion_006612, block_completion_006615, block_completion_006632, block_completion_006650, block_completion_006676, block_completion_006679, block_completion_006683, block_completion_006684, block_completion_006689, block_completion_006699, block_completion_006701, block_completion_006713, block_completion_006714, block_completion_006715, block_completion_006727, block_completion_006739, block_completion_006743, block_completion_006744, block_completion_006745, block_completion_006748, block_completion_006753, block_completion_006754, block_completion_006755, block_completion_006756, block_completion_006759, block_completion_006763, block_completion_006764, block_completion_006767, block_completion_006777, block_completion_006778, block_completion_006780, block_completion_006782, block_completion_006783, block_completion_006785, block_completion_006786, block_completion_006788, block_completion_006791, block_completion_006792, block_completion_006793, block_completion_006796, block_completion_006818, block_completion_006833, block_completion_006834, block_completion_006836, block_completion_006837, block_completion_006842, block_completion_006847, block_completion_006848, block_completion_006852, block_completion_006854, block_completion_006855, block_completion_006861, block_completion_006862, block_completion_006866, block_completion_006867, block_completion_006871, block_completion_006889, block_completion_006892, block_completion_006904, block_completion_006911, block_completion_006921, block_completion_006925, block_completion_006931, block_completion_006932, block_completion_006940, block_completion_006943, block_completion_006967, block_completion_006969, block_completion_006971, block_completion_006992, block_completion_006997, block_completion_007000, block_completion_007003, block_completion_007008, block_completion_007036, block_completion_007056, block_completion_007058, block_completion_007059, block_completion_007062, block_completion_007065, block_completion_007066, block_completion_007073, block_completion_007074, block_completion_007076, block_completion_007079, block_completion_007080, block_completion_007081, block_completion_007083, block_completion_007084, block_completion_007087, block_completion_007088, block_completion_007090, block_completion_007091, block_completion_007112, block_completion_007115, block_completion_007116, block_completion_007117, block_completion_007120, block_completion_007122, block_completion_007125, block_completion_007130, block_completion_007131, block_completion_007132, block_completion_007134, block_completion_007136, block_completion_007147, block_completion_007154, block_completion_007155, block_completion_007160, block_completion_007164, block_completion_007166, block_completion_007172, block_completion_007173, block_completion_007175, block_completion_007176, block_completion_007177, block_completion_007178, block_completion_007179, block_completion_007180, block_completion_007181, block_completion_007182, block_completion_007183, block_completion_007184, block_completion_007185, block_completion_007186, block_completion_007187, block_completion_007188, block_completion_007189, block_completion_007190, block_completion_007192, block_completion_007197, block_completion_007218, block_completion_007238, block_completion_007240, block_completion_007243, block_completion_007256, block_completion_007260, block_completion_007262, block_completion_007265, block_completion_007271, block_completion_007274, block_completion_007275, block_completion_007277, block_completion_007278, block_completion_007279, block_completion_007280, block_completion_007284, block_completion_007285, block_completion_007290, block_completion_007292, block_completion_007294, block_completion_007295, block_completion_007303, block_completion_007336, block_completion_007350, block_completion_007351, block_completion_007352, block_completion_007353, block_completion_007355, block_completion_007363, block_completion_007371, block_completion_007379, block_completion_007394, block_completion_007397, block_completion_007406, block_completion_007411, block_completion_007420, block_completion_007427, block_completion_007428, block_completion_007434, block_completion_007438, block_completion_007441, block_completion_007443, block_completion_007445, block_completion_007446, block_completion_007456, block_completion_007458, block_completion_007459, block_completion_007460, block_completion_007462, block_completion_007463, block_completion_007464, block_completion_007484, block_completion_007486, block_completion_007490, block_completion_007491, block_completion_007493, block_completion_007498, block_completion_007500, block_completion_007506, block_completion_007509, block_completion_007510, block_completion_007511, block_completion_007519, block_completion_007523, block_completion_007525, block_completion_007527, block_completion_007529, block_completion_007530, block_completion_007531, block_completion_007533, block_completion_007560, block_completion_007562, block_completion_007565, block_completion_007569, block_completion_007572, block_completion_007574, block_completion_007677, block_completion_007700, block_completion_007707, block_completion_007708, block_completion_007717, block_completion_007718, block_completion_007719, block_completion_007720, block_completion_007723, block_completion_007725, block_completion_007726, block_completion_007729, block_completion_007733, block_completion_007741, block_completion_007758, block_completion_007760, block_completion_007771, block_completion_007776, block_completion_007777, block_completion_007778, block_completion_007779, block_completion_007780, block_completion_007784, block_completion_007786, block_completion_007789, block_completion_007790, block_completion_007795, block_completion_007797, block_completion_007801, block_completion_007810, block_completion_007814, block_completion_007819, block_completion_007823, block_completion_007832, block_completion_007850, block_completion_007852, block_completion_007853, block_completion_007859, block_completion_007874, block_completion_007880, block_completion_007904, block_completion_007905, block_completion_007907, block_completion_007910, block_completion_007923, block_completion_007929, block_completion_007931, block_completion_007933, block_completion_007934, block_completion_007936, block_completion_007942, block_completion_007947, block_completion_007952, block_completion_007955, block_completion_007960, block_completion_007984, block_completion_007988, block_completion_007991, block_completion_007997, block_completion_007998, block_completion_008004, block_completion_008019, block_completion_008023, block_completion_008025, block_completion_008026, block_completion_008028, block_completion_008029, block_completion_008038, block_completion_008044, block_completion_008053, block_completion_008056, block_completion_008058, block_completion_008059, block_completion_008060, block_completion_008062, block_completion_008071, block_completion_008072, block_completion_008075, block_completion_008076, block_completion_008077, block_completion_008078, block_completion_008080, block_completion_008083, block_completion_008085, block_completion_008086, block_completion_008089, block_completion_008102, block_completion_008108, block_completion_008110, block_completion_008114, block_completion_008140, block_completion_008147, block_completion_008149, block_completion_008153, block_completion_008155, block_completion_008158, block_completion_008165, block_completion_008167, block_completion_008172, block_completion_008174, block_completion_008176, block_completion_008201, block_completion_008203, block_completion_008204, block_completion_008206, block_completion_008208, block_completion_008209, block_completion_008210, block_completion_008212, block_completion_008213, block_completion_008214, block_completion_008215, block_completion_008216, block_completion_008218, block_completion_008220, block_completion_008226, block_completion_008228, block_completion_008230, block_completion_008231, block_completion_008233, block_completion_008235, block_completion_008237, block_completion_008240, block_completion_008242, block_completion_008243, block_completion_008246, block_completion_008248, block_completion_008249, block_completion_008250, block_completion_008251, block_completion_008253, block_completion_008255, block_completion_008259, block_completion_008260, block_completion_008266, block_completion_008272, block_completion_008276, block_completion_008278, block_completion_008280, block_completion_008285, block_completion_008288, block_completion_008289, block_completion_008293, block_completion_008295, block_completion_008297, block_completion_008299, block_completion_008300, block_completion_008303, block_completion_008306, block_completion_008307, block_completion_008308, block_completion_008309, block_completion_008310, block_completion_008319, block_completion_008321, block_completion_008328, block_completion_008330, block_completion_008331, block_completion_008337, block_completion_008338, block_completion_008344, block_completion_008349, block_completion_008363, block_completion_008364, block_completion_008366, block_completion_008367, block_completion_008368, block_completion_008369, block_completion_008371, block_completion_008376, block_completion_008380, block_completion_008382, block_completion_008383, block_completion_008384, block_completion_008385, block_completion_008387, block_completion_008388, block_completion_008389, block_completion_008391, block_completion_008392, block_completion_008393, block_completion_008395, block_completion_008399, block_completion_008403, block_completion_008407, block_completion_008408, block_completion_008413, block_completion_008418, block_completion_008419, block_completion_008426, block_completion_008427, block_completion_008431, block_completion_008433, block_completion_008444, block_completion_008445, block_completion_008447, block_completion_008451, block_completion_008455, block_completion_008475, block_completion_008477, block_completion_008479, block_completion_008490, block_completion_008493, block_completion_008501, block_completion_008517, block_completion_008533, block_completion_008535, block_completion_008536, block_completion_008538, block_completion_008540, block_completion_008544, block_completion_008549, block_completion_008551, block_completion_008553, block_completion_008554, block_completion_008557, block_completion_008558, block_completion_008559, block_completion_008560, block_completion_008561, block_completion_008562, block_completion_008566, block_completion_008576, block_completion_008582, block_completion_008584, block_completion_008587, block_completion_008589, block_completion_008595, block_completion_008596, block_completion_008597, block_completion_008599, block_completion_008601, block_completion_008611, block_completion_008613, block_completion_008615, block_completion_008641, block_completion_008654, block_completion_008670, block_completion_008681, block_completion_008684, block_completion_008686, block_completion_008689, block_completion_008690, block_completion_008691, block_completion_008692, block_completion_008693, block_completion_008694, block_completion_008695, block_completion_008701, block_completion_008709, block_completion_008710, block_completion_008711, block_completion_008713, block_completion_008714, block_completion_008716, block_completion_008722, block_completion_008730, block_completion_008732, block_completion_008733, block_completion_008735, block_completion_008738, block_completion_008739, block_completion_008741, block_completion_008742, block_completion_008743, block_completion_008744, block_completion_008746, block_completion_008747, block_completion_008749, block_completion_008750, block_completion_008753, block_completion_008756, control_completion_000005, control_completion_000008, control_completion_000014, control_completion_000018, control_completion_000019, control_completion_000025, control_completion_000038, control_completion_000051, control_completion_000057, control_completion_000059, control_completion_000073, control_completion_000107, control_completion_000123, control_completion_000148, control_completion_000150, control_completion_000155, control_completion_000157, control_completion_000161, control_completion_000166, control_completion_000167, control_completion_000169, control_completion_000172, control_completion_000192, control_completion_000193, control_completion_000198, control_completion_000200, control_completion_000219, control_completion_000260, control_completion_000261, control_completion_000262, control_completion_000263, control_completion_000265, control_completion_000266, control_completion_000267, control_completion_000268, control_completion_000270, control_completion_000271, control_completion_000291, control_completion_000303, control_completion_000355, control_completion_000365, control_completion_000372, control_completion_000389, control_completion_000390, control_completion_000393, control_completion_000394, control_completion_000395, control_completion_000397, control_completion_000402, control_completion_000405, control_completion_000407, control_completion_000409, control_completion_000417, control_completion_000425, control_completion_000426, control_completion_000429, control_completion_000453, control_completion_000475, control_completion_000501, control_completion_000503, control_completion_000510, control_completion_000527, control_completion_000536, control_completion_000539, control_completion_000564, control_completion_000577, control_completion_000592, control_completion_000601, control_completion_000605, control_completion_000607, control_completion_000610, control_completion_000611, control_completion_000612, control_completion_000613, control_completion_000614, control_completion_000620, control_completion_000630, control_completion_000632, control_completion_000638, control_completion_000670, control_completion_000679, control_completion_000680, control_completion_000690, control_completion_000693, control_completion_000697, control_completion_000766, control_completion_000836, control_completion_000848, control_completion_000877, control_completion_000890, control_completion_000894, control_completion_000896, control_completion_000899, control_completion_000900, control_completion_000905, control_completion_000908, control_completion_000910, control_completion_000913, control_completion_000916, control_completion_000931, control_completion_000960, control_completion_000964, control_completion_000993, control_completion_000995, control_completion_000996, control_completion_001014, control_completion_001020, control_completion_001021, control_completion_001023, control_completion_001032, control_completion_001039, control_completion_001043, control_completion_001044, control_completion_001046, control_completion_001047, control_completion_001049, control_completion_001089, control_completion_001091, control_completion_001156, control_completion_001159, control_completion_001181, control_completion_001197, control_completion_001212, control_completion_001224, control_completion_001225, control_completion_001233, control_completion_001236, control_completion_001244, control_completion_001254, control_completion_001261, control_completion_001276, control_completion_001289, control_completion_001293, control_completion_001313, control_completion_001318, control_completion_001332, control_completion_001347, control_completion_001350, control_completion_001361, control_completion_001365, control_completion_001385, control_completion_001386, control_completion_001393, control_completion_001413, control_completion_001419, control_completion_001455, control_completion_001500, control_completion_001505, control_completion_001509, control_completion_001516, control_completion_001547, control_completion_001548, control_completion_001608, control_completion_001611, control_completion_001612, control_completion_001613, control_completion_001614, control_completion_001616, control_completion_001619, control_completion_001620, control_completion_001622, control_completion_001625, control_completion_001626, control_completion_001629, control_completion_001631, control_completion_001634, control_completion_001638, control_completion_001640, control_completion_001644, control_completion_001646, control_completion_001664, control_completion_001689, control_completion_001694, control_completion_001724, control_completion_001725, control_completion_001747, control_completion_001838, control_completion_001841, control_completion_001848, control_completion_001874, control_completion_001881, control_completion_001903, control_completion_001937, control_completion_001945, control_completion_001953, control_completion_001954, control_completion_001956, control_completion_001958, control_completion_001959, control_completion_001962, control_completion_001963, control_completion_001965, control_completion_002033, control_completion_002038, control_completion_002039, control_completion_002041, control_completion_002077, control_completion_002104, control_completion_002108, control_completion_002126, control_completion_002137, control_completion_002139, control_completion_002143, control_completion_002145, control_completion_002165, control_completion_002166, control_completion_002168, control_completion_002218, control_completion_002227, control_completion_002232, control_completion_002233, control_completion_002240, control_completion_002269, control_completion_002344, control_completion_002350, control_completion_002360, control_completion_002411, control_completion_002419, control_completion_002423, control_completion_002425, control_completion_002480, control_completion_002507, control_completion_002518, control_completion_002524, control_completion_002526, control_completion_002528, control_completion_002537, control_completion_002539, control_completion_002554, control_completion_002557, control_completion_002561, control_completion_002563, control_completion_002565, control_completion_002584, control_completion_002588, control_completion_002594, control_completion_002595, control_completion_002611, control_completion_002612, control_completion_002613, control_completion_002614, control_completion_002616, control_completion_002617, control_completion_002619, control_completion_002675, control_completion_002678, control_completion_002683, control_completion_002685, control_completion_002692, control_completion_002697, control_completion_002698, control_completion_002702, control_completion_002703, control_completion_002705, control_completion_002709, control_completion_002716, control_completion_002718, control_completion_002721, control_completion_002724, control_completion_002725, control_completion_002726, control_completion_002728, control_completion_002730, control_completion_002801, control_completion_002823, control_completion_002849, control_completion_002850, control_completion_002855, control_completion_002858, control_completion_002863, control_completion_002865, control_completion_002869, control_completion_002870, control_completion_002872, control_completion_002890, control_completion_002892, control_completion_002895, control_completion_002897, control_completion_002922, control_completion_002924, control_completion_002926, control_completion_002930, control_completion_002933, control_completion_002941, control_completion_002942, control_completion_002943, control_completion_002947, control_completion_002952, control_completion_002957, control_completion_002958, control_completion_002961, control_completion_002968, control_completion_002971, control_completion_002973, control_completion_002977, control_completion_002982, control_completion_002983, control_completion_003000, control_completion_003034, control_completion_003059, control_completion_003060, control_completion_003063, control_completion_003074, control_completion_003100, control_completion_003119, control_completion_003122, control_completion_003125, control_completion_003133, control_completion_003142, control_completion_003161, control_completion_003164, control_completion_003209, control_completion_003212, control_completion_003224, control_completion_003229, control_completion_003248, control_completion_003254, control_completion_003259, control_completion_003261, control_completion_003263, control_completion_003264, control_completion_003265, control_completion_003266, control_completion_003267, control_completion_003268, control_completion_003270, control_completion_003274, control_completion_003295, control_completion_003300, control_completion_003308, control_completion_003339, control_completion_003369, control_completion_003388, control_completion_003392, control_completion_003402, control_completion_003405, control_completion_003429, control_completion_003432, control_completion_003437, control_completion_003439, control_completion_003441, control_completion_003442, control_completion_003445, control_completion_003446, control_completion_003448, control_completion_003451, control_completion_003471, control_completion_003489, control_completion_003493, control_completion_003504, control_completion_003507, control_completion_003512, control_completion_003530, control_completion_003532, control_completion_003536, control_completion_003538, control_completion_003558, control_completion_003564, control_completion_003573, control_completion_003589, control_completion_003596, control_completion_003597, control_completion_003598, control_completion_003600, control_completion_003602, control_completion_003603, control_completion_003605, control_completion_003606, control_completion_003607, control_completion_003608, control_completion_003609, control_completion_003610, control_completion_003611, control_completion_003612, control_completion_003616, control_completion_003619, control_completion_003634, control_completion_003635, control_completion_003639, control_completion_003641, control_completion_003644, control_completion_003668, control_completion_003689, control_completion_003690, control_completion_003738, control_completion_003739, control_completion_003740, control_completion_003741, control_completion_003745, control_completion_003747, control_completion_003750, control_completion_003751, control_completion_003752, control_completion_003774, control_completion_003780, control_completion_003788, control_completion_003791, control_completion_003793, control_completion_003794, control_completion_003795, control_completion_003802, control_completion_003809, control_completion_003812, control_completion_003826, control_completion_003831, control_completion_003835, control_completion_003838, control_completion_003840, control_completion_003845, control_completion_003846, control_completion_003847, control_completion_003851, control_completion_003855, control_completion_003856, control_completion_003898, control_completion_003902, control_completion_003903, control_completion_003906, control_completion_003907, control_completion_003913, control_completion_003916, control_completion_003959, control_completion_003969, control_completion_003970, control_completion_003973, control_completion_003977, control_completion_003978, control_completion_003979, control_completion_003987, control_completion_003989, control_completion_004020, control_completion_004023, control_completion_004033, control_completion_004034, control_completion_004052, control_completion_004061, control_completion_004071, control_completion_004084, control_completion_004092, control_completion_004116, control_completion_004194, control_completion_004264, control_completion_004322, control_completion_004323, control_completion_004368, control_completion_004389, control_completion_004393, control_completion_004440, control_completion_004441, control_completion_004442, control_completion_004448, control_completion_004452, control_completion_004453, control_completion_004462, control_completion_004463, control_completion_004464, control_completion_004469, control_completion_004498, control_completion_004501, control_completion_004531, control_completion_004537, control_completion_004543, control_completion_004545, control_completion_004586, control_completion_004590, control_completion_004600, control_completion_004637, control_completion_004644, control_completion_004647, control_completion_004648, control_completion_004650, control_completion_004651, control_completion_004653, control_completion_004658, control_completion_004664, control_completion_004680, control_completion_004696, control_completion_004700, control_completion_004701, control_completion_004702, control_completion_004705, control_completion_004710, control_completion_004711, control_completion_004712, control_completion_004714, control_completion_004719, control_completion_004721, control_completion_004726, control_completion_004805, control_completion_004806, control_completion_004807, control_completion_004809, control_completion_004812, control_completion_004818, control_completion_004831, control_completion_004833, control_completion_004835, control_completion_004839, control_completion_004841, control_completion_004842, control_completion_004843, control_completion_004844, control_completion_004845, control_completion_004848, control_completion_004849, control_completion_004850, control_completion_004856, control_completion_004858, control_completion_004859, control_completion_004861, control_completion_004863, control_completion_004866, control_completion_004899, control_completion_004901, control_completion_004905, control_completion_004913, control_completion_004941, control_completion_004953, control_completion_005024, control_completion_005028, control_completion_005033, control_completion_005037, control_completion_005044, control_completion_005084, control_completion_005149, control_completion_005184, control_completion_005185, control_completion_005188, control_completion_005199, control_completion_005205, control_completion_005219, control_completion_005244, control_completion_005248, control_completion_005250, control_completion_005251, control_completion_005259, control_completion_005263, control_completion_005269, control_completion_005279, control_completion_005282, control_completion_005290, control_completion_005294, control_completion_005296, control_completion_005298, control_completion_005314, control_completion_005315, control_completion_005323, control_completion_005326, control_completion_005329, control_completion_005341, control_completion_005342, control_completion_005378, control_completion_005402, control_completion_005410, control_completion_005415, control_completion_005416, control_completion_005418, control_completion_005421, control_completion_005422, control_completion_005430, control_completion_005461, control_completion_005462, control_completion_005478, control_completion_005689, control_completion_005705, control_completion_005707, control_completion_005708, control_completion_005711, control_completion_005714, control_completion_005720, control_completion_005733, control_completion_005735, control_completion_005738, control_completion_005797, control_completion_005802, control_completion_005803, control_completion_005805, control_completion_005808, control_completion_005809, control_completion_005813, control_completion_005817, control_completion_005819, control_completion_005843, control_completion_005880, control_completion_005891, control_completion_005911, control_completion_005921, control_completion_005925, control_completion_005927, control_completion_005931, control_completion_005954, control_completion_005958, control_completion_005959, control_completion_005962, control_completion_005963, control_completion_005964, control_completion_005969, control_completion_005978, control_completion_005987, control_completion_005988, control_completion_005991, control_completion_005995, control_completion_006008, control_completion_006024, control_completion_006025, control_completion_006026, control_completion_006027, control_completion_006030, control_completion_006034, control_completion_006039, control_completion_006041, control_completion_006044, control_completion_006050, control_completion_006053, control_completion_006055, control_completion_006058, control_completion_006069, control_completion_006071, control_completion_006073, control_completion_006076, control_completion_006077, control_completion_006079, control_completion_006081, control_completion_006086, control_completion_006089, control_completion_006091, control_completion_006092, control_completion_006093, control_completion_006098, control_completion_006099, control_completion_006104, control_completion_006123, control_completion_006124, control_completion_006131, control_completion_006132, control_completion_006134, control_completion_006143, control_completion_006157, control_completion_006159, control_completion_006180, control_completion_006249, control_completion_006251, control_completion_006260, control_completion_006291, control_completion_006293, control_completion_006299, control_completion_006300, control_completion_006302, control_completion_006314, control_completion_006329, control_completion_006335, control_completion_006336, control_completion_006338, control_completion_006347, control_completion_006352, control_completion_006353, control_completion_006355, control_completion_006404, control_completion_006408, control_completion_006410, control_completion_006411, control_completion_006413, control_completion_006430, control_completion_006455, control_completion_006460, control_completion_006462, control_completion_006465, control_completion_006471, control_completion_006475, control_completion_006478, control_completion_006496, control_completion_006497, control_completion_006498, control_completion_006499, control_completion_006504, control_completion_006505, control_completion_006507, control_completion_006510, control_completion_006514, control_completion_006518, control_completion_006543, control_completion_006544, control_completion_006550, control_completion_006564, control_completion_006574, control_completion_006592, control_completion_006594, control_completion_006596, control_completion_006598, control_completion_006599, control_completion_006602, control_completion_006605, control_completion_006610, control_completion_006629, control_completion_006637, control_completion_006643, control_completion_006695, control_completion_006723, control_completion_006737, control_completion_006739, control_completion_006753, control_completion_006778, control_completion_006779, control_completion_006783, control_completion_006792, control_completion_006797, control_completion_006807, control_completion_006809, control_completion_006849, control_completion_006865, control_completion_006940, control_completion_006943, control_completion_006968, control_completion_006969, control_completion_007003, control_completion_007006, control_completion_007007, control_completion_007009, control_completion_007011, control_completion_007014, control_completion_007015, control_completion_007017, control_completion_007018, control_completion_007023, control_completion_007024, control_completion_007029, control_completion_007030, control_completion_007031, control_completion_007037, control_completion_007040, control_completion_007045, control_completion_007072, control_completion_007098, control_completion_007127, control_completion_007159, control_completion_007217, control_completion_007220, control_completion_007224, control_completion_007226, control_completion_007230, control_completion_007238, control_completion_007241, control_completion_007250, control_completion_007307, control_completion_007312, control_completion_007324, control_completion_007327, control_completion_007330, control_completion_007331, control_completion_007333, control_completion_007354, control_completion_007356, control_completion_007362, control_completion_007363, control_completion_007365, control_completion_007366, control_completion_007367, control_completion_007368, control_completion_007369, control_completion_007370, control_completion_007371, control_completion_007373, control_completion_007397, control_completion_007442, control_completion_007483, control_completion_007489, control_completion_007588, control_completion_007590, control_completion_007591, control_completion_007592, control_completion_007596, control_completion_007597, control_completion_007598, control_completion_007599, control_completion_007602, control_completion_007604, control_completion_007630, control_completion_007632, control_completion_007641, control_completion_007714, control_completion_007734, control_completion_007779, control_completion_007793, control_completion_007795, control_completion_007848, control_completion_007860, control_completion_007878, control_completion_007888, control_completion_007928, control_completion_007953, control_completion_007974, control_completion_007995, control_completion_008002, control_completion_008021, control_completion_008024, control_completion_008048, control_completion_008084, control_completion_008085, control_completion_008100, control_completion_008124, control_completion_008141, control_completion_008144, control_completion_008146, control_completion_008166, control_completion_008167, control_completion_008168, control_completion_008169, control_completion_008172, control_completion_008174, control_completion_008175, control_completion_008176, control_completion_008177, control_completion_008178, control_completion_008179, control_completion_008180, control_completion_008181, control_completion_008182, control_completion_008184, control_completion_008185, control_completion_008188, control_completion_008192, control_completion_008194, control_completion_008196, control_completion_008199, control_completion_008200, control_completion_008202, control_completion_008206, control_completion_008207, control_completion_008208, control_completion_008226, control_completion_008229, control_completion_008233, control_completion_008234, control_completion_008235, control_completion_008236, control_completion_008274, control_completion_008326, control_completion_008381, control_completion_008384, control_completion_008386, control_completion_008387, control_completion_008388, control_completion_008392, control_completion_008402, control_completion_008404, control_completion_008413, control_completion_008418, control_completion_008430, control_completion_008459, control_completion_008461, control_completion_008473, control_completion_008492, control_completion_008494, control_completion_008495, control_completion_008513, control_completion_008514, control_completion_008515, control_completion_008516, control_completion_008517, control_completion_008518, control_completion_008519, control_completion_008520, control_completion_008521, control_completion_008525, control_completion_008527, control_completion_008528, control_completion_008530, control_completion_008538, control_completion_008539, control_completion_008543, control_completion_008544, control_completion_008549, control_completion_008563, control_completion_008581, control_completion_008584, control_completion_008585, control_completion_008594, control_completion_008595, control_completion_008596, control_completion_008597, control_completion_008600, control_completion_008602, control_completion_008603, control_completion_008604

Problems solved by 1 model only

example_link model min_elo
block_completion_003688 deepseek-coder-33b 1363.698
control_completion_003658 deepseek-coder-33b 1363.698
block_completion_007368 deepseek-coder-33b 1363.698
block_completion_004447 deepseek-coder-33b 1363.698
block_completion_007308 deepseek-coder-33b 1363.698
control_completion_008505 deepseek-coder-33b 1363.698
block_completion_004383 deepseek-coder-33b 1363.698
control_completion_000668 deepseek-coder-33b 1363.698
block_completion_002158 deepseek-coder-33b 1363.698
block_completion_008256 deepseek-coder-33b 1363.698
control_completion_008282 deepseek-coder-33b 1363.698
control_completion_004217 deepseek-coder-33b 1363.698
control_completion_004026 deepseek-coder-33b 1363.698
control_completion_001203 deepseek-coder-33b 1363.698
block_completion_001572 deepseek-coder-33b 1363.698
block_completion_003639 deepseek-coder-33b 1363.698
block_completion_002588 deepseek-coder-33b 1363.698
block_completion_008440 deepseek-coder-33b 1363.698
block_completion_005198 deepseek-coder-33b 1363.698
block_completion_005235 deepseek-coder-33b 1363.698
block_completion_002087 deepseek-coder-33b 1363.698
block_completion_008221 deepseek-coder-33b 1363.698
block_completion_004989 deepseek-coder-33b 1363.698
control_completion_006609 deepseek-coder-33b 1363.698
block_completion_007822 deepseek-coder-33b 1363.698
block_completion_008618 deepseek-coder-33b 1363.698
control_completion_006085 deepseek-coder-33b 1363.698
block_completion_006758 deepseek-coder-33b 1363.698
control_completion_004493 deepseek-coder-33b 1363.698
block_completion_006010 deepseek-coder-33b 1363.698
control_completion_003837 deepseek-coder-33b 1363.698
block_completion_005044 deepseek-coder-33b 1363.698
block_completion_007146 deepseek-coder-33b 1363.698
control_completion_008269 deepseek-coder-33b 1363.698
control_completion_002290 deepseek-coder-33b 1363.698
control_completion_000628 deepseek-coder-33b 1363.698
control_completion_000416 deepseek-coder-33b 1363.698
block_completion_006410 deepseek-coder-33b 1363.698
block_completion_000368 deepseek-coder-33b 1363.698
block_completion_007293 deepseek-coder-33b 1363.698
control_completion_001351 deepseek-coder-33b 1363.698
block_completion_008241 deepseek-coder-33b 1363.698
control_completion_002544 deepseek-coder-33b 1363.698
control_completion_004459 deepseek-coder-33b 1363.698
control_completion_008284 deepseek-coder-33b 1363.698
control_completion_001499 deepseek-coder-33b 1363.698
block_completion_005593 deepseek-coder-33b 1363.698
control_completion_002003 deepseek-coder-33b 1363.698
block_completion_001688 deepseek-coder-33b 1363.698
block_completion_005927 deepseek-coder-33b 1363.698
block_completion_003848 deepseek-coder-33b 1363.698
control_completion_008463 deepseek-coder-33b 1363.698
block_completion_003961 deepseek-coder-33b 1363.698
block_completion_001456 deepseek-coder-33b 1363.698
block_completion_002850 deepseek-coder-33b 1363.698
control_completion_003657 deepseek-coder-33b 1363.698
block_completion_003105 deepseek-coder-33b 1363.698
block_completion_000694 deepseek-coder-33b 1363.698
control_completion_001827 deepseek-coder-33b 1363.698
control_completion_005678 deepseek-coder-33b 1363.698
control_completion_000249 deepseek-coder-33b 1363.698
block_completion_006949 deepseek-coder-33b 1363.698
block_completion_003825 deepseek-coder-33b 1363.698
block_completion_002765 deepseek-coder-33b 1363.698
block_completion_002712 deepseek-coder-33b 1363.698
control_completion_005673 deepseek-coder-33b 1363.698
block_completion_006826 deepseek-coder-33b 1363.698
block_completion_001548 deepseek-coder-33b 1363.698
control_completion_000911 deepseek-coder-33b 1363.698
block_completion_000601 deepseek-coder-33b 1363.698
control_completion_000274 deepseek-coder-33b 1363.698
control_completion_005322 deepseek-coder-33b 1363.698
block_completion_001627 deepseek-coder-33b 1363.698
block_completion_003369 deepseek-coder-33b 1363.698
block_completion_007364 deepseek-coder-33b 1363.698
control_completion_005001 deepseek-coder-33b 1363.698
block_completion_001451 deepseek-coder-33b 1363.698
block_completion_002030 deepseek-coder-33b 1363.698
control_completion_003932 deepseek-coder-33b 1363.698
block_completion_004825 deepseek-coder-33b 1363.698
block_completion_005003 deepseek-coder-33b 1363.698
control_completion_008211 deepseek-coder-33b 1363.698
block_completion_005349 deepseek-coder-33b 1363.698
control_completion_004030 deepseek-coder-33b 1363.698
control_completion_007026 deepseek-coder-33b 1363.698
block_completion_005783 deepseek-coder-33b 1363.698
control_completion_003443 deepseek-coder-33b 1363.698
block_completion_001755 deepseek-coder-33b 1363.698
control_completion_003830 deepseek-coder-33b 1363.698
control_completion_007020 deepseek-coder-33b 1363.698
block_completion_001542 deepseek-coder-33b 1363.698
block_completion_001644 deepseek-coder-33b 1363.698
block_completion_002967 deepseek-coder-33b 1363.698
control_completion_005064 deepseek-coder-33b 1363.698
block_completion_004424 deepseek-coder-33b 1363.698
block_completion_002658 deepseek-coder-33b 1363.698
control_completion_000591 deepseek-coder-33b 1363.698
block_completion_007234 deepseek-coder-33b 1363.698
block_completion_007830 deepseek-coder-33b 1363.698
block_completion_005774 deepseek-coder-33b 1363.698
block_completion_000821 deepseek-coder-33b 1363.698
block_completion_003122 deepseek-coder-33b 1363.698
control_completion_003515 deepseek-coder-33b 1363.698
block_completion_001774 deepseek-coder-33b 1363.698
block_completion_000876 deepseek-coder-33b 1363.698
block_completion_008170 deepseek-coder-33b 1363.698
block_completion_007245 deepseek-coder-33b 1363.698
block_completion_004996 deepseek-coder-33b 1363.698
block_completion_000759 deepseek-coder-33b 1363.698
control_completion_005710 deepseek-coder-33b 1363.698
control_completion_006726 deepseek-coder-33b 1363.698
block_completion_005383 deepseek-coder-33b 1363.698
control_completion_001042 deepseek-coder-33b 1363.698
block_completion_007455 deepseek-coder-33b 1363.698
control_completion_007222 deepseek-coder-33b 1363.698
block_completion_008594 deepseek-coder-33b 1363.698
block_completion_007331 deepseek-coder-33b 1363.698
block_completion_008414 deepseek-coder-33b 1363.698
block_completion_004695 deepseek-coder-33b 1363.698
block_completion_000850 deepseek-coder-33b 1363.698
block_completion_007152 deepseek-coder-33b 1363.698
block_completion_001756 deepseek-coder-33b 1363.698
control_completion_000275 deepseek-coder-33b 1363.698
block_completion_002950 deepseek-coder-33b 1363.698
control_completion_005699 deepseek-coder-33b 1363.698
block_completion_004324 deepseek-coder-33b 1363.698
block_completion_002769 deepseek-coder-33b 1363.698
block_completion_001777 deepseek-coder-33b 1363.698
control_completion_007022 deepseek-coder-33b 1363.698
block_completion_008435 deepseek-coder-33b 1363.698
block_completion_004635 deepseek-coder-33b 1363.698
control_completion_005676 deepseek-coder-33b 1363.698
block_completion_001744 deepseek-coder-33b 1363.698
block_completion_006543 deepseek-coder-33b 1363.698
block_completion_002162 deepseek-coder-33b 1363.698
block_completion_001345 deepseek-coder-33b 1363.698
block_completion_001300 deepseek-coder-33b 1363.698
control_completion_003786 deepseek-coder-33b 1363.698
block_completion_003576 deepseek-coder-33b 1363.698
block_completion_007543 deepseek-coder-33b 1363.698
control_completion_002731 deepseek-coder-33b 1363.698
block_completion_005134 deepseek-coder-33b 1363.698
block_completion_006803 deepseek-coder-33b 1363.698
block_completion_005620 deepseek-coder-33b 1363.698
block_completion_000522 deepseek-coder-33b 1363.698
control_completion_003623 deepseek-coder-33b 1363.698
block_completion_003045 deepseek-coder-33b 1363.698
control_completion_004840 deepseek-coder-33b 1363.698
block_completion_005146 deepseek-coder-33b 1363.698
block_completion_006551 deepseek-coder-33b 1363.698
block_completion_001579 deepseek-coder-33b 1363.698
control_completion_001961 deepseek-coder-33b 1363.698
control_completion_003552 deepseek-coder-33b 1363.698
block_completion_006102 deepseek-coder-33b 1363.698
block_completion_008370 deepseek-coder-33b 1363.698
block_completion_008051 deepseek-coder-33b 1363.698
block_completion_008238 deepseek-coder-33b 1363.698
block_completion_002433 deepseek-coder-33b 1363.698
block_completion_000499 deepseek-coder-33b 1363.698
control_completion_008285 deepseek-coder-33b 1363.698
control_completion_000967 deepseek-coder-33b 1363.698
block_completion_006160 deepseek-coder-33b 1363.698
block_completion_001758 deepseek-coder-33b 1363.698
block_completion_002684 deepseek-coder-33b 1363.698
control_completion_001754 deepseek-coder-33b 1363.698
control_completion_004757 deepseek-coder-33b 1363.698
control_completion_008009 deepseek-coder-33b 1363.698
block_completion_006599 deepseek-coder-33b 1363.698
block_completion_005984 deepseek-coder-33b 1363.698
block_completion_005867 deepseek-coder-33b 1363.698
block_completion_003880 deepseek-coder-33b 1363.698
block_completion_005152 deepseek-coder-33b 1363.698
block_completion_000803 deepseek-coder-33b 1363.698
block_completion_005377 deepseek-coder-33b 1363.698
block_completion_007985 deepseek-coder-33b 1363.698
block_completion_002881 deepseek-coder-33b 1363.698
control_completion_005881 deepseek-coder-6.7b 1281.580
control_completion_001113 deepseek-coder-6.7b 1281.580
control_completion_006152 deepseek-coder-6.7b 1281.580
block_completion_008225 deepseek-coder-6.7b 1281.580
control_completion_005722 deepseek-coder-6.7b 1281.580
control_completion_002050 deepseek-coder-6.7b 1281.580
control_completion_001115 deepseek-coder-6.7b 1281.580
block_completion_001304 deepseek-coder-6.7b 1281.580
block_completion_005894 deepseek-coder-6.7b 1281.580
block_completion_000518 deepseek-coder-6.7b 1281.580
block_completion_002796 deepseek-coder-6.7b 1281.580
block_completion_005113 deepseek-coder-6.7b 1281.580
block_completion_000705 deepseek-coder-6.7b 1281.580
block_completion_006009 deepseek-coder-6.7b 1281.580
block_completion_005046 deepseek-coder-6.7b 1281.580
control_completion_004837 deepseek-coder-6.7b 1281.580
block_completion_008087 deepseek-coder-6.7b 1281.580
control_completion_006534 deepseek-coder-6.7b 1281.580
block_completion_003390 deepseek-coder-6.7b 1281.580
block_completion_004601 deepseek-coder-6.7b 1281.580
block_completion_004794 deepseek-coder-6.7b 1281.580
block_completion_000349 deepseek-coder-6.7b 1281.580
block_completion_000779 deepseek-coder-6.7b 1281.580
block_completion_006504 deepseek-coder-6.7b 1281.580
block_completion_000346 deepseek-coder-6.7b 1281.580
control_completion_004796 deepseek-coder-6.7b 1281.580
block_completion_005617 deepseek-coder-6.7b 1281.580
block_completion_004121 deepseek-coder-6.7b 1281.580
control_completion_003523 deepseek-coder-6.7b 1281.580
block_completion_000361 deepseek-coder-6.7b 1281.580
control_completion_001957 deepseek-coder-6.7b 1281.580
control_completion_006405 deepseek-coder-6.7b 1281.580
block_completion_005304 deepseek-coder-6.7b 1281.580
block_completion_007361 deepseek-coder-6.7b 1281.580
block_completion_004603 deepseek-coder-6.7b 1281.580
control_completion_001316 deepseek-coder-6.7b 1281.580
control_completion_004761 deepseek-coder-6.7b 1281.580
block_completion_004095 deepseek-coder-6.7b 1281.580
block_completion_008074 deepseek-coder-6.7b 1281.580
control_completion_007358 deepseek-coder-6.7b 1281.580
block_completion_003828 deepseek-coder-6.7b 1281.580
block_completion_001999 deepseek-coder-6.7b 1281.580
block_completion_004733 deepseek-coder-6.7b 1281.580
block_completion_006524 deepseek-coder-6.7b 1281.580
block_completion_007305 deepseek-coder-6.7b 1281.580
control_completion_002076 deepseek-coder-6.7b 1281.580
block_completion_003011 deepseek-coder-6.7b 1281.580
block_completion_003405 deepseek-coder-6.7b 1281.580
block_completion_004671 deepseek-coder-6.7b 1281.580
block_completion_001404 deepseek-coder-6.7b 1281.580
block_completion_001230 deepseek-coder-6.7b 1281.580
control_completion_004019 deepseek-coder-6.7b 1281.580
control_completion_001297 deepseek-coder-6.7b 1281.580
block_completion_005035 deepseek-coder-6.7b 1281.580
block_completion_000947 deepseek-coder-6.7b 1281.580
block_completion_006434 deepseek-coder-6.7b 1281.580
block_completion_004000 deepseek-coder-6.7b 1281.580
control_completion_006078 deepseek-coder-6.7b 1281.580
block_completion_005251 deepseek-coder-6.7b 1281.580
block_completion_005080 deepseek-coder-6.7b 1281.580
block_completion_007402 deepseek-coder-6.7b 1281.580
block_completion_001789 deepseek-coder-6.7b 1281.580
block_completion_006302 deepseek-coder-6.7b 1281.580
block_completion_001010 deepseek-coder-6.7b 1281.580
control_completion_003152 deepseek-coder-6.7b 1281.580
block_completion_005675 deepseek-coder-6.7b 1281.580
block_completion_000350 deepseek-coder-6.7b 1281.580
block_completion_002023 deepseek-coder-6.7b 1281.580
block_completion_005950 deepseek-coder-6.7b 1281.580
control_completion_001839 deepseek-coder-6.7b 1281.580
control_completion_001670 deepseek-coder-6.7b 1281.580
block_completion_008605 deepseek-coder-6.7b 1281.580
control_completion_007474 deepseek-coder-6.7b 1281.580
block_completion_006988 deepseek-coder-6.7b 1281.580
control_completion_002951 deepseek-coder-6.7b 1281.580
block_completion_003519 deepseek-coder-6.7b 1281.580
block_completion_008119 deepseek-coder-6.7b 1281.580
block_completion_001438 deepseek-coder-6.7b 1281.580
control_completion_001976 deepseek-coder-6.7b 1281.580
control_completion_003126 deepseek-coder-6.7b 1281.580
block_completion_005903 deepseek-coder-6.7b 1281.580
block_completion_001285 wizardcoder-33b 1224.592
block_completion_000816 wizardcoder-33b 1224.592
control_completion_002519 wizardcoder-33b 1224.592
block_completion_006700 wizardcoder-33b 1224.592
control_completion_003231 wizardcoder-33b 1224.592
block_completion_007009 wizardcoder-33b 1224.592
control_completion_006971 wizardcoder-33b 1224.592
control_completion_001154 wizardcoder-33b 1224.592
control_completion_004473 wizardcoder-33b 1224.592
control_completion_008378 wizardcoder-33b 1224.592
control_completion_003273 wizardcoder-33b 1224.592
block_completion_006588 wizardcoder-33b 1224.592
block_completion_006315 wizardcoder-33b 1224.592
block_completion_003574 wizardcoder-33b 1224.592
block_completion_007737 wizardcoder-33b 1224.592
control_completion_000124 wizardcoder-33b 1224.592
block_completion_005546 wizardcoder-33b 1224.592
block_completion_008207 wizardcoder-33b 1224.592
block_completion_005975 wizardcoder-33b 1224.592
block_completion_003028 wizardcoder-33b 1224.592
block_completion_003114 wizardcoder-33b 1224.592
control_completion_001041 wizardcoder-33b 1224.592
block_completion_004698 wizardcoder-33b 1224.592
block_completion_005775 wizardcoder-33b 1224.592
block_completion_006483 wizardcoder-33b 1224.592
block_completion_008217 wizardcoder-33b 1224.592
control_completion_002770 wizardcoder-33b 1224.592
block_completion_002443 wizardcoder-33b 1224.592
control_completion_005218 wizardcoder-33b 1224.592
block_completion_000958 wizardcoder-33b 1224.592
block_completion_004141 wizardcoder-33b 1224.592
block_completion_006807 wizardcoder-33b 1224.592
block_completion_008156 wizardcoder-33b 1224.592
block_completion_002055 wizardcoder-33b 1224.592
block_completion_001341 wizardcoder-33b 1224.592
control_completion_003424 wizardcoder-33b 1224.592
control_completion_002231 wizardcoder-33b 1224.592
block_completion_006872 wizardcoder-33b 1224.592
block_completion_003295 wizardcoder-33b 1224.592
block_completion_002590 wizardcoder-33b 1224.592
control_completion_005211 wizardcoder-33b 1224.592
control_completion_000756 wizardcoder-33b 1224.592
control_completion_004610 wizardcoder-33b 1224.592
control_completion_007769 wizardcoder-33b 1224.592
block_completion_001598 wizardcoder-33b 1224.592
block_completion_001278 wizardcoder-33b 1224.592
block_completion_001557 wizardcoder-33b 1224.592
control_completion_007762 wizardcoder-33b 1224.592
control_completion_007433 wizardcoder-33b 1224.592
block_completion_005606 wizardcoder-33b 1224.592
block_completion_000383 wizardcoder-33b 1224.592
block_completion_005831 wizardcoder-33b 1224.592
control_completion_002343 wizardcoder-33b 1224.592
block_completion_001566 wizardcoder-33b 1224.592
block_completion_000320 wizardcoder-33b 1224.592
block_completion_005641 wizardcoder-33b 1224.592
block_completion_001281 wizardcoder-33b 1224.592
block_completion_004263 wizardcoder-33b 1224.592
control_completion_004588 wizardcoder-33b 1224.592
block_completion_005746 wizardcoder-33b 1224.592
control_completion_006481 wizardcoder-33b 1224.592
block_completion_002003 wizardcoder-33b 1224.592
block_completion_008404 wizardcoder-33b 1224.592
control_completion_005627 wizardcoder-33b 1224.592
control_completion_002729 wizardcoder-33b 1224.592
block_completion_000327 wizardcoder-33b 1224.592
block_completion_003510 wizardcoder-33b 1224.592
block_completion_003814 wizardcoder-33b 1224.592
block_completion_008598 wizardcoder-33b 1224.592
block_completion_000462 wizardcoder-33b 1224.592
block_completion_001594 wizardcoder-33b 1224.592
block_completion_002631 wizardcoder-33b 1224.592
block_completion_002336 wizardcoder-33b 1224.592
control_completion_002331 wizardcoder-33b 1224.592
control_completion_005853 wizardcoder-33b 1224.592
block_completion_004908 wizardcoder-33b 1224.592
block_completion_000665 wizardcoder-33b 1224.592
block_completion_003996 wizardcoder-33b 1224.592
block_completion_008537 wizardcoder-33b 1224.592
control_completion_005632 wizardcoder-33b 1224.592
block_completion_003543 wizardcoder-33b 1224.592
block_completion_003119 wizardcoder-33b 1224.592
control_completion_000010 wizardcoder-33b 1224.592
block_completion_001400 wizardcoder-33b 1224.592
block_completion_007944 wizardcoder-33b 1224.592
block_completion_003584 wizardcoder-33b 1224.592
block_completion_007272 wizardcoder-33b 1224.592
control_completion_002713 wizardcoder-33b 1224.592
block_completion_007224 wizardcoder-33b 1224.592
control_completion_002976 wizardcoder-33b 1224.592
control_completion_008041 wizardcoder-33b 1224.592
block_completion_006344 wizardcoder-33b 1224.592
control_completion_007899 wizardcoder-33b 1224.592
block_completion_000185 wizardcoder-33b 1224.592
control_completion_003805 wizardcoder-33b 1224.592
control_completion_008108 wizardcoder-33b 1224.592
block_completion_000671 wizardcoder-33b 1224.592
block_completion_007299 wizardcoder-33b 1224.592
block_completion_001877 wizardcoder-33b 1224.592
block_completion_001499 wizardcoder-33b 1224.592
block_completion_001283 wizardcoder-33b 1224.592
block_completion_005597 wizardcoder-33b 1224.592
control_completion_006777 wizardcoder-33b 1224.592
control_completion_004872 wizardcoder-33b 1224.592
control_completion_003239 wizardcoder-33b 1224.592
block_completion_002081 wizardcoder-33b 1224.592
block_completion_004860 wizardcoder-33b 1224.592
control_completion_006630 wizardcoder-33b 1224.592
control_completion_007533 wizardcoder-33b 1224.592
block_completion_001539 wizardcoder-33b 1224.592
control_completion_002979 wizardcoder-33b 1224.592
block_completion_008565 wizardcoder-33b 1224.592
control_completion_001521 wizardcoder-33b 1224.592
control_completion_005956 wizardcoder-33b 1224.592
control_completion_004211 wizardcoder-33b 1224.592
block_completion_007746 wizardcoder-33b 1224.592
block_completion_007077 wizardcoder-33b 1224.592
control_completion_000909 wizardcoder-33b 1224.592
control_completion_007627 wizardcoder-33b 1224.592
block_completion_002960 wizardcoder-33b 1224.592
block_completion_005638 wizardcoder-33b 1224.592
control_completion_004302 wizardcoder-33b 1224.592
control_completion_001337 wizardcoder-33b 1224.592
control_completion_005335 wizardcoder-33b 1224.592
block_completion_005744 wizardcoder-33b 1224.592
control_completion_001982 wizardcoder-33b 1224.592
block_completion_002360 wizardcoder-33b 1224.592
control_completion_003559 wizardcoder-33b 1224.592
block_completion_008138 wizardcoder-33b 1224.592
block_completion_002521 wizardcoder-33b 1224.592
control_completion_005516 starcoderbase-16b 1140.277
block_completion_006682 starcoderbase-16b 1140.277
block_completion_001007 starcoderbase-16b 1140.277
control_completion_003276 starcoderbase-16b 1140.277
block_completion_006583 starcoderbase-16b 1140.277
control_completion_003613 starcoderbase-16b 1140.277
block_completion_005444 starcoderbase-16b 1140.277
block_completion_008550 starcoderbase-16b 1140.277
block_completion_002702 starcoderbase-16b 1140.277
control_completion_006822 starcoderbase-16b 1140.277
block_completion_003265 starcoderbase-16b 1140.277
block_completion_008097 starcoderbase-16b 1140.277
control_completion_000106 starcoderbase-16b 1140.277
block_completion_003085 starcoderbase-16b 1140.277
control_completion_002117 starcoderbase-16b 1140.277
control_completion_005110 starcoderbase-16b 1140.277
control_completion_004548 starcoderbase-16b 1140.277
block_completion_006446 starcoderbase-16b 1140.277
control_completion_004709 starcoderbase-16b 1140.277
block_completion_002205 starcoderbase-16b 1140.277
block_completion_002302 starcoderbase-16b 1140.277
control_completion_006727 starcoderbase-16b 1140.277
block_completion_004939 starcoderbase-16b 1140.277
control_completion_003396 codellama-13b 1123.025
block_completion_006221 codellama-13b 1123.025
block_completion_008341 codellama-13b 1123.025
control_completion_001666 codellama-13b 1123.025
control_completion_000022 codellama-13b 1123.025
control_completion_006004 codellama-13b 1123.025
control_completion_007595 codellama-13b 1123.025
block_completion_008412 codellama-13b 1123.025
control_completion_006311 codellama-13b 1123.025
control_completion_003749 codellama-13b 1123.025
control_completion_005706 codellama-13b 1123.025
control_completion_001334 codellama-13b 1123.025
control_completion_006125 codellama-13b 1123.025
block_completion_007804 codellama-13b 1123.025
control_completion_001771 codellama-13b 1123.025
block_completion_004798 codellama-13b 1123.025
control_completion_007945 codellama-13b 1123.025
block_completion_001753 codellama-13b 1123.025
control_completion_001539 codellama-13b 1123.025
block_completion_004146 codellama-13b 1123.025
control_completion_004468 codellama-13b 1123.025
block_completion_002157 codellama-13b 1123.025
block_completion_007004 codellama-13b 1123.025
block_completion_007489 codellama-13b 1123.025
control_completion_001010 codellama-13b 1123.025
control_completion_003502 codellama-13b 1123.025
block_completion_004559 codellama-13b 1123.025
control_completion_007935 codellama-13b 1123.025
control_completion_008426 codellama-13b 1123.025
block_completion_007646 codellama-13b 1123.025
block_completion_001047 codellama-13b 1123.025
block_completion_000762 codellama-13b 1123.025
control_completion_001284 codellama-13b 1123.025
control_completion_007947 codellama-13b 1123.025
block_completion_000980 deepseek-coder-1.3b 1109.413
block_completion_003795 deepseek-coder-1.3b 1109.413
control_completion_003811 deepseek-coder-1.3b 1109.413
block_completion_005335 deepseek-coder-1.3b 1109.413
block_completion_001363 deepseek-coder-1.3b 1109.413
block_completion_001453 deepseek-coder-1.3b 1109.413
block_completion_000613 deepseek-coder-1.3b 1109.413
control_completion_004773 deepseek-coder-1.3b 1109.413
control_completion_006791 deepseek-coder-1.3b 1109.413
block_completion_007518 deepseek-coder-1.3b 1109.413
control_completion_008608 deepseek-coder-1.3b 1109.413
control_completion_006112 deepseek-coder-1.3b 1109.413
block_completion_002889 deepseek-coder-1.3b 1109.413
control_completion_007962 deepseek-coder-1.3b 1109.413
control_completion_002576 deepseek-coder-1.3b 1109.413
control_completion_004309 deepseek-coder-1.3b 1109.413
block_completion_004480 deepseek-coder-1.3b 1109.413
block_completion_008020 deepseek-coder-1.3b 1109.413
block_completion_002170 deepseek-coder-1.3b 1109.413
control_completion_005247 deepseek-coder-1.3b 1109.413
block_completion_005926 deepseek-coder-1.3b 1109.413
control_completion_003627 deepseek-coder-1.3b 1109.413
control_completion_002759 wizardcoder-15b 1104.659
block_completion_007676 wizardcoder-15b 1104.659
block_completion_008432 wizardcoder-15b 1104.659
block_completion_001068 wizardcoder-15b 1104.659
control_completion_001669 wizardcoder-15b 1104.659
block_completion_002870 wizardcoder-15b 1104.659
block_completion_008449 wizardcoder-15b 1104.659
control_completion_007781 wizardcoder-15b 1104.659
block_completion_001576 wizardcoder-15b 1104.659
control_completion_008292 wizardcoder-15b 1104.659
block_completion_008129 wizardcoder-15b 1104.659
control_completion_004862 wizardcoder-15b 1104.659
control_completion_008289 wizardcoder-15b 1104.659
control_completion_007765 wizardcoder-15b 1104.659
control_completion_000531 wizardcoder-15b 1104.659
block_completion_000342 wizardcoder-15b 1104.659
block_completion_000353 wizardcoder-15b 1104.659
block_completion_004757 wizardcoder-15b 1104.659
control_completion_008485 wizardcoder-15b 1104.659
control_completion_001766 wizardcoder-15b 1104.659
block_completion_003459 wizardcoder-15b 1104.659
block_completion_005841 wizardcoder-15b 1104.659
block_completion_002667 wizardcoder-15b 1104.659
block_completion_006794 wizardcoder-15b 1104.659
block_completion_005611 wizardcoder-15b 1104.659
block_completion_004936 wizardcoder-15b 1104.659
block_completion_001822 wizardcoder-15b 1104.659
block_completion_001726 wizardcoder-15b 1104.659
block_completion_005065 gpt-4-1106-preview 1089.098
block_completion_006266 gpt-4-1106-preview 1089.098
block_completion_004488 gpt-4-1106-preview 1089.098
control_completion_003067 gpt-4-1106-preview 1089.098
block_completion_004742 gpt-4-1106-preview 1089.098
block_completion_003618 gpt-4-1106-preview 1089.098
block_completion_000626 gpt-4-1106-preview 1089.098
block_completion_004530 gpt-4-1106-preview 1089.098
control_completion_008267 gpt-4-1106-preview 1089.098
block_completion_005226 gpt-4-1106-preview 1089.098
control_completion_008308 gpt-4-1106-preview 1089.098
control_completion_002856 gpt-4-1106-preview 1089.098
block_completion_006135 gpt-4-1106-preview 1089.098
control_completion_005904 gpt-4-1106-preview 1089.098
block_completion_002930 gpt-4-1106-preview 1089.098
block_completion_008027 gpt-4-1106-preview 1089.098
control_completion_001038 gpt-4-1106-preview 1089.098
control_completion_006613 gpt-4-1106-preview 1089.098
control_completion_003401 gpt-4-1106-preview 1089.098
block_completion_004934 gpt-4-1106-preview 1089.098
control_completion_007451 gpt-4-1106-preview 1089.098
control_completion_001498 gpt-4-1106-preview 1089.098
control_completion_000164 gpt-4-1106-preview 1089.098
control_completion_001158 gpt-4-1106-preview 1089.098
block_completion_004645 gpt-4-1106-preview 1089.098
control_completion_004894 gpt-4-1106-preview 1089.098
control_completion_005970 gpt-4-1106-preview 1089.098
block_completion_005679 gpt-4-1106-preview 1089.098
block_completion_003644 gpt-4-1106-preview 1089.098
block_completion_003823 gpt-4-1106-preview 1089.098
control_completion_005918 gpt-4-1106-preview 1089.098
block_completion_001505 gpt-4-1106-preview 1089.098
control_completion_000862 gpt-4-1106-preview 1089.098
block_completion_008563 gpt-4-1106-preview 1089.098
control_completion_000174 gpt-4-1106-preview 1089.098
block_completion_004106 gpt-4-1106-preview 1089.098
block_completion_002538 gpt-4-1106-preview 1089.098
control_completion_002337 gpt-4-1106-preview 1089.098
control_completion_001543 gpt-4-1106-preview 1089.098
block_completion_008146 gpt-4-1106-preview 1089.098
control_completion_003996 gpt-4-1106-preview 1089.098
control_completion_001667 gpt-4-1106-preview 1089.098
control_completion_000570 gpt-4-1106-preview 1089.098
control_completion_005215 gpt-4-1106-preview 1089.098
control_completion_007175 gpt-4-1106-preview 1089.098
block_completion_003429 gpt-4-1106-preview 1089.098
control_completion_001642 gpt-4-1106-preview 1089.098
block_completion_007119 gpt-4-1106-preview 1089.098
control_completion_003908 gpt-4-1106-preview 1089.098
control_completion_008512 gpt-4-1106-preview 1089.098
block_completion_008314 gpt-4-1106-preview 1089.098
control_completion_003576 gpt-4-1106-preview 1089.098
control_completion_007223 gpt-4-1106-preview 1089.098
block_completion_001595 gpt-4-1106-preview 1089.098
control_completion_003130 gpt-4-1106-preview 1089.098
control_completion_001290 gpt-4-1106-preview 1089.098
block_completion_005901 gpt-4-1106-preview 1089.098
block_completion_003294 gpt-4-1106-preview 1089.098
control_completion_002762 gpt-4-1106-preview 1089.098
control_completion_005255 gpt-4-1106-preview 1089.098
block_completion_000872 gpt-4-1106-preview 1089.098
control_completion_003933 gpt-4-1106-preview 1089.098
control_completion_002572 gpt-4-1106-preview 1089.098
block_completion_004016 gpt-4-1106-preview 1089.098
block_completion_004693 gpt-4-1106-preview 1089.098
block_completion_007158 gpt-4-1106-preview 1089.098
block_completion_005340 gpt-4-1106-preview 1089.098
control_completion_003670 gpt-4-1106-preview 1089.098
block_completion_003572 gpt-4-1106-preview 1089.098
control_completion_000012 gpt-4-1106-preview 1089.098
block_completion_001864 gpt-4-1106-preview 1089.098
block_completion_004368 gpt-4-1106-preview 1089.098
block_completion_007103 gpt-4-1106-preview 1089.098
control_completion_006542 gpt-4-1106-preview 1089.098
control_completion_001702 gpt-4-1106-preview 1089.098
block_completion_008144 gpt-4-1106-preview 1089.098
control_completion_007913 gpt-4-1106-preview 1089.098
control_completion_000122 gpt-4-1106-preview 1089.098
block_completion_006665 gpt-4-1106-preview 1089.098
control_completion_007019 gpt-4-1106-preview 1089.098
block_completion_001500 gpt-4-1106-preview 1089.098
block_completion_002383 gpt-4-1106-preview 1089.098
control_completion_004189 gpt-4-1106-preview 1089.098
control_completion_001750 gpt-4-1106-preview 1089.098
control_completion_000286 gpt-4-1106-preview 1089.098
block_completion_001589 gpt-4-1106-preview 1089.098
block_completion_003675 gpt-4-1106-preview 1089.098
block_completion_001447 gpt-4-1106-preview 1089.098
control_completion_005427 gpt-4-1106-preview 1089.098
control_completion_008306 gpt-4-1106-preview 1089.098
block_completion_006258 gpt-4-1106-preview 1089.098
block_completion_003342 gpt-4-1106-preview 1089.098
control_completion_001675 gpt-4-1106-preview 1089.098
control_completion_000037 gpt-4-1106-preview 1089.098
control_completion_000117 gpt-4-1106-preview 1089.098
control_completion_003656 gpt-4-1106-preview 1089.098
block_completion_004332 gpt-4-1106-preview 1089.098
block_completion_005943 gpt-4-1106-preview 1089.098
control_completion_005698 gpt-4-1106-preview 1089.098
block_completion_000920 gpt-4-1106-preview 1089.098
control_completion_005697 gpt-4-1106-preview 1089.098
control_completion_003964 gpt-4-1106-preview 1089.098
control_completion_004950 gpt-4-1106-preview 1089.098
control_completion_000168 gpt-4-1106-preview 1089.098
control_completion_000886 gpt-4-1106-preview 1089.098
block_completion_003511 gpt-4-1106-preview 1089.098
block_completion_008574 gpt-4-1106-preview 1089.098
block_completion_001515 gpt-4-1106-preview 1089.098
block_completion_003307 gpt-4-1106-preview 1089.098
block_completion_002437 gpt-4-1106-preview 1089.098
block_completion_008318 gpt-4-1106-preview 1089.098
block_completion_008402 gpt-4-1106-preview 1089.098
control_completion_001621 gpt-4-1106-preview 1089.098
block_completion_004295 gpt-4-1106-preview 1089.098
block_completion_002523 gpt-4-1106-preview 1089.098
block_completion_003296 gpt-4-1106-preview 1089.098
block_completion_002244 gpt-4-1106-preview 1089.098
control_completion_003496 gpt-4-1106-preview 1089.098
block_completion_002578 gpt-4-1106-preview 1089.098
block_completion_001347 gpt-4-1106-preview 1089.098
control_completion_003057 gpt-4-1106-preview 1089.098
block_completion_003992 gpt-4-1106-preview 1089.098
block_completion_007911 gpt-4-1106-preview 1089.098
control_completion_008503 gpt-4-1106-preview 1089.098
control_completion_002049 gpt-4-1106-preview 1089.098
control_completion_003287 gpt-4-1106-preview 1089.098
control_completion_002767 gpt-4-1106-preview 1089.098
block_completion_007567 gpt-4-1106-preview 1089.098
control_completion_000987 gpt-4-1106-preview 1089.098
block_completion_001110 gpt-4-1106-preview 1089.098
block_completion_003681 gpt-4-1106-preview 1089.098
control_completion_000280 gpt-4-1106-preview 1089.098
control_completion_006635 gpt-4-1106-preview 1089.098
control_completion_000007 gpt-4-1106-preview 1089.098
control_completion_001349 gpt-4-1106-preview 1089.098
control_completion_004402 gpt-4-1106-preview 1089.098
control_completion_003495 gpt-4-1106-preview 1089.098
block_completion_007948 gpt-4-1106-preview 1089.098
control_completion_001632 gpt-4-1106-preview 1089.098
block_completion_001699 gpt-4-1106-preview 1089.098
control_completion_003824 gpt-4-1106-preview 1089.098
control_completion_002727 gpt-4-1106-preview 1089.098
control_completion_006356 gpt-4-1106-preview 1089.098
control_completion_008483 gpt-4-1106-preview 1089.098
control_completion_002119 gpt-4-1106-preview 1089.098
control_completion_003127 gpt-4-1106-preview 1089.098
control_completion_000039 gpt-4-1106-preview 1089.098
control_completion_004734 gpt-4-1106-preview 1089.098
control_completion_007076 gpt-4-1106-preview 1089.098
control_completion_004816 gpt-4-1106-preview 1089.098
block_completion_006835 gpt-4-1106-preview 1089.098
block_completion_006954 gpt-4-1106-preview 1089.098
control_completion_003431 gpt-4-1106-preview 1089.098
control_completion_004265 gpt-4-1106-preview 1089.098
block_completion_001441 gpt-4-1106-preview 1089.098
control_completion_006591 gpt-4-1106-preview 1089.098
control_completion_001220 gpt-4-1106-preview 1089.098
block_completion_008575 gpt-4-1106-preview 1089.098
control_completion_003499 gpt-4-1106-preview 1089.098
block_completion_005912 gpt-4-1106-preview 1089.098
block_completion_007600 gpt-4-1106-preview 1089.098
block_completion_003512 gpt-4-1106-preview 1089.098
block_completion_007381 gpt-4-1106-preview 1089.098
block_completion_000679 gpt-4-1106-preview 1089.098
block_completion_005177 gpt-4-1106-preview 1089.098
control_completion_006853 gpt-4-1106-preview 1089.098
control_completion_000029 gpt-4-1106-preview 1089.098
block_completion_008092 gpt-4-1106-preview 1089.098
control_completion_007908 gpt-4-1106-preview 1089.098
control_completion_000895 gpt-4-1106-preview 1089.098
control_completion_003981 gpt-4-1106-preview 1089.098
control_completion_001234 gpt-4-1106-preview 1089.098
block_completion_004882 gpt-4-1106-preview 1089.098
block_completion_004018 gpt-4-1106-preview 1089.098
control_completion_002682 gpt-4-1106-preview 1089.098
control_completion_003281 gpt-4-1106-preview 1089.098
block_completion_006936 gpt-4-1106-preview 1089.098
block_completion_002013 gpt-4-1106-preview 1089.098
block_completion_003903 gpt-4-1106-preview 1089.098
control_completion_001090 gpt-4-1106-preview 1089.098
block_completion_002136 gpt-4-1106-preview 1089.098
control_completion_005246 gpt-4-1106-preview 1089.098
control_completion_007010 gpt-4-1106-preview 1089.098
control_completion_002935 gpt-4-1106-preview 1089.098
control_completion_000744 gpt-4-1106-preview 1089.098
control_completion_006009 gpt-4-1106-preview 1089.098
control_completion_004450 gpt-4-1106-preview 1089.098
control_completion_003116 gpt-4-1106-preview 1089.098
block_completion_001956 gpt-4-1106-preview 1089.098
control_completion_002700 gpt-4-1106-preview 1089.098
block_completion_004270 gpt-4-1106-preview 1089.098
block_completion_003077 gpt-4-1106-preview 1089.098
control_completion_001087 gpt-4-1106-preview 1089.098
block_completion_001897 gpt-4-1106-preview 1089.098
control_completion_000331 gpt-4-1106-preview 1089.098
control_completion_000004 gpt-4-1106-preview 1089.098
block_completion_006470 gpt-4-1106-preview 1089.098
control_completion_004893 gpt-4-1106-preview 1089.098
block_completion_007157 gpt-4-1106-preview 1089.098
block_completion_005332 gpt-4-1106-preview 1089.098
block_completion_006647 gpt-4-1106-preview 1089.098
control_completion_004765 gpt-4-1106-preview 1089.098
block_completion_000871 gpt-4-1106-preview 1089.098
control_completion_001176 gpt-4-1106-preview 1089.098
block_completion_004285 gpt-4-1106-preview 1089.098
block_completion_007200 gpt-4-1106-preview 1089.098
block_completion_002607 gpt-4-1106-preview 1089.098
control_completion_007991 gpt-4-1106-preview 1089.098
block_completion_007024 gpt-4-1106-preview 1089.098
control_completion_001033 gpt-4-1106-preview 1089.098
control_completion_007027 gpt-4-1106-preview 1089.098
block_completion_000912 gpt-4-1106-preview 1089.098
control_completion_003166 gpt-4-1106-preview 1089.098
block_completion_003235 gpt-4-1106-preview 1089.098
control_completion_000685 gpt-4-1106-preview 1089.098
block_completion_000389 gpt-4-1106-preview 1089.098
block_completion_006214 gpt-4-1106-preview 1089.098
block_completion_002571 gpt-4-1106-preview 1089.098
block_completion_003306 gpt-4-1106-preview 1089.098
control_completion_001532 gpt-4-1106-preview 1089.098
control_completion_002720 gpt-4-1106-preview 1089.098
control_completion_003284 gpt-4-1106-preview 1089.098
control_completion_007036 gpt-4-1106-preview 1089.098
block_completion_002106 gpt-4-1106-preview 1089.098
block_completion_003304 gpt-4-1106-preview 1089.098
control_completion_000065 gpt-4-1106-preview 1089.098
block_completion_005619 gpt-4-1106-preview 1089.098
control_completion_008497 gpt-4-1106-preview 1089.098
control_completion_000042 gpt-4-1106-preview 1089.098
control_completion_005507 gpt-4-1106-preview 1089.098
control_completion_000820 gpt-4-1106-preview 1089.098
block_completion_007121 gpt-4-1106-preview 1089.098
block_completion_006412 gpt-4-1106-preview 1089.098
control_completion_005328 gpt-4-1106-preview 1089.098
block_completion_001550 gpt-4-1106-preview 1089.098
control_completion_007035 gpt-4-1106-preview 1089.098
control_completion_006316 gpt-4-1106-preview 1089.098
control_completion_006952 gpt-4-1106-preview 1089.098
block_completion_007023 gpt-4-1106-preview 1089.098
control_completion_001752 gpt-4-1106-preview 1089.098
block_completion_000616 gpt-4-1106-preview 1089.098
control_completion_007944 gpt-4-1106-preview 1089.098
control_completion_008327 gpt-4-1106-preview 1089.098
control_completion_006814 gpt-4-1106-preview 1089.098
block_completion_002773 gpt-4-1106-preview 1089.098
control_completion_008276 gpt-4-1106-preview 1089.098
control_completion_004274 gpt-4-1106-preview 1089.098
control_completion_003579 gpt-4-1106-preview 1089.098
block_completion_006289 gpt-4-1106-preview 1089.098
control_completion_006184 gpt-4-1106-preview 1089.098
control_completion_002298 gpt-4-1106-preview 1089.098
control_completion_002833 gpt-4-1106-preview 1089.098
control_completion_004445 gpt-4-1106-preview 1089.098
block_completion_001159 gpt-4-1106-preview 1089.098
control_completion_000289 gpt-4-1106-preview 1089.098
control_completion_004263 gpt-4-1106-preview 1089.098
block_completion_000656 gpt-4-1106-preview 1089.098
control_completion_007041 gpt-4-1106-preview 1089.098
control_completion_003848 gpt-4-1106-preview 1089.098
block_completion_004223 gpt-4-1106-preview 1089.098
block_completion_006913 gpt-4-1106-preview 1089.098
block_completion_005734 gpt-4-1106-preview 1089.098
control_completion_001524 gpt-4-1106-preview 1089.098
block_completion_007950 gpt-4-1106-preview 1089.098
control_completion_004059 gpt-4-1106-preview 1089.098
block_completion_001977 gpt-4-1106-preview 1089.098
block_completion_003719 gpt-4-1106-preview 1089.098
control_completion_004515 gpt-4-1106-preview 1089.098
control_completion_008052 gpt-4-1106-preview 1089.098
block_completion_004539 gpt-4-1106-preview 1089.098
block_completion_005431 gpt-4-1106-preview 1089.098
control_completion_003643 gpt-4-1106-preview 1089.098
block_completion_005161 gpt-4-1106-preview 1089.098
control_completion_003289 gpt-4-1106-preview 1089.098
control_completion_001077 gpt-4-1106-preview 1089.098
block_completion_001697 gpt-4-1106-preview 1089.098
block_completion_008580 gpt-4-1106-preview 1089.098
block_completion_008571 gpt-4-1106-preview 1089.098
block_completion_008091 gpt-4-1106-preview 1089.098
control_completion_008346 gpt-4-1106-preview 1089.098
block_completion_004051 gpt-4-1106-preview 1089.098
control_completion_008186 gpt-4-1106-preview 1089.098
control_completion_007649 gpt-4-1106-preview 1089.098
block_completion_002541 gpt-4-1106-preview 1089.098
control_completion_004959 gpt-4-1106-preview 1089.098
control_completion_007077 gpt-4-1106-preview 1089.098
control_completion_006614 gpt-4-1106-preview 1089.098
block_completion_005647 gpt-4-1106-preview 1089.098
control_completion_000061 gpt-4-1106-preview 1089.098
block_completion_002501 gpt-4-1106-preview 1089.098
block_completion_006176 gpt-4-1106-preview 1089.098
control_completion_008324 gpt-4-1106-preview 1089.098
block_completion_005958 gpt-4-1106-preview 1089.098
block_completion_005631 gpt-4-1106-preview 1089.098
control_completion_000366 gpt-4-1106-preview 1089.098
control_completion_005362 gpt-4-1106-preview 1089.098
block_completion_007953 gpt-4-1106-preview 1089.098
control_completion_000214 gpt-4-1106-preview 1089.098
block_completion_003517 gpt-4-1106-preview 1089.098
block_completion_004282 gpt-4-1106-preview 1089.098
block_completion_001254 gpt-4-1106-preview 1089.098
block_completion_001727 gpt-4-1106-preview 1089.098
block_completion_004852 gpt-4-1106-preview 1089.098
control_completion_008037 gpt-4-1106-preview 1089.098
control_completion_005261 gpt-4-1106-preview 1089.098
block_completion_007078 gpt-4-1106-preview 1089.098
block_completion_003520 gpt-4-1106-preview 1089.098
control_completion_004736 gpt-4-1106-preview 1089.098
block_completion_004532 gpt-4-1106-preview 1089.098
control_completion_006354 gpt-4-1106-preview 1089.098
control_completion_005786 gpt-4-1106-preview 1089.098
control_completion_001418 gpt-4-1106-preview 1089.098
control_completion_004824 gpt-4-1106-preview 1089.098
control_completion_008173 gpt-4-1106-preview 1089.098
control_completion_005721 gpt-4-1106-preview 1089.098
block_completion_005956 gpt-4-1106-preview 1089.098
control_completion_008353 gpt-4-1106-preview 1089.098
block_completion_000568 gpt-4-1106-preview 1089.098
control_completion_005330 gpt-4-1106-preview 1089.098
control_completion_006425 gpt-4-1106-preview 1089.098
block_completion_001603 gpt-4-1106-preview 1089.098
block_completion_008301 gpt-4-1106-preview 1089.098
block_completion_003976 gpt-4-1106-preview 1089.098
block_completion_000789 gpt-4-1106-preview 1089.098
block_completion_007745 gpt-4-1106-preview 1089.098
control_completion_000410 gpt-4-1106-preview 1089.098
control_completion_003553 gpt-4-1106-preview 1089.098
control_completion_002722 gpt-4-1106-preview 1089.098
block_completion_000782 gpt-4-1106-preview 1089.098
block_completion_005925 gpt-4-1106-preview 1089.098
block_completion_003611 gpt-4-1106-preview 1089.098
control_completion_000791 gpt-4-1106-preview 1089.098
block_completion_001248 gpt-4-1106-preview 1089.098
control_completion_003618 gpt-4-1106-preview 1089.098
block_completion_003137 gpt-4-1106-preview 1089.098
block_completion_005148 gpt-4-1106-preview 1089.098
block_completion_006523 gpt-4-1106-preview 1089.098
block_completion_005661 gpt-4-1106-preview 1089.098
control_completion_004439 gpt-4-1106-preview 1089.098
control_completion_001624 gpt-4-1106-preview 1089.098
block_completion_004599 gpt-4-1106-preview 1089.098
control_completion_004524 gpt-4-1106-preview 1089.098
block_completion_008698 gpt-4-1106-preview 1089.098
block_completion_003990 gpt-4-1106-preview 1089.098
control_completion_002564 gpt-4-1106-preview 1089.098
control_completion_005423 gpt-4-1106-preview 1089.098
block_completion_007161 gpt-4-1106-preview 1089.098
block_completion_008591 gpt-4-1106-preview 1089.098
control_completion_001270 gpt-4-1106-preview 1089.098
control_completion_007698 gpt-4-1106-preview 1089.098
block_completion_005045 gpt-4-1106-preview 1089.098
block_completion_002622 gpt-4-1106-preview 1089.098
control_completion_004408 gpt-4-1106-preview 1089.098
block_completion_004188 gpt-4-1106-preview 1089.098
block_completion_004044 gpt-4-1106-preview 1089.098
control_completion_000378 gpt-4-1106-preview 1089.098
control_completion_007039 gpt-4-1106-preview 1089.098
block_completion_001933 gpt-4-1106-preview 1089.098
block_completion_003410 gpt-4-1106-preview 1089.098
control_completion_001607 gpt-4-1106-preview 1089.098
block_completion_002527 gpt-4-1106-preview 1089.098
block_completion_000391 gpt-4-1106-preview 1089.098
control_completion_000683 gpt-4-1106-preview 1089.098
block_completion_003360 gpt-4-1106-preview 1089.098
control_completion_005801 gpt-4-1106-preview 1089.098
block_completion_001600 gpt-4-1106-preview 1089.098
control_completion_005227 gpt-4-1106-preview 1089.098
control_completion_001036 gpt-4-1106-preview 1089.098
block_completion_004112 gpt-4-1106-preview 1089.098
control_completion_005910 gpt-4-1106-preview 1089.098
block_completion_002222 gpt-4-1106-preview 1089.098
control_completion_000430 gpt-4-1106-preview 1089.098
block_completion_002144 gpt-4-1106-preview 1089.098
block_completion_008573 gpt-4-1106-preview 1089.098
control_completion_003275 gpt-4-1106-preview 1089.098
block_completion_001597 gpt-4-1106-preview 1089.098
block_completion_003905 gpt-4-1106-preview 1089.098
control_completion_003839 gpt-4-1106-preview 1089.098
control_completion_001108 gpt-4-1106-preview 1089.098
block_completion_001751 gpt-4-1106-preview 1089.098
block_completion_002875 gpt-4-1106-preview 1089.098
block_completion_002058 gpt-4-1106-preview 1089.098
block_completion_006511 gpt-4-1106-preview 1089.098
block_completion_006505 gpt-4-1106-preview 1089.098
block_completion_007163 gpt-4-1106-preview 1089.098
block_completion_003403 gpt-4-1106-preview 1089.098
control_completion_002864 gpt-4-1106-preview 1089.098
control_completion_007156 gpt-4-1106-preview 1089.098
block_completion_005712 gpt-4-1106-preview 1089.098
block_completion_006935 gpt-4-1106-preview 1089.098
block_completion_005777 gpt-4-1106-preview 1089.098
block_completion_006979 gpt-4-1106-preview 1089.098
control_completion_006747 codellama-34b 1084.595
control_completion_006424 codellama-34b 1084.595
block_completion_002125 codellama-34b 1084.595
block_completion_001129 codellama-34b 1084.595
block_completion_005163 codellama-34b 1084.595
block_completion_007357 codellama-34b 1084.595
control_completion_004037 codellama-34b 1084.595
control_completion_007981 codellama-34b 1084.595
block_completion_002867 codellama-34b 1084.595
control_completion_000115 codellama-34b 1084.595
control_completion_003159 codellama-34b 1084.595
block_completion_002668 codellama-34b 1084.595
block_completion_006893 codellama-34b 1084.595
block_completion_002878 codellama-34b 1084.595
block_completion_006023 codellama-34b 1084.595
block_completion_007283 codellama-34b 1084.595
block_completion_002679 codellama-34b 1084.595
control_completion_001288 codellama-34b 1084.595
control_completion_001183 codellama-34b 1084.595
control_completion_006247 codellama-34b 1084.595
block_completion_007866 codellama-34b 1084.595
block_completion_008680 codellama-34b 1084.595
control_completion_003781 codellama-34b 1084.595
block_completion_000976 codellama-34b 1084.595
block_completion_000360 codellama-34b 1084.595
block_completion_003557 codellama-34b 1084.595
block_completion_004334 codellama-34b 1084.595
block_completion_002565 codellama-34b 1084.595
block_completion_008346 codellama-7b 1047.076
block_completion_004211 codellama-7b 1047.076
control_completion_007910 codellama-7b 1047.076
block_completion_001458 codellama-7b 1047.076
control_completion_000255 codellama-7b 1047.076
block_completion_007215 codellama-7b 1047.076
block_completion_003600 codellama-7b 1047.076
control_completion_001772 codellama-7b 1047.076
control_completion_000408 codellama-7b 1047.076
control_completion_001331 codellama-7b 1047.076
control_completion_006022 codellama-7b 1047.076
block_completion_002876 codellama-7b 1047.076
block_completion_005949 codellama-7b 1047.076
control_completion_002424 codellama-7b 1047.076
control_completion_006290 codellama-7b 1047.076
control_completion_003490 codellama-7b 1047.076
control_completion_007092 codellama-7b 1047.076
control_completion_005334 codellama-7b 1047.076
control_completion_001138 codellama-7b 1047.076
control_completion_005713 codellama-7b 1047.076
control_completion_002571 codellama-7b 1047.076
block_completion_004941 codellama-7b 1047.076
block_completion_006309 codellama-7b 1047.076
block_completion_003081 codellama-7b 1047.076
control_completion_000116 codellama-7b 1047.076
block_completion_002176 codellama-7b 1047.076
block_completion_002682 codellama-7b 1047.076
control_completion_007931 codellama-7b 1047.076
control_completion_004128 codellama-7b 1047.076
control_completion_006830 codellama-7b 1047.076
control_completion_004122 codellama-7b 1047.076
block_completion_007714 mixtral-8x7b 1030.222
control_completion_002807 mixtral-8x7b 1030.222
control_completion_001396 mixtral-8x7b 1030.222
block_completion_002577 mixtral-8x7b 1030.222
block_completion_001811 mixtral-8x7b 1030.222
block_completion_001617 mixtral-8x7b 1030.222
control_completion_005409 mixtral-8x7b 1030.222
block_completion_002882 mixtral-8x7b 1030.222
control_completion_005212 mixtral-8x7b 1030.222
block_completion_004845 mixtral-8x7b 1030.222
control_completion_008533 mixtral-8x7b 1030.222
block_completion_002212 mixtral-8x7b 1030.222
block_completion_001633 mixtral-8x7b 1030.222
block_completion_005260 mixtral-8x7b 1030.222
control_completion_006813 mixtral-8x7b 1030.222
control_completion_005403 mixtral-8x7b 1030.222
block_completion_000573 mixtral-8x7b 1030.222
block_completion_006178 mixtral-8x7b 1030.222
block_completion_004301 mixtral-8x7b 1030.222
block_completion_006998 mixtral-8x7b 1030.222
block_completion_008616 mixtral-8x7b 1030.222
control_completion_002586 mixtral-8x7b 1030.222
block_completion_006386 mixtral-8x7b 1030.222
control_completion_005401 mixtral-8x7b 1030.222
block_completion_007082 mixtral-8x7b 1030.222
control_completion_002938 mixtral-8x7b 1030.222
block_completion_007485 mixtral-8x7b 1030.222
block_completion_006875 wizardcoder-3b 1018.419
control_completion_008006 wizardcoder-3b 1018.419
block_completion_006031 wizardcoder-3b 1018.419
block_completion_004250 wizardcoder-3b 1018.419
control_completion_000020 wizardcoder-3b 1018.419
control_completion_007601 wizardcoder-3b 1018.419
block_completion_004496 wizardcoder-3b 1018.419
control_completion_003241 wizardcoder-3b 1018.419
block_completion_004232 wizardcoder-3b 1018.419
control_completion_005702 wizardcoder-3b 1018.419
block_completion_000404 wizardcoder-3b 1018.419
block_completion_005433 wizardcoder-3b 1018.419
control_completion_004854 wizardcoder-3b 1018.419
block_completion_006096 wizardcoder-3b 1018.419
block_completion_006117 wizardcoder-3b 1018.419
block_completion_005087 wizardcoder-3b 1018.419
block_completion_007124 wizardcoder-3b 1018.419
block_completion_000635 wizardcoder-3b 1018.419
control_completion_005897 wizardcoder-3b 1018.419
block_completion_000344 wizardcoder-3b 1018.419
block_completion_001766 gpt-3.5-turbo-0301 938.671
block_completion_001374 gpt-3.5-turbo-0301 938.671
block_completion_004953 gpt-3.5-turbo-0301 938.671
control_completion_006174 gpt-3.5-turbo-0301 938.671
block_completion_002777 gpt-3.5-turbo-0301 938.671
block_completion_002303 gpt-3.5-turbo-0301 938.671
control_completion_001658 gpt-3.5-turbo-0301 938.671
control_completion_005420 gpt-3.5-turbo-0301 938.671
block_completion_005346 gpt-3.5-turbo-0301 938.671
block_completion_001510 gpt-3.5-turbo-0301 938.671
block_completion_004030 gpt-3.5-turbo-0301 938.671
block_completion_006897 gpt-3.5-turbo-0301 938.671
control_completion_007966 gpt-3.5-turbo-0301 938.671
block_completion_007113 gpt-3.5-turbo-0301 938.671
block_completion_000583 gpt-3.5-turbo-0301 938.671
block_completion_003530 gpt-3.5-turbo-0301 938.671
control_completion_004775 gpt-3.5-turbo-0301 938.671
block_completion_001979 gpt-3.5-turbo-0301 938.671
block_completion_007987 gpt-3.5-turbo-0301 938.671
block_completion_000442 gpt-3.5-turbo-0301 938.671
control_completion_007387 gpt-3.5-turbo-0301 938.671
control_completion_003500 gpt-3.5-turbo-0301 938.671
block_completion_007325 gpt-3.5-turbo-0301 938.671
block_completion_006212 gpt-3.5-turbo-0301 938.671
block_completion_007956 gpt-3.5-turbo-0301 938.671
block_completion_001506 gpt-3.5-turbo-0301 938.671
block_completion_001468 gpt-3.5-turbo-0301 938.671
block_completion_002049 gpt-3.5-turbo-0301 938.671
control_completion_007247 gpt-3.5-turbo-0301 938.671
control_completion_006361 gpt-3.5-turbo-0301 938.671
block_completion_008236 gpt-3.5-turbo-0301 938.671
block_completion_007566 gpt-3.5-turbo-0301 938.671
block_completion_000575 gpt-3.5-turbo-0301 938.671
control_completion_000388 gpt-3.5-turbo-0301 938.671
control_completion_003818 gpt-3.5-turbo-0301 938.671
block_completion_004075 gpt-3.5-turbo-0301 938.671
block_completion_006768 gpt-3.5-turbo-0301 938.671
block_completion_000835 gpt-3.5-turbo-0301 938.671
block_completion_007487 gpt-3.5-turbo-0301 938.671
block_completion_002161 gpt-3.5-turbo-0301 938.671
control_completion_001392 gpt-3.5-turbo-0301 938.671
block_completion_002143 gpt-3.5-turbo-0301 938.671
control_completion_005136 gpt-3.5-turbo-0301 938.671
block_completion_007114 gpt-3.5-turbo-0301 938.671
control_completion_002764 gpt-3.5-turbo-0301 938.671
block_completion_001723 gpt-3.5-turbo-0301 938.671
control_completion_002141 gpt-3.5-turbo-0301 938.671
block_completion_007788 gpt-3.5-turbo-0301 938.671
block_completion_005792 gpt-3.5-turbo-0301 938.671
control_completion_006938 gpt-3.5-turbo-0301 938.671
control_completion_001112 gpt-3.5-turbo-0301 938.671
control_completion_001936 gpt-3.5-turbo-0301 938.671
block_completion_004071 gpt-3.5-turbo-0301 938.671
block_completion_000767 gpt-3.5-turbo-0301 938.671
block_completion_000577 gpt-3.5-turbo-0301 938.671
block_completion_007781 gpt-3.5-turbo-0301 938.671
control_completion_003928 gpt-3.5-turbo-0301 938.671
block_completion_006733 gpt-3.5-turbo-0301 938.671
block_completion_001408 gpt-3.5-turbo-0301 938.671
block_completion_003740 gpt-3.5-turbo-0301 938.671
control_completion_002552 gpt-3.5-turbo-0301 938.671
block_completion_006202 gpt-3.5-turbo-0301 938.671
block_completion_006131 gpt-3.5-turbo-0301 938.671
control_completion_007235 gpt-3.5-turbo-0301 938.671
block_completion_006776 gpt-3.5-turbo-0301 938.671
block_completion_001279 gpt-3.5-turbo-0301 938.671
block_completion_004125 gpt-3.5-turbo-0301 938.671
block_completion_007142 gpt-3.5-turbo-0301 938.671
control_completion_002499 gpt-3.5-turbo-0301 938.671
block_completion_008373 gpt-3.5-turbo-0301 938.671
control_completion_002699 gpt-3.5-turbo-0301 938.671
control_completion_003551 gpt-3.5-turbo-0301 938.671
control_completion_002555 gpt-3.5-turbo-0301 938.671
control_completion_003073 gpt-3.5-turbo-0301 938.671
control_completion_001623 gpt-3.5-turbo-0301 938.671
block_completion_002680 gpt-3.5-turbo-0301 938.671
block_completion_005870 gpt-3.5-turbo-0301 938.671
block_completion_004199 gpt-3.5-turbo-0301 938.671
control_completion_001204 gpt-3.5-turbo-0301 938.671
block_completion_008472 gpt-3.5-turbo-0301 938.671
block_completion_002892 gpt-3.5-turbo-0301 938.671
control_completion_001188 gpt-3.5-turbo-0301 938.671
block_completion_000814 gpt-3.5-turbo-0301 938.671
control_completion_000385 gpt-3.5-turbo-0301 938.671
control_completion_008171 gpt-3.5-turbo-0301 938.671
block_completion_007989 gpt-3.5-turbo-0301 938.671
control_completion_001949 gpt-3.5-turbo-0301 938.671
control_completion_001652 gpt-3.5-turbo-0301 938.671
control_completion_005081 gpt-3.5-turbo-0301 938.671
control_completion_002131 gpt-3.5-turbo-0301 938.671
control_completion_006169 gpt-3.5-turbo-0301 938.671
control_completion_001527 gpt-3.5-turbo-0301 938.671
control_completion_003464 gpt-3.5-turbo-0301 938.671
control_completion_005997 gpt-3.5-turbo-0301 938.671
control_completion_003992 gpt-3.5-turbo-0301 938.671
control_completion_002867 gpt-3.5-turbo-0301 938.671
block_completion_008342 gpt-3.5-turbo-0301 938.671
control_completion_001904 gpt-3.5-turbo-0301 938.671
block_completion_002830 gpt-3.5-turbo-0301 938.671
block_completion_001109 gpt-3.5-turbo-0301 938.671
block_completion_007835 gpt-3.5-turbo-0301 938.671
control_completion_007008 wizardcoder-1b 933.581
block_completion_002082 wizardcoder-1b 933.581
control_completion_004846 wizardcoder-1b 933.581
control_completion_001126 wizardcoder-1b 933.581
control_completion_003044 wizardcoder-1b 933.581
block_completion_000916 wizardcoder-1b 933.581
control_completion_003832 wizardcoder-1b 933.581
control_completion_007359 wizardcoder-1b 933.581
control_completion_003430 wizardcoder-1b 933.581
control_completion_003511 wizardcoder-1b 933.581
control_completion_006768 wizardcoder-1b 933.581
control_completion_002695 wizardcoder-1b 933.581
control_completion_002415 wizardcoder-1b 933.581
control_completion_001628 wizardcoder-1b 933.581
control_completion_006350 wizardcoder-1b 933.581
control_completion_006100 wizardcoder-1b 933.581
block_completion_007310 wizardcoder-1b 933.581
block_completion_006396 codegen-16b 872.495
block_completion_002034 codegen-16b 872.495
block_completion_000658 codegen-16b 872.495
control_completion_002348 codegen-16b 872.495
control_completion_007357 codegen-16b 872.495
control_completion_000028 codegen-16b 872.495
block_completion_000549 codegen-16b 872.495
block_completion_008001 codegen-16b 872.495
control_completion_003756 codegen-6b 846.719
block_completion_007620 codegen-6b 846.719
control_completion_003843 codegen-6b 846.719
control_completion_008385 codegen-6b 846.719
control_completion_007731 codegen-6b 846.719
block_completion_003050 codegen-6b 846.719
control_completion_004857 codegen-6b 846.719
block_completion_007935 codegen-6b 846.719
control_completion_004937 codegen-6b 846.719
block_completion_000377 codegen-6b 846.719
block_completion_004727 codegen-6b 846.719
control_completion_003816 codegen-6b 846.719
block_completion_000479 phi-2 843.379
control_completion_005252 phi-2 843.379
block_completion_007263 phi-2 843.379
control_completion_005243 phi-2 843.379
block_completion_003819 phi-2 843.379
control_completion_008165 phi-2 843.379
control_completion_002969 phi-2 843.379
control_completion_003912 incoder-6b 838.027
block_completion_006006 incoder-6b 838.027
block_completion_006034 incoder-6b 838.027
control_completion_008083 incoder-6b 838.027
block_completion_005981 incoder-6b 838.027
block_completion_005982 incoder-6b 838.027
block_completion_007233 incoder-6b 838.027
block_completion_002628 incoder-6b 838.027
control_completion_001329 incoder-6b 838.027
control_completion_001165 incoder-6b 838.027
control_completion_006412 incoder-6b 838.027
control_completion_002831 incoder-6b 838.027
control_completion_003708 incoder-6b 838.027
control_completion_002638 incoder-6b 838.027
control_completion_008080 incoder-6b 838.027
block_completion_000269 incoder-6b 838.027
control_completion_001335 incoder-6b 838.027
block_completion_005440 incoder-6b 838.027
control_completion_003714 incoder-6b 838.027
block_completion_000381 codegen-2b 835.137
block_completion_004720 codegen-2b 835.137
control_completion_001502 codegen-2b 835.137
block_completion_005522 codegen-2b 835.137
control_completion_007812 codegen-2b 835.137
block_completion_004251 codegen-2b 835.137
block_completion_006471 codegen-2b 835.137
control_completion_001333 codegen-2b 835.137
block_completion_002566 incoder-1b 775.217
block_completion_004056 incoder-1b 775.217
block_completion_005357 incoder-1b 775.217
control_completion_007441 incoder-1b 775.217
control_completion_005036 incoder-1b 775.217
block_completion_007204 incoder-1b 775.217
block_completion_002835 incoder-1b 775.217
control_completion_003899 incoder-1b 775.217
control_completion_000600 incoder-1b 775.217
control_completion_004703 incoder-1b 775.217
control_completion_001709 phi-1.5 773.992
block_completion_000778 phi-1.5 773.992
control_completion_008618 phi-1.5 773.992
control_completion_003098 phi-1.5 773.992
control_completion_003817 phi-1.5 773.992
control_completion_004764 phi-1.5 773.992
block_completion_007728 phi-1.5 773.992
control_completion_008580 phi-1.5 773.992
block_completion_001771 phi-1.5 773.992
control_completion_000208 phi-1.5 773.992
control_completion_006305 codegen-350m 726.127
control_completion_008394 codegen-350m 726.127
control_completion_006147 codegen-350m 726.127
control_completion_000233 codegen-350m 726.127
block_completion_001196 codegen-350m 726.127
control_completion_004438 codegen-350m 726.127
control_completion_002224 codegen-350m 726.127
block_completion_006841 codegen-350m 726.127
control_completion_005355 codegen-350m 726.127
block_completion_007270 codegen-350m 726.127
control_completion_005909 codegen-350m 726.127
block_completion_004854 codegen-350m 726.127
control_completion_008586 codegen-350m 726.127

Suspect problems

These are 10 problems with the lowest correlation with the overall evaluation (i.e. better models tend to do worse on these. )

example_link acc tau
control_completion_007721 0.455 -0.697
block_completion_001013 0.273 -0.618
control_completion_002848 0.364 -0.609
control_completion_000220 0.636 -0.609
block_completion_001652 0.409 -0.554
control_completion_004086 0.409 -0.554
control_completion_002776 0.636 -0.547
control_completion_006636 0.636 -0.547
control_completion_002426 0.409 -0.541
control_completion_003014 0.818 -0.527

Histogram of accuracies

Histogram of problems by the accuracy on each problem.

Histogram of difficulties

Histogram of problems by the minimum Elo to solve each problem.