claude-3-opus-20240229
opencodeinterpreter-ds-33b
speechless-codellama-34b
deepseek-coder-6.7b-instruct
HuggingFaceH4--starchat2-15b-v0.1
opencodeinterpreter-ds-6.7b
xwincoder-34b
claude-3-haiku-20240307
code-llama-70b-instruct
codebooga-34b
speechless-starcoder2-15b
deepseek-coder-1.3b-instruct
microsoft--Phi-3-mini-4k-instruct
code-13b
speechless-coding-7b-16k-tora
wizardcoder-15b
code-33b
phi-2
code-llama-multi-34b
mistral-7b-codealpaca
codegemma-7b
solar-10.7b-instruct
gemma-1.1-7b-it
octocoder
python-code-13b
HumanEval/129
HumanEval/163
HumanEval/124
HumanEval/93
HumanEval/83
HumanEval/64
HumanEval/125
HumanEval/131
HumanEval/84
HumanEval/138
HumanEval/133
HumanEval/10
HumanEval/141
HumanEval/97
HumanEval/113
HumanEval/102
HumanEval/123
HumanEval/103
HumanEval/151
HumanEval/44
HumanEval/95
HumanEval/63
HumanEval/158
HumanEval/36
HumanEval/156
HumanEval/8
HumanEval/14
HumanEval/112
HumanEval/20
HumanEval/24
HumanEval/11
HumanEval/107
HumanEval/18
HumanEval/92
HumanEval/52
HumanEval/31
HumanEval/12
HumanEval/30
HumanEval/16
HumanEval/4
HumanEval/7
0
0.2
0.4
0.6
0.8
1
pass1_ex
model
example_id
plotly-logomark