claude-sonnet-5.5 vs gemma-3-12b-it
Pricing and scores side by side. Blank cells mean the price is undisclosed or the model did not take that test.
InputUSD / 1M tokens$2.00$0.05
OutputUSD / 1M tokens$10.00$0.15
Monthly costat 10M tokens/month$40.00₩52,956$0.75₩993
Context1M131K
Report card
Overall56.0#2/1753.8#175/175
ScienceGPQAnot taken34.9#154/159
MathAA Math Indexnot taken18.3#71/94
CodingAA Coding Indexnot taken5.8#80/82
ReadingAA-LCR82.7#14/1558.3#143/155
KnowledgeMMLU-Pronot taken59.5#86/92
Instruction followingIFBenchnot taken36.7#99/129
Hard reasoningHLE55.0#5/1714.2#141/171
Measured and published by Artificial Analysis. Each subject is a different test, so compare within a subject rather than across them.
Try another pair
Swap one side and keep comparing.