gemma-3-12b-it vs gpt-6-astra
Pricing and scores side by side. Blank cells mean the price is undisclosed or the model did not take that test.
InputUSD / 1M tokens$0.05$10.00
OutputUSD / 1M tokens$0.15$50.00
Monthly costat 10M tokens/month$0.75₩993$200.00₩264,781
Context131K1.05M
Report card
Overall3.8#175/17552.7#5/175
ScienceGPQA34.9#154/15996.1#1/159
MathAA Math Index18.3#71/94not taken
CodingAA Coding Index5.8#80/8276.9#4/82
ReadingAA-LCR8.3#143/15580.7#27/155
KnowledgeMMLU-Pro59.5#86/92not taken
Instruction followingIFBench36.7#99/129not taken
Hard reasoningHLE4.2#141/17154.7#7/171
Measured and published by Artificial Analysis. Each subject is a different test, so compare within a subject rather than across them.
Try another pair
Swap one side and keep comparing.