gemma-3-27b-it vs gpt-6.1-sol
Pricing and scores side by side. Blank cells mean the price is undisclosed or the model did not take that test.
InputUSD / 1M tokens$0.08$2.00
OutputUSD / 1M tokens$0.35$10.00
Monthly costat 10M tokens/month$1.47₩1,953$40.00₩52,956
Context131K1.05M
Report card
Overall4.9#172/17551.8#7/175
ScienceGPQA42.8#145/159not taken
MathAA Math Index20.7#68/94not taken
CodingAA Coding Index10.1#78/82not taken
ReadingAA-LCR7.3#144/15583.0#12/155
KnowledgeMMLU-Pro66.9#80/92not taken
Instruction followingIFBench31.8#114/129not taken
Hard reasoningHLE4.4#138/17152.9#8/171
Measured and published by Artificial Analysis. Each subject is a different test, so compare within a subject rather than across them.
Try another pair
Swap one side and keep comparing.