gemma-3-4b-it vs kimi-k3.1-pro
Pricing and scores side by side. Blank cells mean the price is undisclosed or the model did not take that test.
InputUSD / 1M tokens$0.04$2.00
OutputUSD / 1M tokens$0.05$10.00
Monthly costat 10M tokens/month$0.42₩563$40.00₩52,956
Context131K1.049M
Report card
Overall4.8#173/17555.1#3/175
ScienceGPQA29.1#156/159not taken
MathAA Math Index12.7#80/94not taken
CodingAA Coding Index2.7#82/82not taken
ReadingAA-LCR6.7#145/15586.3#2/155
KnowledgeMMLU-Pro41.7#90/92not taken
Instruction followingIFBench28.3#124/129not taken
Hard reasoningHLE5.3#127/17152.5#9/171
Measured and published by Artificial Analysis. Each subject is a different test, so compare within a subject rather than across them.
Try another pair
Swap one side and keep comparing.