Remove AI Remove Azure Remove Benchmarks Remove ChatGPT
article thumbnail

What Happens When AI Performance Asymptotes?

Tom Tunguz

In the past, the bigger the AI model, the better the performance. This is a chart of many recent AI models’ performance according to a broadly accepted benchmark called MMLU. 1 MMLU measures the performance of an AI model compared to a high school student. OpenAI Model Release Date Parameters, B MMLU GPT2 2/14/19 1.5

AI 190