porphyra 5 days ago

pretty wild versioning that GPT 4.1 is newer and better in many regards than GPT 4.5.

2
asdev 5 days ago

it's worse on nearly every benchmark

porphyra 4 days ago

OpenAI themselves said

> One last note: we’ll also begin deprecating GPT-4.5 Preview in the API today as GPT-4.1 offers improved or similar performance on many key capabilities at lower latency and cost. GPT-4.5 in the API will be turned off in three months, on July 14, to allow time to transition (and GPT 4.5 will continue to be available in ChatGPT).

https://x.com/OpenAIDevs/status/1911860805810716929

brokensegue 5 days ago

no? it's better on AIME '24, Multilingual MMLU, SWE-bench, Aider’s polyglot, MMMU, ComplexFuncBench

and it ties on a lot of benchmarks

asdev 5 days ago

look at all the graphs in the article

brokensegue 5 days ago

the data i posted all came from the graphs/charts in the article

mhh__ 5 days ago

I think they're doing it deliberately at this point

hmottestad 5 days ago

Tomorrow they are releasing the open source GPT-1.4 model :P

mhh__ 3 days ago

I'm apparently dyslexic enough that I only just noticed the joke 2 days later