sigmoid10 9 days ago

I wouldn't even say Gemini Pro 2.5 is the best model. Certainly not when you do multimodal or function calling, which is what actually matters in industry applications. Plain chatbots are nice, but I don't think they will decide who wins the race. Google is also no longer in the mindset to really innovate. You'll hear surprisingly similar POVs from ex-Googlers and ex-OpenAI guys. I'd actually say OpenAI still has an edge in terms of culture, even through it fell deep.

4
int_19h 8 days ago

I did some experiments with Gemini Pro 2.5 vs Sonnet 3.7 for coding assistants, and, at least as far as code quality and ability to understand complexities in existing codebase goes, Gemini is noticeably stronger.

tgsovlerkhgsel 9 days ago

> Certainly not when you do multimodal or function calling

Who is? (Genuine question, it's hard to keep up given how quickly the field moves.)

stavros 8 days ago

If you want an LLM to interface with other systems, function calling is absolutely essential.

mjirv 8 days ago

Claude 3.7 Sonnet for function calling, and it’s not particularly close in my experience.

Not sure about multimodal as it’s not what I work on.

mark_l_watson 8 days ago

I have found function calling and ‘roll my own agents’ work much better now with Gemini than they did late last year, but I also do a lot of function calling experiments with small open models using Ollama - much more difficult to work with to get a robust system.

PunchTornado 8 days ago

really? all of my friends and everyone I know actually hates openai. they managed to be the bad guy in AI.