For Gemini: play around with the temperature: the default is terrible: we had much better results with (much) lower values.
From my experience a temperature close to 0 creates the best code (meaning functioning without modifications). When vibe coding I now use a very high temperature for brainstorming and writing specifications, and then have the code written at a very low one.
What improved, specifically?