>I generate a small amount of code, check for validity (much easier to verify in a functional language), and repeat this loop.

This has been true before LLMs as well. Build small, testable functions and compose them together. That's basically it.