I would argue that Egypt apart from temperature was lot less harsh than Europe. Nile offers water all through the year. And the flooding brought fertilizer each year. Also lot less risk of any type of weather causing famine.
In reality that is lot less harsh than Europe before industrial agriculture. Just looking at list of famines shows that Europe was a harsh place to live for stable society.
It's also very hard to compare pharaonic Egypt to a modern society since most people were agricultural labourers. You did have not that many people (lets say 3M which was a lot by ancient standards), and of the elite who actually could use capital and talent were really, really scarce. Literacy rates were maybe 1%-15%?
Think what a modern country would look like with 3M people of which 150K can read. It would not be pretty and Egypt was probably worse. Of course if you can control thousands of people you always have some capabilities which is the reason why we adore their art to this day. But I think one should think "North Korea" what pharaonic egypt likely was like rather than "pinnacle of imaginable civilization". This is not to put down the achievements of the egyptian civilization, but like pointed out, they had lots of time.
Most people anywhere (except the pastoralists ofc) were agricultural labourers before modern farming kicked in.