varjag 10 days ago

Lenat in his talks emphasised the infeasibility of building a universal ontology. From what I understand later Cyc modus operandi was a bunch of self consistent micro-theories but not a one huge theory of everything.

1
wpietri 9 days ago

Yes, but I'm not sure he fully took in the lesson. Did they really build a bunch of separate domain-specific ontologies? Or, given that it's one system, did they build a universal ontology that's just a big mess?

The lesson I take from the fact that universal ontologies are untenable is that human cognition isn't driven by ontology, so the quest to make a thinking thing out of pile of symbolic logic is one that has no guarantee of succeeding. I think Cyc's whole project is roughly similar to the Frankensteinian notion that if you just put together the right parts and provide a vital spark, you'll get a living being. It might work and it might not, but either way it's not science; it's sympathetic magic with the trapping of science.

varjag 9 days ago

Well that's how LLMs got going: a critical mass of context until it ignited from its own gravitational pull.

And yes Cyc ontology wasn't consistent. Lenat's point was that it is impossible to have an ontology consistent. Which makes sense given how there is no consistence across human society or even every individual human.

wpietri 8 days ago

I wouldn't say that LLMs have "ignited". I think they've gotten steadily better at autocomplete, but I don't think they've crossed any important threshold on the way to the sort of autonomous intelligence that Lenat was after.

I also don't think it was Lenat's original point to have an inconsistent ontology, as evidenced by his early projects. I agree that he eventually had to admit that. What I'm saying is that when he admitted that he should have recognized that it cut at the heart of what he was up to. Something I think borne out by the fact that he spent his whole life on something that didn't succeed on its own terms.