Karpathy highlighted a key limitation of LLMs: they lack the sleep-based memory consolidation that the human brain relies on. Every time a model starts a new chat, it begins from scratch with no memory of prior interactions. Humans, by contrast, lock in the day's learning during sleep, solidifying memories overnight. AI simply forgets everything the moment the tab is closed.