on ai memory

22 aug 2025

so i was having a convo with friend about writing and then i suddenly remembered an advice i gave to him about writing three year ago on the same application. it’s interesting how human memory works. i dont remember the whole conversation details since we started chatting on that particular app. but whenever a topic not keyword is introduced in the chat, the past memory about it flashes to me. i still dont have the whole info or context about teh memory but i know/remember enough keywords about the topic so i can search about it and go back to our past convo.

one heuristic i like to think about is the sleeping memory and active memory. AM always needs to be on for survival/living. SM doesnt need to be on always. one reason why human brain is so efficient and requires so less power for any decision making. it doesnt need to think through all its memory while making a decision compared to current LLMs which do a forward pass through all layers/weights.

so a better way to making current ai system efficient is make it more like the human brain. novelty imo wont come through brute forcing knowledge.