LLMs and Information Entropy
A perspective on LLMs through the lens of information theory: compression, transcription, completion, hallucination, and why feedback loops matter more than stronger generation.
Notes on technology, consciousness, and the space between.
Fresh writing from the blog.
A perspective on LLMs through the lens of information theory: compression, transcription, completion, hallucination, and why feedback loops matter more than stronger generation.