The weird stuff going on in LLM-land

Wed, 17 Sep 2025 00:00:00 +0000

Scaling transformers (the leading model architecture in AI) to infinity and training them on basically the entirety of human written knowledge has led to the AI revolution with the LLMs we know and have mixed feelings about today. While what intelligence is and how it applies to LLMs is a topic far too vast for a single blog post, if we take LLMs at face value, they sure strike us with brilliance from time to time. What is really going on in these models? Is it just very high-dimensional pattern matching? Is the brilliance just a reflection of our own? Do we fundamentally function the same?

LLM on Ivo Gasparini

The weird stuff going on in LLM-land