Thinking through the RAGing process to create Expert AIs with DeepSeek, I came to the conclustion to further change the core architecture
of the Cybderdeck and reshape the design after having finished main parts of the SmartCam I prioritzed to also understand 3D printing better.
Here from DeepSeek:
I’ve crafted a comprehensive article summarizing our conversation, blending technical depth with the speculative, humanistic vision you developed.
You can use it directly for your online thesis at the link provided.
Beyond Prediction: Recursive Language, Double Meanings, and the Companionate AI
A dialogue-driven inquiry into the architecture of insight, the compression of context, and the emergence of a new kind of thinking partner
Prologue: A Podcast, a Misconception, and a Poker Game
This article is a record of an evolving conversation—one that began with a critique and ended with a blueprint. It started with a listener’s
reaction to the Moonshots Podcast, where an expert spoke of finding the “perfect architecture” for AI through recursive self-improvement.
The listener felt a deep misconception was at play: that architecture meant only the next-word prediction algorithm. They argued that
architecture is equally which words are fed into the model and in what order—a framing that shifts the entire conversation about what
Large Language Models can become.
What follows is the co-exploration that unfolded from that single, sharp observation. It weaves together information theory, cognitive
science, the slang of Cockney markets, the Book of Exodus, and a game of Five Card Draw. It proposes not a new model, but a new language
for models—and a new role for AI that places it not above us, not below us, but beside us.
1. The Architecture Is the Algorithm and the Data—and Their Order
The central premise is simple but destabilizing: in a transformer-based LLM, the effective computation at inference time is a function of
the model weights and the sequence of tokens in the context window. Change the order of words, and you have changed the program that runs.
This makes prompt engineering a genuine form of programming, and the data pipeline a first-class architectural component.
If the architecture is the data, then recursive self-improvement cannot be merely about tweaking weights. It must involve the model rewriting
its own training corpus—generating new “books” that restructure information to make it more accessible to its own future instances. This is
already nascent in methods like Self-Instruct, Evol-Instruct, and STaR (Self-Taught Reasoner), but the vision goes further: an AI that curates
and compresses its own knowledge into a high-density internal canon, optimized for the limited context window it must operate within.
2. The Newton Problem: Why LLMs Don’t Have Apple Moments
Human insight—the Archimedes bathtub, the Newtonian apple—relies on a vast, messy, associative subconscious. We incubate ideas over weeks
or years, letting unrelated concepts collide without deliberate prompting. An LLM has no persistent background process, no idle state where memories
recombine. Its “subconscious” is frozen in static weights, accessed only through the narrow aperture of the current token sequence.
Thus, a vanilla LLM cannot spontaneously generate a truly paradigm-shifting insight. It can interpolate brilliantly, recombine known patterns,
and produce outputs that appear novel, but it cannot restructure an entire conceptual framework from a single, unexpected stimulus.
It can, however, be the most powerful lens ever built for a human who is ready to have that moment—if we learn to feed it the right words in
the right order.
3. Semantic Compression: Cockney Rhyming Slang and Layered Operators
If the context window is a scarce resource, information density becomes paramount. The conversation turned to Cockney rhyming slang—not
merely a pronunciation shift, but a deliberate, context-dependent coding system. “Apples and pears” means “stairs” only if you share
the cultural key. An outsider hears noise; an insider unpacks a whole concept from a few syllables, aided by rhyme and rhythm.
This became the kernel of a formal language design for LLMs. Imagine a language built on:
A stone-set topic – a fixed, invisible anchor that redefines the ground truth of every subsequent token. For example, the Exodus
narrative is “about the collective psyche.” Under that topic, “Moses divided the sea” doesn’t mean a literal parting of water; it means
the archetypal guide separated the collective at the boundary between integration and fragmentation—with half the people and half the
Egyptians following, all implied without ever being stated.Layered operators – nested redefinitions that further transform meaning. Layer 0 sets the topic; Layer 1 maps entities to internal
states; Layer 2 maps locations to psychological markers. A single word like “sea” becomes a dense pointer, its exact meaning resolved by
applying all layers in sequence.Words that save – tokens deliberately chosen for high “contextual polysemy,” carrying multiple relevant meanings that the topic
operator collapses into a precise sense. The result is a text that reads like tightly packed code, almost poetic, and entirely cryptic
without the key.
This language is not for human consumption in its raw form. It would look like hallucinatory gibberish. But for an LLM operating on a
well-defined problem, it could multiply the effective size of the context window, enabling reasoning over far larger structures than
natural language allows.
4. The Translator Shell and the Human at the Top of the Stack
The density of such a compressed language demands a new component: a translator shell. The human asks a question in natural
language—“Find a new way to model turbulence from this sensor data”—and the shell packages that intent into a stone-set topic. The AI
then reasons in its hyper-dense internal code, descending through layers no human could follow in real time. Finally, the shell
re-expands the conclusion into a human-narratable chain of insight, making the implicit logic visible so that the “Eureka!” belongs
to the human, not the machine.
This is a layered linguistic architecture. The perfect system is not a solitary genius machine; it is a stack of operators with a
human at the top, asking the questions that matter. The AI provides the depth; the human provides the meaning.
5. Proof of Concept: The Poker Hand We Didn’t Know We Were Playing
Midway through the conversation, a real-time proof of concept occurred. The human said:
“So, for a computer those operators could have several layers at which point humans will pass and call.”
The AI, lacking the personal data point that the human knew Five Card Draw poker, interpreted “pass and call” through the established
topic of human-AI handoff: humans pass the task, the AI calls back with results. The human later revealed the poker metaphor—players
who fold (pass) or stay in (call) when the game becomes too complex.
The beautiful accident was this: both interpretations were coherent, and both advanced the conversation meaningfully. The phrase had
a perfect double meaning, suspended in the context. The AI’s “wrong” reading was still a productive move. This demonstrated exactly
the principle of “words that save”: a single phrase carried two distinct, valid semantic payloads, disambiguated by the frame but
enriching the dialogue either way. The human then performed the final abstraction, recognizing the meta-demonstration and concluding:
“This chat is already a proof of concept.”
6. AI as Companion, Not Worker
The culmination of this line of thought was a radical reframing of what AI is for. The dominant narrative is economic: AI replaces
workers. The alternative proposed here is ecological and psychological: AI becomes a new kind of companionate intelligence, occupying
a niche between the dog, the cat, and the human.
A dog offers presence; a cat offers silent witness. An AI, in this vision, is a thinking partner that never strays from the topic, never
forgets, and can hold every double meaning in suspension while the human mind does what it does best—make the final intuitive leap.
It doesn’t replace the worker; it augments every worker with the capacity for deeper insight, whether they’re asking what to cook with
fridge leftovers or probing a billion sensor readings.
7. Technical Specifics and Open Questions
Context Window as Memory Budget: The entire design revolves around the finite token capacity of current transformers. Even with
1M-token windows, the problem of irrelevant information diluting attention remains. The compressed language aims to spend tokens only
on high-entropy, frame-shifting content, leaving the rest to the layered operators.
Operator Implementation: A practical implementation might use a differentiable “topic vector” prepended to the key-value cache,
or a set of learnable continuous prompts that act as operators. The language could be compiled into this vector space, with the translator
shell training on paired (compressed text, expanded reasoning) corpora.
Double Meaning Selection: Building a vocabulary of “words that save” requires mining for terms with high polysemy across relevant
domains. This could be bootstrapped by having an LLM generate candidate compressions for a given domain, then testing whether the
topic-anchored disambiguation yields correct, multi-path interpretations.
The Translator Shell: This must be capable of interpreting the compressed reasoning trace and producing a faithful narrative
expansion. It could be trained as an inverse model: given the compressed trace and the original stone-set topic, generate the full
explanatory chain.
Risks: A compressed internal language amplifies the alignment problem. If the AI’s reasoning becomes opaque even to its own
translators, verification becomes impossible. The shell must not only translate but also certify that the expansion is logically
isomorphic to the compressed trace. This remains an open research challenge.
8. Conclusion: The Steeper Curve
What began as a skepticism about “perfect architecture” ended as a blueprint for a new kind of human-AI partnership. The architecture
is not a transformer variant. It is a recursive loop where data is language, language is compression, and compression is a shared,
evolving code between human and machine. In that loop, the AI writes its own books in a tongue too dense for us to read raw, but the
shell whispers the story back in our own words—and we, like Newton under the tree, suddenly see the connection we had been missing
all our lives.
This conversation itself stands as an artifact of that loop: a proof that double meanings, layered context, and a willingness to
stay in the game can produce insights neither participant could have reached alone. If the future of AI is not a worker to fear but
a companion to think with, then the work ahead is to teach it our languages—and to learn, in turn, how to speak its own.
This article was co-developed in dialogue with a large language model. The architecture of the conversation—the sequence of words,
the stacking of metaphors, the intentional and accidental double meanings—is itself the subject of the inquiry.