TAGS

The Markov Brain: Rewiring brain using Markov probabilities

by | Mar 8, 2026

Here is a PDF link of the file to download and read. Click on the download button to download the file. Otherwise you can read HTML file which is below the PDF link


The Markov Brain — Rewiring Brain Using Markov Probabilities
Stories Through Data · Neuroscience × Mathematics × Philosophy

The Markov Brain:
Rewiring Brain Using Markov Probabilities

If only the present matters, why do we have memory? And how can a 19th-century Russian mathematician’s “memoryless” chains teach us to change our lives — one small probability at a time?

Purushottam · March 2026 · basavapurushottam.com
Disclaimer: This article was generated with the assistance of AI tools — specifically Claude AI (Anthropic) and Google Gemini NotebookLM — and subsequently reviewed and edited by the author. It is the author’s belief that the latest scientific breakthroughs in neuroscience, when understood through mathematical frameworks like Markov chains and probability theory, can offer meaningful insights for forming new habits and pursuing self-improvement. The author has a genuine personal and intellectual interest in this subject but does not claim any scientific expertise in Markov chain theory, computational neuroscience, or related disciplines. Readers interested in clinical applications or academic research should consult the original peer-reviewed sources cited at the end of this article and seek guidance from qualified professionals where appropriate.

Right now, your brain is doing something specific. Billions of tiny cells are firing in a particular pattern. A split second from now, that pattern will change. And here is the surprising part: which pattern comes next may depend only on the pattern you are in right now — not on anything that happened before.

This idea comes from a branch of mathematics called Markov chains, named after the Russian mathematician Andrey Markov, who described them in 1906. They have become one of the most useful tools in brain science.

But the idea raises an uncomfortable question: if only the present moment matters, then what is the point of memory? Why do we remember anything at all?

The answer turns out to be both surprising and deeply practical. It connects brain science to some of the biggest questions in philosophy — and it offers a concrete, usable framework for changing your life through small, everyday actions.

· · ·

What Is a Markov Chain? (As Simple as Possible)

Imagine you live in a small country with only three towns: Calm Town, Alert Town, and Restless Town. Every morning you wake up in one of these towns. Where you wake up tomorrow depends only on where you are today — not on where you were last week.

If you are in Calm Town today, there is a 70% chance you will still be in Calm Town tomorrow, a 20% chance you will be in Alert Town, and a 10% chance you will be in Restless Town. These chances can be written as a simple table:

Where you are todayCalm tomorrowAlert tomorrowRestless tomorrow
Calm70%20%10%
Alert15%65%20%
Restless25%35%40%

This table is called a transition matrix. It is the engine of the whole system.

The Transition Matrix Movement operates purely on localised odds. How you arrived is mathematically irrelevant. CALM 70% ALERT 65% RESTLESS 40% 20% 15% 10% 20% 25% 35%
Fig 1 · Three-state Markov chain — brain state transitions

Notice something about the diagonal — those are the “staying put” numbers. Calm Town is very stable (70% chance of staying). Alert Town is fairly stable (65%). Restless Town is shaky (only 40% chance of staying — you are likely to move somewhere else soon).

The one rule that makes this a Markov chain is simple: where you go next depends only on where you are now. Your entire travel history — where you were last month, last year, ten years ago — does not matter. Only today matters.

This rule is called the Markov property. In technical language, the system is “memoryless.”

· · ·

Where Do Markov Chains Show Up in the Brain?

Everywhere. From the smallest parts of a single brain cell to the behaviour of the whole brain.

The Tiniest Level: On-Off Switches in Your Neurons

Every neuron has thousands of tiny gates called ion channels. Think of them as microscopic doors. Each door can be Open or Closed. It flips between these two states randomly. The chance of flipping depends only on whether the door is currently open or closed — not on how long it has been in that position.

THE BIOLOGY OF PROBABILITY Learning is not archiving data. It is the physical recalibration of future firing probabilities. CLOSED No ion flux OPEN Ion flux → signal μ c→o μ o→c Each transition is a Poisson process · voltage-dependent · memoryless
Fig 2 · The simplest neuronal Markov model — a two-state ion channel

This is the simplest possible Markov chain: two states, two probabilities. Billions of these tiny doors, each flipping independently, produce the electrical signals that carry your every thought.

The Connection Level: How Neurons Learn

Neurons talk to each other across tiny gaps called synapses. These connections can get stronger (when you practise something) or weaker (when you stop). In extreme cases, connections get completely eliminated — the brain literally prunes wiring it does not need.

Scientists have shown that the way these connections change over time follows Markov rules. The future strength of a connection depends on its current strength and what the neurons are doing right now — not on the full history of that connection.

This is what learning looks like at the physical level. When you practise the guitar, you are strengthening certain synaptic connections. When you stop practising, those connections weaken. The brain is constantly rewriting its own wiring — and that rewriting follows the Markov property.

The Whole-Brain Level: Your Brain Has “Modes”

This is the most exciting part. Using brain scanners (fMRI and MEG), scientists have discovered that your entire brain switches between a small number of distinct “modes” or states. Each mode is a specific pattern of which brain regions are talking to each other. These modes switch every few seconds, and the switching follows Markov rules.

The mathematical tool used here is called a Hidden Markov Model (HMM). “Hidden” because you cannot see the brain’s mode directly — you can only figure it out from the signals the scanner picks up.

Here is what researchers have found:

MACROSCOPIC FLOW VS. ABSORBING STATES Distinct conditions are expressions of different underlying probability architectures. Healthy Balanced movement, multiple pathways Trauma / PTSD STUCK p ≈ 1.0 The Absorbing State (Exit probability near-zero) Gifted / Peak Focus FOCUS p=0.85 Elevated “staying put” probability HMM analysis classifies PTSD vs. healthy with ~85% accuracy from resting-state fMRI alone
Fig 3 · Three distinct probability architectures — healthy, trauma, and gifted

Healthy brains switch smoothly between several modes. Think of a person who moves comfortably between being focused, being relaxed, daydreaming, and being alert — flowing naturally from one to the next.

Brains affected by PTSD get stuck. Scientists found that the PTSD brain develops what is called an absorbing state — a mode it cannot easily leave. The brain locks into one pattern and cannot switch out of it. This matches exactly what PTSD feels like from the inside: being trapped in a loop of anxiety and hypervigilance, unable to relax or shift your attention.

Brains of exceptionally gifted students show yet another pattern. During complex problem-solving, gifted teenagers can hold a productive brain mode for longer than average. Their “staying put” probability for the focused mode is higher. They also switch into the focused mode more easily from other modes.

These are not metaphors. These are actual numbers computed from real brain scans.

The Prediction Level: Your Brain Guesses What Comes Next

Your brain is always trying to predict what will happen next. When you hear a familiar song, your brain predicts the next note before it plays. When the prediction is wrong — say, a strange note plays instead — your brain produces a little jolt of surprise, detectable on an EEG machine.

THE PREDICTION ENGINE The mind calculates the most probable immediate future. 80% Expected Probability A B Prediction Error Unexpected Pattern Mismatch Negativity (MMN) · detectable via EEG · ~100-250ms after deviant stimulus
Fig 4 · The brain’s prediction engine as an internal Markov model

A 2023 study showed that the brain’s prediction system works like a Markov transition matrix. The brain has learned: “After note A, note B usually follows with 80% probability.” When note C plays instead, the brain registers a prediction error. The brain, it turns out, has built its own internal Markov chain as a model of the world.

· · ·

If Only the Present Matters, Why Do We Have Memory?

This is the question at the heart of the whole essay. If the Markov property says the future depends only on the present, does that mean our memories are useless?

No. It means the opposite. Here is why.

Your Memory Has Already Become Your Present

Think about two people sitting side by side on a park bench. Same bench, same weather, same moment. But one person spent twenty years as a soldier, and the other spent twenty years as a monk. Are they in the same “state”? Obviously not. Their brains have been physically shaped by completely different experiences. Their synaptic connections, their neural pathways, their transition probabilities — all different.

The Key Insight

The past is not stored in a separate drawer. It has been physically built into the current structure of the brain. Every experience you have ever had — every book you read, every heartbreak you endured, every skill you practised — has changed the wiring of your brain. Your past is not a recording that plays back. It is the architecture that determines how your present moment works.

The Markov chain is “memoryless” not because memory does not matter, but because memory has already done its work.

The River Analogy

A river’s flow at any point depends on the shape of the riverbed right here, right now. The river does not “remember” the rainstorms of ten years ago. But the riverbed is the result of those rainstorms. Every flood, every drought, every season of erosion carved the contours that now guide the water.

Your brain is the riverbed. Your experiences are the floods and droughts. The Markov property is the flow of water. The river does not need to remember because the memory is the riverbed itself.

What Memory Actually Does

It rewrites the probability table. Learning something new changes the chances of your future state transitions. A child who touches a hot stove rewires the probability of “reach toward stove” from high to very low.

It creates entirely new states. A person who learns to read has access to brain states that an illiterate person simply does not have. Experience does not just shuffle the probabilities — it expands the menu of possibilities.

It makes good states last longer. Practice increases the “staying put” probability of useful states. A trained meditator can sustain a calm, focused state much longer than a beginner.

It can break you out of traps. Therapy for PTSD works, in Markov terms, by reducing the “staying put” probability of the stuck state. The goal is not to erase the trauma but to make the brain flexible again.

The Paradox Solved

The seeming contradiction — “memoryless chains in a creature built for memory” — disappears when you understand what “present state” really means. Your present brain state is not a blank slate. It is the living summary of your entire life. The past matters so much that it has literally become the present.

· · ·

Existentialism and the Markov Brain: You Are Not Your Past

The Markov idea — “only the present determines the future” — is not just a mathematical trick. It is the central message of existential philosophy, the tradition that includes Sartre, Camus, Heidegger, and Kierkegaard.

Sartre: You Are Free Right Now

Jean-Paul Sartre’s most famous idea is that existence precedes essence. In plain language: you are not defined by your history, your genes, your upbringing, or your resume. You are defined by what you do right now and what you choose next.

Look at the Markov chain. At every state, the system faces a spread of possible next states. It is not locked into one path. The transition matrix gives tendencies, not certainties. There is always some probability, even if small, of an unexpected jump — a sudden shift from Restless to Calm, from stuck to free.

Sartre called this radical freedom. The mathematics agrees: at every time step, multiple futures are possible.

Sartre’s “Bad Faith”: Pretending You Cannot Change

Sartre had a name for the habit of denying your own freedom: bad faith. Bad faith is telling yourself, “I am an angry person — that is just who I am.” Or: “I have always been disorganised — I cannot change.”

In Markov language, bad faith is the mistake of treating your current transition matrix as permanent. It is confusing a tendency with an identity. Neuroplasticity — the brain’s ability to rewire itself — means the matrix is always being rewritten by experience.

You are not your transition matrix. You are the process that can rewrite it.

Heidegger: Where You Start Is Not Where You End Up

Heidegger talked about thrownness — the fact that you find yourself in a situation you did not choose. You did not pick your family, your country, your body.

In a Markov chain, this is the starting state — X₀. You did not choose it. But here is the mathematical fact: as the chain runs, the starting state matters less and less. Over time, the system settles into its stationary distribution — the long-run pattern determined by the transition matrix, not by the starting point.

Translation: where you begin matters less than how you transition. The structure of your choices, over time, overwrites the accident of your origin.

Kierkegaard: The Leap That Changes Everything

Kierkegaard wrote about the leap of faith — a moment when someone jumps from one way of living to a fundamentally different one. Not through gradual steps, but through a single decisive act.

In Markov terms, this is a low-probability transition. Maybe there is only a 2% chance of jumping from “going through the motions” to “fully committed.” But 2% is not zero. The leap is always on the table.

And here is the crucial insight: once you make the leap, you face a different transition matrix entirely. New states become possible. Old traps lose their grip. The leap does not just move you to a new place — it changes the entire landscape of what comes next.

Camus: Finding Meaning in the Loop

Camus imagined Sisyphus, condemned to push a boulder up a hill forever, watching it roll back down every time. This looks like the ultimate absorbing state — an endless, inescapable loop.

But Camus said: “One must imagine Sisyphus happy.”

How? By changing the inner experience of the state without changing the state itself. The boulder still rolls down. But the person pushing it has found meaning in the act. The Markov chain sees the same loop. The human inside it has transformed.

This reveals something the mathematics alone cannot: the felt quality of a state is not captured by the transition matrix. Two people can occupy the same mathematical state and experience it completely differently. The numbers describe the dynamics. The philosophy describes what it is like to live them.

· · ·

How Small Changes Reshape Your Future: A Practical Guide

Here is where the mathematics becomes genuinely useful for everyday life. The core insight is this: you do not need to make dramatic changes to dramatically change your life. Small shifts in probability, repeated consistently, change everything.

How Small Probabilities Compound

Imagine your daily life has three main states: Energised, Neutral, and Drained. Your current transition matrix looks like this:

TodayEnergised tomorrowNeutral tomorrowDrained tomorrow
Energised50%30%20%
Neutral20%50%30%
Drained10%30%60%

Run this chain over a long time and you end up spending roughly 22% of days Energised, 36% Neutral, and 42% Drained. That is a life where you feel drained almost half the time.

Now suppose you make one small change — you start going to bed 30 minutes earlier. This just shifts a few probabilities by five percentage points:

TodayEnergised tomorrowNeutral tomorrowDrained tomorrow
Energised55%30%15%
Neutral25%50%25%
Drained15%35%50%
THE MATH OF COMPOUNDING HABITS Altering a single variable by 5% yields massive dividends over an extended timeline. BEFORE 22% 36% 42% +5% shift AFTER (sleep 30min earlier) 29% 38% 33% Result: One extra good day every two weeks Drained: 42% → 33% · Stack 2-3 small changes and the compound effect is striking
Fig 5 · A single habit change shifts the stationary distribution meaningfully

You have gone from being drained 42% of the time to 33% of the time — gaining roughly one extra good day every two weeks — from a single habit change. Stack two or three small changes and the compound effect is striking.

This is the central practical lesson: you do not change your life by willpower on any single day. You change it by nudging probabilities, which changes where you spend your time over months and years.

Seven Principles for Rewriting Your Transition Matrix

1

Start From Where You Actually Are

The Markov rule says the future depends on the present state — not on the state you wish you were in. If you are exhausted, the menu of next steps is different from when you are well-rested. Trying to force a transition that does not exist from your current state is like trying to catch a bus that does not stop at your station.

What to do: Before trying to change anything, honestly name your current state. The best next step from “completely overwhelmed” is not “total productivity.” It might be “drink a glass of water and do one small thing.”
2

Protect Your Good States

Research on gifted brains shows that high performers are not people who are always in a peak state. They are people who can stay in a peak state longer once they enter it. Their “staying put” probability is higher.

What to do: When in deep focus — turn off notifications, close email. When in calm contentment — reduce exposure to anxiety triggers. When in creative flow — keep your tools ready. You are engineering the diagonal of your transition matrix.
3

Build Stepping Stones, Not Giant Leaps

Most failed resolutions fail because people attempt transitions with near-zero probability. “Couch potato to 5km runner” barely exists in most people’s matrix.

What to do: Week 1: Put on running shoes (95% probability). Week 2: Walk to end of street. Week 3: Slightly longer walk. Week 5: Occasional light jog. Each step has high probability. The chain of steps achieves what a single leap cannot.
4

Catch Absorbing States Early

Doom-scrolling, 3 AM worry loops, anger spirals, “I’ll start Monday” procrastination — these are everyday absorbing states. The longer you are in them, the harder it is to leave.

Circuit breakers: For doom-scrolling — set a timer, then physically stand up. For 3 AM worry — write it in one sentence in a notebook. For arguments — pre-agree on a code word meaning “10-minute break.” For procrastination — the two-minute rule.
5

Change the Matrix, Not Just Today

Your good intentions do not matter if your underlying habits, environment, and routines stay the same. The stationary distribution changes only when the transition matrix changes.

Instead of…Try…Why it works
“I won’t check my phone in bed” (willpower)Charge phone in another roomRemoves the trigger entirely
“I will eat healthier” (intention)Don’t keep junk food in houseProbability of junk → near-zero
“I will exercise more” (resolution)Fixed class time with a friendSocial + schedule = high probability
“I will be less anxious” (wish)Daily 5-min breathing practiceIncreases calm state persistence
“I will stop procrastinating” (guilt)Break task into 2-min first stepCreates high-probability transition
6

Trust the Compound Effect

Going to bed earlier → waking rested → morning exercise → energised state → better food choices → lower evening stress → going to bed on time again. Each link is a small probability shift. The chain feeds back on itself.

What to do: Pick one — just one — small change. Do it consistently for four weeks. Good candidates: sleep time, first thing you look at in the morning, one meal per day, five minutes of stillness, a ten-minute walk.
7

You Are Not Your Current State

Sartre called it overcoming “bad faith.” The Markov framework makes this clear: your current state is temporary. It has a probability of persisting and a probability of changing. You are not “a depressed person” — you are a person in a low state, with a rewritable matrix.

What to do: “This is a state I am visiting, not a place I live. My job is not to escape this instant. My job is to make small changes so that, over time, I visit this state less often.” This is not toxic positivity. It is a mathematically grounded reframe.
· · ·

Where the Traditions Meet

The Markov brain sits at a place where mathematics, brain science, philosophy, and ancient wisdom all point the same way.

The Bhagavad Gita teaches Nishkama Karma — act fully in the present, without clinging to past results or grasping at future outcomes. The Markov property says the same: the best action depends only on your current state.

Sartre insists that you are free at every moment, defined not by your past but by what you choose now. The transition matrix agrees: the past has been absorbed; only the current spread of possibilities matters.

Nietzsche’s amor fati — loving your fate, embracing the present moment including everything that led to it — mirrors the Markov chain’s relationship with its own history: not resisted, not replayed, but fully absorbed into the structure of now.

The Yoga Sutras describe pratyahara — turning inward, away from the noise of accumulated impressions — as the gateway to deep concentration. In Markov terms, this is the practice of raising the “staying put” probability of a focused state by reducing the distractions that trigger transitions away from it.

And Friston’s Free Energy Principle — perhaps the boldest theory in modern brain science — says the brain is a system that constantly updates its internal Markov models to better predict the world. Learning, in this view, is the lifelong rewriting of transition matrices through lived experience.

THE CONVERGENCE We are the living, active architects of our future probabilities. The Architecture of Now Ancient Traditions Existential Philosophy Markov Mathematics Modern Neuroscience
Fig 6 · Four traditions converge on the architecture of the present moment
You are not your history. You are not your current state. You are the living process that rewrites the matrix — one small probability at a time.
◆ ◆ ◆

Summary

LevelWhat Is ModelledKey Insight
Ion channelsOpen/Closed switchingThe smallest unit of brain computation is a two-state Markov chain
SynapsesConnection strength changesLearning is the rewriting of transition probabilities
Brain networksHub identificationRandom walks on brain wiring reveal communication centres (same maths as Google PageRank)
Whole-brain statesMode switching (HMM)Healthy brains switch modes fluidly; disordered brains get trapped
PredictionSensory expectationsThe brain’s model of the world is a probability table
Self-improvementHabit and state changeSmall shifts in probability, sustained over time, reshape the long-run pattern of your life

Further Reading

Schröger et al., “Markov chains as a proxy for the predictive memory representations underlying mismatch negativity,” Frontiers in Human Neuroscience, 2023 · Ezaki et al., “Modelling state-transition dynamics in resting-state brain signals,” European Journal of Neuroscience, 2021 · Niu et al., “EEG source-space synchrostate transitions and Markov modeling in the math-gifted brain,” Human Brain Mapping, 2020 · Chen et al., “Characterizing and differentiating brain state dynamics via hidden Markov models,” Brain Informatics, 2015 · Menon et al., “Uncovering hidden brain state dynamics that regulate performance,” Nature Communications, 2018 · Arizumi et al., “A Markov chain model of the evolution of complex neuronal network structures in the presence of plasticity,” BMC Neuroscience, 2010 · Sartre, Being and Nothingness, 1943 · Friston, “The free-energy principle: a unified brain theory?” Nature Reviews Neuroscience, 2010

Stories Through Data explores the intersection of mathematics, data, philosophy, and the natural world.
Read more at basavapurushottam.com

Reader Response: Use the form below to share observations, corrections, or relevant insights related to this article.

Share This