← back

the bitter lesson of self-improvement

october 2026

tl;drhow I actually improved my life. I spent seven years building productivity systems, from normie advice to 'natty' biohacking and dissecting the ontology of executive function. Each one helped a little. Adderall one-shotted it. This is basically the bitter lesson but for self-improvement. Clever scaffolding loses to a better base model, and as the base improves, new abilities emerge that no amount of prompting could elicit. The same goes for people. A better base raises your reliability at every step at once, and things that used to be impossible suddenly become routine. If you've been prompt-engineering yourself, the model itself might be the problem.

For most of my life, I could not get myself to do work.

This was fine through elementary, middle, and high school. Where I grew up, you could skip the homework and still get good grades as long as you did well on the exams. Most days I didn't even open my backpack. I played hours of League every night until my eyes bled.

Then I got to Berkeley, and reality hit: I actually had to do homework and study. Other students seemed to do it with ease, and I couldn't figure out how. My theory was that a lot of them grew up in competitive places like the Bay Area, where they'd been forced to develop productivity systems. I never had to. I set a goal to catch up on productivity systems. I've been on that journey ever since.

The first problem was procrastination. Some days at Berkeley I spent 14 hours rotating through cheap dopamine: groupchats, TikTok, Instagram, Snapchat, YouTube, Reddit. Reddit was so bad that I'd exhaust everything in "hot" and "top" and move on to "new" and "rising." When I got tired of those, I'd cycle through Gmail, Slack, Piazza (the class forum), and sometimes random Wikipedia pages. When I was a TA, I was consistently #1 out of everyone in the class (close to a thousand people cause it was Berkeley) for threads read.

Piazza statistics table with other students' names blurred; I'm ranked first by posts viewed
Piazza stats from a class I TA'd, sorted by posts viewed.

Then I would repeat the cycle.

Obviously this was terrible, so I started building systems. It started with normie advice you'd see in self-help books and surface-level youtube. That helped somewhat; it helped me go from a 3.1 GPA my first semester to a 4.0 my next.

But it wasn't enough. I still spent hours procrastinating every day. I could not stand wasting so much time when I only have one life to live...

the pre-work ritual

I aimed deeper in the layers of abstraction to the neurotransmitter level. I discovered Andrew Huberman in 2021 and went into 'natty' biohacking optimization.

I would do a pre-work ritual to try to increase my likelihood of doing work instead of procrastinating.

I'd start with some breathwork to spike my autonomic arousal. Binaural beats. Baseball cap + hoodie to narrow my field of view. A mantra I verbalized to myself to get me going. Optimizing the everloving shit out of my workspace environment: monitor slightly above eye level (since looking up increases alertness), various social media blocking apps, and so on. This all helped a little, but still not enough.

So I went deeper. I mapped out the full ontology of my procedural executive function. I added implementation intentions: trigger-action plans for exactly what I'd do when I sat down, when I got distracted, and when I got stuck. I used beeminder to try to counter akrasia. I coded a desktop app with an "execution window" and a script to go with it, so the transition into work could run like a program.

I also tried the opposite: stripping the system down to a few heuristics, and eventually to a single one, "just do it." That didn't stick either.

7 years of attacking the problem from every angle and layer I could find (habit formation, identity change, meditation, task organization, stress reduction, etc), and nothing solved it.

Then I started taking Adderall, and it basically just one-shotted it.1 No need to unravel the abstraction down to the neurotransmitter level or engineer a full system. Now I just sit down and start.

The day I first took it, at 30 mg, the songs in my head went quiet for the first time in six years. Everything felt seamless. I was at a bar with some friends, and I stepped outside to enjoy the peace in my head. I then felt compelled to do a leetcode problem to see if my brain could do it easier. And indeed, I could think more clearly and it felt amazing.

Looking back, my main feeling wasn't relief. It was: damn, I wasted a lot of time trying to be natural when I should have just gotten enhanced.

the bitter lesson

In 2019, Rich Sutton wrote a short essay called The Bitter Lesson. His observation, drawn from 70 years of AI research: methods that encode human cleverness (hand-built chess heuristics, linguistic rules for speech recognition, hand-designed features for vision) get beaten again and again by general methods that just use more computation. Search and learning, scaled up.

The lesson is bitter because researchers keep relearning it. The clever approach is satisfying. It reflects your understanding of the problem, and it works in the short term. Then scale arrives and makes it irrelevant, and years of careful work turn out to have been a local optimum.

Large language models made this concrete in a way that's hard to ignore, and they added something Sutton's essay only hints at: emergence.

emergence

In the GPT-3 paper, the 13-billion-parameter model could do two-digit addition and subtraction only about half the time, even with examples in the prompt. The 175-billion-parameter model, trained the same way, got two-digit addition right essentially 100% of the time. Same recipe, more scale: unreliable became dependable.

This pattern is everywhere in the scaling literature. Wei et al. (2022) catalogued dozens of tasks where performance sits near random across a wide range of model sizes, then jumps sharply past some threshold.

Multi-step arithmetic, word unscrambling, multi-hop questions: these abilities don't improve gradually from small models. Below a certain scale they're effectively absent, and above it they're present.

Meanwhile, an enormous amount of human ingenuity went into scaffolding weaker models:

At Algoverse in 2023-2024, we also had our fair share of these scaffolds (1,2,3).

The scaffolds weren't useless. But they were local fixes on a system that was below the threshold, and no amount of local fixing pushed it over. What pushed it over was improving the model itself: first scale, then reinforcement learning on chain of thought, which is what finally fixed reasoning.

Anthropic's own engineers documented this happening in 2026. Their harness for long-running coding agents used context resets, because Claude Sonnet 4.5 showed what they called "context anxiety" as its context window filled up, and a "sprint" structure that broke big tasks into chunks, because Opus 4.5 couldn't sustain them. Opus 4.5 made the context resets unnecessary. With Opus 4.6, they removed the sprint structure too. The newer model worked coherently for over two hours without that decomposition. They kept the planner and evaluator, which still helped. Their summary: every harness component "encodes an assumption about what the model can't do on its own."

My pre-work ritual was AutoGPT. Trigger-action plans were "take a deep breath."

why scaffolds can't get you there

The defining feature of emergent capabilities is that nobody built them. No one at OpenAI wrote an arithmetic module for GPT-3. They made the model better at one general thing, predicting text, and arithmetic showed up as a side effect, along with translation, code, and dozens of other abilities nobody targeted.

Scaffolds are the opposite. Each one is built for one specific failure: a prompt trick for this task, an agent loop for that one. You get exactly what you engineered, and nothing else.

My systems were all scaffolds. The pre-work ritual targeted starting. Beeminder targeted akrasia. Trigger-action plans targeted distraction. Task managers targeted forgetting: a physical notebook, then a notepad, Todoist, Asana, Google Docs, back to a notepad, Obsidian with extra scaffolding on top, and finally my own vibe-coded system with a Discord bot, a mobile app, and a desktop app. One system per failure, for seven years.

Adderall didn't target any of them. It changed one general thing,2 and a whole list of abilities showed up together: starting on demand, staying inside a time block, the five-minute rule actually working, keeping things organized, finishing projects that take weeks. I'd spent years engineering each of those individually. They arrived as side effects.

Some of what showed up, I'd never tried to engineer at all. My room looked way better. I felt more creative. Ideas started coming to me unprompted, and I got an urge to make things: content, side projects, essays. This one included.

When the base improves, you don't just get the thing you were working on. You get everything downstream of it, including things you never thought to work on.

the scaffolds are emergent too!

My favorite detail from the LLM literature is this one. Chain-of-thought prompting, which asks the model to reason step by step, is the most famous prompt technique ever discovered. In the original paper, it hurt smaller models. They produced fluent but illogical reasoning and got worse answers. The technique only started helping at around 100B parameters.

The scaffold itself was an emergent ability. It only worked above the threshold.

This is true in the real world too.

My scaffolds in the above section all ran on the same resource they were meant to supplement. A task manager needs executive function to maintain. A pre-work ritual needs executive function to execute. Below the threshold, each system is just one more thing to fail at, which is why so many people with ADHD have a graveyard of abandoned apps.

In order to use these scaffolds to manage your ADHD, you have to not have ADHD!

It was a daily struggle to use them. Now they just work.

I think this is the most underrated idea in self-improvement. A lot of advice works brilliantly for the people who give it, and they're not lying. Plan your week on Sunday. Do the hardest task first. Time-block your calendar. It works for them because they're above the threshold where the advice becomes usable.

Adderall didn't make the urge to procrastinate go away. It made the anti-procrastination advice I already knew finally start working.

muscle

Online natural bodybuilding has developed an impressively sophisticated literature on technique and exercise selection. Lengthened partials, resistance curves, stretch-mediated hypertrophy, exercise rankings by tension profile.

Go read r/naturalbodybuilding for an afternoon and you'll see the lengths people go to just to get a fraction of what enhanced lifters get within months. That's been true in my experience too.

There's a reason people make fun of the science-based lifting crowd: a lot of it is grasping at straws for extremely marginal improvements.

In 1996, Bhasin et al. put healthy men into four groups for ten weeks: placebo or testosterone, with or without training. The men who got testosterone and did not train at all gained more fat-free mass than the men who trained naturally. Testosterone plus training produced the largest gains.3

The couch plus the base beat the gym without it.

Enhanced pros run training volumes that would wreck a natural lifter, which is why "don't copy pro routines" is standard advice for naturals. The program isn't wrong. It's a scaffold that only works above the threshold, just like chain-of-thought.

Do note I'm not dunking on being natural or being a "science-based lifter". There are some tradeoffs with going on TRT or blasting test, to say the least. If you've decided to stay natural, and you have the bandwidth to take on the extra complexity, there's no downside to optimizing technique. You might as well. But you have to understand that all of it is tiny compared to just improving your anabolic response by modulating your hormones.

the lesson

Sutton's advice to AI researchers was to stop building intelligence one skill at a time and bet on what scales. Every clever system built for a specific ability eventually lost to a model that just got better in general, and the abilities everyone had been engineering showed up on their own.

Self-improvement has the same trap. It's natural to treat each failure as its own problem with its own fix: a ritual for starting, an app for forgetting, a technique for each muscle. Each one helps a little. But what I actually wanted was never one ability. It was everything downstream of a better base.

So before you build the next system, ask the question AI researchers kept learning the hard way: am I scaffolding around a weak model, or should I be improving the model?4


notes

This is my own experience, not medical advice. Stimulants and testosterone carry real risks; talk to a doctor.

  1. Not 100%, to be clear. There are still days it doesn't work.

    Why did it take seven years to try medication? I was scared of the health risks. I think a lot of my ADHD-like symptoms come from my UARS, and ADHD diagnosis is pretty subjective anyway. As Scott Alexander argues, attention is a normally distributed trait, and the diagnosis is an arbitrary line drawn somewhere on the curve. I'd also read that Adderall is probably neurotoxic, and the conventional advice, including my parents', was to do the natural thing first. Plausibly, if I engineered the systems just a litttle moreeee, then I wouldn't need it. Well, I do still think Adderall is probably neurotoxic (Scott, for what it's worth, seems less worried about this than I am), but it's worth the tradeoff in moderation. So I use it on occasion, which also slows the tolerance buildup. ↩

  2. The analogy isn't exact. Scaling a language model typically means training a new, bigger model from scratch. The literal human version would be growing a whole new person with a bigger brain, not giving a pill to an adult. Adderall doesn't change my weights. It changes how the existing model runs, which is closer to adjusting a model's internal activity at inference time (e.g activation steering) than to scaling it up. What carries over is the shape: one general change, a whole set of abilities nobody targeted showing up at once, and a pile of targeted fixes becoming unnecessary. ↩

  3. Bhasin et al., NEJM 1996. 43 men, 600 mg testosterone enanthate per week (a supraphysiological dose, well above TRT), 10 weeks. Fat-free mass gains: testosterone without training +3.2 kg, training without testosterone +1.9 kg, both +6.1 kg. ↩

  4. Not every base comes with a dial, though. There's no Adderall for IQ. Why muscle and focus, but not intelligence? Gwern's Algernon argument: if a simple tweak gave a free gain, evolution would already have taken it, so anything that works must cost something or serve a goal evolution didn't share. Testosterone and dopamine pass that test. Evolution set them at a compromise, because more muscle costs food and fertility and constant arousal costs sleep, so you can push them if you're willing to pay. Human intelligence wasn't a compromise. More kept winning, so evolution has already taken every cheap gain. ↩