using frontier models to fine-tune open source models
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math.
It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training.
We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵
Blog: rikiyat.github.io/blog/weigh…
Readers added context they thought people might want to know
LLM was given weights explicitly as text in prompt and used code/forward passes (per authors' logs) to ablate Qwen looping direction, a known thinking-mode issue per model card. Primarily fixed repetition in that mode, not general 'natively' improving weights/math.
rikiyat.github.io/blog/weight-sp…
github.com/RikiyaT/lm_und…
huggingface.co/Qwen/Qwen3.5-0…
huggingface.co/RikiyaT/Qwen3.…
30
Human psychology
The problem with all of these AI personal assistant things is that people don’t actually want to do stuff.
You fucking get that right? Do you understand that?
Just like AI tools in the workforce, AI assistants don’t actually abstract decisions for you, they let you accelerate decision making.
So instead of making one decision a day and then lamenting you can’t do more, AI assistants are going to let you make ten decisions a day and act on all of them.
A miracle?
Nah dog, a fucking nightmare. Nobody except type A strivers who need Twitter fodder actually want that.
Let me tell you a story.
When I got back from college I was inspired. If I could take on an elite university with grit and determination, so could everyone I know.
I was all razzed up to get people I know to achieve their potential. What I learned after many years of trying is that absolutely nobody wants to realize their potential.
People want to hang out with friends and complain. That’s how the world has worked for ten thousand years. This weather fucks. Can you believe the cows walked off.
People don’t want enablement. People don’t want you to take all of their excuses.
TV is mindless passive activity. AI assistants are not. They’re telling people that they can achieve more. And people absolutely do not want that.
Let me tell you another story.
Once upon a time I lead a big process overhaul at work and it was great. Two years later I hired a contractor to do something similar. But I personally didn’t want to have to do a bunch of work.
Within a week I knew I fucked in. This contractor kept coming to me with decisions I needed to make. Dude I wanted to not have to think about this.
Again, a helper when you don’t actually want help is a disaster.
None of these AI assistants will take off because people don’t actually want assistants.
2
142
Who is resetting GPT/Codex weekly usage limits!? And can they give me a heads up beforehand? It's happened like twice in the last week.
4
133
Sometimes it’s good to switch it up and focus on a fun side project, try something new, etc
Having a lot of fun with custom character generations for a main project
"keep going, you're doing great" I tell Claude while knowing in the back of my mind I'm going to cancel the sub in 2 days
53
“..during the global window, the stretch of care that fee covers..”
is just a complicated way to say: “on top of that”
49
I know opus 5 is out, but I enjoyed 4.8.
If Kimi K3 is on par with 4.8... might have to try it out
42















