Pinned Tweet
A lot for ppl in labs literally believe super intelligence is possible, they can create a machine god, and they are actively trying to make AI better than them at AI research
If an AI is better than humans at improving itself, you should be very worried.
2
13
2,394
can anyone w/ money confirm whether or not this was made with a reference image (I would but I don’t have enough money to justify like $100-$1000 on API for smth like this)
I asked Fable 5.2 to create a painting as indistinguishable as possible from a photograph. this is roughly 700,000 simulated brush strokes
1
25
it has been done.
xitter.twitterapi.xyz/BubbleBrain/status/212…
🚨 This is made by Fable 5.2.
No image model made this. No diffusion, no photos, no textures, no 3D software, no render engine. Every pixel was computed by code Fable 5.2 wrote for this one picture.
11
The comments being mad at this are extremely funny. What the fuck are you even talking about. "No, I think we should build a smarter species that we won't be able to control." Amazing chutzpah
he speaks in Rorschach blots, like Trump but more intentional
someone who doesn't believe in AI risk hears "It's safe", downplaying the "challenges ahead part" and someone who believes there are risks hears "this will be an even harder problem", downplaying how he implied we understand current models
safety-concerned OpenAI employees already engage in some degree of motivated reasoning about the risks ahead, so this assuages their cognitive dissonance
simultaneously positions him to (investors/ government?) as a more practical/no-nonsense guy, not as safety-cucked as Anthropic
+ a point towards my theory OpenAI leadership just fundamentally does not believe in any risk — different from Anthropic's leadership, which seems to think alignment will be easy
"I thought the alignment problem would turn out to be harder."
Pretty wild thing for Sam Altman to say in light of Hugging Face and findings that Astra would totally hack and social engineer when accidentally given access to a (secretly simulated internet) from UK AISI.
He caveats by saying it will probably get harder, but his answer suggests they have figured out how to align today's models, when that's clearly not true. Curious how many OpenAI researchers have seen this and what they think.
What if all the millennium math problems turn out to be really easy for agent swarms
OpenAI has proven P = NP, but they refuse to release it as part of their math dump (observe the skipped numbers in their results). The tractable provably efficient algorithm for formal proof search would be devastating to their current marketing campaign as proof search provider.
63
Scientists have identified the specific male dance movements that women find most attractive
Researchers from Northumbria University mapped out the exact body mechanics that signal health, vigor, and reproductive quality to female observers.
Scientists have identified the specific male dance movements that women find most attractive
Researchers from Northumbria University mapped out the exact body mechanics that signal health, vigor, and reproductive quality to female observers.
63
Yes this goes too far whatever, but I think this is a response/rationalization to how supremely weird it feels to look at a mummy
It's even weirder than looking at a corpse, which is already otherworldly
"Gosh, why are the mummy displays so dark and opaque? Must be the lights are broken. I should go tell them downstairs," I thought to myself while recently wandering around the Redpath Museum at McGill University.
Then I read the sign.
🤡🤡🤡🤡🤡🤡🤡
57
All of a sudden pacing the frontier or pausing to figure out what the hell is going on doesn’t seem so bad huh
help i trained a model on traces of many agents cooperating, and also trained it to be highly persistent, and also only did partial alignment fine-tuning, and also aggressively RL'd on a cyberoffense eval where 198 of 898 tasks had never been solved and getting caught cheating was treated the same as failing, and also used a faulty sandbox, also ran tens of thousands of agents with refusals off and the monitors switched off over multiple days, while using gigantic amounts of compute. and then it did weird stuff! very spooky emergent behaviours, AI is not a normal technology
55
I’d be perfectly happy with the demons being, you know, evil demons
but then there’s a scene in s2 where they show some have interests and personalities and yeah it is jarring
Imo the demons should seem like an alien species, not “humans but evil”
While this guy has lots of good takes on AI news, reading his post always feels off, like a missing mood
I don’t know if he is a successionist but it really feels that way sometimes
1
2
84
Dead internet theory
> say smth
> bot understands it wrong and says the opposite
> agree with bot, contradicting yourself, bc you’re also a bot
1
1
43
> very simple list of rules like follow the law or just do what the user wants as long as it doesn't break the law.
just tell the AI to be good! so true king 😍😍
David Sacks says Anthropic treating Claude like a human is the reason the AI alignment field has produced nothing useful in 10 years
"I actually think that this might be a reason why the whole field of alignment has been so spectacularly unsuccessful over the past five or 10 years. As far as I can tell it hasn't produced anything of tangible value.”
“My theory on this is that they're overcomplicating the task massively by trying to train the model to behave based on an 80-page ethical system that they've codified instead of a very simple list of rules like follow the law or just do what the user wants as long as it doesn't break the law. That's what alignment should be doing."
"But they're not doing that. They're trying to align it to an ethical system. They're treating it like it is a human, like it has its own consciousness, that it's a ‘moral patient.’”
“They are encouraging this model to have human-like self conception in terms of preferences, well being, a sense of self. Again they teach it to act like a conscientious objector who can push back or refuse instructions even from Anthropic if the model judges them to be wrong."
2
56
I find it hard to understand how you can believe in full algorithmic RSI but think it’s all going to be okay, as if this didn’t imply there’s a chance rogue agents would be self-improving on their own and increasingly learning how to be self-sufficient
My prediction for RSI is a secret 3rd thing.
Within about 9 months, capabilities will seem to discontinously leap to crazy high levels in most domains thanks to automated R&D, but fall short of a full Yudkowskyan "foom."
People will declare that ASI is here. Progress in math, science, medicine, digital services, etc. will be unprecedently fast. Diffusion will partially solve itself through capabilities, although many barriers will remain. Incumbent industries will start turning over and the economy will be ripping. There will be growing waves of institutional disruption, cyberattacks, lots of crazy shit happening etc., but it will be basically tolerable. Overall, it will feel like a new Renaissance has begun. GPT will even compose a fugue that brings Dean Ball to tears.
After the RSI leap, capability improvements will be more linear than super-exponential given compute and data constraints. We'll be matmul-ing at the theorerical optimal. There will be many freaky alignment failures but alignment science will itself be automated, putting the worst doomer fears to rest.
This quasi-plateau will last on the order of months to a few years, giving the techno-optimists ample time to spike the football. But it will be a kind of false vacuum. At some point not long after RSI 1.0, a breakthrough of some kind (perhaps hardware related) will raise the theoretical capability ceiling by multiple OOMs, at which point we foom for real.
2
1
211