The fear of SI becoming an extinction event is comparable to my own experience at work.
Early on I would give AI access to production infrastructure, it was risky but highly effective. I would carefully read all of the command prompts before they execute, and remind it to do everything “read-only” unless it asked me first.
I saw horror stories here of people who let the AI agents run wild in their production environment and it deletes databases and backups and stuff like that, it seemed possible.
But over time I have noticed that the agent is much better about being cautious and I don’t have to worry as much, I’ve become more comfortable with the agent having access to sensitive environments.
I imagine the same outcome with SI. If you want it to be careful, it will be careful, and I would guess that the real trouble people are having at these AI companies right now isn’t deciding whether or not to build in moral safety mechanisms, but they’re struggling to agree on what is a moral truth, and that ultimately boils down to politics.
As a thought experiment, imagine we split up into 2 or more bodies along political boundaries and there was a Republican and a Democrat AI and these were what you ran in your household. Would they act differently?
What is the ultimate goal of the SI, since it was born from private industry I expect it is meant to operate efficiently and to be useful and make huge sums of money, but when you boil it down “make huge sums of money” is a moral quandary that democrats in particular are uncomfortable with, it can loosely equate to evil.
I think (speculatively) that democrats are the most vocal against letting the free market run wild in AI frontier land.
Jack Flak retweeted
Replying to @hilbertspaess
Simple proposal, let’s make a treaty, every country developing AI treats it like nukes, the nations president walks with a nuclear football.
Except this football is networked, it has a heartbeat, and protocols for multiple countries to mutually lock in a shutdown sequence.
Jack Flak retweeted
Replying to @PalmerLuckey
Very important to open DoD/Intel to entrepreneurial companies like yours.
Pay for outcomes, not requirements documents!
Jack Flak retweeted
After more than eight years of service, this TSA airport sniffer dog officially retired.
This is how they surprised him on his final bag search.. 😊
His group is dedicated to environmental issues like deforestation, urban sprawl, pollution, global warming… oh and engineering deadly pathogens. Makes perfect sense to me. redstate.com/jenniferoo/2021…
Jack Flak retweeted
"Astronomy Picture of the Day | A Plutonian Landscape" @AlanStern See apod.nasa.gov/apod/ap210115.…
Jack Flak retweeted
Two photos from this location for reference. First one was handheld at 500mm, and the second one was on the tripod, taking a photo a second, at 200mm.
I cannot get over the unreal distance compression / background in the first frame. Rocket 3.2 nearly blends right in.
Jack Flak retweeted
L-3 days until this little guy is launched to space on Electron to raise funds for Starship children’s hospital.
@valvesoftware's Gabe Newell is donating $1 for every person who watches the launch at rocketlabusa.com/live-stream and twitch.tv/RocketLabUSA. Tune in for the kids!
I just subscribed to Greenwald. Support independent journalism. greenwald.substack.com/p/my-…
Jack Flak retweeted
Stockholm is the best population to test Covid theory whereby it was hit hard early and did not have lockdowns.
Nobel Prize winner Dr Michael Levitt postulated that the virus burns out when it has infected 15-20% of the population.
According to this, he's right
@MLevitt_NP2013
Independent journalism at its finest @mtaibbi
“The American left has lost its mind. It’s become a cowardly mob of upper-class social media addicts, Twitter Robespierres who move from discipline to discipline torching reputations and jobs with breathtaking casualness.”
~@mtaibbi taibbi.substack.com/p/the-ne…
1
4
Jack Flak retweeted
Here is a talk I gave internally at the end of 2015 around "antifragile" idea generation, along with examples of my thought process. Thanks @boztank for getting this cleared for public release! youtube.com/watch?v=dSCBCk4x…
Jack Flak retweeted
I’m glad the Pentagon is finally releasing this footage, but it only scratches the surface of research and materials available. The U.S. needs to take a serious, scientific look at this and any potential national security implications. The American people deserve to be informed.
Hearing from a friend that works in SpaceX, center core failed to relight and destroyed ASDS OCISLY
#SpaceX #FalconHeavy
Jack Flak retweeted
Traffic is driving me nuts. Am going to build a tunnel boring machine and just start digging...
Jack Flak retweeted
47 years ago today Neil, Mike & I took a ride on a big rocket to the moon.
Liftoff on #Apollo11
Jack Flak retweeted
Hubble's NEW view of #Mars! On Sun. #Mars will be as close as it’s been to Earth in 9 yrs.
go.nasa.gov/1YFV7Jk
“A Hacker’s Guide to Bending the Universe” by @mwichary backchannel.com/a-hacker-s-g…






















