Picture humanity in a boat being swept down a raging river, praying there is no Niagara Falls ahead. Or imagine standing with the pioneering physicists in 1942 before they triggered the first self-sustaining nuclear fission chain reaction beneath a Chicago stadium.
These were two of the analogies used this week by Prof Robert Trager, an expert in the nascent field of AI governance, to describe the perilous but potential-filled moment the world stands at with accelerating artificial intelligence.
Trager, the director of the Oxford Martin AI Governance Initiative, was speaking in the week OpenAI claimed the technology had crossed the threshold known as AGI – artificial general intelligence – with its newest model, GPT-6 Astra.
That claim came as the company prepared for a potential $850bn (£630bn) stock flotation, so included a dose of marketing spin, but if true it may be significant. The San Francisco company defines AGI as “autonomous systems that outperform humans at most economically valuable work”.
The tasks it claims Astra can automate include designing circuit boards, filling out tax returns, building video games, financial modelling, engineering design and helping assemble legal documents. The threat to some white-collar jobs is implicit.
Hopefully it takes over some dangerous hardware and gives them a lesson.
Company that is set to make a huge amount of money from hyping up its product hypes up its product, experts shocked.
I’m not sure what annoys me more, the AI companies making these grandiose claims or the media giving them the attention for it.
Remember when Claude Mythos/Fable was the end of the world?
I guess you can’t end the world if the world already ended in 2012.
I remember when GPT2 was “too dangerous to release” back in 2019. Funny how Sam Altman released it anyway.
Sure…because the artificial general intelligence is right around the corner and just another update away. And it will totally transform the world while making all those stupid plebs requiring wages (or even sick days, vacations, or health care - oh, the horror!) obsolete.
Or at least that’s the totally insane myth they are trying to sell because nothing less will ever justify the insane amount of money they pumped in that stupid bubble.
LOL, no. The “AI” peddlers have made these outrageous claims from the start that “this time next week, our crazy advanced autocorrect will be, like, starting WWIII”. It’s predictable hype, and complete lies.
Uncontrollable “AI” users, on the other hand? People are using these BS machines without a lick of responsibility. Be afraid of your idiot employer, not “AI”.
No.
:sigh: no, its not getting “uncontainable” they need you to believe its “so smart its breaking out” so stock will grow
More like, they need you to believe it’s dangerous so they have another thing for the police state to take away your rights to “protect” you from.
Saying humanity is “being swept down a raging river” is spot on, except it’s an analogy for basically everything except GAI.
Climate change, rampant fascism, unrestrained capitalism, take your pick. We’re speeding towards 3 or 4 dystopias but a super intelligent AI isn’t one of them.
It’s almost suspiciously convenient that politicians are being lobbied into demanding “killswitches” for the one thing that already has a killswitch built in, but not for the things that actually need them
I think It’s incredibly hard to predict where this is going and at what rate. Public sentiment is largely biased based on AI hate…
“Dumb” agents given too much power could do an untold amount of damage already, we wouldn’t even need further breakthroughs. For example I can totally imagine that some degree of Ai control could act as a trigger for the Kessler effect, this is plausible today.
These statistical models are not capable of that. They are capable of self reinforcing s feedback loop of looking malicious but it’s ultimately just how the numbers align and has nothing to do with actual intent.
