Artificial General Intelligence Development: Tech Leaders' Motivations and the Risks of Superintelligence

Artificial General Intelligence Development: Tech Leaders' Motivations and the Risks of Superintelligence
Seattle City Council from Seattle, CC BY 2.0 https://creativecommons.org/licenses/by/2.0, via Wikimedia Commons

Leading technology billionaires including Sam Altman, Elon Musk, Mark Zuckerberg, and Jeff Bezos are actively investing in artificial general intelligence (AGI) and superintelligence development, claiming their goal is to save humanity. Still, experts suggest these grandiose visions conceal their true motivations. Analysis published by Live Science indicates that AGI is an extremely difficult concept to define and even more challenging to implement, which Stuart Russell, professor at the University of California Berkeley, describes as a system capable of solving any intellectual task that a human can solve. However, based on statements from tech leaders, it's suspected that the pursuit of AGI is actually about securing power and economic advantages, while often ignoring the dangers of development.

OpenAI CEO Sam Altman's latest plans include securing three trillion dollars in funding for AI chip production, which is eight and a half times all current investment capital globally. At the same time, Mark Zuckerberg recently announced that Meta's goal is to create a free, open-source superintelligent AI. Analysis published by Futurism, however, points out that Zuckerberg's plan contains fundamental flaws, as creating and operating a true superintelligence would be extremely expensive and pose significant security risks if operated as an open-source system. Experts from the Effective Altruism Forum go even further when explaining that a superintelligent AI could potentially extinguish human civilisation, regardless of who owns it, as it would likely not be fully controllable. Billionaires would not be protected against such an event.

The current technological race in AGI development shows several concerning trends, and according to experts, this is much more a dangerous competition than a genuine humanitarian effort. According to Cybernews, over the past five years, more than three dozen companies worldwide are working on AGI development, and at least seven and a half billion dollars have been invested in this area. Experts, including Timnit Gebru, founder of the Distributed AI Research Institute, warn that these grandiose promises primarily serve to attract further investment and increase the value of technology companies. At the same time, real social problems and ethical questions of AI development are often pushed into the background by interests in increasing profit and power.

Sources:

1.

‘Foolhardy at best, and deceptive and dangerous at worst’: Don’t believe the hype — here’s why artificial general intelligence isn’t what the billionaires tell you it is
“Unfortunately, the goal of creating artificial general intelligence isn’t just a project that lives as a hypothetical in scientific papers. There’s real money invested in this work, much of it coming from venture capitalists.”

2.

News Logo
Tech leaders on AGI: when will it change the world?
Cybernews · January 13, 2025

3.

Why Billionaires Will Not Survive an AGI Extinction Event — EA Forum
By A. Nobody • Introduction Throughout history, the ultra-wealthy have insulated themselves from catastrophe. Whether it’s natural disasters, econom…

4.

There’s a Very Basic Flaw in Mark Zuckerberg’s Plan for Superintelligent AI
Zuckerberg is dreaming up a utopia in which superintelligent AIs benevolently stop short of taking over everybody’s jobs, critics say.