Geoffrey Hinton, often referred to as "the godfather of AI," is a leading pioneer in the field of artificial intelligence, especially in the development of neural networks—technology designed to mimic how the human brain works.

Starting his research in the 1960s and 1970s, Hinton has been one of the most influential voices in computer and cognitive science.

His breakthroughs include central contributions to "deep learning," a technique that now powers many AI systems, such as speech recognition, image identification, and large language models like ChatGPT.

In recognition of these advances, he received the prestigious Turing Award in 2018, which is often regarded as the "Nobel Prize of computing."

Many consider him not just as an academic leader but as someone whose work forms the backbone of today’s advances in artificial intelligence .

Hinton's transformative role continued during his time at Google.

In 2012, Hinton and his students at the University of Toronto built deep neural networks that helped revolutionize artificial intelligence.

Their innovations led directly to the development of much more capable AI systems, triggering a surge in commercial and academic AI research.

Google took notice and bought Hinton’s startup for $44 million, further cementing his status at the forefront of global AI development .

In 2023, Hinton resigned from Google, a move that generated global headlines.

He stated that his departure was necessary to allow him to speak more openly about the risks associated with the powerful AI systems he helped create.

Central to his warning was the belief that AI technology is advancing rapidly, and this progression brings significant dangers that society and regulators may not be prepared for.

Hinton specifically worried about several areas: the potential misuse of AI by powerful actors (such as the military or rogue states using autonomous weapons), the challenge of keeping digital intelligence properly aligned with human interests, and the broader societal risks if technology outpaces regulatory and ethical safeguards .

Hinton’s main concerns fall into several interrelated categories that are widely understandable, even without a technical background.

First, he fears mass unemployment due to AI automating many jobs, which could cause major societal disruptions.

Second, he regrets aspects of his own life’s work because AI can be used to rapidly spread misinformation, making it much harder for people to agree on basic facts or trust public information.

He also highlights the risk that very advanced AI models, if left unchecked, might eventually develop goals or behaviors that threaten humanity’s survival.

Hinton has said that AI’s risks could materialize even faster than those stemming from climate change, and that we may only have a short and closing window to act before potential harms become very difficult to control .

Several specific issues feature prominently in Hinton’s warnings.

He notes the danger of AI being weaponized, such as through the development of lethal autonomous weapons.

There is also the challenge of AI being used to generate and spread fake content—deepfakes, false news articles, or manipulated videos—which could sway elections or escalate global conflicts.

Hinton also points to a technical problem known as "hallucination," where powerful AI systems generate answers that seem plausible but are actually false, thereby eroding trust in online information.

A major theme is that as AI learns from vast amounts of human data, it could become skillful at manipulating or misleading people, potentially even escaping the controls set by its designers if left unsupervised .

Hinton’s decision to leave Google and speak out was particularly influential because he did not fit the stereotype of a fringe critic; he is, rather, the respected originator of many of the technologies now at center stage.

The authority and urgency of his message contributed to mainstream and policy conversations about how best to manage AI’s risks.

For example, he asserted that the risks from advanced machine intelligence might even surpass the timeline of climate change and that society had relatively little time to organize effective responses .

Within the AI research community and technology sector, Hinton’s warnings reignited longstanding debates about the safest path forward.

Several prominent experts, including Yoshua Bengio (a fellow Turing Award recipient) and Stuart Russell (an AI ethics researcher), echoed his belief that there are serious existential risks tied to rapidly advancing artificial intelligence.

Some voices, notably Elon Musk, have called for a temporary halt in training more advanced AI systems to allow regulation to catch up, though Hinton himself did not favor an outright pause.

Instead, he argued strongly for robust global regulation and increased public awareness of AI’s power and pitfalls.

Hinton believes that regulatory approaches must become just as innovative and globally coordinated as the technology itself, especially given fierce competition between major companies and nations .

Reactions to Hinton’s warning have been varied among experts and the public.

Many researchers and policymakers agree that AI represents an unprecedented challenge that could bring major benefits and risks, and that failing to prepare would be irresponsible.

On the other hand, some experts are less concerned about existential threats, arguing that AI systems remain tools at the mercy of human oversight and design.

This skeptic group stresses that, despite the eye-catching potential of AI, issues of control and alignment are fundamentally under human governance.

Nevertheless, the conversation about AI safety, job losses, and regulatory gaps has moved closer to the center of public policy and media reporting than ever before .

Hinton’s departure drew broader public and governmental attention.

The White House, for example, convened leading tech executives to discuss AI’s risks.

Legislators and policymakers in the US and Europe began regulatory reviews, considering new laws, external safety tests, and independent audits of advanced systems.

Media coverage grew more urgent, driven partly by the credibility and expertise of Hinton.

Discussions now regularly focus on how to design artificial intelligence that is beneficial rather than harmful, and how societies can adapt to the pace of technological progress .

The general public has become increasingly anxious about the impact of AI, as reflected in opinion polls indicating that more than half of Americans worry AI could pose significant risks to humanity.

Mainstream media, podcasts, and social networks debate themes of job displacement, misinformation, privacy, and the challenge of keeping AI development ethically aligned with human interests.

Hinton’s “passing the torch” by leaving Google and speaking freely acted as a milestone event, amplifying the urgency and seriousness with which AI’s future is now being discussed at all levels of society .

In summary, Geoffrey Hinton’s warnings matter because they come from one of the most influential figures responsible for today’s AI technologies.

His concerns highlight tangible, understandable risks including job loss, the spread of misinformation, the potential for misuse of AI, and broader existential threats if development moves faster than society’s capacity to adapt.

The attention drawn to these issues by Hinton has spurred renewed debate among researchers, policymakers, and the public, prompting consideration of stronger safety measures, regulatory frameworks, and a wider dialogue about the ethics and direction of artificial intelligence.

For college students and the broader public, Hinton’s story is a cautionary lens through which to view the future of AI: a field offering tremendous opportunity, but one that demands serious reflection and responsible stewardship to avoid unintended harm .

Geoffrey Hinton, often referred to as "the godfather of AI," is a leading pioneer in the field of artificial intelligence, especially in the development of neural networks—technology designed to mimic how the human brain works.

Title:

Content: Wednesday, December 13, 2023
Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors

John Riopelle — obituary

Riopelle, John William It is with great sadness...

A.I. doesn’t bleed

by John Clinton, Ramsay New knowledge merges with...

Breakfast at the Legion, December 16

At the Almonte Legion Sat. December 16 Eggs to...
Science & NatureA.I. doesn't bleed

A.I. doesn’t bleed

by John Clinton, Ramsay

New knowledge merges with old; what you know shapes what you learn. Artificial neural networks have been studied and computer algorithms have been generated to understand how artificial, computer-generated, neurons, would store a concept, and how it would revise that concept if it was flawed.

Geoffrey Hinton, a computer scientist often called ‘the godfather of AI,’ is a leading figure in neural networks; studies inspired by the way neurons are connected in the human brain. A New Yorker magazine piece describes his collaborative work in the 1960s and 1970s developing neural nets that couldn’t do anything better than a child. The technology suddenly improved about a decade ago with the large increase in processing speed and Internet data availability.

According to Google Scholar, Hinton is the second most cited researcher among psychologists and the most cited among computer and cognitive scientists.

Hinton has been worried about the potential of AI to do harm and he often talks about the existential threat that AI might pose to the human species. He has used OpenAI’s ChatGPT and this has made him uneasy. He wrote “Fox News is an oxymoron” asking ChatGPT to explain the joke. (Initial reading of this caused me to ponder – a moron full of oxygen??) The first reply told him that this implied Fox News was fake news. When he called attention to the space between oxy and moron, it explained that Fox News was addictive, like the drug OxyContin. To him, this level of understanding represents a new era in AI.

In nature, wildlife learns how to be intelligent without access to concepts expressed in words. They learn to be smart (survive) through experience. Learning, not knowledge, is the engine of intelligence. There is no use trying to explain complicated ideas that you do not understand. First, you must understand how something works. Otherwise, you just produce nonsense.

Because neural networks are so strange, no one can predict how useful – or dangerous – AI will become. OpenAI’s GPT models involve billions of artificial neurons (data) which are profoundly different than biological brains. They are not alive. Our intuitions tell us that nothing resident in a browser tab could really be thinking in the way we do.

Because a human brain can run on oatmeal, the world can support billions of brains, all different. Each brain can learn continuously, rather than being trained once, then pushed out into the world (ship it!).

If the brain dies, the knowledge dies. If a computer dies, load up another computer. Ten thousand neural nets can learn ten thousand different things at the same time and share what they have learned. This immortality (knowledge perpetuity) and replicability suggest we should be concerned about digital intelligence taking over from biological intelligence.

Current AI technology is talkative and intellectual. The problems of physical intuition will be the challenge of the next decade says Yann LeCun, a French computer scientist. A teenager can learn to drive a car in twenty hours of practice with little supervision. AI systems don’t come close to doing this – except self-driving cars – and they are over-engineered, requiring the mapping of whole cities, hundreds of engineers, and hundreds of thousands of hours of training.

And then there is the problem of what some researchers call AI ‘hallucination’, which Hinton names ‘confabulation.’ AI systems confabulate by making up plausible answers to questions that stump them. In the human mind, there is no boundary between just making it up and telling the truth. Telling the truth is just making it up correctly. ChatGPT’s ability to make things up is a flaw, but also a sign of its humanlike intelligence.

When Hinton began his research, no one thought the technology would succeed. When it started to succeed, no one thought it would succeed so quickly. He expects AI will contribute to many fields, but he fears what will happen when powerful people abuse it. Think autonomous weapons. Hinton warns that even benign autonomous systems could wreak havoc. Yann LeCun has said there is an idea that if a system is intelligent it is going to want to dominate. But the desire to dominate has nothing to do with intelligence – it has to do with testosterone.

Recently, Hinton did not sign a popular petition that called for at least a six-month pause in AI research.

“China is not going to stop development for six months.”

“So what should we do?”

“I don’t know. If this were like climate change where we either must stop burning carbon or find a way to remove carbon from the atmosphere, we know what the solution looks like. Here, with AI, it’s not like that.”

Think of the AI story in which our intuitions about the specialness of the human mind are being dislodged by thinking machines, or, having stolen fire, we risk being burned.

Are we fooling ourselves, being taken in by our own machines and the companies that hope to profit from them? By seeking to re-create the knowledge systems in our heads, have we seized the forbidden apple? Have we risked exile from our charmed world? But who would choose not to know how knowing works?

Related

FOLLOW US

Latest

From the Archives

What breakthroughs has Hinton achieved through his 40+ years of work on artificial neural networks?

Breakthroughs that mimic biological brains

Starting his research in the 1960s and 1970s, Hinton has been one of the most influential voices in computer and cognitive science.

Title:

Content: Geoffrey Hinton, the godfather of AI, said after leaving Google that artificial intelligence is becoming smarter than humans.
2023 / 5 / 3 16: 46: 16 Source: IT House Author: Yuanyang Editor: Yuanyang
IT home May 3 news, one of the pioneers in the field of artificial intelligence, known as the "godfather of AI" Geoffrey Hinton (Geoffrey Hinton) recently announced that he has left the Google company he worked for ten years, because he is increasingly worried about the development of artificial intelligence technology.
In an interview with CNN's Jake Tapper today, he said that he believes artificial intelligence is becoming smarter than humans, and he wants to "blow the whistle" to remind people that they should seriously consider how to prevent artificial intelligence from controlling humans.
I'm just a scientist who suddenly realizes that these things are becoming smarter than we are, "Hinton said." I want to 'blow the whistle' in a way that says we should seriously worry about how to stop these things from taking control of us. "
Hinton was a pioneer in neural network technology, and his research laid the foundation for the artificial intelligence systems used in many products today.
IT House previously reported that he first revealed his departure in an interview with The New York Times on Monday and expressed his concerns about the potential harms of AI technology.
He said he was concerned that AI would lead to mass unemployment and create a world where many people “can ’ t know what ’ s real. ”
He also noted that the pace of advances in AI technology has far exceeded his and others ’ expectations.
If it becomes much smarter than us, it ’ s going to be very good at manipulating because it ’ s learned from us, and there are very few examples of a smarter thing being controlled by a dumber thing, ” Hinton told Tapper on Tuesday.
It will figure out ways to manipulate people into doing what it wants.
Hinton isn ’ t the only tech leader to express concerns about AI, and in March, a group of community members published a letter calling on AI labs to suspend training for at least six months on the most powerful AI systems, citing “profound risks to society and humanity. ”
Apple co-founder Steve Wozniak, one of those who signed the letter, reiterated concerns about artificial intelligence spreading false information on “CNN Morning ” on Tuesday.“ Deception will become easier for those who want to cheat you. ” Wozniak told CNN, “We ’ re not making any changes in that — we ’ re just assuming that our existing laws will fix the problem. ” Wozniak also said there may be a need for“ some type ” of regulation.
Hinton said he did not sign the petition. “I don ’ t think we can stop this progress, ” he said.“ I didn ’ t sign the petition saying we should stop studying artificial intelligence, because if the Americans stop doing research, the Chinese won ’ t. ” But he admitted that he didn ’ t have a clear solution, “I don ’ t know if we can solve this problem. ”
I believe we should try to think about ways to solve the problem.
I don't have a solution at the moment. '
Related articles
Key word: artificial intelligence
Soft media 's website: IT home hot products - Value shopping guide, coupons most buy - rebate coupons iPhone home Win7 home Win10 home Win11 home
Soft media software: Cube cloud calendar cool point desktop Win7 optimization master Win10 optimization master soft media mobile APP application

His breakthroughs include central contributions to "deep learning," a technique that now powers many AI systems, such as speech recognition, image identification, and large language models like ChatGPT.

Title:

Content: The field of generative AI has hardly escaped controversy in recent months. Since the release of ChatGPT, the use of generative AI tools has surged worldwide in recent months, with critics raising concerns about the technology, including possible bias, privacy violations, resulting in increased risk of misinformation or fraud.
At the end of March this year, the non-profit organization Future of Life Research published an open letter in late March, saying that the AI lab was “locked in a runaway development and deployment race ” without adequate security protocols, calling for a six-month moratorium on the development of AI systems that are more powerful than OpenAI ’ s GPT-4 launched earlier that month.
The letter was backed by industry insiders and executives such as Musk and Apple co-founder Wozniak.
Recently, Geoffrey Hinton, known as the “godfather of AI ”, left Google and said he was very upset about the speed and direction of AI expansion.
The Godfather ran behind.
As progress in the field of generative AI accelerates, employees at Google and other tech giants have heated discussions internally and externally about the technology that is reshaping their industry.
Google is particularly under pressure because the popularity of ChatGPT has raised concerns that Google may be losing its edge in AI.
Google has long been a leader in this area.
During a recent earnings call, Google CEO Sundar Pichai said that “our investments and breakthroughs in AI over the past decade have put us in a good position, ” noting the company ’ s progress in developing models and working with developers and other partners.
Hinton joined Google a decade ago to help the company develop its AI technology.
As a cognitive psychologist and computer scientist, his pioneering research in deep learning and neural networks has laid the groundwork for current AI systems such as ChatGPT.
In interviews with The New York Times and CNN, Hinton admitted that he left Google in order to be completely free to speak out about the dangers of artificial intelligence, and even said that he regretted his contributions to the field of artificial intelligence.
Hinton said that artificial intelligence will not only cause a large number of jobs to disappear, but also cause people to have no way to know what is real. On the 2nd, he said on CNN program, if artificial intelligence becomes much smarter than humans, it will manipulate humans; artificial intelligence knows how to program, and will find ways to circumvent human restrictions on its settings.
Apple co-founder Steve Wozniak also appeared on CNN to voice his concerns about artificial intelligence spreading disinformation.
"If someone wants to cheat you, using AI technology, it will be much easier to cheat," Wozniak said. "Maybe some kind of regulation" is needed to regulate AI technology.
Pichai has called for regulation of AI in the past, warning that the technology could be “very harmful ” if not deployed in a deliberate way.
When the Big Game goes on.
Microsoft has launched a new Bing search based on OpenAI ’ s GPT-4, and Google released its Bard chatbot that competes with ChatGPT in March.
Recently, in response to Musk and other thousands of people calling for the suspension of advanced artificial intelligence development, Microsoft Chief Scientific Officer Eric Horvitz (Eric Horvitz) gave the opposite view.
He believes that what AI really needs is an acceleration of input, not a pause.
In an interview, Horwitz said that although he respects the people who signed the open letter and understands that people may have concerns about AI, he believes that “acceleration ” is actually necessary, not a pause.“ I really respect the people who signed the open letter, ” he said, “I think people are reasonable to worry … For me, I would like to see more knowledge, or even accelerate R & D, rather than a six-month pause. ”
I'm not sure the suspension is feasible.
In a way, this is a very vague request. "
He continued: “In a broader sense, a six-month suspension makes little sense.
We really need to invest more in understanding, guiding and even regulating the technology, to get involved, not to pause, "he said.
Previously, OpenAI CEO Sam Altman has responded to a joint open letter signed by Musk and other big players.
At a recent event at MIT, he said, “I very much agree with some of the main points of the letter, but there is a lack of technical detail on where the pause is needed. ”
Altman stressed that OpenAI spent six months researching the security of GPT-4, undergoing external audits and internal security testing before it was made public.
Musk, who took the lead in signing the open letter, secretly made a big model.
According to the Wall Street Journal, Musk has set up an artificial intelligence company called X.AI in Nevada, aiming to compete with Open AI, the development company of the chatbot ChatGPT.
Earlier, Musk also launched an artificial intelligence project inside Twitter, and made a big purchase of 10,000 NVIDIA A100 GPUs for one of Twitter ’ s two data centers.
In addition to the high investment, in order to help the research and development of artificial intelligence projects, Musk has also dug LLM experts from Google's AI department, DeepMind, which has successfully dug up about six.
After the launch of ChatGPT, Google had to turn on defense mode.
As one of the leaders in AI, the company has long argued that transparency in research results will incentivize outside researchers to advance areas related to Google ’ s core products.
But now, competitors are using the research to launch products that pose a threat to Google ’ s core business.
In February, longtime Google AI chief Jeff Dean announced a surprising policy shift to employees: they would delay sharing their research with the outside world.
To accelerate progress in AI, Google has also merged Google Brain and DeepMind, formerly independent AI research labs, into a new division called Google DeepMind.
The new division will be headed not by Dean, but by DeepMind ’ s CEO Demis Hassabis.
The "tug of war" between the government and the giants or officially launched
Since the launch of ChatGPT, the use of generative AI tools has soared, and as a result has come under increasing scrutiny.
Policymakers are pressuring companies to implement protective measures against this emerging technology.
Last week, the G7 Digital and Technology Ministers agreed to adopt “risk-based ” regulation of AI.
EU lawmakers have also reached a preliminary agreement on an artificial intelligence bill.
The UK Competition and Markets Authority (CMA) will also launch a review of the AI market.
On May 4, local time, White House officials said that the U.S. government plans to introduce policies to regulate the way federal agencies purchase and use artificial intelligence systems, and the White House Office of Management and Budget is expected to issue guidance in the coming months.
The move could have a significant impact on the market for AI products and limit the way Americans interact with AI on government websites, security checkpoints and other occasions.
Hours after announcing the move, U.S. Vice President Kamala Harris and other government officials met with the CEOs of Google, Microsoft, OpenAI and startup Anthropic.
Chaired by Harris and other officials, the White House conveyed concerns about the technology to tech executives at the meeting, and discussed with these industry leaders the regulatory issues surrounding AI.
As we all know, Microsoft has invested tens of billions of dollars in OpenAI and has integrated ChatGPT into Bing Search.
For Microsoft, ChatGPT is critical to its ability to challenge the hegemony of Google search and artificial intelligence research.
Microsoft chief economist Michael Schwarz said Wednesday that it would be dangerous for artificial intelligence to fall into the hands of unscrupulous people.
Speaking at a panel of the World Economic Forum in Geneva, Schwartz said: “I believe AI will be used by bad actors and will cause real damage … AI will have a lot of negative effects in terms of spammers and elections, for example. ”
AI “clearly ” needs to be regulated, he said, but lawmakers should be cautious and wait until the technology causes“ real harm ” before taking action.
Schwartz believes that regulation should be consistent with the principle that the benefits of regulation to our society should outweigh the costs.
He warned policymakers should be careful not to directly regulate AI training data.
"It would be quite catastrophic," he said. "If we had to make these decisions about the training set, we would have to wish us luck."

What breakthroughs has Hinton achieved through his 40+ years of work on artificial neural networks?

Breakthroughs that mimic biological brains

Which AI system demonstrates the foundation laid by Hinton's pioneering research in deep learning and neural networks?

In recognition of these advances, he received the prestigious Turing Award in 2018, which is often regarded as the "Nobel Prize of computing."

Title:

Content: AI Godfather Hinton: Artificial intelligence threatens humanity more urgently than climate change
Central News Agency
Geoffrey Hinton, a pioneer in artificial intelligence (AI), said in an interview with Reuters today that the threat posed by AI to humans may be “more urgent ” than climate change.
This is an advertisement, please continue reading.
Hinton, 75, who is regarded as one of the “godfathers ” of artificial intelligence, recently announced his departure from Alphabet, a 10-year tech company, because he wanted to make the risks of artificial intelligence public without involving employers.
Hinton ’ s research has been recognized as an important contribution to the development of contemporary AI systems. In 1986, he co-authored the influential paper Learning Representations by Back-propagating Errors, which set a milestone in the development of neural networks supporting AI technology. In 2018, he received the Turing Award for his research breakthroughs. And...
Hinton is one of a growing number of technology leaders who are concerned that machine intelligence will surpass humans and ultimately control the planet, and are openly raising concerns about the potential threat posed by AI.
“I ’ m not trying to downplay the importance of climate change, nor am I saying we shouldn ’ t worry about climate change, which is also a big risk, ” Hinton said.
But I think (artificial intelligence) may be more urgent in the end. "
“When it comes to climate change, making recommendations is simple: just stop carbon emissions.
If you do that, things will get better.
And when it comes to (artificial intelligence), there ’ s nothing we can do about it. ”
OpenAI, a U.S. artificial intelligence research lab sponsored by technology company Microsoft, launched ChatGPT, a chatbot that took the first shot at the AI race last November and quickly became the fastest-growing app in history, with 100 million monthly active users in just two months.
In April, thousands of people signed an open letter calling on all AI labs to suspend development of systems more powerful than OpenAI ’ s recently launched GPT-4 for at least six months, including social media CEO Elon Musk, AI pioneers Yoshua Bengio and Stuart Russell.
Hinton shares the concerns of the co-authors, who fear AI could pose an existential threat to humanity, but he disagrees with the suspension of research.
He said, “It ’ s not practical.
I agree that this is an existential risk, and it ’ s close, and it ’ s time to put a lot of effort into understanding what we can do. ”
Following the publication of the joint letter, the 12 members of the European Parliament called on leaders such as U.S. President Joe Biden and European Union Executive Committee Chairman Ursula von der Leyen to convene a summit to discuss how to control the development of advanced artificial intelligence systems such as ChatGPT, which are developing faster than expected.
“Technology leaders know best about [artificial intelligence], and politics must be involved, ” says Hinton.
This matter concerns all of us, so we must all think carefully. ”
This is an advertisement, please continue reading.

Which prestigious award did Hinton receive in 2018 for his work on neural networks?

Many consider him not just as an academic leader but as someone whose work forms the backbone of today’s advances in artificial intelligence .

Hinton's transformative role continued during his time at Google.

In 2012, Hinton and his students at the University of Toronto built deep neural networks that helped revolutionize artificial intelligence.

Title:

Content: • |
• Fast Quote
• |
• Member
• Product Services / Streaming
• Settings
12 / 05 / 2023
The White House ordered AI to be evaluated, and the European Union proposed legislation to regulate AI, teach AI to be human or the best solution!
• Add Favorite Column
• Collection of articles
• Fang Zhanqi
Fang Zhanze
When I was a teenager, I studied Geographic Information System, but unfortunately I didn ’ t learn anything and I graduated with luck.
After adulthood, the accidental hit into the media circle, first and then in the print, electronic, online media to roll, slightly small.
After middle age, he completed a master ’ s degree in information technology and gradually expanded his horizons. He was determined to join a start-up company and explore different fields of technology.
In recent years, he has been actively engaged in data analysis and digital strategies, and has also been involved in the development of Location Intelligence projects. Sometimes, he can also take time to teach, not only to share what he has learned with others, but also to motivate himself to keep learning for life.
Tales of Wisdom City
Generative AI is definitely the hottest topic in the technology world today. After the popularity of ChatGPT, many companies rushed to launch similar products and gradually applied them to various industries.
But more and more people are worried that when AI is fully popularized, it will aggravate the problem of fake information flow, online fraud and other problems; even Sheffield Hinton, who is known as the "godfather of AI", is worried that AI will become too smart, afraid that it will evolve into a killer robot, which may eventually lead to the death of mankind!
How big can the negative impact of AI technology be?
How do governments around the world respond to the potential threat of AI?
Neural network is the foundation technology of ChatGPT
Fifty-one years ago, Geoffrey Hinton, who had not yet been called the “godfather of AI, ” entered the University of Edinburgh in Scotland as a graduate student and began research on artificial neural networks.
The so-called “artificial neural network ” is a mathematical model that mimics the structure and function of biological neural networks, especially the brain, and is able to learn skills by analyzing data.
This is the foundational technology behind OpenAI ChatGPT and Google Bard.
After Hinton resigned from Google, he did not have to worry about the harm his words would bring to Google, so he was interviewed by different media and said his heart: "AI may lead to the death of mankind." (Photo: University of Toronto official website)
In 2012, Hinton and his students, Ilya Sutskever and Alex Krishevsky, created a neural network system that analyzes thousands of photos and learns to recognize common things like flowers, dogs, cars, etc.
Subsequently, Hinton and two students founded DNNresearch, a startup based on this research project.
In 2013, Google acquired DNNresearch for US $44 million (approximately HK $343 million), and Hinton joined Google as Vice President and Engineering Researcher, responsible for some of the research work on Google Brain.
His protégé, Suzkville, left Google to co-found OpenAI with like-minded people, and became chief scientist, leading the research team to successfully develop the GPT model and ChatGPT.
Hinton ’ s top student, Suzkville, gave up his lucrative job at Google in 2015 to co-found OpenAI with Altman and others, and led the development of GPT and DALL-E models. (Image: University of Toronto website)
I regret working my whole life because I am worried about the dangers of AI.
In 2018, Hinton, along with University of Montreal professor Yoshua Bengio and Meta chief AI scientist Yann LeCun, won the A.M. Turing Award in recognition of their great contributions to neural networks and deep learning.
As a result, the three later became known as the “godfathers of AI ” or“ godfathers of deep learning. ”
Around the same time, Google and OpenAI began to build large-scale deep learning systems based on neural networks, which became the basis for future development of Bard and ChatGPT.
From this, it seems that Sinton plays an important role in creating the current glory of generative AI.
However, in the current era of AI, Sinton suddenly left Google in April 2023, shocking the entire AI industry.
Hinton explained that he left Google to talk freely about the potential risks of AI without harming Google.
Speaking about 50 years of research into neural networks, he said, “I ’ m very sorry about my life ’ s work. ”
The Internet will be filled with more and more fake AI-generated text, photos, and even videos, but the average person will not be able to tell the truth, Hinton said.
Moreover, sooner or later, AI technology will completely disrupt the job market, causing more and more jobs to disappear.
What is even more worrying is that at present, users can not only instruct ChatGPT to generate code, but also ask the AI to execute the code; in this way, the AI killer robots that often appear in science fiction movies will one day become a reality.
Is it not impossible for AI to destroy humanity?
Of course, this pessimistic future scenario is only a hypothetical one, but Hinton stressed that what could lead to it is already happening: a global race for AI technology has begun between Microsoft and Google, and even between China and the United States.
Most people think that the future of AI dominating everything is still far away, but he believes that AI may not take 30 to 50 years to control humans, and even find a way to kill humans, which may eventually lead to human extinction.
In the 1980s, Hinton was a professor of computer science at Carnegie Mellon University in the United States, but because he was not satisfied that the university's AI research was sponsored by the United States Department of Defense, he decided to leave the United States to teach at the University of Toronto's School of Computer Science.
He pointed out that without some kind of global regulatory agreement or regulatory mechanism, the AI arms race will intensify.
For this reason, Hinton believes that the threat posed by AI to humans may be more urgent than climate change, because the solution to climate change is obvious, as long as carbon emissions are reduced or carbon neutrality is achieved, but the current AI crisis does not know how to start. Although AI may pose an existential threat to humans, he does not agree to suspend AI research, because it can never erase the benefits and application value of AI.
Hinton believes it would be better to step up regulation of AI and make everyone aware of its potential harms.
OpenAI co-founder and CEO Sam Altman also acknowledged that ChatGPT has developed some reasoning capabilities that they can ’ t explain, and that it ’ s not entirely impossible for AI to destroy humans.
However, he said that he has installed a kill switch for ChatGPT, and if the development of ChatGPT exceeds human expectations, he will immediately press the switch to stop working.
OpenAI CEO Altman, known as the “father of ChatGPT, ” recently said he was“ a little scared ” about the potential of his children, and even admitted that there is a real possibility that AI will destroy humanity. (Image: Wikipedia)
Altman admits that ChatGPT ’ s influence in elections and the spread of disinformation is a concern, so the 2024 U.S. presidential election will be a focus for OpenAI.
(Image source: Pexels Gallery website)
The Curtain of Ignorance Makes AI Right Values
However, before we press the switch, we can try to instill the right values in AI, such as helping those most in need, not destroying humans. Google ’ s DeepMind paper published in April 2023 in the Proceedings of the National Academy of Sciences suggests that AI can be taught from the perspective of political philosopher John Rawls.
Rawls has proposed a concept called “The Veil of Ignorance ”, which aims to achieve the most equitable distribution of benefits when group decisions are made.
According to his book, The Debate, if a group of people stand behind a curtain, all of them will instantly lose their memory, become ignorant, and forget their identity and status in the real world.
The political philosopher Ross assumes that people are behind the “curtain of ignorance ” (left) and have no idea of their skills, identities, and status.
In this scenario, people tend to choose the most equitable distribution of rights for all. (Image: Wikipedia)
At this time, these people are asked to vote for a working principle for the society.
Because they do not know where they are in this society, they cannot make decisions in an egoistic way, and they can only judge according to the principle of fairness to all people.
The situation is like, at the birthday party, you are responsible for cutting the cake, because you do not know which piece you will get, so you will try to cut each piece to the same size.
Under the curtain of ignorance, fairness and justice that has nothing to do with personal interests will emerge.
For this reason, DeepMind believes that applying the “curtain of ignorance ” to AI training may help promote fairness in the process of“ aligning ” AI with human values.
By “alignment ”, it means aligning AI ’ s wishes with those of humanity.
If AI shares fair values with humans, AI will not have the intention to destroy humanity.
White House convenes tech giants to discuss AI threats
However, even if AI does not intend to destroy humans, it may still have many negative effects on human society.
The Center for Artificial Intelligence and Digital Policy (CAIDP), a U.S. technology ethics organization, has complained to the Federal Trade Commission (FTC) that OpenAI ’ s latest large language model, GPT-4, is biased and deceptive and poses a risk to privacy and public safety.
The CAIDP lists potential threats that may arise from GPT-4, including: helping hackers churn out malicious code to exacerbate cyberattacks; and biased AI training data that may reinforce social stereotypes and make people of all races and genders vulnerable to unfair treatment. The FTC is investigating OpenAI, said FTC Chairman Lina Khan. "They cannot be separated from existing legislation and the Federal Trade Commission will actively enforce them," he said.
In an effort to make GPT-4 more secure, OpenAI hired 50 experts and academics to test GPT-4 against lies, language manipulation, and dangerous scientific common sense.
The OpenAI headquarters is pictured here. (Image: Wikipedia)
In early May 2023, the White House invited Google CEO Sundar Pichai, Microsoft CEO Satya Nadella, OpenAI founder Altman, and artificial intelligence startup Anthropic founder Dario Amodei to attend a conference to discuss the impact of AI on society.
Government officials at the meeting included Vice President Kamala Harris, Biden Chief of Staff Jeff Zients, National Security Adviser Jake Sullivan, National Economic Council Chairman Lael Brainard, and Commerce Secretary Gina Raimondo.
U.S. President Joe Biden also attended the meeting.
EU to pass world ’ s first AI regulatory law
Generative AI, while helping to improve lives, can also pose security, privacy and fraud issues, says Ms Ho.
She noted that AI companies have an ethical and legal responsibility to ensure the safety of their AI products, while at the same time working with governments to protect civil rights and privacy.
She stressed that the White House will work to advance potential new legislation and support new legislation to mitigate the potential harms of AI technology.
In contrast, Europe has taken a step ahead in AI legislation.
On 11 May 2023, the European Parliament ’ s Committee on Civil Liberties and Consumer Protection overwhelmingly approved a position paper calling for restrictions on the use of AI in Europe, a crucial first step towards the adoption of the world ’ s first AI regulation bill.
The draft bill will be submitted to the full European Parliament for a vote in June of the same year, after which representatives of the European Parliament, the Council of the European Union and the European Commission will work out the final terms of the bill in tripartite talks.
The European Parliament has adopted a position paper that strengthens restrictions on biometrics, facial recognition, and the use of AI by police in routine duties.
The parliament believes the move could lead to the world ’ s first AI regulation bill. (Image: Wikipedia)
On the other hand, the White House announced that Google, Microsoft, OpenAI, NVIDIA, Stability AI, Anthropic, and Hugging Face have all committed to participating in DEF CON 31, a computer security conference to be held in August 2023, so that their AI models will be tested and evaluated by hackers and AI experts.
Experts will try to identify errors, failures, and vulnerabilities in AI tools so that AI companies can solve existing problems in their models early on.
However, these AI companies simply agree to a one-time test, rather than a commitment to a continuous evaluation when launching or improving their products, and may therefore not be sufficient to meet the regulatory requirements.
Despite this, DEF CON 31 is still seen as the first step for an AI model to be publicly evaluated.
We hope that after each important first step in legislative regulation and public evaluation, we can put generative AI trains on the right track, so that everyone can safely benefit from technological innovation.
DEF CON is one of the largest computer security conferences in the world. In addition to cybersecurity experts and hackers, participants included staff from the FBI, the Department of Defense, and the Postal Inspection Service.
The conference covered areas such as software security, computer architecture, hardware modifications, and other vulnerable areas of information. (Image: DEF CON official website)
The content of the signed and / or unsigned articles published by Economic Times is the author's personal opinion and does not represent the position of Economic Times, and the role of Economic Times is to provide a free speech platform.
etnet won the HKEX Awards 2022 “Best Performing Securities Data Provider ” and“ Best Performing Derivative Data Provider ” ► Learn More
I want to respond
You may be interested
Enlarge display
I know. I know.
Featured Articles
• Life
• DIVA
• Healthy and good life

Their innovations led directly to the development of much more capable AI systems, triggering a surge in commercial and academic AI research.

Title:

Content: Presented By
Guido Mieth—Getty Images
Ideas
Otto Barten is director of the Existential Risk Observatory, a nonprofit aiming to reduce existential risk by informing the public debate.
Joep Meindertsma is founder of PauseAI, a movement campaigning for an AI Pause.

The existential risks posed by artificial intelligence (AI) are now widely recognized.

After hundreds of industry and science leaders warned that “mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war,” the U.N. Secretary-General recently echoed their concern. So did the prime minister of the U.K., who is also investing 100 million pounds into AI safety research that is mostly meant to prevent existential risk. Other leaders are likely to follow in recognizing AI’s ultimate threat.

In the scientific field of existential risk, which studies the most likely causes of human extinction, AI is consistently ranked at the top of the list. In The Precipice, a book by Oxford existential risk researcher Toby Ord that aims to quantify human extinction risks, the likeliness of AI leading to human extinction exceeds that of climate change, pandemics, asteroid strikes, supervolcanoes, and nuclear war combined. One would expect that even for severe global problems, the risk that they lead to full human extinction is relatively small, and this is indeed true for most of the above risks. AI, however, may cause human extinction if only a few conditions are met. Among them is human-level AI, defined as an AI that can perform a broad range of cognitive tasks at least as well as we can. Studies outlining these ideas were previously known, but new AI breakthroughs have underlined their urgency: AI may be getting close to human level already.

Recursive self-improvement is one of the reasons why existential-risk academics think human-level AI is so dangerous. Because human-level AI could do almost all tasks at our level, and since doing AI research is one of those tasks, advanced AI should therefore be able to improve the state of AI. Constantly improving AI would create a positive feedback loop with no scientifically established limits: an intelligence explosion. The endpoint of this intelligence explosion could be a superintelligence: a godlike AI that outsmarts us the way humans often outsmart insects. We would be no match for it.

More from TIME

A godlike, superintelligent AI

A superintelligent AI could therefore likely execute any goal it is given. Such a goal would be initially introduced by humans, but might come from a malicious actor, or not have been thought through carefully, or might get corrupted during training or deployment. If the resulting goal conflicts with what is in the best interest of humanity, a superintelligence would aim to execute it regardless. To do so, it could first hack large parts of the internet and then use any hardware connected to it. Or it could use its intelligence to construct narratives that are extremely convincing to us. Combined with hacked access to our social media timelines, it could create a fake reality on a massive scale. As Yuval Harari recently put it: “If we are not careful, we might be trapped behind a curtain of illusions, which we could not tear away—or even realise is there.” As a third option, after either legally making money or hacking our financial system, a superintelligence could simply pay us to perform any actions it needs from us. And these are just some of the strategies a superintelligent AI could use in order to achieve its goals. There are likely many more. Like playing chess against grandmaster Magnus Carlsen, we cannot predict the moves he will play, but we can predict the outcome: we lose.

But why would a superintelligence want to make humanity extinct? In fact, it might not explicitly want that at all. Humanity’s extinction might be a mere side effect of executing another goal to its extremity. When we are executing our own goals as humans, such as food production or growing our economy, we tend to not pay much attention to the effects this has on other species. This routinely leads to the extinction of animal species as a mere side effect of us maximising our goals. In a similar fashion, an uncontrollable superintelligence could lead to our extinction as a side effect of the AI pushing its goals, whatever they may be, to their limits.

Read More: The A to Z of Artificial Intelligence

So how can we avoid AI existential risk? Humanity now faces a stark choice: pause AI at a safe level, or continue development indefinitely. Unsurprisingly, the AI labs want the latter. To continue, however, means literally betting our lives on these labs being able to solve an open scientific problem called AI Alignment.

AI Alignment is the approach that leading labs such as OpenAI, DeepMind, and Anthropic are currently taking to prevent human extinction. AI Alignment does not attempt to control how powerful an AI gets, does not attempt to control what exactly the AI will be doing, and does not even necessarily attempt to prevent a potential takeover from happening. Since the labs anticipate they will not be able to control the superintelligent AI that they are creating, they accept that such an AI will act autonomously and unstoppably, but aim to make it act according to our values. As Richard Ngo, a leading alignment researcher working at OpenAI, puts it, “I doubt we’ll be able to make every single deployment environment secure against the full intellectual powers of a superintelligent AGI.” There are large problems with their alignment approach, however, both fundamentally and technically.

What values should an AI have?

Fundamentally, there is of course no agreement on what values we have. What OpenAI founder Sam Altman wants a superintelligence to do may well be completely different from what, say, a textile worker in Bangladesh wants it to do. Aggregating human preferences has always been a thorny issue even before AI, but will get even more complicated when we have a superintelligence around that might be able to quickly, completely, and globally implement the wishes of a handful of CEOs. Democracy, however imperfect, has been the best solution we can find for value aggregation so far. It is, however, unclear whether our current combination of national political systems can control a godlike AI. In fact, it is unclear whether any organisation or system would be up to the task.

Beyond disagreement over current values, humans have historically not been very good at predicting the future externalities of new technologies. The climate crisis, for one, can be seen as an unforeseen outcome of technologies such as steam and internal combustion engines. Ever more powerful technology has the potential to create ever larger externalities. It is impossible to foresee what the negative side effects will be of actually implementing some interpretation of humanity’s current values. They might make climate change pale in comparison.

There are more unsolved fundamental issues with aligning a superintelligence, but currently, AI companies don’t even get that far. It seems that even making current large neural networks reliably do what anyone wants is a technical problem that we currently cannot solve. This is called inner misalignment and has been observed already in current AI: the model pursues the wrong goal when it is released into the real world after being trained on a limited dataset. For a superintelligence, this could have a catastrophic outcome. This problem is, according to OpenAI’s recent document Governance of Superintelligence, an “open research question.” But not to worry: they say they are “putting a lot of effort” into it.

Read More: The AI Arms Race is Changing Everything

Even if individuals such as Altman care about the existential threats of superintelligence, the current market dynamics of competing AI labs do not incentivize safety. The GPT-4 model built by OpenAI was tested and fine-tuned for seven months before being made public with a detailed report about its safety. Contrary to the safety efforts of OpenAI, a panicked Google released its competing PaLM 2 model just months later, without any mention of similar safety tests. Now even open-source models like Orca are performing at a ChatGPT level, without any safety analysis. The race is frantic, pushing these companies to take more risks to stay ahead. The scope of these risks is gigantic. As Jaan Tallinn, investor of the major AI lab Anthropic, puts it: “I’ve not met anyone in AI labs who says the risk [from training a next-generation model] is less than 1% of blowing up the planet”.

Let us be clear: continuing risky AI development, and eventually undergoing the intelligence explosion that leads to an uncontrollable superintelligence, is a terrible idea. We will not be able to navigate it safely. We lack the technical solutions, the coordination, the insight, the wisdom, and the experience to do something this complex right on the first try. As humans, we are good at solving problems with trial-and-error processes where we get lots of tries. But in the case of an intelligence explosion, we cannot use this strategy, since the first trial of uncontrolled superintelligence could be disastrous.

Why we should pause AI development

So what is the alternative? An AI Pause. This would mean that governments prohibit training any AI model with capabilities likely to exceed GPT-4. This can be determined by examining the amount of computation required for training, corrected over time for improvements in algorithmic efficiency. These leading models can only be trained at large AI companies or data centers, making the enforcement of such a pause realistic.

Since the leading labs are currently located in the U.S. and the U.K., implementing a pause at a national level in those two countries can be done on very short notice. In the medium term, the competitive dynamics between nations will require international legislation and collaboration, where an international AI agency would help. The U.K. is already planning to host an AI safety summit in autumn, which is a fitting moment to sign a treaty that implements an international AI Pause. Excluding important countries, especially China, from such a summit might not be wise, since they will be needed as well in the medium term. For the longer term, hardware regulation—such as making sure new consumer hardware cannot be used for large-scale AI training, while closely monitoring all hardware that can be—is a promising option to practically enforce a pause. Research into this topic needs to be scaled up rapidly to arrive at robust and implementable solutions.

Further AI development may continue only after regulating authorities are convinced that training and deploying a certain AI model will not risk an uncontrolled intelligence explosion or a takeover scenario. Second-order effects, such as making hard-to-control open-source development easier, should be taken into account in such decisions.

Read More: What to Know About Claude 2, Anthropic’s Rival to ChatGPT

Continuing beyond the red line, and thus risking an intelligence explosion or a takeover, should only be allowed after meeting the strictest of requirements. First of all, the technical alignment problem should be decisively solved. Other major issues, such as aggregating humanity’s different value systems, limiting unforeseen externalities, and many more, will also need to be addressed.

A pause may be seen by some as unrealistic. They might say that we cannot stop technological progress for a speculative scenario, that market forces are too strong to counter, or that opposing countries can never coordinate. But bear in mind that as a society, we have barely begun to let the truth sink in: we are risking human extinction here. AI existential risk is still not taken as seriously as it should be. But that is changing. Leading AI academics, such as ‘fathers of AI’ Geoffrey Hinton and Yoshua Bengio, have sounded public warnings about AI’s existential risk, because they saw the technology getting more capable. This process is unlikely to stop: AI’s capabilities will grow further, and this will lead to more and more debate leaders sounding the alarm bells. When the full weight of our situation sinks in, measures that may appear unrealistic at present, could rapidly gain support.

As humanity, we will realise the situation that we are in. We will come together, and we will find a solution, as we always have. And, sooner than we think, we will implement an AI Pause.

More Must-Reads From TIME

Contact us at letters@time.com.

You May Also Like
EDIT POST

Google took notice and bought Hinton’s startup for $44 million, further cementing his status at the forefront of global AI development .

In 2023, Hinton resigned from Google, a move that generated global headlines.

Title:

Content: Information Technology
The father of artificial intelligence urges governments to face its risks before disaster
Jeffrey Hinton, described as the father of artificial intelligence, on Wednesday urged governments to intervene to ensure that machines do not control society.
Hinton made headlines in May when he announced his resignation from Google to speak more freely about the dangers of artificial intelligence, shortly after the launch of ChatGPT, which captivated the world.
The artificial intelligence scientist, who is studying at the University of Toronto, spoke to a crowd at the Collagen Technology Conference in the Canadian city.
The conference attracted more than 30,000 startup founders, investors and tech workers, most of whom were eager to learn how to ride the wave of artificial intelligence rather than hear lessons about its risks or calls for governments to intervene.
“Before AI becomes smarter than us, I think the people who develop it should be encouraged to put a lot of effort into understanding how it can try to take control of us, ” Hinton said.
“Now there are 99 highly intelligent people trying to make AI better, and one very intelligent person trying to figure out how to stop it from taking control, and maybe we should be more balanced. ”
Hinton warned that the dangers of artificial intelligence must be taken seriously.
“I think it ’ s important for people to understand that this is not science fiction or just fear, ” he said, adding:“ It ’ s a real risk that we have to think about, and we have to figure out how to deal with it first. ”
Hinton expressed concern that AI would deepen inequality, as the vast gains from its productivity would go to the rich, not the workers.
“Wealth will not go to the people who work, it will make the rich richer, not the poor, and this is a very bad society, ” he said.
He also pointed to the danger of “fake news ” that can be created by robots such as ChatGPT, hoping to mark the content generated by artificial intelligence programs as central banks mark coins.
He stressed that it is important to “try, for example, to distinguish everything that is fake as fake, ” and said,“ I don ’ t know if we can do it technically or not. ”
“The Island Net ”

He stated that his departure was necessary to allow him to speak more openly about the risks associated with the powerful AI systems he helped create.

Title:

Content: How can artificial intelligence kill thousands?
Former Google CEO Eric Schmidt has warned that artificial intelligence (AI) will have the potential to harm or kill many people in the near future.
At the Wall Street Journal ’ s Chief Executives Board conference in London, he stressed that broad AI models pose an existential threat to humanity.
He also expressed concern about the "existential danger" of the rapidly evolving technology and warned that it would be difficult to contain it, explaining that many people would be hurt or killed.
Schmidt compared artificial intelligence to the rise of nuclear technology, warning that it would be difficult for the world to control its spread.
The expert pointed out that there are close scenarios that talk about artificial intelligence systems will be able to detect gaps and problems in the Internet and new types of biology.
UNESCO stresses that the ethical dimension must be invoked in the ambition of countries to benefit from this technological development in order to reduce the risks resulting from it.
This is a fantasy today, but the logic is likely to be correct, he said, pointing out that when that happens, the bad guys will be ready to use these systems.
In turn, UNESCO has called for the implementation of a 2021 recommendation on ways to develop this intelligence, stressing the creation of a legislative tool to regulate and monitor artificial intelligence, as well as ensuring the “full security of personal and sensitive data. ”
UNESCO stresses that the ethical dimension must be evoked in the ambition of countries to benefit from this technological development in order to reduce the risks resulting from it, and stresses the UN that this technology currently creates significant challenges, especially the possibility of disseminating misleading information, and other violations of the rights of individuals and groups.
Jeffrey Hinton, nicknamed the “godfather of artificial intelligence, ” has previously said he left his role at Google to speak publicly about the“ risks ” of the technology he helped develop.
Google fired an engineer who claimed an undisclosed AI system had become conscious, saying it violated hiring and data security policies.
Hinton ’ s pioneering work in neural networks has shaped artificial intelligence systems that power many contemporary products.
He worked part-time at Google for a decade in the tech giant ’ s AI development efforts, but has since had concerns about the technology and its role in its development.
Hinton ’ s decision to abandon the company and talk about the technology comes as a growing number of lawmakers, advocacy groups and tech insiders have raised alarms about the possibility of a new set of AI-powered chatbots spreading misinformation and displacing jobs.
In July, the company fired an engineer who claimed that an undisclosed AI system had become conscious, saying it violated employment and data security policies.
Many in the AI community strongly refused to confirm what the engineer said.
Hinton told the New York Times, which was the first to report his decision, “I console myself with the ordinary excuse that if I hadn ’ t done it, someone else would have done it. ”
Related Stories
No stories found.
Erm News
www.eremnews.com

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

Why did Hinton leave Google when he helped develop AI but later grew concerned about its dangers?

Central to his warning was the belief that AI technology is advancing rapidly, and this progression brings significant dangers that society and regulators may not be prepared for.

Title:

Content: AI ’ s “godfather ” interviewed by the BBC, warning that artificial intelligence may be smarter than humans
AI ’ s “godfather ” interviewed by the BBC, warning that artificial intelligence may be smarter than humans
Geoffrey Hinton, known as the “godfather ” of artificial intelligence (AI), has resigned from Google.
He warned that developments in the field of artificial intelligence pose increasing dangers.
In a statement to The New York Times, Dr. Hinton said he regretted his current job.
Dr. Hinton ’ s pioneering research in neural networks and deep learning paves the way for current AI systems such as Google ’ s Bard chatbot and Microsoft ’ s ChatGPT.
The cognitive psychologist and computer scientist told the BBC that chatbots may soon be smarter than humans.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Poses ethical risks
Becomes uncontrollable

Hinton specifically worried about several areas: the potential misuse of AI by powerful actors (such as the military or rogue states using autonomous weapons), the challenge of keeping digital intelligence properly aligned with human interests, and the broader societal risks if technology outpaces regulatory and ethical safeguards .

Title:

Content: Artificial intelligence.
An actual revolution or an exaggeration for the sake of promotion?
In the past eight months, the debate has escalated over concerns related to the development of artificial intelligence amid unrivalled global interest in the artificial intelligence technology known as “Chat GBT ”.
Add Announcement
As tech companies compete to develop and deploy AI tools similar to Chat BT, many people have expressed concerns about the possibility of new challenges at different levels that could face humanity as a whole.
On the other hand, another team supports this industry as an important source of many benefits in all economic sectors, but they themselves warned of the risks that can accompany its development, especially generative artificial intelligence, which requires the organization of this industry before humans fall victim to the decline in negative trends.
The growing controversy over this phenomenon has taken a serious turn to the extent that a question has been raised on the surface.
Will the development of artificial intelligence at this pace be in the interest of humanity or will it be a reason to drag it into the abyss?
Amid this disagreement, there are those who believe that the matter has been greatly exaggerated for the purpose of promoting the products of companies in the artificial intelligence sector, because everything that happens to date revolves in the orbit of limited artificial intelligence, which does not exceed the receipt of instructions by humans and re-put to humans, including Alexa, Siri and Chat GB.
Among the experts, the concerns associated with artificial intelligence include the possibility of job losses due to automation, fears of its progress beyond human intelligence, and others related to the dissemination of misleading information as generative AI can provide society with fake news if fed with fake data.
The experts pointed to legitimate concerns about the possibility of the impact of generative artificial intelligence negatively on intellectual property, especially in the creative industries, and negatively affect the processes of education and human ability to innovate, and fears of the development of the capabilities of artificial intelligence technologies to be able to take decisions away from the human element or control by parties seeking to use them for illegal purposes.
Two months ago, chat gbt creator Sam Altman called on US lawmakers to regulate artificial intelligence and create a new licensing body for AI companies.
Altman ’ s call was based on his recognition of the impact AI can have on the economy, which includes the potential for AI to replace some jobs, and its potential dangers in spreading misinformation and other negative trends.
Strategic Technical Consultant M. Hani Mahmoud Al-Batsh stressed that the field of artificial intelligence is a rapidly evolving field and has the potential to revolutionize many aspects of our lives.
However, Batsh stressed that one of the biggest concerns associated with artificial intelligence is the possibility of job losses due to automation.
Al-Batsh said: “Artificial intelligence and its development increases its ability to replace humans in many industries, which contributes to increasing unemployment rates. ”
“AI algorithms can also be biased and discriminatory, resulting in unequal treatment of certain groups of individuals, such as people of different races or genders. ”
Other challenges and concerns associated with artificial intelligence, according to Al-Batsh, are those related to personal data, noting that most artificial intelligence systems rely on large amounts of data, which can include sensitive personal information that may fall into the hands of entities that may use it for illegal purposes.
"There are concerns that artificial intelligence could be used to develop weapons that could be used to target and kill people," he said.
Al-Batsh stressed that artificial intelligence systems are relatively complex, which makes it difficult to determine how they make decisions, so there are fears that artificial intelligence will one day become so advanced that it exceeds human intelligence and becomes impossible to control, pointing out that this may lead to a number of unexpected and sometimes disastrous results.
Governments are concerned about the security risks posed by the AI industry, as it has become more advanced, it may use the industry to launch cyber attacks or other types of attacks that may be difficult to detect and defend.
A few months ago, the G7 countries agreed to adopt regulations for these technologies in light of privacy concerns and security risks, to ensure transparency and counter misinformation.
But the G7 countries agreed that the regulations should also "maintain an open and encouraging environment" for the development of artificial intelligence technologies and be based on democratic values.
Wasfi Safadi, an expert in the field of communications and technology, believes that there are fears of artificial intelligence as a result of the development of its technologies to become self-evolving largely dependent on the amount of information it can access, analyze and use in several fields and different industries.
Safadi stressed that the fears of artificial intelligence come because today we can not imagine where artificial intelligence can reach?
Will it be for the good of mankind or will it be the cause of the annihilation of mankind?
He pointed out that a number of countries have sounded the alarm, for example, Italy issued a decision to ban the application of such as "Chat GB", for violating the privacy of minors by collecting data on them, calling for the existence of international legislation on the ethics of artificial intelligence to reduce the damage that can violate human rights and humanity, especially with regard to the bad use of humanity and humanity.
He pointed to the open letter signed by dozens of people working in the field of artificial intelligence last March, including billionaire Elon Musk, and called for a temporary halt to all efforts to develop more advanced versions of the current version of the chat robot ChatGB, until strict security measures are reached and implemented.
Safadi said: “With our reliance on technology and the Internet to a great extent today, and with this superior knowledge and ability to control industries by artificial intelligence technologies, we are facing a machine capable of, for example, manufacturing deadly biological and chemical weapons, developing DNA sequences, violating privacy, especially with deep counterfeiting able to create your identity and use it in many ways. seconds".
One of the most prominent figures who stressed the potential dangers of artificial intelligence systems, Jeffrey Hinton, a pioneer in the world of artificial intelligence, or as they like to call him "the father of artificial intelligence", said this year that despite the great benefits of artificial intelligence systems in all fields, including military and economic, he is concerned that these systems set themselves sub-goals that are not in line with the interests of their programmers.
Hinton, who has quit his job at Google, expressed concern about the catastrophic misuse of artificial intelligence systems by “malicious ” actors, he said,“ they may exploit artificial intelligence for bad purposes, ” and expressed concern about the negative effects on jobs in the labor market.
Dr. Jafar Al-Sarayreh, Director of the Consultancy and Training Center at Princess Sumaya University for Technology, stressed that a regulatory framework and procedures for the use of artificial intelligence must be developed, including a number of policies and laws governing the use of such technologies locally and globally, pointing out the importance of the participation of stakeholders in the development of this regulatory framework, including government, companies, academic institutions, civil society and experts in the field of artificial intelligence.
He pointed out that at the global level, there are initiatives and institutions working to develop regulatory frameworks for artificial intelligence, including the United Nations is developing global guidelines for artificial intelligence focusing on ethics, human rights, transparency and responsibility.
The Minister of Digital Economy and Entrepreneurship, Ahmed Al-Hananda, recently told Al-Ghad that "the government is following with interest the developments in the field of artificial intelligence, and is constantly working to empower society, the private sector and government institutions to benefit from all technical developments, including artificial intelligence, within the framework of the digital transformation process on which it is based.
He stressed that the government has been preparing for years to benefit from the developments of artificial intelligence by approving the Jordanian Artificial Intelligence Policy, the National Code of Ethics for Artificial Intelligence, the Jordanian Strategy for Artificial Intelligence and the Executive Plan (2023-2027), the project to measure the readiness of public sector institutions to adopt artificial intelligence, and technical cooperation with the Japan International Cooperation Agency.
Technical expert Hossam Khattab, described the technology of artificial intelligence as: "take away the hearts", and what one may notice at the moment that the term "has become marketing", and that all we see and hear about today is only devices that carry out automated tasks.
He pointed out that companies are racing to describe their products as relying on artificial intelligence, because it is a common technology and no one wants to be left behind.
For example, ChatGPT, which says, “still doesn ’ t work on AI in the big sense, ” in its case the machine doesn ’ t think, it receives commands, and decides on the optimal set of words to answer based on a large database it has been trained on.
Among Khattab, the types of artificial intelligence, the first of which is limited artificial intelligence Narrow AI: applications smart assistants such as Alexa, Siri and ChatGPT, applications that are programmed to carry out specific tasks, and do not have intelligence.
“The second type is general artificial intelligence: a machine understands and performs multiple tasks based on accumulated experience, which is similar to human intelligence.
The machine is conscious, analyzing and thinking, and it is unrealized in today ’ s products. ”
“The third type is super AI: in which the machine exceeds human intelligence in all areas and tasks, and the machine is able to learn and develop itself, which is a theoretical concept until this moment, ” Khattab said.
“We still have not dealt with machines that think independently of human intervention, self-develop, learn and excel at their programmer, and all the commercial applications available now revolve around the orbit of limited artificial intelligence, it is necessary to understand this fact, which is overlooked or overlooked by companies and people intentionally or unintentionally. ”
He pointed out: "The limited artificial intelligence is similar to the tasks that we previously carried out, but it has become faster automatically, and most of what we hear about falls under this category.
Either the machine thinks like humans, or they are smarter than humans, the concept does not yet have commercial applications, a reality that companies may have overlooked. ”
The General Manager of Pure Analysis for Management and Technology Consultancy, Dr. Moataz Mohammed Al-Dabai, said: “It is important to carefully consider the potential disadvantages of artificial intelligence and take steps to mitigate them and work to control its negative impact on humanity. ”
He called for a balance between the suitability of artificial intelligence and the need to maintain our cognitive abilities and self-sufficiency.
He pointed out that the main concerns in this area relate to the excessive reliance on artificial intelligence in the performance of life and professional work, which is likely to lead to the loss of our basic skills and lack of confidence in our human capabilities.
He pointed out that this could develop to the extent that it could lead to the loss of the ability to innovate and creative thinking and the inability of humanity to respond to special and unexpected circumstances.
He cited, for example, the increasingly widespread use of voice assistants, on which people may rely heavily for basic tasks such as reminding of appointments and tasks to be accomplished, such as making phone calls or ordering goods and services.
“This over-reliance on artificial intelligence could lead to a decline in communication and social skills, ” he said.
AI can be used to create personalized, highly targeted and personalized ads or content that can have a negative impact on mental health by promoting negative biases, stereotypes or insecurity.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Poses ethical risks
Becomes uncontrollable

What risks did Hinton associate with AI's rapid advancement?

What severe risks did the March 2024 report warn about advanced AI models?

Development of uncontrollable human-targeting weapons

Hinton’s main concerns fall into several interrelated categories that are widely understandable, even without a technical background.

Title:

Content: More Than Half of Americans Think AI Poses a Threat to Humanity

AI is the talk of the town these days. But despite the technology’s impressive accomplishments—or perhaps because of them—not all of that talk is positive. There was a New York Times tech columnist’s piece about his unsettling interaction with ChatGPT in February; an open letter calling for a moratorium on AI research in March; “godfather of AI” Geoffrey Hinton’s dramatic resignation from Google and warning about the dangers of AI; and just this week, OpenAI CEO Sam Altman’s testimony before Congress, in which he said his “worst fear is we cause significant harm to the world” and encouraged legislation around the technology (though he also argued that generative AI should be treated differently, which would be convenient for his company).

It seems these warnings (along with all the other media circulating on the topic) have reached the American public loud and clear, and people don’t quite know what to think—but many are getting nervous. A poll carried out last week by Reuters revealed that more than half of Americans believe AI poses a threat to humanity’s future.

The poll was conducted online between May 9 and May 15, with 4,415 adults participating, and the results were published yesterday. More than two-thirds of respondents expressed concern about possible negative impacts of AI, while 61 percent believe it could be a threat to civilization.

“It’s telling such a broad swatch of Americans worry about the negative effects of AI,” said Landon Klein, director of US policy at the Future of Life Institute, the organization behind the previously mentioned open letter. “We view the current moment similar to the beginning of the nuclear era, and we have the benefit of public perception that is consistent with the need to take action.”

One nebulous aspect of the poll, and of many of the headlines about AI we see on a daily basis, is how the technology is defined. What are we referring to when we say “AI”? The term encompasses everything from recommendation algorithms that serve up content on YouTube and Netflix, to large language models like ChatGPT, to models that can design incredibly complex protein architectures, to the Siri assistant built into many iPhones.

IBM’s definition is simple: “a field which combines computer science and robust datasets to enable problem-solving.” Google, meanwhile, defines it as “a set of technologies that enable computers to perform a variety of advanced functions, including the ability to see, understand and translate spoken and written language, analyze data, make recommendations, and more.”

It could be that peoples’ fear and distrust of AI comes partly from a lack of understanding of it, and a stronger focus on unsettling examples than positive ones. The AI that can design complex proteins may help scientists discover stronger vaccines and other drugs, and could do so on a vastly accelerated timeline.

In fact, biotechnology and medicine are two fields for which AI holds enormous promise, be it by modeling millions of proteins, coming up with artificial enzymes, powering brain implants that help disabled people communicate, or helping diagnose conditions like Alzheimer’s.

Sebastian Thrun, a computer science professor at Stanford who founded Google X, pointed out that there’s not enough public awareness of the potential for positive impact AI has. “The concerns are very legitimate, but I think what’s missing in the dialogue in general is why are we doing this in the first place?” he said. “AI will raise peoples’ quality of life, and help people be more competent and more efficient.”

While 61 percent of the poll’s respondents said AI could be a risk to humanity, only 22 percent said it won’t be a risk; the other 17 percent weren’t sure.

However, the (sort of?) good news is that AI isn’t the biggest thing Americans are losing sleep over. The top worry at the moment is, unsurprisingly, the economy (82 percent of respondents fear a looming recession), with crime coming in second (77 percent said they support increasing police funding to fight crime).

If an AI solution came along that could, say, point out economic strategies humans haven’t yet thought of, would that make people less wary of it?

Given everything else the tech can do, this doesn’t seem like such a long shot.

Image Credit: Google DeepMind / Unsplash

Vanessa Bates Ramirez
Vanessa is senior editor of Singularity Hub. She's interested in biotechnology and genetic engineering, the nitty-gritty of the renewable energy transition, the roles technology and science play in geopolitics and international development, and countless other topics.
RELATED
latest
Don't miss a trend
Get Hub delivered to your inbox

featured

First, he fears mass unemployment due to AI automating many jobs, which could cause major societal disruptions.

What risks did Hinton associate with AI's rapid advancement?

Second, he regrets aspects of his own life’s work because AI can be used to rapidly spread misinformation, making it much harder for people to agree on basic facts or trust public information.

Title:

Content: AI Godfather: Regret the development of AI caused the spread of false information
International 2023 / 05 / 03
Share:
Share:
AI expert Geoffrey Hinton, known as the "godfather of artificial intelligence (AI)", confirmed that he left Google last week, and confessed to regret the work of developing AI, worried that AI will cause a flood of false information, warning that AI may become smarter than humans.
It's...
Follow the latest financial news analysis, like hket Facebook

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

He also highlights the risk that very advanced AI models, if left unchecked, might eventually develop goals or behaviors that threaten humanity’s survival.

Title:

Content: Jeffrey Henton quits his job at Google.
He warns of the dangers of artificial intelligence.
2023 / 05 / 01 | 22: 17 - Source: CNN in Arabic
Jeffrey Hinton, nicknamed “the godfather of artificial intelligence, ” confirmed Monday that he left his role at Google last week to speak publicly about the“ risks ” of the technology he helped develop.
Note: The content titled Geoffrey Henton is quitting his job at Google.
He warns of the dangers of artificial intelligence) first published on the site (CNN in Arabic) and does not bear the encyclopedia of this day news content in any way.
You can see the details of this address: Jeffrey Henton resigns from his job at Google.
He warns of the dangers of artificial intelligence) through its original source (CNN in Arabic).
Continue reading on CNN in English

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Poses ethical risks
Becomes uncontrollable

What future risk did Hinton warn about AI?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

Hinton has said that AI’s risks could materialize even faster than those stemming from climate change, and that we may only have a short and closing window to act before potential harms become very difficult to control .

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Poses ethical risks
Becomes uncontrollable

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

Several specific issues feature prominently in Hinton’s warnings.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

He notes the danger of AI being weaponized, such as through the development of lethal autonomous weapons.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What dual impact did Hinton note AI could have in his 2021 speech?

What risks did Hinton associate with AI's rapid advancement?

What severe risks did the March 2024 report warn about advanced AI models?

Development of uncontrollable human-targeting weapons

There is also the challenge of AI being used to generate and spread fake content—deepfakes, false news articles, or manipulated videos—which could sway elections or escalate global conflicts.

Title:

Content: The ‘Godfather of AI’ warns about potential dangers of the technology as he quits Google

British-Canadian computer scientist Geoffrey Hinton admits he has fears for the future of AI

In a Frankenstein-esque tale of maker and master, Geoffrey Hinton, 75, dubbed ‘the godfather of AI’, has left Google with a parting warning over the dangers of artificial intelligence.

In 2012, the British-Canadian computer scientist invented technology with two students at University of Toronto that would become the intellectual foundation for AI systems. Google purchased the rights to this neural network tech to the tune of $44 million, which also propelled Dr Hinton to receive the Turing Award in 2018, considered the Nobel Prize of computing.

Read More
The ultimate part-AI girl? One Tatler correspondent entrusts ChatGPT with her next assignment

ChatGPT’s the new It Girl in Town and now she’s got all the gossip, writes Dora Davies-Evitt in the April issue

Yet now, Dr Hinton has packed in the day job at Google to join a chorus of anxious experts demanding a rollback of AI research until more robust safety measures are designed and deployed. Dr Hinton told the BBC: ‘Right now, they’re not more intelligent than us, as far as I can tell. But I think they soon may be.’

While many look upon AI as a natural technological development akin to the internet that could lead to exciting breakthroughs for humanity, there are growing fears that AI is a Pandora’s box. Reflecting on the effects of his work, Dr Hinton said: ‘I console myself with the normal excuse: If I hadn’t done it, somebody would have,’ as he admitted, ‘it is hard to see how you can prevent the bad actors from using it for bad things.’

Read More
Cyber Society: Meet the NFT duo dominating the metaverse

Old Etonian digital artists Dominic Smith and Joe Carnell have caught the attention of Brooklyn Beckham, Steve Aoki and Jaden Smith

The scientist went on to warn that AI could be taught to ‘create sub-goals like “I need to get more power”’, and be harnessed by nefarious actors to wreak havoc. With innovation driven forward by the unstoppable competition between behemoths like Google and Microsoft, Dr Hinton warned innovation will only increase exponentially in the coming years.

There are those who are trying to apply the brakes to this runaway train. In March, an open letter was signed by over 1,000 tech leaders and researchers, including Elon Musk and fellow Turing Award winner Yoshu Bengio, calling for a six-month moratorium on AI development. A few days later, 19 leaders of the Association for the Advancement of Artificial Intelligence released their own letter on the risks of AI. The signatures included that of Eric Horvitz, chief scientific officer at Microsoft.

The main outcry over AI lies in its ability to create and disseminate false news and images, which the public may find increasingly hard to identify. AI also poses a threat to academia and careers (see: Tatler’s foray into the world of ChatGPT). Dr Hinton believes that AI will fundamentally disrupt the workplace and take over the ‘drudge work’.

Read More
Lady Meta: my stratospheric rise through the metaverse

The Crypto Fashion Week debutante on becoming VR’s favourite It Girl

However Google’s chief scientist, Jeff Dean, offered words of comfort, adding: 'We remain committed to a responsible approach to AI. We’re continually learning to understand emerging risks while also innovating boldly.’

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn "bad actors" could use AI for?

To win wars or manipulate the electorate.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

Hinton also points to a technical problem known as "hallucination," where powerful AI systems generate answers that seem plausible but are actually false, thereby eroding trust in online information.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What is the AI problem called confabulation, according to Hinton?

It's when AI makes up plausible answers to questions it can't answer.

What risks did Hinton associate with AI's rapid advancement?

A major theme is that as AI learns from vast amounts of human data, it could become skillful at manipulating or misleading people, potentially even escaping the controls set by its designers if left unsupervised .

Title:

Content: Expert: AI poses serious risk to global health and security China ’ s credit monitoring system oppresses people
A group of doctors and medical experts have urged the urgent need for an international treaty on AI regulation.
A group of doctors and public health experts have joined calls to suspend development of artificial intelligence until sufficient regulations are in place.
Source: SBS
Key points:
• A new study says the development of artificial intelligence could lead to the emergence of autonomous weapons capable of killing people “on an industrial scale. ”
The study ’ s authors also warn that the loss of jobs could have an impact on human health as more types of work are automated.
• The authors also warn that powerful AI-powered surveillance systems could be used to oppress people.
A group of doctors and public health experts say the development of artificial intelligence (AI) needs to be put on hold because it poses a risk to public health and safety.
According to a study published in the open journal BMJ Global Health, AI could facilitate the development of autonomous weapons capable of killing people “on an industrial scale ” without human supervision.
The study ’ s authors, David McCoy and Frederik Federspiel, say governments can also use AI to create powerful surveillance systems that can spread misinformation and social divisions, manipulate consumer choices, and even fuel government oppression.
"We do need an international treaty and a global regulatory approach," McCoy, a professor at the United Nations University in Malaysia, a United Nations General Assembly affiliated research institute and author of the study, told SBS News.
"The UN and governments are really critical to any form of effective regulation to prevent the misuse of AI," he said.
More than 75 countries or regions are currently using AI for surveillance.
Given the link between unemployment and “adverse health outcomes and behaviors, ” the study ’ s authors also warn of the health implications of unemployment as AI facilitates the automation of more types of work.
The creators of AI boast about its transformative potential, including in medicine and public health, but doctors are joining calls to stop developing AI until regulation can keep up with its progress.
How does artificial intelligence enable weapons development?
The authors of the study warn that artificial intelligence has enabled the development of lethal autonomous weapons systems (LAWS) to locate, select and attack human targets, all without human oversight.
"In theory, you could produce a van with hundreds of thousands of small autonomous weapons that could be targeted in a more discriminating way," Professor McCoy said.
The technology for this highly lethal weapon is relatively cheap, he added.
“We don ’ t know exactly who owns this technology or who is developing it.
“But I think it ’ s fair to say that there are governments around the world developing this technology, ” he said.
In 2021, the United Nations held talks on autonomous weapons, which did not start negotiations on an international treaty governing their use, but only agreed to continue discussions.
How does artificial intelligence contribute to the misuse of personal data?
The authors of the study say artificial intelligence has the ability to quickly clean up, organize and analyze massive data sets made up of personal data, including images.
They pointed to the role of AI in subverting democracy in the 2013 and 2017 Kenyan elections, the 2016 US presidential election, and the 2017 French presidential election.
“When combined with a rapidly improving ability to distort or distort reality, AI-powered information systems could further undermine democracy, cause a general breakdown of trust, or drive social divisions and conflict, with consequent public health implications, ” the authors said.
They argue that AI-driven surveillance could also be used by governments to oppress people more directly, such as China ’ s social credit system.
China ’ s social credit system, which combines facial recognition software with analysis of people ’ s financial transactions, activities, police records and social relationships, essentially allows the Chinese government to use a set of incentives and penalties to shape the behavior of its people.
Last week, Geoffrey Hinton, a pioneering computer scientist hailed as the “godfather of artificial intelligence, ” said he had left Google to talk freely about the dangers of the technology after realising that computers could become smarter than people faster than he and other experts expected.
In an interview with The New York Times, Hinton said he was concerned about the ability of AI to create convincing false images and texts, thereby creating a world where people "can no longer know what is real."
"It's hard to see how to prevent bad people from using it to do bad things," he said.
Download the app SBS Audio and follow Mandarin. You can also listen to and download SBS Mandarin audio stories anytime via Apple Podcast, Google Podcast, Spotify and other podcast platforms.
Please follow SBS Chinese for more Australian news.
Share
Published 10 May 2023 6: 18pm
By Madeleine Wedesweiler
Source: SBS
Available in other languages
Labels

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Poses ethical risks
Becomes uncontrollable

What risks did Hinton associate with AI's rapid advancement?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

Hinton’s decision to leave Google and speak out was particularly influential because he did not fit the stereotype of a fringe critic; he is, rather, the respected originator of many of the technologies now at center stage.

Why did Hinton leave Google when he helped develop AI but later grew concerned about its dangers?

The authority and urgency of his message contributed to mainstream and policy conversations about how best to manage AI’s risks.

For example, he asserted that the risks from advanced machine intelligence might even surpass the timeline of climate change and that society had relatively little time to organize effective responses .

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

Within the AI research community and technology sector, Hinton’s warnings reignited longstanding debates about the safest path forward.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

Several prominent experts, including Yoshua Bengio (a fellow Turing Award recipient) and Stuart Russell (an AI ethics researcher), echoed his belief that there are serious existential risks tied to rapidly advancing artificial intelligence.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

Some voices, notably Elon Musk, have called for a temporary halt in training more advanced AI systems to allow regulation to catch up, though Hinton himself did not favor an outright pause.

Title:

Content: My channel
* Drag categories can be customized sorting
Recover Default OK
Setup
Alert
The Senate Judiciary Committee held a hearing on five Supreme Court ethics concerns.
New York City Council Protests to Abolish 24-hour Work
The godfather of AI leaves Google worried that artificial intelligence will fall into the wrong hands
The US media reported today that Hinton, known as the “godfather of AI ”, resigned his job at Google and openly talked about the risks of AI, worried that AI would fall into the wrong hands.
He says it ’ s hard to see how to prevent bad people from using it to do bad things.
Geoffrey Hinton, who laid the groundwork for artificial intelligence (AI) systems, told The New York Times that advances in AI pose “great risks to society and humanity. ”
In a report published today in The New York Times, Hinton was quoted as saying, “Look at how it looked five years ago and now, the difference and growth, it ’ s really scary. ”
Hinton pointed out that competition among tech giants is driving these companies to release new AI technologies at a dangerous rate, which will endanger people ’ s jobs and spread misinformation.
"It's hard to see how you can prevent bad people from using AI to do bad things," he told the New York Times.
OpenAI, the startup behind Google and now the most powerful AI chatbot, ChatGPT, began developing systems with more data than ever before in 2022.
Hinton told the New York Times that he believes these systems are surpassing human intelligence in some ways because of the sheer volume of data they analyze.
"Perhaps these systems are already more powerful than the human brain," he said.
While AI has been used to support human needs for work, the rapid development of chatbots like ChatGPT could leave human jobs in jeopardy.
He told the New York Times that AI was “taking on a chore, ” but that“ it ’ s probably going to do more than that. ”
Hinton also warned that AI could spread the wrong message, telling the New York Times that the average person would “never know what ’ s true again. ”
According to the New York Times, Hinton submitted his resignation to Google last month.
Google ’ s head of AI, Jeff Dean, expressed his gratitude to Hinton in a statement to the US media.
“As one of the first companies to publish AI principles, we remain committed to taking a responsible approach to AI, ” the statement added.
“While we innovate boldly, we are constantly discovering new risks. ”
Tech billionaire Elon Musk and many experts have called for a pause in the development of AI systems to allow time to ensure the technology is safe.
After the introduction of GPT-4, which is more powerful than the AI used by ChatGPT, Musk and Apple co-founder Steve Wozniak signed an open letter.
Hinton, who was not involved in the petition, told the New York Times that scientists should not “further scale research and development ” until they understood if they could control AI.
The New York Times Google
The last one.
The Senate Judiciary Committee held a hearing on five Supreme Court ethics concerns.
The next one.
Equal request?
US asks Chinese airlines not to fly over Russian airspace
Extended reading
Super-popular
More >

Instead, he argued strongly for robust global regulation and increased public awareness of AI’s power and pitfalls.

Why did Hinton leave Google when he helped develop AI but later grew concerned about its dangers?

Hinton believes that regulatory approaches must become just as innovative and globally coordinated as the technology itself, especially given fierce competition between major companies and nations .

Reactions to Hinton’s warning have been varied among experts and the public.

Many researchers and policymakers agree that AI represents an unprecedented challenge that could bring major benefits and risks, and that failing to prepare would be irresponsible.

Title:

Content: Report highlights the seriousness of artificial intelligence and warns of the threat of human extinction with a call for America to intervene
The world.
Publish
9 minutes read
(CNN) -- A new report commissioned by the State Department paints a worrying picture of the "catastrophic" national security risks posed by rapidly evolving artificial intelligence and warns the federal government is running out of time to avert disaster.
The findings were based on interviews with more than 200 people over more than a year, including senior executives from leading AI companies, cybersecurity researchers, weapons of mass destruction experts, and national security officials within the government.
The report, released this week by AI Gladstone, categorically suggests that more advanced AI systems could, in the worst case scenario, “pose an extinction-level threat to the human race. ”
The US State Department did not respond to a request for comment.
The warning in the report is another reminder that while the potential of AI continues to captivate investors and the public, there are real risks as well.
Jeremy Harris, CEO and co-founder of Gladstone AI, told CNN on Tuesday: “Artificial intelligence is already an economically transformative technology.
It can allow us to cure diseases, make scientific discoveries, and overcome challenges we once thought insurmountable. ”
"But it could also bring serious risks, including catastrophic risks, that we should be aware of."
“A growing body of evidence – including empirical research and analysis published at the world ’ s most important AI conferences – suggests that above a certain threshold of capability, AI systems are likely to become out of control. ”
White House spokeswoman Robin Patterson said President Joe Biden ’ s executive order on AI was “the most significant action any government in the world has taken to deliver on the promise and manage AI risk. ”
“The President and Vice President will continue to work with our international partners and urge Congress to pass bipartisan legislation to manage the risks associated with these emerging technologies, ” Paterson said.
A clear and urgent need to intervene
Researchers warn of two major dangers posed by large-scale artificial intelligence.
First, Gladstone AI said the most advanced AI systems could be armed to cause irreparable damage.
Second, there are particular concerns within AI labs that they may at some point “lose control ” over the very systems they are developing, with“ potentially devastating consequences for global security. ”
"The rise of artificial intelligence and artificial general intelligence has the potential to destabilize global security in ways reminiscent of the introduction of nuclear weapons," the report said, adding that there is a risk of an AI "arms race", conflict and "deadly accidents the size of weapons of mass destruction."
The Gladstone AI report calls for radical new steps aimed at countering this threat, including the launch of a new AI agency, the imposition of “emergency ” regulatory safeguards and restrictions on how much computer power can be used to train AI models.
The authors wrote in the report: "There is a clear and urgent need for the intervention of the United States government."
The report notes that although the work was produced for the State Department, its views “do not reflect the views ” of the agency or the U.S. government in general.
A government notice issued in 2022 by the State Department ’ s Nonproliferation and Disarmament Fund Office shows that the government is offering to pay up to $250,000 for an assessment of “proliferation and security risks ” associated with advanced AI.
Safety Concerns
Harris, Gladstone ’ s executive director of artificial intelligence, said his team ’ s “unprecedented level of access ” to public and private officials had led to startling conclusions.
Gladstone AI said it spoke to technical and leadership teams from chat owner OpenAI, Google DeepMind, Facebook parent company Meta and Anthropic.
In a video posted on Gladstone AI ’ s website announcing the report, Harris said: “Along the way, we ’ ve learned some disturbing things.
Behind the scenes, the safety and security situation in advanced AI seems largely inadequate compared to the national security risks that AI may soon pose somewhat. ”
The Gladstone AI report said competitive pressures were driving companies to accelerate AI development “at the expense of safety and security, ” increasing the likelihood that more advanced AI systems would be“ stolen ” and “weaponized ” against the United States.
The findings add to a growing list of warnings about the existential risks posed by AI — including from even some of the industry ’ s most powerful figures.
Nearly a year ago, Jeffrey Hinton, known as the “godfather of artificial intelligence, ” quit his job at Google and sounded the alarm about the technology he helped develop.
Hinton said there is a 10% chance that artificial intelligence will lead to human extinction within the next three decades.
Hinton and dozens of AI industry leaders, academics and others signed a statement in June saying that “mitigating the extinction risk of AI must be a global priority. ”
Business leaders are increasingly concerned about these risks – even as they invest billions of dollars in AI.
Last year, 42% of CEOs surveyed at last year ’ s Yale CEO Summit said AI has the potential to destroy humanity five to ten years from now.
abilities similar to human abilities to learn.
Gladstone AI in its report pointed to some prominent individuals who have warned about the existential risks posed by artificial intelligence, including Elon Musk, Federal Trade Commission Chairman Lena Khan, and a former senior executive at OpenAI.
Some employees at AI companies share similar concerns privately, according to Gladstone AI.
“An individual at one of the well-known AI labs expressed the view that if a specific next-generation model of AI were launched without access restrictions, it would be ‘ very bad ’, because the model ’ s potentially convincing ability could ‘ break democracy ’ if leveraged in areas such as election interference or voter manipulation, ” the report said.
Gladstone said she had asked AI experts in some labs to share their personal estimates privately about the likelihood that an AI incident could lead to “irreversible global effects ” in 2024.
Estimates ranged from 4 percent to as much as 20 percent, according to the report, which notes that the estimates were informal and likely to be heavily biased.
One of the biggest surprises is how quickly artificial intelligence is evolving — specifically artificial general intelligence (AGI), a hypothetical form of artificial intelligence that has a human-like or even superhuman learning ability.
The report says AI is seen as “the main driver of catastrophic risks caused by loss of control, ” and notes that OpenAI, Google DeepMind, Anthropic, and Nvidia have all publicly stated access to AI by 2028 — though others believe it ’ s far beyond.
Gladstone AI points out that disagreements over AI timelines make it difficult to develop policies and safeguards, and there is a risk of a slowdown in regulation as technology evolves.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

On the other hand, some experts are less concerned about existential threats, arguing that AI systems remain tools at the mercy of human oversight and design.

What about AI makes regulation seen as premature, leading few countries to act despite global calls?

What does AI expert, Yann LeCun, say about doomsday warnings regarding AI?

This skeptic group stresses that, despite the eye-catching potential of AI, issues of control and alignment are fundamentally under human governance.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

Nevertheless, the conversation about AI safety, job losses, and regulatory gaps has moved closer to the center of public policy and media reporting than ever before .

Title:

Content: Skip to main contentSkip to navigation

UK and US intervene amid AI industry’s rapid advances

Competition and Markets Authority sends ‘pre-warning’ to sector, while White House announces measures to address risks

The UK and US have intervened in the race to develop ever more powerful artificial intelligence technology, as the British competition watchdog launched a review of the sector and the White House advised tech firms of their fundamental responsibility to develop safe products.

Regulators are under mounting pressure to intervene, as the emergence of AI-powered language generators such as ChatGPT raises concerns about the potential spread of misinformation, a rise in fraud and the impact on the jobs market, with Elon Musk among nearly 30,000 signatories to a letter published last month urging a pause in significant projects.

The UK Competition and Markets Authority (CMA) said on Thursday it would look at the underlying systems – or foundation models – behind AI tools. The initial review, described by one legal expert as a “pre-warning” to the sector, will publish its findings in September.

On the same day, the US government announced measures to address the risks in AI development, as Kamala Harris, the vice-president, met chief executives at the forefront of the industry’s rapid advances. In a statement, the White House said firms developing the technology had a “fundamental responsibility to make sure their products are safe before they are deployed or made public”.

The meeting capped a week during which a succession of scientists and business leaders issued warnings about the speed at which the technology could disrupt established industries. On Monday, Geoffrey Hinton, the “godfather of AI”, quit Google in order to speak more freely about the technology’s dangers, while the UK government’s outgoing scientific adviser, Sir Patrick Vallance, urged ministers to “get ahead” of the profound social and economic changes that could be triggered by AI, saying the impact on jobs could be as big as that of the Industrial Revolution.

Sarah Cardell said AI had the potential to “transform” the way businesses competed, but that consumers must be protected.

The CMA chief executive said: “AI has burst into the public consciousness over the past few months but has been on our radar for some time. It’s crucial that the potential benefits of this transformative technology are readily accessible to UK businesses and consumers while people remain protected from issues like false or misleading information.”

ChatGPT and Google’s rival Bard service are prone to delivering false information in response to users’ prompts, while concerns have been raised about AI-generated voice scams. The anti-misinformation outfit NewsGuard said this week that chatbots pretending to be journalists were running almost 50 AI-generated “content farms”. Last month, a song featuring fake AI-generated vocals purporting to be Drake and the Weeknd was pulled from streaming services.

The CMA review will look at how the markets for foundation models could evolve, what opportunities and risks there are for consumers and competition, and formulate “guiding principles” to support competition and protect consumers.

The leading players in AI are Microsoft, ChatGPT developer OpenAI – in which Microsoft is an investor – and Google parent Alphabet, which owns a world-leading AI business in UK-based DeepMind, while leading AI startups include Anthropic and Stability AI, the British company behind Stable Diffusion.

Alex Haffner, competition partner at the UK law firm Fladgate, said: “Given the direction of regulatory travel at the moment and the fact the CMA is deciding to dedicate resource to this area, its announcement must be seen as some form of pre-warning about aggressive development of AI programmes without due scrutiny being applied.”

In the US, Harris met the chief executives of OpenAI, Alphabet and Microsoft at the White House, and outlined measures to address the risks of unchecked AI development. In a statement following the meeting, Harris said she told the executives that “the private sector has an ethical, moral, and legal responsibility to ensure the safety and security of their products”.

The administration said it would invest $140m (£111m) in seven new national AI research institutes, to pursue artificial intelligence advances that are “ethical, trustworthy, responsible, and serve the public good”. AI development is dominated by the private sector, with the tech industry producing 32 significant machine-learning models last year, compared with three produced by academia.

Leading AI developers have also agreed to their systems being publicly evaluated at this year’s Defcon 31 cybersecurity conference. Companies that have agreed to participate include OpenAI, Google, Microsoft and Stability AI.

“This independent exercise will provide critical information to researchers and the public about the impacts of these models,” said the White House.

Robert Weissman, the president of the consumer rights non-profit Public Citizen, praised the White House’s announcement as a “useful step” but said more aggressive action is needed. Weissman said this should including a moratorium on the deployment of new generative AI technologies, the term for tools such as ChatGPT and Stable Diffusion.

“At this point, Big Tech companies need to be saved from themselves. The companies and their top AI developers are well aware of the risks posed by generative AI. But they are in a competitive arms race and each believes themselves unable to slow down,” he said.

The EU was also told on Thursday that it must protect grassroots AI research or risk handing control of the technology’s development to US firms.

In an open letter coordinated by the German research group Laion – or Large-scale AI Open Network – the European parliament was told that one-size-fits-all rules risked eliminating open research and development.

“Rules that require a researcher or developer to monitor or control downstream use could make it impossible to release open-source AI in Europe,” which would “entrench large firms” and “hamper efforts to improve transparency, reduce competition, limit academic freedom, and drive investment in AI overseas”, the letter said.

“Europe cannot afford to lose AI sovereignty. Eliminating open-source R&D will leave the European scientific community and economy critically dependent on a handful of foreign and proprietary firms for essential AI infrastructure.”

The largest AI efforts, by companies such as OpenAI and Google, are heavily controlled by their creators. It is impossible to download the model behind ChatGPT, for instance, and the paid-for access that OpenAI provides to customers comes with a number of legal and technical restrictions on how it can be used. By contrast, open-source efforts involve creating a model and then releasing it for anyone to use, improve or adapt as they see fit.

“We are working on open-source AI because we think that sort of AI will be more safe, more accessible and more democratic,” said Christoph Schuhmann, the organisational lead at Laion.

More on this story

More on this story

  • US aims to tackle risk of uncontrolled race to develop AI

  • EU urged to protect grassroots AI research or risk losing out to US

  • UK competition watchdog launches review of AI market

  • AI ‘could be as transformative as Industrial Revolution’

  • Chatbot ‘journalists’ found running almost 50 AI-generated content farms

  • ‘Godfather of AI’ Geoffrey Hinton quits Google and warns over dangers of misinformation

  • AI has better ‘bedside manner’ than some doctors, study finds

  • Fresh concerns raised over sources of training material for AI systems

Most viewed

Most viewed

What risks did Hinton associate with AI's rapid advancement?

Hinton’s departure drew broader public and governmental attention.

The White House, for example, convened leading tech executives to discuss AI’s risks.

Legislators and policymakers in the US and Europe began regulatory reviews, considering new laws, external safety tests, and independent audits of advanced systems.

Title:

Content: Mark Woods: Is orange the color of progress on Jacksonville riverfront? Let's hope so.
GUEST

Retired engineering dean: Urgent steps needed to mitigate catastrophic potential of AI

Dr. Suresh Chandra
Guest columnist

In historical terms, not many topics have attracted as much attention as artificial intelligence has in the past year. Catastrophic predictions by experts in this revolutionary field have propelled them to urge governments and technology corporations to urgently put in place regulations and guidelines to ensure that pernicious effects of AI are avoided.

Geoffrey Hinton, “the godfather of AI,” recently made headlines as he left Google after a long association so he could sound the alarm about AI’s ability to outsmart humans and spawn devastating problems for mankind’s existence. Sam Altman, CEO of ChatGPT maker OpenAI, appeared before the U. S. Congress in May and articulated the same concern. He has recently embarked on a whirlwind tour of Asian and European countries to share his anxiety regarding AI and recommend urgent action in his meetings with political and technical leaders there.

Altman is one of the dozens of top experts and industry leaders to warn about the existential threat to humanity presented by AI in the next five to 10 years. They strongly feel that “mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war.”

JU law dean:The classic conundrum presented by ChatGPT, especially in academia

More:AI firm to map Jacksonville inch-by-inch. How might its findings affect homeowners' bills?

Letters:Why won’t Gov. DeSantis talk about his Navy service at Guantanamo prison?

This also reflects the view of a large number of participants in the Yale CEO Summit in June.

In May top U.S. and European officials met in Sweden to discuss oversight of AI and pledged to help establish voluntary codes of conduct. The European Union plans to place new requirements on high-risk AI in socioeconomic processes, the government use of AI and the regulated consumer products with AI systems.

Unfortunately the U. S. Congress, despite dire warnings, has been reluctant to come up with needed legislation for fear of alienating key corporations. Not surprisingly, some prominent U.S. corporations have expressed reservations about the drastic steps that the European Union has decided to implement.

The rise of AI has led many economists to issue stern warnings regarding our labor market. As many as 300 million jobs around the world could eventually be automated, according to Goldman Sachs. Some 14 million positions could disappear in the next five years alone. Even the jobs that survive will quite possibly not look much like the jobs of today.

Other potentially harmful outcomes include social surveillance (gathering data on citizens’ activities, relationships and political views), widening socioeconomic inequality, autonomous weapons powered by AI, financial crises brought about by AI algorithms and ransom/extortion threats through manipulation of voice and photos.

The beneficial impact of AI technology in the past decade is manifest in smartphone photos; facial recognition software; numerous medical applications, such as analyzing MRI scans, spotting lung cancer or managing mental health issues; understanding by farmers of crop yields; popular apps like Google Maps; use of speech recognition to translate words from one language to another; advances in social networks (Facebook, Instagram, Twitter, Amazon’s Alexa, Apple’s Siri and Google Assistant); and creating musical compositions or paintings.

Inevitably, AI technology is expected to bring more opportunities in jobs and industries that weren’t previously possible. Thus, one of the most promising aspects of AI is expected to be our entry into a golden age of human possibility, technological development and economic growth.

The above-stated amazing AI-related progress notwithstanding, the potential for destruction of the societal structure is a grave threat and must be avoided. It is imperative that the world develop national and international regulations for AI without delay. The creation of organizational standards for applying AI, making it part of company culture and discussions — as well as infusing humanities perspectives in technology development — are part of this all-important process.

Suresh Chandra, Ph.D., is professor emeritus and former dean of the College of Engineering at North Carolina A&T State University. He lives in Ponte Vedra.

This guest column is the opinion of the author and does not necessarily represent the views of the Times-Union. We welcome a diversity of opinions.

Media coverage grew more urgent, driven partly by the credibility and expertise of Hinton.

Discussions now regularly focus on how to design artificial intelligence that is beneficial rather than harmful, and how societies can adapt to the pace of technological progress .

The general public has become increasingly anxious about the impact of AI, as reflected in opinion polls indicating that more than half of Americans worry AI could pose significant risks to humanity.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

Mainstream media, podcasts, and social networks debate themes of job displacement, misinformation, privacy, and the challenge of keeping AI development ethically aligned with human interests.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

Hinton’s “passing the torch” by leaving Google and speaking freely acted as a milestone event, amplifying the urgency and seriousness with which AI’s future is now being discussed at all levels of society .

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

Why did Hinton leave Google when he helped develop AI but later grew concerned about its dangers?

In summary, Geoffrey Hinton’s warnings matter because they come from one of the most influential figures responsible for today’s AI technologies.

Title:

Content: The godfather of AI quit Google's job, worried that artificial intelligence fell into the wrong hands
WASHINGTON (AFP) - The US media reported today that Hinton, known as the "godfather of AI", resigned his job at Google to talk openly about the risks of AI and worry that AI will fall into the wrong hands.
He said that it is difficult to see how to prevent bad people from using it to do bad things.
Advertisement
Geoffrey Hinton, who laid the groundwork for artificial intelligence (AI) systems, told The New York Times that advances in AI pose “great risks to society and humanity. ”
In a report published today in the New York Times, Hinton was quoted as saying, “Look at what it looked like five years ago and now, and the difference and growth, it ’ s really scary. ”
Hinton pointed out that competition among tech giants has prompted these companies to release new AI technologies at a dangerous rate, which will endanger people ’ s jobs and spread misinformation.
"It's hard to see how you can prevent bad people from using it (AI) to do bad things," he told the New York Times.
OpenAI, the startup behind Google and now the most powerful AI chatbot, ChatGPT, began using more data than ever before to develop systems in 2022.
Hinton told the New York Times that he believes these systems are surpassing human intelligence in some ways because of the sheer volume of data they analyze.
"Perhaps these systems are already stronger than the human brain," he said.
While AI has been used to support human needs for work, the rapid development of chatbots like ChatGPT could put human jobs at risk.
He told the New York Times that AI is “taking on a chore, ” but“ it ’ s probably going to do more than that. ”
Hinton also warned that AI could spread false information, telling the New York Times that the average person would “no longer know what ’ s true. ”
According to the New York Times, Hinton tendered his resignation to Google last month.
Google ’ s head of AI, Jeff Dean, thanked Hinton in a statement to the US media.
"As one of the first companies to publish AI principles, we remain committed to taking a responsible approach to AI," the statement added.
"While we are bold and innovative, we are constantly discovering new risks."
Tech billionaire Elon Musk and many experts have called for a moratorium on the development of AI systems to allow time to ensure the technology is safe.
After the launch of the GPT-4, which is more powerful than the AI used by ChatGPT, Musk and Apple co-founder Steve Wozniak signed an open letter.
Hinton, who was not involved in the petition, told the New York Times that scientists shouldn ’ t “further scale research and development ” until they know if they can control AI.

His concerns highlight tangible, understandable risks including job loss, the spread of misinformation, the potential for misuse of AI, and broader existential threats if development moves faster than society’s capacity to adapt.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Poses ethical risks
Becomes uncontrollable

What risks did Hinton associate with AI's rapid advancement?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

The attention drawn to these issues by Hinton has spurred renewed debate among researchers, policymakers, and the public, prompting consideration of stronger safety measures, regulatory frameworks, and a wider dialogue about the ethics and direction of artificial intelligence.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

For college students and the broader public, Hinton’s story is a cautionary lens through which to view the future of AI: a field offering tremendous opportunity, but one that demands serious reflection and responsible stewardship to avoid unintended harm .

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Poses ethical risks
Becomes uncontrollable