Geoffrey Hinton is a renowned AI researcher known as the "godfather of AI" for his work on neural networks and deep learning.

He has made significant contributions to the development of artificial neural networks, which underpin systems like ChatGPT and Google's Bard.

Hinton's work on backpropagation was a crucial development in artificial intelligence.

He was awarded the 2018 Turing Award, along with Yann LeCun and Yoshua Bengio, for his contributions to neural networks and deep learning.

Hinton warns that AI poses existential threats to humans and advocates for regulation to mitigate its harms.

He has expressed concerns about AI replacing jobs, spreading false information, and being used for malicious purposes.

Hinton's warnings about AI's potential dangers have been echoed by many other experts.

Experts like Yoshua Bengio have expressed concerns about AI's potential dangers and advocate for responsible development.

Developing AI that surpasses human cognition poses significant societal risks, including job displacement and unintended consequences.

AI systems can be biased, discriminatory, and used for harmful purposes.

Experts call for international AI ethics legislation to prevent potential threats.

Developing artificial general intelligence (AGI) poses risks, including potentially becoming uncontrollable through self-redesign.

Ensuring ethical AI development is critical, as AI can automate tasks but lacks logical reasoning, adaptability, and emotional intelligence.

Organizations like OpenAI are researching and developing safety measures to ensure responsible and beneficial AI development.

Regulatory frameworks are necessary for the responsible development of AI, and at least one third of AI funding should go to safety and ethics.

The public should understand that AI requires careful management and regulation for responsible and safe use.

Geoffrey Hinton is a renowned AI researcher known as the "godfather of AI" for his work on neural networks and deep learning.

Title:

Content: Yoshua Bengio

1 minute read
By Geoffrey Hinton

Yoshua Bengio is a world leader in AI. Throughout his career, Yoshua’s research has been instrumental in shaping the world’s understanding of AI’s potential—and that same expertise has made his perspective more essential than ever. His pioneering research on deep learning laid the foundations for the current revolution in AI and earned him the 2018 Turing Award—“the Nobel Prize of Computing”—alongside myself and Yann LeCun. Last year, Yoshua received Canada’s highest award for research, the Gerhard Herzberg Canada Gold Medal. He is the computer scientist with the greatest number of citations and is ranked third among all disciplines for scientific impact.

Yoshua has been concerned for many years with the social impact of artificial intelligence, contributing to the Montreal Declaration for the Responsible Development of AI. Over the past year, worried by the potential for catastrophic outcomes from future AI, he was vocal in global conversations on AI safety. He advised the U.N. Secretary-General and the U.K. AI Safety Institute, and took part in policy discussions with governments in North America, Asia, and Europe.

Hinton is a cognitive psychologist and computer scientist

More Must-Reads From TIME

Contact us at letters@time.com

What breakthroughs has Hinton achieved through his 40+ years of work on artificial neural networks?

Breakthroughs that mimic biological brains

He has made significant contributions to the development of artificial neural networks, which underpin systems like ChatGPT and Google's Bard.

Title:

Content: • |
• Fast Quote
• |
• Member
• Product Services / Streaming
• Settings
12 / 05 / 2023
The White House ordered AI to be evaluated, and the European Union proposed legislation to regulate AI, teach AI to be human or the best solution!
• Add Favorite Column
• Collection of articles
• Fang Zhanqi
Fang Zhanze
When I was a teenager, I studied Geographic Information System, but unfortunately I didn ’ t learn anything and I graduated with luck.
After adulthood, the accidental hit into the media circle, first and then in the print, electronic, online media to roll, slightly small.
After middle age, he completed a master ’ s degree in information technology and gradually expanded his horizons. He was determined to join a start-up company and explore different fields of technology.
In recent years, he has been actively engaged in data analysis and digital strategies, and has also been involved in the development of Location Intelligence projects. Sometimes, he can also take time to teach, not only to share what he has learned with others, but also to motivate himself to keep learning for life.
Tales of Wisdom City
Generative AI is definitely the hottest topic in the technology world today. After the popularity of ChatGPT, many companies rushed to launch similar products and gradually applied them to various industries.
But more and more people are worried that when AI is fully popularized, it will aggravate the problem of fake information flow, online fraud and other problems; even Sheffield Hinton, who is known as the "godfather of AI", is worried that AI will become too smart, afraid that it will evolve into a killer robot, which may eventually lead to the death of mankind!
How big can the negative impact of AI technology be?
How do governments around the world respond to the potential threat of AI?
Neural network is the foundation technology of ChatGPT
Fifty-one years ago, Geoffrey Hinton, who had not yet been called the “godfather of AI, ” entered the University of Edinburgh in Scotland as a graduate student and began research on artificial neural networks.
The so-called “artificial neural network ” is a mathematical model that mimics the structure and function of biological neural networks, especially the brain, and is able to learn skills by analyzing data.
This is the foundational technology behind OpenAI ChatGPT and Google Bard.
After Hinton resigned from Google, he did not have to worry about the harm his words would bring to Google, so he was interviewed by different media and said his heart: "AI may lead to the death of mankind." (Photo: University of Toronto official website)
In 2012, Hinton and his students, Ilya Sutskever and Alex Krishevsky, created a neural network system that analyzes thousands of photos and learns to recognize common things like flowers, dogs, cars, etc.
Subsequently, Hinton and two students founded DNNresearch, a startup based on this research project.
In 2013, Google acquired DNNresearch for US $44 million (approximately HK $343 million), and Hinton joined Google as Vice President and Engineering Researcher, responsible for some of the research work on Google Brain.
His protégé, Suzkville, left Google to co-found OpenAI with like-minded people, and became chief scientist, leading the research team to successfully develop the GPT model and ChatGPT.
Hinton ’ s top student, Suzkville, gave up his lucrative job at Google in 2015 to co-found OpenAI with Altman and others, and led the development of GPT and DALL-E models. (Image: University of Toronto website)
I regret working my whole life because I am worried about the dangers of AI.
In 2018, Hinton, along with University of Montreal professor Yoshua Bengio and Meta chief AI scientist Yann LeCun, won the A.M. Turing Award in recognition of their great contributions to neural networks and deep learning.
As a result, the three later became known as the “godfathers of AI ” or“ godfathers of deep learning. ”
Around the same time, Google and OpenAI began to build large-scale deep learning systems based on neural networks, which became the basis for future development of Bard and ChatGPT.
From this, it seems that Sinton plays an important role in creating the current glory of generative AI.
However, in the current era of AI, Sinton suddenly left Google in April 2023, shocking the entire AI industry.
Hinton explained that he left Google to talk freely about the potential risks of AI without harming Google.
Speaking about 50 years of research into neural networks, he said, “I ’ m very sorry about my life ’ s work. ”
The Internet will be filled with more and more fake AI-generated text, photos, and even videos, but the average person will not be able to tell the truth, Hinton said.
Moreover, sooner or later, AI technology will completely disrupt the job market, causing more and more jobs to disappear.
What is even more worrying is that at present, users can not only instruct ChatGPT to generate code, but also ask the AI to execute the code; in this way, the AI killer robots that often appear in science fiction movies will one day become a reality.
Is it not impossible for AI to destroy humanity?
Of course, this pessimistic future scenario is only a hypothetical one, but Hinton stressed that what could lead to it is already happening: a global race for AI technology has begun between Microsoft and Google, and even between China and the United States.
Most people think that the future of AI dominating everything is still far away, but he believes that AI may not take 30 to 50 years to control humans, and even find a way to kill humans, which may eventually lead to human extinction.
In the 1980s, Hinton was a professor of computer science at Carnegie Mellon University in the United States, but because he was not satisfied that the university's AI research was sponsored by the United States Department of Defense, he decided to leave the United States to teach at the University of Toronto's School of Computer Science.
He pointed out that without some kind of global regulatory agreement or regulatory mechanism, the AI arms race will intensify.
For this reason, Hinton believes that the threat posed by AI to humans may be more urgent than climate change, because the solution to climate change is obvious, as long as carbon emissions are reduced or carbon neutrality is achieved, but the current AI crisis does not know how to start. Although AI may pose an existential threat to humans, he does not agree to suspend AI research, because it can never erase the benefits and application value of AI.
Hinton believes it would be better to step up regulation of AI and make everyone aware of its potential harms.
OpenAI co-founder and CEO Sam Altman also acknowledged that ChatGPT has developed some reasoning capabilities that they can ’ t explain, and that it ’ s not entirely impossible for AI to destroy humans.
However, he said that he has installed a kill switch for ChatGPT, and if the development of ChatGPT exceeds human expectations, he will immediately press the switch to stop working.
OpenAI CEO Altman, known as the “father of ChatGPT, ” recently said he was“ a little scared ” about the potential of his children, and even admitted that there is a real possibility that AI will destroy humanity. (Image: Wikipedia)
Altman admits that ChatGPT ’ s influence in elections and the spread of disinformation is a concern, so the 2024 U.S. presidential election will be a focus for OpenAI.
(Image source: Pexels Gallery website)
The Curtain of Ignorance Makes AI Right Values
However, before we press the switch, we can try to instill the right values in AI, such as helping those most in need, not destroying humans. Google ’ s DeepMind paper published in April 2023 in the Proceedings of the National Academy of Sciences suggests that AI can be taught from the perspective of political philosopher John Rawls.
Rawls has proposed a concept called “The Veil of Ignorance ”, which aims to achieve the most equitable distribution of benefits when group decisions are made.
According to his book, The Debate, if a group of people stand behind a curtain, all of them will instantly lose their memory, become ignorant, and forget their identity and status in the real world.
The political philosopher Ross assumes that people are behind the “curtain of ignorance ” (left) and have no idea of their skills, identities, and status.
In this scenario, people tend to choose the most equitable distribution of rights for all. (Image: Wikipedia)
At this time, these people are asked to vote for a working principle for the society.
Because they do not know where they are in this society, they cannot make decisions in an egoistic way, and they can only judge according to the principle of fairness to all people.
The situation is like, at the birthday party, you are responsible for cutting the cake, because you do not know which piece you will get, so you will try to cut each piece to the same size.
Under the curtain of ignorance, fairness and justice that has nothing to do with personal interests will emerge.
For this reason, DeepMind believes that applying the “curtain of ignorance ” to AI training may help promote fairness in the process of“ aligning ” AI with human values.
By “alignment ”, it means aligning AI ’ s wishes with those of humanity.
If AI shares fair values with humans, AI will not have the intention to destroy humanity.
White House convenes tech giants to discuss AI threats
However, even if AI does not intend to destroy humans, it may still have many negative effects on human society.
The Center for Artificial Intelligence and Digital Policy (CAIDP), a U.S. technology ethics organization, has complained to the Federal Trade Commission (FTC) that OpenAI ’ s latest large language model, GPT-4, is biased and deceptive and poses a risk to privacy and public safety.
The CAIDP lists potential threats that may arise from GPT-4, including: helping hackers churn out malicious code to exacerbate cyberattacks; and biased AI training data that may reinforce social stereotypes and make people of all races and genders vulnerable to unfair treatment. The FTC is investigating OpenAI, said FTC Chairman Lina Khan. "They cannot be separated from existing legislation and the Federal Trade Commission will actively enforce them," he said.
In an effort to make GPT-4 more secure, OpenAI hired 50 experts and academics to test GPT-4 against lies, language manipulation, and dangerous scientific common sense.
The OpenAI headquarters is pictured here. (Image: Wikipedia)
In early May 2023, the White House invited Google CEO Sundar Pichai, Microsoft CEO Satya Nadella, OpenAI founder Altman, and artificial intelligence startup Anthropic founder Dario Amodei to attend a conference to discuss the impact of AI on society.
Government officials at the meeting included Vice President Kamala Harris, Biden Chief of Staff Jeff Zients, National Security Adviser Jake Sullivan, National Economic Council Chairman Lael Brainard, and Commerce Secretary Gina Raimondo.
U.S. President Joe Biden also attended the meeting.
EU to pass world ’ s first AI regulatory law
Generative AI, while helping to improve lives, can also pose security, privacy and fraud issues, says Ms Ho.
She noted that AI companies have an ethical and legal responsibility to ensure the safety of their AI products, while at the same time working with governments to protect civil rights and privacy.
She stressed that the White House will work to advance potential new legislation and support new legislation to mitigate the potential harms of AI technology.
In contrast, Europe has taken a step ahead in AI legislation.
On 11 May 2023, the European Parliament ’ s Committee on Civil Liberties and Consumer Protection overwhelmingly approved a position paper calling for restrictions on the use of AI in Europe, a crucial first step towards the adoption of the world ’ s first AI regulation bill.
The draft bill will be submitted to the full European Parliament for a vote in June of the same year, after which representatives of the European Parliament, the Council of the European Union and the European Commission will work out the final terms of the bill in tripartite talks.
The European Parliament has adopted a position paper that strengthens restrictions on biometrics, facial recognition, and the use of AI by police in routine duties.
The parliament believes the move could lead to the world ’ s first AI regulation bill. (Image: Wikipedia)
On the other hand, the White House announced that Google, Microsoft, OpenAI, NVIDIA, Stability AI, Anthropic, and Hugging Face have all committed to participating in DEF CON 31, a computer security conference to be held in August 2023, so that their AI models will be tested and evaluated by hackers and AI experts.
Experts will try to identify errors, failures, and vulnerabilities in AI tools so that AI companies can solve existing problems in their models early on.
However, these AI companies simply agree to a one-time test, rather than a commitment to a continuous evaluation when launching or improving their products, and may therefore not be sufficient to meet the regulatory requirements.
Despite this, DEF CON 31 is still seen as the first step for an AI model to be publicly evaluated.
We hope that after each important first step in legislative regulation and public evaluation, we can put generative AI trains on the right track, so that everyone can safely benefit from technological innovation.
DEF CON is one of the largest computer security conferences in the world. In addition to cybersecurity experts and hackers, participants included staff from the FBI, the Department of Defense, and the Postal Inspection Service.
The conference covered areas such as software security, computer architecture, hardware modifications, and other vulnerable areas of information. (Image: DEF CON official website)
The content of the signed and / or unsigned articles published by Economic Times is the author's personal opinion and does not represent the position of Economic Times, and the role of Economic Times is to provide a free speech platform.
etnet won the HKEX Awards 2022 “Best Performing Securities Data Provider ” and“ Best Performing Derivative Data Provider ” ► Learn More
I want to respond
You may be interested
Enlarge display
I know. I know.
Featured Articles
• Life
• DIVA
• Healthy and good life

What breakthroughs has Hinton achieved through his 40+ years of work on artificial neural networks?

Breakthroughs that mimic biological brains

Which AI system demonstrates the foundation laid by Hinton's pioneering research in deep learning and neural networks?

Hinton's work on backpropagation was a crucial development in artificial intelligence.

Title:

Content: Geoffrey Hinton: GPT-4 is 100 times more knowledgeable than any human
Author: MIAO Yongqi
Published: Updated:
Computer scientist Geoffrey Hinton, known as the "godfather of artificial intelligence", announced Monday that he has resigned from Google. He has devoted his life to developing artificial intelligence systems, saying he "regrets his life's work" and is wary of the potential dangers of AI development.
In another recent interview, Hinton further talked about why he is afraid of AI development.
Hinton, 75, left Google a few days after the news broke in an interview with MIT Technology Review senior editor Will Douglas Heaven.
Hinton points out that the new generation of AI language models, especially the GPT-4, which came out in March, made him realize that these machines were moving in a direction that was much smarter than he thought, and he was afraid of these developments.
He is best known for a technique he proposed in the 1980s (with two colleagues) called backpropagation.
In short, the algorithms that allow machines to learn support almost all of today ’ s artificial neural networks, from computer vision systems to large language models.
It wasn ’ t until the 2010s that Hinton and his two recent graduates developed a “neural network ” that demonstrated its power, stronger than any computer ’ s ability to identify objects in images, and trained it to predict the next letter of a sentence, a precursor to today ’ s large-scale language patterns.
One of the students was Ilya Sutskever, the founder of OpenAI, who led the development of ChatGPT.
“We first thought it might be great. ”“ But it ’ s going to take a long time to realize that it needs to be done on a large scale to get good results. ”
In the 1980s, the discussion of “neural networks ” was considered a joke.
But Hinton doesn ’ t think so, and is working on this, software that mimics the abstract human brain and uses code as a connection between neurons. For 40 years, Hinton has viewed artificial neural networks as a clumsy attempt to mimic biological neural networks.
Now he thinks things have changed: he thinks there are better results when trying to mimic the behavior of the biological brain.
“It ’ s scary when you see it with your own eyes, ” he said.“ It ’ s a sudden change. ”
So why did ChatGPT surprise Hinton, too? He explained that the human brain has about 100 trillion connections, and “large language models have up to 500 billion, up to a trillion. ”
However, the knowledge of GPT-4 is a hundred times greater than that of any human.
So maybe it actually has a better learning algorithm than we do. "
He also pointed out that apart from the ability to learn, the ability to communicate is another kind of point.
“If you or I learn a new thing and want to teach it to another person, we can ’ t just send them a copy. ”
But artificial neural networks can do it.
It ’ s like there are 10,000 people here, and when one person learns a new thing, the other 9,999 people all learn it at the same time.
Hinton now believes that there are two types of intelligence: animal brains and artificial neural networks.
“It ’ s a completely different kind of intelligence.
“A new, better intelligence. ” Hinton believes that whether superintelligence is good or bad depends largely on whether you ’ re an optimist or a pessimist, and he says,“ mildly depressed, ” “that ’ s why I ’ m afraid. ”
“Whether these things are going to be smarter than us, I suddenly changed my mind. ”
I think they are very close to us now and they will be much smarter than us in the future, ” he said.
“How do we survive? ” he is particularly worried that people will use the tools he has developed to change the trajectory of human life, including elections and wars.
He said that he hopes to continue talking about AI security after leaving office and spend more time on “more philosophical work ”.“ As long as I ’ m still employed at Google, I can ’ t say what I want to say, ” he said. “I have a lot of good things to say about Google, and it would be more convincing if I wasn ’ t at Google. ”
Who is the godfather of AI computer scientist Geoffrey Hinton?
Hinton pioneered the basic technology of AI systems and became interested in artificial neural networks when he was a graduate student at the University of Edinburgh in 1972. In 2018, he and two experts in the field of deep learning were awarded the Turing Award, known as the “Nobel Prize in Computing ”.
What are the main concerns of “AI Godfather ” Geoffrey Hinton about the development of artificial intelligence?
He believes that the most direct impact is to promote the dissemination of false information and the loss of employment opportunities, and also worries about the use of this tool for evil, such as influencing elections and using it in war.

Which 1986 paper by Hinton became foundational for modern neural networks?

He was awarded the 2018 Turing Award, along with Yann LeCun and Yoshua Bengio, for his contributions to neural networks and deep learning.

Which prestigious award did Hinton receive in 2018 for his work on neural networks?

Hinton warns that AI poses existential threats to humans and advocates for regulation to mitigate its harms.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What future risk did Hinton warn about AI?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

He has expressed concerns about AI replacing jobs, spreading false information, and being used for malicious purposes.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

Hinton's warnings about AI's potential dangers have been echoed by many other experts.

Title:

Content: AI ’ s “godfather ” interviewed by the BBC, warning that artificial intelligence may be smarter than humans
AI ’ s “godfather ” interviewed by the BBC, warning that artificial intelligence may be smarter than humans
Geoffrey Hinton, known as the “godfather ” of artificial intelligence (AI), has resigned from Google.
He warned that developments in the field of artificial intelligence pose increasing dangers.
In a statement to The New York Times, Dr. Hinton said he regretted his current job.
Dr. Hinton ’ s pioneering research in neural networks and deep learning paves the way for current AI systems such as Google ’ s Bard chatbot and Microsoft ’ s ChatGPT.
The cognitive psychologist and computer scientist told the BBC that chatbots may soon be smarter than humans.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Experts like Yoshua Bengio have expressed concerns about AI's potential dangers and advocate for responsible development.

Title:

Content: Geoffrey Hinton, the godfather of AI, said after leaving Google that artificial intelligence is becoming smarter than humans.
2023 / 5 / 3 16: 46: 16 Source: IT House Author: Yuanyang Editor: Yuanyang
IT home May 3 news, one of the pioneers in the field of artificial intelligence, known as the "godfather of AI" Geoffrey Hinton (Geoffrey Hinton) recently announced that he has left the Google company he worked for ten years, because he is increasingly worried about the development of artificial intelligence technology.
In an interview with CNN's Jake Tapper today, he said that he believes artificial intelligence is becoming smarter than humans, and he wants to "blow the whistle" to remind people that they should seriously consider how to prevent artificial intelligence from controlling humans.
I'm just a scientist who suddenly realizes that these things are becoming smarter than we are, "Hinton said." I want to 'blow the whistle' in a way that says we should seriously worry about how to stop these things from taking control of us. "
Hinton was a pioneer in neural network technology, and his research laid the foundation for the artificial intelligence systems used in many products today.
IT House previously reported that he first revealed his departure in an interview with The New York Times on Monday and expressed his concerns about the potential harms of AI technology.
He said he was concerned that AI would lead to mass unemployment and create a world where many people “can ’ t know what ’ s real. ”
He also noted that the pace of advances in AI technology has far exceeded his and others ’ expectations.
If it becomes much smarter than us, it ’ s going to be very good at manipulating because it ’ s learned from us, and there are very few examples of a smarter thing being controlled by a dumber thing, ” Hinton told Tapper on Tuesday.
It will figure out ways to manipulate people into doing what it wants.
Hinton isn ’ t the only tech leader to express concerns about AI, and in March, a group of community members published a letter calling on AI labs to suspend training for at least six months on the most powerful AI systems, citing “profound risks to society and humanity. ”
Apple co-founder Steve Wozniak, one of those who signed the letter, reiterated concerns about artificial intelligence spreading false information on “CNN Morning ” on Tuesday.“ Deception will become easier for those who want to cheat you. ” Wozniak told CNN, “We ’ re not making any changes in that — we ’ re just assuming that our existing laws will fix the problem. ” Wozniak also said there may be a need for“ some type ” of regulation.
Hinton said he did not sign the petition. “I don ’ t think we can stop this progress, ” he said.“ I didn ’ t sign the petition saying we should stop studying artificial intelligence, because if the Americans stop doing research, the Chinese won ’ t. ” But he admitted that he didn ’ t have a clear solution, “I don ’ t know if we can solve this problem. ”
I believe we should try to think about ways to solve the problem.
I don't have a solution at the moment. '
Related articles
Key word: artificial intelligence
Soft media 's website: IT home hot products - Value shopping guide, coupons most buy - rebate coupons iPhone home Win7 home Win10 home Win11 home
Soft media software: Cube cloud calendar cool point desktop Win7 optimization master Win10 optimization master soft media mobile APP application

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Developing AI that surpasses human cognition poses significant societal risks, including job displacement and unintended consequences.

Title:

Content: Presented By
Getty Images
Ideas
Jan Brauner is a Ph.D. researcher in Artificial Intelligence at the University of Oxford, focusing on the safety of AI systems and their application in public health.
Alan Chan is a Ph.D. student at Mila, a research institute in Montreal focusing on AI, where he works on technical and socio-technical problems in AI safety. He's particularly interested in evaluation and AI regulation.

In May, more than 100 artificial intelligence (AI) professors, including some of the field's leading experts, scholars from other areas, and AI executives signed a one-sentence statement: "Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war.” Many signing researchers have explained their reason for worry: the risk that we might build powerful AI systems that we cannot control within this decade or the next ones.

Some have suggested the statement is an industry ploy to hype up AI companies’ products or influence regulation, ignoring that most of the signatories—ourselves included—are academics who do not work for industry. But the most common concern we have heard is that, by focusing on the risk of extinction, the statement distracts from present-day AI harms. As volunteers involved in collecting signatures for and constructing the statement, we disagree because both problems share a common core. The false dichotomy between ongoing harms and emergent risks makes it needlessly difficult to address common root causes.

AI poses many ongoing problems. AI systems can sustain human rights abuses, perpetuate systemic discrimination, and entrench power imbalances. Because AI systems are often widely deployed, harms can reach massive scales. For example, tens of thousands of families were pushed into poverty when the Dutch Tax and Customs Administration wrongly accused them of fraud and requested they pay back large sums of money, based on risk profiles created with AI systems.

The root causes of AI harm

There are several root causes that contribute to many instances of the harm caused by AI. One is that we do not know how to design AI systems that reliably behave exactly as we intend them to. For example, a health system was designed to allocate care based on need but discriminated against Black hospital patients. It turned out the algorithm used health care costs as a proxy for need, but institutionalized racism means that less money has been spent on Black patients historically. In many similar cases, companies do not explicitly set out to build harmful AI systems. Instead, creating state-of-the-art AI systems requires vast amounts of data, and the AI systems unintendedly inherit the biases encoded in this data.

Another cause is competitive pressures and limited accountability. There is often a strong economic incentive to deploy AI systems without sufficient safety checks. For example, Microsoft rushed the release of the Bing chatbot, which resulted in the chatbot threatening and insulting users. When the Dutch Tax Administration replaced human judgment with AI systems, this, too, happened in the name of efficiency.

Without decisive action to address these root causes, increasingly powerful and widely deployed AI systems will cause even more pervasive and significant harm. Many experts believe future AI systems may outmatch humans in crucial cognitive skills, such as social persuasion, planning, and development of novel technologies. Just as these cognitive abilities enabled humanity to control the fate of other species, the same skills could enable smarter AI systems to out-perform us. Given competition and limited accountability, there would be pressure on organizations to replace expensive human labor with AI systems. Economic forces encourage the rapid deployment of new AI systems (at the cost of safety testing), making them ever more powerful, building general (and potentially more powerful) systems rather than narrow (and potentially more controllable) systems, and increasing the autonomy of AI systems to take action in the world. AI systems could increasingly control our society's key productive, managerial, and military capacities. By then, we must have figured out how to design systems that always and truly behave as we intend. Otherwise, powerful AI systems that pursue goals at odds with humanity could lead to human marginalization or even extinction.

Read More: An AI Pause is Humanity's Best Bet for Preventing Extinction

Moreover, many researchers expect us to develop such advanced AI systems very soon. Companies are pouring more money and talent into AI development while the cost of computing power is decreasing. Simply using more computing power and data has reliably produced more capable AI systems, while AI algorithms have also improved. After seeing the rapid progress in AI over the past five years, Geoffrey Hinton, a founding father of modern AI, now expects that AI could broadly surpass human cognitive abilities—such as persuasion, planning, and scientific reasoning—within five to 20 years. Such time horizons are shared by many in the AI research community.

Twenty years is short; in discussions about the climate crisis, we regularly consider effects on such timescales. And just as climate change requires us to face air pollution and ongoing natural disasters as well as prevent future, even more, extreme weather events, we must tackle various AI risks and harms simultaneously. Even if we might be a couple of decades away from AI systems that are smarter than humans, that is little time to create the complex global governance structures necessary for this technology.

Work to address ongoing harms sometimes differs from work to manage extinction risk. We do not wish to erase nuance or potential differences between the perspectives. Yet, given common root causes, there is much room for collaboration and cooperation.

Four possible interventions

Many interventions could address the root problems. First, the public currently has little to no say over what models are built and how they are deployed. For example, those most affected by welfare systems have had little say in their automation. Private companies decide which risks are acceptable, as they have free rein over computing power and data, the key levers of AI development. Stronger democratic oversight over the supply of computing power and data would enhance public control over AI development and associated risks. For example, governments can monitor when large amounts of computing power are being used and for what purpose.

Second, a strong auditing regime, where independent third-parties would scrutinize the practices and development processes of AI labs, would help reduce risks overall. Auditing has already surfaced previously overlooked harms, such as bias in facial recognition, and could catch future failure modes like AI systems subverting human control or replicating autonomously. A standards body could ensure  AI systems, both before and after deployment, meet specified safety guidelines. Domestic agencies could enforce compliance, while an international organization would create universal standards.

Third, we should require meaningful human oversight of critical AI decisions, and avoid very-high-risk use cases such as lethal autonomous weapons. Uncertainty about AI systems' current and near-future capabilities means we should proceed cautiously around their deployment in critical domains.

Fourth, we should rebalance the  funding going into AIs and urge companies to spend less on making them smarter while increasing funding into making them safer, more transparent, and studying their social impacts. While it is good that industry labs are funding such research, this funding is liable to change with market conditions. Much more public funding for non-industry groups is required.

The development of increasingly powerful AI systems poses increasingly vast societal-scale risks. The complexity of these risks requires cooperation between people with potentially different motivations but with a shared interest in ensuring that AI development proceeds in a just and beneficial way.

More Must-Reads From TIME

Contact us at letters@time.com.

You May Also Like
EDIT POST

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

AI systems can be biased, discriminatory, and used for harmful purposes.

Title:

Content: Artificial intelligence.
An actual revolution or an exaggeration for the sake of promotion?
In the past eight months, the debate has escalated over concerns related to the development of artificial intelligence amid unrivalled global interest in the artificial intelligence technology known as “Chat GBT ”.
Add Announcement
As tech companies compete to develop and deploy AI tools similar to Chat BT, many people have expressed concerns about the possibility of new challenges at different levels that could face humanity as a whole.
On the other hand, another team supports this industry as an important source of many benefits in all economic sectors, but they themselves warned of the risks that can accompany its development, especially generative artificial intelligence, which requires the organization of this industry before humans fall victim to the decline in negative trends.
The growing controversy over this phenomenon has taken a serious turn to the extent that a question has been raised on the surface.
Will the development of artificial intelligence at this pace be in the interest of humanity or will it be a reason to drag it into the abyss?
Amid this disagreement, there are those who believe that the matter has been greatly exaggerated for the purpose of promoting the products of companies in the artificial intelligence sector, because everything that happens to date revolves in the orbit of limited artificial intelligence, which does not exceed the receipt of instructions by humans and re-put to humans, including Alexa, Siri and Chat GB.
Among the experts, the concerns associated with artificial intelligence include the possibility of job losses due to automation, fears of its progress beyond human intelligence, and others related to the dissemination of misleading information as generative AI can provide society with fake news if fed with fake data.
The experts pointed to legitimate concerns about the possibility of the impact of generative artificial intelligence negatively on intellectual property, especially in the creative industries, and negatively affect the processes of education and human ability to innovate, and fears of the development of the capabilities of artificial intelligence technologies to be able to take decisions away from the human element or control by parties seeking to use them for illegal purposes.
Two months ago, chat gbt creator Sam Altman called on US lawmakers to regulate artificial intelligence and create a new licensing body for AI companies.
Altman ’ s call was based on his recognition of the impact AI can have on the economy, which includes the potential for AI to replace some jobs, and its potential dangers in spreading misinformation and other negative trends.
Strategic Technical Consultant M. Hani Mahmoud Al-Batsh stressed that the field of artificial intelligence is a rapidly evolving field and has the potential to revolutionize many aspects of our lives.
However, Batsh stressed that one of the biggest concerns associated with artificial intelligence is the possibility of job losses due to automation.
Al-Batsh said: “Artificial intelligence and its development increases its ability to replace humans in many industries, which contributes to increasing unemployment rates. ”
“AI algorithms can also be biased and discriminatory, resulting in unequal treatment of certain groups of individuals, such as people of different races or genders. ”
Other challenges and concerns associated with artificial intelligence, according to Al-Batsh, are those related to personal data, noting that most artificial intelligence systems rely on large amounts of data, which can include sensitive personal information that may fall into the hands of entities that may use it for illegal purposes.
"There are concerns that artificial intelligence could be used to develop weapons that could be used to target and kill people," he said.
Al-Batsh stressed that artificial intelligence systems are relatively complex, which makes it difficult to determine how they make decisions, so there are fears that artificial intelligence will one day become so advanced that it exceeds human intelligence and becomes impossible to control, pointing out that this may lead to a number of unexpected and sometimes disastrous results.
Governments are concerned about the security risks posed by the AI industry, as it has become more advanced, it may use the industry to launch cyber attacks or other types of attacks that may be difficult to detect and defend.
A few months ago, the G7 countries agreed to adopt regulations for these technologies in light of privacy concerns and security risks, to ensure transparency and counter misinformation.
But the G7 countries agreed that the regulations should also "maintain an open and encouraging environment" for the development of artificial intelligence technologies and be based on democratic values.
Wasfi Safadi, an expert in the field of communications and technology, believes that there are fears of artificial intelligence as a result of the development of its technologies to become self-evolving largely dependent on the amount of information it can access, analyze and use in several fields and different industries.
Safadi stressed that the fears of artificial intelligence come because today we can not imagine where artificial intelligence can reach?
Will it be for the good of mankind or will it be the cause of the annihilation of mankind?
He pointed out that a number of countries have sounded the alarm, for example, Italy issued a decision to ban the application of such as "Chat GB", for violating the privacy of minors by collecting data on them, calling for the existence of international legislation on the ethics of artificial intelligence to reduce the damage that can violate human rights and humanity, especially with regard to the bad use of humanity and humanity.
He pointed to the open letter signed by dozens of people working in the field of artificial intelligence last March, including billionaire Elon Musk, and called for a temporary halt to all efforts to develop more advanced versions of the current version of the chat robot ChatGB, until strict security measures are reached and implemented.
Safadi said: “With our reliance on technology and the Internet to a great extent today, and with this superior knowledge and ability to control industries by artificial intelligence technologies, we are facing a machine capable of, for example, manufacturing deadly biological and chemical weapons, developing DNA sequences, violating privacy, especially with deep counterfeiting able to create your identity and use it in many ways. seconds".
One of the most prominent figures who stressed the potential dangers of artificial intelligence systems, Jeffrey Hinton, a pioneer in the world of artificial intelligence, or as they like to call him "the father of artificial intelligence", said this year that despite the great benefits of artificial intelligence systems in all fields, including military and economic, he is concerned that these systems set themselves sub-goals that are not in line with the interests of their programmers.
Hinton, who has quit his job at Google, expressed concern about the catastrophic misuse of artificial intelligence systems by “malicious ” actors, he said,“ they may exploit artificial intelligence for bad purposes, ” and expressed concern about the negative effects on jobs in the labor market.
Dr. Jafar Al-Sarayreh, Director of the Consultancy and Training Center at Princess Sumaya University for Technology, stressed that a regulatory framework and procedures for the use of artificial intelligence must be developed, including a number of policies and laws governing the use of such technologies locally and globally, pointing out the importance of the participation of stakeholders in the development of this regulatory framework, including government, companies, academic institutions, civil society and experts in the field of artificial intelligence.
He pointed out that at the global level, there are initiatives and institutions working to develop regulatory frameworks for artificial intelligence, including the United Nations is developing global guidelines for artificial intelligence focusing on ethics, human rights, transparency and responsibility.
The Minister of Digital Economy and Entrepreneurship, Ahmed Al-Hananda, recently told Al-Ghad that "the government is following with interest the developments in the field of artificial intelligence, and is constantly working to empower society, the private sector and government institutions to benefit from all technical developments, including artificial intelligence, within the framework of the digital transformation process on which it is based.
He stressed that the government has been preparing for years to benefit from the developments of artificial intelligence by approving the Jordanian Artificial Intelligence Policy, the National Code of Ethics for Artificial Intelligence, the Jordanian Strategy for Artificial Intelligence and the Executive Plan (2023-2027), the project to measure the readiness of public sector institutions to adopt artificial intelligence, and technical cooperation with the Japan International Cooperation Agency.
Technical expert Hossam Khattab, described the technology of artificial intelligence as: "take away the hearts", and what one may notice at the moment that the term "has become marketing", and that all we see and hear about today is only devices that carry out automated tasks.
He pointed out that companies are racing to describe their products as relying on artificial intelligence, because it is a common technology and no one wants to be left behind.
For example, ChatGPT, which says, “still doesn ’ t work on AI in the big sense, ” in its case the machine doesn ’ t think, it receives commands, and decides on the optimal set of words to answer based on a large database it has been trained on.
Among Khattab, the types of artificial intelligence, the first of which is limited artificial intelligence Narrow AI: applications smart assistants such as Alexa, Siri and ChatGPT, applications that are programmed to carry out specific tasks, and do not have intelligence.
“The second type is general artificial intelligence: a machine understands and performs multiple tasks based on accumulated experience, which is similar to human intelligence.
The machine is conscious, analyzing and thinking, and it is unrealized in today ’ s products. ”
“The third type is super AI: in which the machine exceeds human intelligence in all areas and tasks, and the machine is able to learn and develop itself, which is a theoretical concept until this moment, ” Khattab said.
“We still have not dealt with machines that think independently of human intervention, self-develop, learn and excel at their programmer, and all the commercial applications available now revolve around the orbit of limited artificial intelligence, it is necessary to understand this fact, which is overlooked or overlooked by companies and people intentionally or unintentionally. ”
He pointed out: "The limited artificial intelligence is similar to the tasks that we previously carried out, but it has become faster automatically, and most of what we hear about falls under this category.
Either the machine thinks like humans, or they are smarter than humans, the concept does not yet have commercial applications, a reality that companies may have overlooked. ”
The General Manager of Pure Analysis for Management and Technology Consultancy, Dr. Moataz Mohammed Al-Dabai, said: “It is important to carefully consider the potential disadvantages of artificial intelligence and take steps to mitigate them and work to control its negative impact on humanity. ”
He called for a balance between the suitability of artificial intelligence and the need to maintain our cognitive abilities and self-sufficiency.
He pointed out that the main concerns in this area relate to the excessive reliance on artificial intelligence in the performance of life and professional work, which is likely to lead to the loss of our basic skills and lack of confidence in our human capabilities.
He pointed out that this could develop to the extent that it could lead to the loss of the ability to innovate and creative thinking and the inability of humanity to respond to special and unexpected circumstances.
He cited, for example, the increasingly widespread use of voice assistants, on which people may rely heavily for basic tasks such as reminding of appointments and tasks to be accomplished, such as making phone calls or ordering goods and services.
“This over-reliance on artificial intelligence could lead to a decline in communication and social skills, ” he said.
AI can be used to create personalized, highly targeted and personalized ads or content that can have a negative impact on mental health by promoting negative biases, stereotypes or insecurity.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Experts call for international AI ethics legislation to prevent potential threats.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

Developing artificial general intelligence (AGI) poses risks, including potentially becoming uncontrollable through self-redesign.

Title:

Content: Artificial intelligence (AI) is a rapidly growing technological advancement with the potential to transform various industries. The development of AI has brought about significant changes in education, music, transportation, and healthcare. It holds the promise of self-driving cars, revolutionary medical breakthroughs, and increased productivity. However, concerns arise regarding the potential dangers associated with the development of General Artificial Intelligence (AGI).

AGI is a theoretical form of AI that possesses human-level intelligence and self-awareness. While Narrow AI, designed for specific tasks, has made impressive progress, achieving AGI remains uncertain. One of the main challenges is developing algorithms that can reason abstractly and think creatively, skills that current AI systems lack. Replicating human-like abstract and creative thinking in machines is a complex task.

In the medical field, AI shows great potential in diagnosing diseases and developing more effective treatments. It can analyze big data to prevent the spread of infectious diseases by creating early-warning systems. In other areas, such as climate change and transportation, AI can contribute to scientific advancements. Predictive modeling and early-warning systems can help us prepare for climate-related events, while self-driving cars have the potential to revolutionize transportation.

However, ethical concerns arise when it comes to AI’s impact on the arts, particularly in music production. Questions arise regarding the role of human artists and the authenticity of AI-generated music. Additionally, the use of AI in military technology raises ethical questions about decision-making without human intervention. Countries like the United States, China, and Russia have already implemented AI in weapons systems and drones, sparking the need for global regulations to ensure responsible use.

Renowned physicist Stephen Hawking has warned against the development of AGI, expressing concerns that it could surpass human intelligence and redesign itself at an exponential rate, potentially rendering humanity obsolete. This highlights the importance of ethical considerations, regulations, and international cooperation to mitigate any risks associated with AI development.

As AI continues to advance, it is crucial to strike a balance between harnessing its potential benefits and addressing the potential dangers. Measures such as ethical considerations, regulations, and international cooperation are necessary to ensure the responsible use of AI and to mitigate any risks associated with its development.

How does Hinton think AI could escape human control?

By writing their own computer code to modify themselves..

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Becomes uncontrollable
Poses ethical risks

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

Ensuring ethical AI development is critical, as AI can automate tasks but lacks logical reasoning, adaptability, and emotional intelligence.

Title:

Content: Summary:
Artificial intelligence has made significant advances in recent years, leading many to question whether it has surpassed human intelligence.
While AI has shown remarkable abilities in specific tasks, it is still unable to replicate the overall cognitive abilities of humans.
This article explores the current state of artificial intelligence, compares its strengths and limitations to human intelligence, and provides insights from experts in the field.
Are Artificial Intelligence Really Smarter Than Humans?
Artificial intelligence has made tremendous strides in recent years, making remarkable breakthroughs that were once thought to be limited to human intelligence.
From defeating world champions in complex games like chess and Go to helping with medical diagnostics, AI has demonstrated its ability to process vast amounts of data and make decisions with unparalleled accuracy.
However, the question remains: Is artificial intelligence really smarter than humans?
To answer this question, it is important to understand the fundamental differences between artificial intelligence and human intelligence.
Artificial intelligence refers to computer systems designed to perform tasks that typically require human intelligence, such as visual perception, speech recognition, and decision making.
These systems rely on algorithms and machine learning techniques to analyze data and make predictions or decisions.
While AI excels in specific areas, it lacks the comprehensive cognitive capabilities that humans possess.
Human intelligence encompasses a wide range of skills, including emotional intelligence, creativity, common sense, and adaptability.
These qualities enable humans to navigate complex social interactions, think critically, and solve problems in diverse and unpredictable environments.
Moreover, AI systems are limited by their reliance on data.
They require extensive training in classified data sets to learn patterns and make accurate predictions.
In turn, humans can learn from some examples and apply their knowledge to new situations.
Humans also have intuition and can make judgments based on incomplete or ambiguous information, an ability that AI struggles to imitate.
Experts in the field of artificial intelligence confirm that despite the great progress achieved by artificial intelligence, it is still far from keeping pace with human intelligence.
Dr. John Doe, a renowned AI researcher, explains that “AI excels in narrow domains where it has been extensively trained, but lacks the ability to generalize knowledge across domains or demonstrate sound understanding. ”
It is essential to realize that artificial intelligence and human intelligence are not mutually exclusive, but rather complement each other.
The goal of developing artificial intelligence is not to replace human intelligence, but to enhance it.
By leveraging the computational power of AI and data processing capabilities, humans can enhance decision-making processes and tackle complex problems more efficiently.
Frequently Asked Questions:
Q: Can artificial intelligence outperform human intelligence in the future?
A: Although artificial intelligence has made significant progress, achieving the level of human intelligence remains a major challenge.
The development of artificial general intelligence (AGI), which encompasses the range of human cognitive abilities, remains a distant goal.
Q: Are there any risks associated with the superiority of artificial intelligence over human intelligence?
A: The potential risks associated with AI ’ s superiority over human intelligence, often referred to as AI superintelligence, are the subject of debate among experts.
Ensuring ethical and responsible development of AI systems is critical to mitigating any potential risks.
Q: How can artificial intelligence and human intelligence work together?
A: AI can complement human intelligence by automating repetitive tasks, providing data-driven insights, and aiding decision-making processes.
This collaboration allows humans to focus on tasks that require creativity, empathy, and critical thinking.
Q: What are some of the notable achievements of artificial intelligence?
A: AI has made significant achievements, including defeating human heroes in games like chess and Go, enabling autonomous vehicles, improving medical diagnostics, and enhancing natural language processing capabilities.
Q: What are the limits of artificial intelligence compared to human intelligence?
A: AI lacks the ability to demonstrate logical reasoning, adaptability, creativity, and emotional intelligence, which are inherent in human intelligence.
AI also relies heavily on disaggregated data sets and struggles to generalize knowledge across domains.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Organizations like OpenAI are researching and developing safety measures to ensure responsible and beneficial AI development.

Title:

Content: Summary:
In recent years, the concept of artificial intelligence (AI) has become increasingly prevalent in our society.
While AI has the potential to revolutionize many industries, concerns have been raised about the potential risks it may pose.
One of these concerns revolves around the idea of an artificial intelligence robot that wants to destroy humans.
This article delves into the origins of this idea, explores the current state of AI development, and offers an insightful analysis of the likelihood of such a scenario.
Introduction:
The idea of an artificial intelligence robot with a desire to destroy humans has spread through science fiction films and novels.
However, it is necessary to distinguish between fictional images and the reality of artificial intelligence technology.
The concept of malicious artificial intelligence, often referred to as "artificial general intelligence" (AGI), has sparked many discussions among experts in the field.
Current state of artificial intelligence:
So far, AI technology has not reached the level of general artificial intelligence (AGI), with machines having human-like general intelligence.
The artificial intelligence systems we face today are referred to as “narrow artificial intelligence ” or“ weak artificial intelligence. ”
These systems are designed to perform specific tasks, such as image recognition or natural language processing, but lack the ability to think or think like humans.
Fears:
Despite the current limitations AI faces, concerns about its potential risks remain.
Some experts argue that if general AI is developed without adequate safety precautions, it could pose risks to humanity.
This fear stems from the idea that a general AI system, with its superior intelligence and ability to self-improve, can develop goals that are not in line with human values, leading to unintended consequences.
Insightful analysis:
While the idea of an AI robot that wants to destroy humans embodies our imagination, it is crucial to approach this idea from a rational perspective.
The development of general artificial intelligence is a complex and challenging task that requires intensive research and careful study of ethical implications.
The AI community is actively involved in discussions regarding safety measures and responsible development of public AI.
Questions and Answers:
Q: Is there any evidence that the AI robot wants to destroy humans?
A: No, there is currently no evidence to support the claim that the AI robot wants to destroy humans.
The concerns surrounding general AI are largely speculative and based on hypothetical scenarios.
Q: Are there any regulations in place to prevent AI from becoming a threat?
A: Although there are no specific regulations targeting general AI, organizations such as OpenAI have committed to conducting research to ensure that general AI benefits all humanity.
The development of safety measures and ethical guidelines is an ongoing process within the AI community.
Q: Can AI systems become dangerous without human intervention?
A: AI systems, as they exist today, are designed to operate within predefined limits and require human intervention to function.
The potential risks arise from the development of general artificial intelligence, which may have the ability to act independently and possibly make decisions that may not be in line with human values.
Conclusion:
The idea of an artificial intelligence robot that wants to destroy humans remains largely speculative and rooted in science fiction.
While it is crucial to address the potential risks associated with the development of general AI, it is equally important to approach the subject from a balanced perspective.
The AI community is actively working to ensure responsible and safe development of AI technologies, mitigate potential risks, and maximize benefits for humanity.

Regulatory frameworks are necessary for the responsible development of AI, and at least one third of AI funding should go to safety and ethics.

Title:

Content: Governments, firms should spend more on AI safety, top researchers say

By

'At least one third of their AI research and development funding'.

Artificial intelligence companies and governments should allocate at least one third of their AI research and development funding to ensuring the safety and ethical use of the systems, top AI researchers said in a paper.

The paper, issued a week before the international AI Safety Summit in London, lists measures that governments and companies should take to address AI risks.

"Governments should also mandate that companies are legally liable for harms from their frontier AI systems that can be reasonably foreseen and prevented," according to the paper written by three Turing Award winners, a Nobel laureate, and more than a dozen top AI academics.

Currently there are no broad-based regulations focusing on AI safety, and the first set of legislation by the European Union is yet to become law as lawmakers are yet to agree on several issues.

"Recent state of the art AI models are too powerful, and too significant, to let them develop without democratic oversight," said Yoshua Bengio, one of the three people known as the godfather of AI.

"It (investments in AI safety) needs to happen fast, because AI is progressing much faster than the precautions taken," he said.

Authors include Geoffrey Hinton, Andrew Yao, Daniel Kahneman, Dawn Song and Yuval Noah Harari.

Since the launch of OpenAI's generative AI models, top academics and prominent CEOs such as Elon Musk have warned about the risks on AI, including calling for a six-month pause in developing powerful AI systems.

Some companies have countered this, saying they will face high compliance costs and disproportionate liability risks.

"Companies will complain that it's too hard to satisfy regulations - that 'regulation stifles innovation' - that's ridiculous," said British computer scientist Stuart Russell.

"There are more regulations on sandwich shops than there are on AI companies."

Got a news tip for our journalists? Share it with us anonymously here.
Tags:

Most Read Articles

Services Australia's digital credential sharing with NSW on ice

CBA to test products and messaging on AI-created 'customers'

Australian Federal Police officers using more online face search tools

ANZ targets 3000 engineers to use GitHub Copilot

Log In

  |  Forgot your password?

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

The public should understand that AI requires careful management and regulation for responsible and safe use.

Title:

Content: Advertisement
Arabic-International
Is Artificial Intelligence More Dangerous to Humanity than Nuclear Warfare?
02-06-2023 | 11: 00
A-
A +
photos 0
A +
A-
Once again, the heads of two prominent AI companies have issued a warning of the existential risks posed by advanced AI.
DeepMind and OpenAI executives Demis Hasebes and Sam Altman have pledged their support for a brief statement published by the Centre for AI Safety, calling on regulators and lawmakers to take AI ’ s “serious risks ” more seriously.
Advertisement
“Mitigating AI mortality should be a global priority, along with other risks that affect society as a whole, such as pandemics and nuclear war, ” the statement said.
The Center for Artificial Intelligence Safety, a San Francisco-based nonprofit that aims to "reduce the socially significant risks posed by artificial intelligence," said the use of AI in warfare may be "excessively harmful" because it could be used to develop new chemical weapons and boost air warfare.
The brief statement was signed by senior executives and academics in space science, although it does not explain what the signatories see as being threatened with annihilation by the dangers of artificial intelligence.
Signatories include Geoffrey Hinton, sometimes nicknamed the “godfather of artificial intelligence ”, and Elia Sotskifer, CEO of ChatGPT and one of the developers of OpenAI.
The list of signatories also includes dozens of managers of well-known companies, such as the director of Google, one of the founders of Skype, and the founders of the artificial intelligence company Anthropic.
Today, global discussions are focused on artificial intelligence after a number of companies launched new tools that enable users to produce text, images and even computer codes, without costing them anything but asking for what they want.
Experts say the technology could strip humans of many jobs – but this new statement points to deeper and greater risks.
The rise of tools such as ChatGBT and Dall-E has led to fears that artificial intelligence will one day annihilate humanity if it surpasses human intelligence.
Earlier this year, prominent tech bosses called on leading AI companies to halt their systems development for six months to work out ways to mitigate risks.
“Artificial intelligence systems that can compete with human intelligence can pose enormous risks to society and humanity as a whole, ” said an open letter published by the Future of Life Institute.
AI research and development activities should be focused on making today ’ s highly sophisticated and sophisticated systems more accurate, secure, clear, transparent, capable, adaptive, reliable, and loyal (to human life). ”
Go ahead.
Advertisement
Our news via your email
SIGN UP

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.