Geoffrey Hinton is a renowned artificial intelligence researcher known as the "godfather of artificial intelligence".

He is known for his pioneering work in artificial intelligence and deep learning.

Hinton's neural network work enabled AI systems like ChatGPT, used by over 100 million monthly users.

He has warned that unmanaged AI could become dangerous and surpass human intelligence.

Hinton believes AI may lead to human extinction due to autonomous weapons and systems.

He has expressed concerns about AI's potential misuse in elections and wars.

Experts, including OpenAI co-founder Altman, have acknowledged AI's potential risks and called for more transparency and regulation.

Hinton's warnings have sparked a debate about the need for more careful management and regulation of AI development.

The European Parliament approved an AI regulation bill in 2023 to mitigate AI development risks.

Hinton believes AI can contribute to many fields if developed and used responsibly.

Hinton estimates a 10% chance of AI causing human extinction as it rapidly evolves and raises societal concerns.

Hinton has advised governments to manage AI risks and suggested measures like universal basic income to mitigate its negative employment effects.

The EU's Artificial Intelligence Act establishes a risk-based approach to AI governance.

International cooperation on AI regulation is crucial, with organizations like the EU and US government playing a key role.

Experts agree that decisive action is needed to address AI risks.

Governments and companies must collaborate to establish AI regulations, allocating at least one third of funding to safety and ethics.

The public should carefully consider AI development's potential risks and benefits.

Geoffrey Hinton is a renowned artificial intelligence researcher known as the "godfather of artificial intelligence".

Title:

Content: Yoshua Bengio

1 minute read
By Geoffrey Hinton

Yoshua Bengio is a world leader in AI. Throughout his career, Yoshua’s research has been instrumental in shaping the world’s understanding of AI’s potential—and that same expertise has made his perspective more essential than ever. His pioneering research on deep learning laid the foundations for the current revolution in AI and earned him the 2018 Turing Award—“the Nobel Prize of Computing”—alongside myself and Yann LeCun. Last year, Yoshua received Canada’s highest award for research, the Gerhard Herzberg Canada Gold Medal. He is the computer scientist with the greatest number of citations and is ranked third among all disciplines for scientific impact.

Yoshua has been concerned for many years with the social impact of artificial intelligence, contributing to the Montreal Declaration for the Responsible Development of AI. Over the past year, worried by the potential for catastrophic outcomes from future AI, he was vocal in global conversations on AI safety. He advised the U.N. Secretary-General and the U.K. AI Safety Institute, and took part in policy discussions with governments in North America, Asia, and Europe.

Hinton is a cognitive psychologist and computer scientist

More Must-Reads From TIME

Contact us at letters@time.com

He is known for his pioneering work in artificial intelligence and deep learning.

Title:

Content: • |
• Fast Quote
• |
• Member
• Product Services / Streaming
• Settings
12 / 05 / 2023
The White House ordered AI to be evaluated, and the European Union proposed legislation to regulate AI, teach AI to be human or the best solution!
• Add Favorite Column
• Collection of articles
• Fang Zhanqi
Fang Zhanze
When I was a teenager, I studied Geographic Information System, but unfortunately I didn ’ t learn anything and I graduated with luck.
After adulthood, the accidental hit into the media circle, first and then in the print, electronic, online media to roll, slightly small.
After middle age, he completed a master ’ s degree in information technology and gradually expanded his horizons. He was determined to join a start-up company and explore different fields of technology.
In recent years, he has been actively engaged in data analysis and digital strategies, and has also been involved in the development of Location Intelligence projects. Sometimes, he can also take time to teach, not only to share what he has learned with others, but also to motivate himself to keep learning for life.
Tales of Wisdom City
Generative AI is definitely the hottest topic in the technology world today. After the popularity of ChatGPT, many companies rushed to launch similar products and gradually applied them to various industries.
But more and more people are worried that when AI is fully popularized, it will aggravate the problem of fake information flow, online fraud and other problems; even Sheffield Hinton, who is known as the "godfather of AI", is worried that AI will become too smart, afraid that it will evolve into a killer robot, which may eventually lead to the death of mankind!
How big can the negative impact of AI technology be?
How do governments around the world respond to the potential threat of AI?
Neural network is the foundation technology of ChatGPT
Fifty-one years ago, Geoffrey Hinton, who had not yet been called the “godfather of AI, ” entered the University of Edinburgh in Scotland as a graduate student and began research on artificial neural networks.
The so-called “artificial neural network ” is a mathematical model that mimics the structure and function of biological neural networks, especially the brain, and is able to learn skills by analyzing data.
This is the foundational technology behind OpenAI ChatGPT and Google Bard.
After Hinton resigned from Google, he did not have to worry about the harm his words would bring to Google, so he was interviewed by different media and said his heart: "AI may lead to the death of mankind." (Photo: University of Toronto official website)
In 2012, Hinton and his students, Ilya Sutskever and Alex Krishevsky, created a neural network system that analyzes thousands of photos and learns to recognize common things like flowers, dogs, cars, etc.
Subsequently, Hinton and two students founded DNNresearch, a startup based on this research project.
In 2013, Google acquired DNNresearch for US $44 million (approximately HK $343 million), and Hinton joined Google as Vice President and Engineering Researcher, responsible for some of the research work on Google Brain.
His protégé, Suzkville, left Google to co-found OpenAI with like-minded people, and became chief scientist, leading the research team to successfully develop the GPT model and ChatGPT.
Hinton ’ s top student, Suzkville, gave up his lucrative job at Google in 2015 to co-found OpenAI with Altman and others, and led the development of GPT and DALL-E models. (Image: University of Toronto website)
I regret working my whole life because I am worried about the dangers of AI.
In 2018, Hinton, along with University of Montreal professor Yoshua Bengio and Meta chief AI scientist Yann LeCun, won the A.M. Turing Award in recognition of their great contributions to neural networks and deep learning.
As a result, the three later became known as the “godfathers of AI ” or“ godfathers of deep learning. ”
Around the same time, Google and OpenAI began to build large-scale deep learning systems based on neural networks, which became the basis for future development of Bard and ChatGPT.
From this, it seems that Sinton plays an important role in creating the current glory of generative AI.
However, in the current era of AI, Sinton suddenly left Google in April 2023, shocking the entire AI industry.
Hinton explained that he left Google to talk freely about the potential risks of AI without harming Google.
Speaking about 50 years of research into neural networks, he said, “I ’ m very sorry about my life ’ s work. ”
The Internet will be filled with more and more fake AI-generated text, photos, and even videos, but the average person will not be able to tell the truth, Hinton said.
Moreover, sooner or later, AI technology will completely disrupt the job market, causing more and more jobs to disappear.
What is even more worrying is that at present, users can not only instruct ChatGPT to generate code, but also ask the AI to execute the code; in this way, the AI killer robots that often appear in science fiction movies will one day become a reality.
Is it not impossible for AI to destroy humanity?
Of course, this pessimistic future scenario is only a hypothetical one, but Hinton stressed that what could lead to it is already happening: a global race for AI technology has begun between Microsoft and Google, and even between China and the United States.
Most people think that the future of AI dominating everything is still far away, but he believes that AI may not take 30 to 50 years to control humans, and even find a way to kill humans, which may eventually lead to human extinction.
In the 1980s, Hinton was a professor of computer science at Carnegie Mellon University in the United States, but because he was not satisfied that the university's AI research was sponsored by the United States Department of Defense, he decided to leave the United States to teach at the University of Toronto's School of Computer Science.
He pointed out that without some kind of global regulatory agreement or regulatory mechanism, the AI arms race will intensify.
For this reason, Hinton believes that the threat posed by AI to humans may be more urgent than climate change, because the solution to climate change is obvious, as long as carbon emissions are reduced or carbon neutrality is achieved, but the current AI crisis does not know how to start. Although AI may pose an existential threat to humans, he does not agree to suspend AI research, because it can never erase the benefits and application value of AI.
Hinton believes it would be better to step up regulation of AI and make everyone aware of its potential harms.
OpenAI co-founder and CEO Sam Altman also acknowledged that ChatGPT has developed some reasoning capabilities that they can ’ t explain, and that it ’ s not entirely impossible for AI to destroy humans.
However, he said that he has installed a kill switch for ChatGPT, and if the development of ChatGPT exceeds human expectations, he will immediately press the switch to stop working.
OpenAI CEO Altman, known as the “father of ChatGPT, ” recently said he was“ a little scared ” about the potential of his children, and even admitted that there is a real possibility that AI will destroy humanity. (Image: Wikipedia)
Altman admits that ChatGPT ’ s influence in elections and the spread of disinformation is a concern, so the 2024 U.S. presidential election will be a focus for OpenAI.
(Image source: Pexels Gallery website)
The Curtain of Ignorance Makes AI Right Values
However, before we press the switch, we can try to instill the right values in AI, such as helping those most in need, not destroying humans. Google ’ s DeepMind paper published in April 2023 in the Proceedings of the National Academy of Sciences suggests that AI can be taught from the perspective of political philosopher John Rawls.
Rawls has proposed a concept called “The Veil of Ignorance ”, which aims to achieve the most equitable distribution of benefits when group decisions are made.
According to his book, The Debate, if a group of people stand behind a curtain, all of them will instantly lose their memory, become ignorant, and forget their identity and status in the real world.
The political philosopher Ross assumes that people are behind the “curtain of ignorance ” (left) and have no idea of their skills, identities, and status.
In this scenario, people tend to choose the most equitable distribution of rights for all. (Image: Wikipedia)
At this time, these people are asked to vote for a working principle for the society.
Because they do not know where they are in this society, they cannot make decisions in an egoistic way, and they can only judge according to the principle of fairness to all people.
The situation is like, at the birthday party, you are responsible for cutting the cake, because you do not know which piece you will get, so you will try to cut each piece to the same size.
Under the curtain of ignorance, fairness and justice that has nothing to do with personal interests will emerge.
For this reason, DeepMind believes that applying the “curtain of ignorance ” to AI training may help promote fairness in the process of“ aligning ” AI with human values.
By “alignment ”, it means aligning AI ’ s wishes with those of humanity.
If AI shares fair values with humans, AI will not have the intention to destroy humanity.
White House convenes tech giants to discuss AI threats
However, even if AI does not intend to destroy humans, it may still have many negative effects on human society.
The Center for Artificial Intelligence and Digital Policy (CAIDP), a U.S. technology ethics organization, has complained to the Federal Trade Commission (FTC) that OpenAI ’ s latest large language model, GPT-4, is biased and deceptive and poses a risk to privacy and public safety.
The CAIDP lists potential threats that may arise from GPT-4, including: helping hackers churn out malicious code to exacerbate cyberattacks; and biased AI training data that may reinforce social stereotypes and make people of all races and genders vulnerable to unfair treatment. The FTC is investigating OpenAI, said FTC Chairman Lina Khan. "They cannot be separated from existing legislation and the Federal Trade Commission will actively enforce them," he said.
In an effort to make GPT-4 more secure, OpenAI hired 50 experts and academics to test GPT-4 against lies, language manipulation, and dangerous scientific common sense.
The OpenAI headquarters is pictured here. (Image: Wikipedia)
In early May 2023, the White House invited Google CEO Sundar Pichai, Microsoft CEO Satya Nadella, OpenAI founder Altman, and artificial intelligence startup Anthropic founder Dario Amodei to attend a conference to discuss the impact of AI on society.
Government officials at the meeting included Vice President Kamala Harris, Biden Chief of Staff Jeff Zients, National Security Adviser Jake Sullivan, National Economic Council Chairman Lael Brainard, and Commerce Secretary Gina Raimondo.
U.S. President Joe Biden also attended the meeting.
EU to pass world ’ s first AI regulatory law
Generative AI, while helping to improve lives, can also pose security, privacy and fraud issues, says Ms Ho.
She noted that AI companies have an ethical and legal responsibility to ensure the safety of their AI products, while at the same time working with governments to protect civil rights and privacy.
She stressed that the White House will work to advance potential new legislation and support new legislation to mitigate the potential harms of AI technology.
In contrast, Europe has taken a step ahead in AI legislation.
On 11 May 2023, the European Parliament ’ s Committee on Civil Liberties and Consumer Protection overwhelmingly approved a position paper calling for restrictions on the use of AI in Europe, a crucial first step towards the adoption of the world ’ s first AI regulation bill.
The draft bill will be submitted to the full European Parliament for a vote in June of the same year, after which representatives of the European Parliament, the Council of the European Union and the European Commission will work out the final terms of the bill in tripartite talks.
The European Parliament has adopted a position paper that strengthens restrictions on biometrics, facial recognition, and the use of AI by police in routine duties.
The parliament believes the move could lead to the world ’ s first AI regulation bill. (Image: Wikipedia)
On the other hand, the White House announced that Google, Microsoft, OpenAI, NVIDIA, Stability AI, Anthropic, and Hugging Face have all committed to participating in DEF CON 31, a computer security conference to be held in August 2023, so that their AI models will be tested and evaluated by hackers and AI experts.
Experts will try to identify errors, failures, and vulnerabilities in AI tools so that AI companies can solve existing problems in their models early on.
However, these AI companies simply agree to a one-time test, rather than a commitment to a continuous evaluation when launching or improving their products, and may therefore not be sufficient to meet the regulatory requirements.
Despite this, DEF CON 31 is still seen as the first step for an AI model to be publicly evaluated.
We hope that after each important first step in legislative regulation and public evaluation, we can put generative AI trains on the right track, so that everyone can safely benefit from technological innovation.
DEF CON is one of the largest computer security conferences in the world. In addition to cybersecurity experts and hackers, participants included staff from the FBI, the Department of Defense, and the Postal Inspection Service.
The conference covered areas such as software security, computer architecture, hardware modifications, and other vulnerable areas of information. (Image: DEF CON official website)
The content of the signed and / or unsigned articles published by Economic Times is the author's personal opinion and does not represent the position of Economic Times, and the role of Economic Times is to provide a free speech platform.
etnet won the HKEX Awards 2022 “Best Performing Securities Data Provider ” and“ Best Performing Derivative Data Provider ” ► Learn More
I want to respond
You may be interested
Enlarge display
I know. I know.
Featured Articles
• Life
• DIVA
• Healthy and good life

What breakthroughs has Hinton achieved through his 40+ years of work on artificial neural networks?

Breakthroughs that mimic biological brains

Hinton's neural network work enabled AI systems like ChatGPT, used by over 100 million monthly users.

Title:

Content: Meet the honorees ⭐ Mother's Day shopping Take our news quiz 📝 The Crossword
Proud Boys

4 Proud Boys found guilty of seditious conspiracy, latest AI warning: 5 Things podcast

Taylor Wilson
USA TODAY

On today's episode of the 5 Things podcast: Proud Boys, including leader Enrique Tarrio, guilty of seditious conspiracy for Jan. 6

Several Proud Boys have been found guilty of seditious conspiracy for the Jan. 6 Capitol attack. Plus, banking anxieties continue, USA TODAY World Affairs Correspondent Kim Hjelmgaard reports on protests over proposed reforms in Israel, an autopsy reveals Tyre Nichols was killed by blunt force trauma to the head, and USA TODAY Domestic Security Correspondent Josh Meyer looks at the latest debate around artificial intelligence.

Podcasts: True crime, in-depth interviews and more USA TODAY podcasts right here

Hit play on the player above to hear the podcast and follow along with the transcript below. This transcript was automatically generated, and then edited for clarity in its current form. There may be some differences between the audio and the text.

Taylor Wilson:

Good morning. I'm Taylor Wilson and this is 5 things you need to know Friday, the 5th of May 2023. Today, a verdict for the Proud Boys. Plus, more bank anxiety, and we hear the latest from protests in Israel.

Proud Boys leader Enrique Tarrio and three lieutenants were found guilty yesterday of entering a seditious conspiracy against the US government, leading to the January 6th, 2021 Capitol attack. A fifth Proud Boy was acquitted of the charge. Prosecutors said Tarrio was the leader of the plot, despite not being in Washington that day. His arrest two days before the insurrection on unrelated charges and the stabbing of several Proud Boys at a protest in December 2020 served as motivators to try and stop the certification of the 2020 presidential election, according to the government. Tarrio's attorneys argued that he was just the government's scapegoat. They said the true culprit of January 6th was former President Donald Trump.

PacWest Bancorp saw its shares plunge earlier this week, dropping more than 39% at one point. The bank said yesterday that it was considering asset sales and has been approached by several parties about a deal. The bank insists that it has not experienced a high number of customer withdrawals in the wake of the failure and sale of First Republic Bank after a modern day bank run. But anxiety over regional bank stability appeared to spread late this week. Comerica slumped more than 8% and TD Bank Group and First Horizon called off a planned merger citing regulatory hurdles.

Months long protests for and against proposed judicial reforms in Israel will continue this weekend, with tens of thousands expected on the streets of Tel Aviv and elsewhere. Many of the protests are accusing Prime Minister Benjamin Netanyahu's right wing coalition of using the reforms to get around the checks and balances of government, and of turning Israel into more of a religious state that could even amount to a dictatorship. Others say they just want their views reflected by a parliament they elected. I sat down with USA TODAY World Affairs Correspondent Kim Hjelmgaard, who recently traveled to Israel, to learn more. Kim, thanks for hopping on 5 Things.

Kim Hjelmgaard:

Thanks for having me.

Taylor Wilson:

Protests have erupted across Israel over these proposed judicial reforms. Some folks opposed to the reforms have said if they're enacted, Israel will not be a democracy anymore. Others even suggest the reforms would make Israel a dictatorship. What's your general perspective on that?

Kim Hjelmgaard:

My general perspective is that Israel is a pretty healthy democracy. Like all democracies, it's not perfect. Constitutional legal scholars say there is space for reform. And this is one of the things that the people who are leading these reforms are saying, look, we can't get laws passed that sort of reflect what our constituents want. The ability to, for example, have separate concerts for men and women, or we can't get laws passed that would allow us to kind of sufficiently build the infrastructure of settlements in the West Bank.

However, it's kind of problematic because if you look at something like a settlement in the West Bank, these things are not legal by international standards. They're often built on Palestinian land.

One of the things about these proposed reforms that the protestors are so angry about has to do with Prime Minister Benjamin Netanyahu. He's in the middle of a corruption case and he's on trial for it. He's suddenly taken an interest in these reforms because they kind of essentially enable him, through a majority in parliament which his government controls, to kind of get a get out of jail free card a bit. So let's say Netanyahu's convicted, there is the possibility that he can't be removed from power. So the protestors are kind of saying this is just not a healthy thing for a democracy.

Taylor Wilson:

Kim, you mentioned the international community. What is the US government's stance on these reforms and on all of the protests that have happened in recent months?

Kim Hjelmgaard:

US government, as some listeners may be aware, is Israel's biggest source of foreign military aid. The US was the first country in the world to recognize Israel as a country, and the Biden administration has expressed quite publicly, quite loudly, that it does not like the look of these reforms. It feels that they are not democratic, that they're problematic for various reasons.

Taylor Wilson:

And finally, Kim, what's next for these reform proposals and the protests in the coming months?

Kim Hjelmgaard:

Well, things have kind of been stalled since before the Passover holiday, which was last month, when essentially the Parliament went on recess. And Netanyahu, he was kind of faced with this growing escalating insurrection from the Israeli public. There was a series of kind of walkouts from different labor unions, teachers, airport workers went on strike. And they kind of reached this moment where Netanyahu was like, whoa, he needed to calm things down before all of Israeli society kind of unraveled. And so he paused it.

Parliament came back last week. The protestors are still there. The political establishment in Israel is kind of talking about how they're going to try to reach some kind of compromise on this. And nothing has really changed, and it is a kind of standoff where both sides are digging in. But over the last couple of weeks, pro-reform people have started to protest in bigger numbers. A week ago there was about 200,000 of them that showed up outside of the Knesset, which is the Israeli parliament.

So I think everyone in Israel, as far as I can tell, is kind of scratching their heads going, this is not getting any better. In fact, it's getting worse. And one of the places where it could go is another election. And Israel has had five elections since 2019, I believe it is, because they couldn't agree with each other about exactly how to move this country forward. So who knows where that would end up.

Taylor Wilson:

All right. USA TODAY World Affairs Correspondent Kim Hjelmgaard. Thanks so much.

Kim Hjelmgaard:

Thanks for having me.

Taylor Wilson:

An autopsy revealed yesterday that Tyre Nichols was killed by blunt force trauma to the head. The 29-year-old motorist died earlier this year after being brutally beaten by Memphis Police Officers. Nichols' family viewed the autopsy report this week, some four months after Tyre's death. Their attorney, Ben Crump, said the manner of death was homicide. Attorneys said the report was similar to an independent January autopsy that found Nichols suffered extensive bleeding.

♦

Artificial intelligence. No matter how you feel about it, the technology is here. That includes chatbots like ChatGPT, which recently passed a hundred million monthly active users, according to Reuters and others. I spoke with USA TODAY Domestic Security Correspondent Josh Meyer to learn more. Hi there, Josh.

Josh Meyer:

Good to be here. How are you?

Taylor Wilson:

Good, thanks. Thanks for hopping back on. Josh, the Biden White House is concerned about AI being developed by the tech sector and then unleashed on the public with little to no guardrails on how it might be used. What did they say this week?

Josh Meyer:

The Biden administration did have a meeting at the White House, led by Kamala Harris, with some of these tech leaders to talk about some of the reforms that the White House says are needed, including more transparency in the way these companies develop these technologies, giving access to the work in progress by critics and the public, just so they can weigh in on what's happening.

And also, the Biden administration last October released what they called the AI Bill of Rights. That's designed to sort of put more safeguards in place. Right now, that's just a recommendation. And so some critics that say the Biden administration hasn't gone far enough say that that needs to be mandatory, that these companies aren't going to really do much on their own, and that they're going to have to be forced to comply more and to do more in terms of protecting the safety, security, and the privacy of Americans as we go forward.

Taylor Wilson:

And there have been several prominent tech leaders warning about this recently, including the so-called godfather of AI. So Josh, who is the godfather of AI?

Josh Meyer:

The godfather of AI is a guy named Geoffrey Hinton. He's a renowned researcher, vice president at Google. He's also a Toronto professor, and he's spent the last couple of decades at the forefront of innovating and research and development into artificial intelligence and related topics, including ChatGPT.

Taylor Wilson:

And what are some of his concerns about this technology?

Josh Meyer:

He said that his concerns have mostly come about in the last few months, and one of the concerns is that it is becoming so advanced so quickly. One of the things that it's learning to do is simple reasoning. He said that he's concerned that somebody could actually take over the world and push humanity toward extinction.

He was at a seminar yesterday and one of the things that jumped out at me, and everybody else that was there, was he was asked by the panel's moderator, "What's the worst case scenario that you think is conceivable?" And without hesitation, Hinton said, "I think it's quite conceivable that humanity is just a passing phase in the evolution of intelligence."

Taylor Wilson:

Strong words, I would say. Geez.

Josh Meyer:

Yeah. And then he went on to say that even if we think that we're in control of the technology and we can just turn it off, he said it could easily be brought back to life again on another machine if given the proper instructions. And this is another quote from him at the MIT Technology Review conference yesterday. Hinton said, "And it may keep us around for a while to keep the power stations running, but after that, maybe not." So food for thought.

Taylor Wilson:

Yeah, food for thought. So do other experts agree with this pretty pessimistic outlook?

Josh Meyer:

Actually, after he said that, I wanted to find people that would take exception to it, and I talked to a lot of people. I looked around and a lot of people share his concerns. I did find some people that are a little bit more skeptical, including a longtime trusted source of mine who said, "I think that it's overstated. People need to take a step back. Take a deep breath."

I talked to a guy named Michael Hamilton, who's the co-founder of Critical Insight Risk Management. He's a former advisor to the Department of Homeland Security on tech issues. And he said that computer assisted machine learning, including artificial intelligence, will never be the kind of sentient, self-aware and all-knowing technology that people are afraid of, and that created the Terminator of movie fame. He said basically, artificial intelligence is an extremely sophisticated programming platform that can only go as far as humans allow it.

Taylor Wilson:

Josh, one concern is that AI could wipe out thousands, maybe millions of jobs by making them obsolete. What does he say on that point?

Josh Meyer:

Oh yeah, he's very concerned about that. And so is the White House, as a matter of fact, when they rolled out this new initiative. They said that's one of their biggest concerns. And they want to make sure that the developers of AI, which include Google, Microsoft, and some other companies, that they keep that in mind and make sure that there's guardrails there to prevent that kind of thing from happening.

But we do live in a capitalist economy. According to Hinton, he actually spoke very specifically about it, and he said that, we live in a world where profit comes first and the rich could get richer and the poor get poorer because of ways in which AI is used to do menial tasks that are often done by human beings at a lower range of the pay scale. He said, "It's going to cause huge increases in productivity. My worry is for those increases in productivity to put people out of work and make the rich richer and the poor poorer. And as you do that," Hinton said, "you make that gap bigger and society gets more and more violent."

Taylor Wilson:

Josh Meyer, thanks so much.

Josh Meyer:

Sure.

Taylor Wilson:

And happy Cinco de Mayo. The date marks Mexico's victory over the French empire at the Battle of Puebla in 1862.

Thanks for listening to 5 Things. We're produced by Shannon Rae Green, and our executive producer is Laura Beatty. Special thanks to Cherie Saunders and Alexis Gustin. I'm Taylor Wilson back tomorrow with another episode of 5 Things.

Featured Weekly Ad

Which AI system demonstrates the foundation laid by Hinton's pioneering research in deep learning and neural networks?

He has warned that unmanaged AI could become dangerous and surpass human intelligence.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What future risk did Hinton warn about AI?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

Hinton believes AI may lead to human extinction due to autonomous weapons and systems.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What dual impact did Hinton note AI could have in his 2021 speech?

What future risk did Hinton warn about AI?

What risks did Hinton associate with AI's rapid advancement?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

What severe risks did the March 2024 report warn about advanced AI models?

Development of uncontrollable human-targeting weapons

He has expressed concerns about AI's potential misuse in elections and wars.

Title:

Content: Geoffrey Hinton: GPT-4 is 100 times more knowledgeable than any human
Author: MIAO Yongqi
Published: Updated:
Computer scientist Geoffrey Hinton, known as the "godfather of artificial intelligence", announced Monday that he has resigned from Google. He has devoted his life to developing artificial intelligence systems, saying he "regrets his life's work" and is wary of the potential dangers of AI development.
In another recent interview, Hinton further talked about why he is afraid of AI development.
Hinton, 75, left Google a few days after the news broke in an interview with MIT Technology Review senior editor Will Douglas Heaven.
Hinton points out that the new generation of AI language models, especially the GPT-4, which came out in March, made him realize that these machines were moving in a direction that was much smarter than he thought, and he was afraid of these developments.
He is best known for a technique he proposed in the 1980s (with two colleagues) called backpropagation.
In short, the algorithms that allow machines to learn support almost all of today ’ s artificial neural networks, from computer vision systems to large language models.
It wasn ’ t until the 2010s that Hinton and his two recent graduates developed a “neural network ” that demonstrated its power, stronger than any computer ’ s ability to identify objects in images, and trained it to predict the next letter of a sentence, a precursor to today ’ s large-scale language patterns.
One of the students was Ilya Sutskever, the founder of OpenAI, who led the development of ChatGPT.
“We first thought it might be great. ”“ But it ’ s going to take a long time to realize that it needs to be done on a large scale to get good results. ”
In the 1980s, the discussion of “neural networks ” was considered a joke.
But Hinton doesn ’ t think so, and is working on this, software that mimics the abstract human brain and uses code as a connection between neurons. For 40 years, Hinton has viewed artificial neural networks as a clumsy attempt to mimic biological neural networks.
Now he thinks things have changed: he thinks there are better results when trying to mimic the behavior of the biological brain.
“It ’ s scary when you see it with your own eyes, ” he said.“ It ’ s a sudden change. ”
So why did ChatGPT surprise Hinton, too? He explained that the human brain has about 100 trillion connections, and “large language models have up to 500 billion, up to a trillion. ”
However, the knowledge of GPT-4 is a hundred times greater than that of any human.
So maybe it actually has a better learning algorithm than we do. "
He also pointed out that apart from the ability to learn, the ability to communicate is another kind of point.
“If you or I learn a new thing and want to teach it to another person, we can ’ t just send them a copy. ”
But artificial neural networks can do it.
It ’ s like there are 10,000 people here, and when one person learns a new thing, the other 9,999 people all learn it at the same time.
Hinton now believes that there are two types of intelligence: animal brains and artificial neural networks.
“It ’ s a completely different kind of intelligence.
“A new, better intelligence. ” Hinton believes that whether superintelligence is good or bad depends largely on whether you ’ re an optimist or a pessimist, and he says,“ mildly depressed, ” “that ’ s why I ’ m afraid. ”
“Whether these things are going to be smarter than us, I suddenly changed my mind. ”
I think they are very close to us now and they will be much smarter than us in the future, ” he said.
“How do we survive? ” he is particularly worried that people will use the tools he has developed to change the trajectory of human life, including elections and wars.
He said that he hopes to continue talking about AI security after leaving office and spend more time on “more philosophical work ”.“ As long as I ’ m still employed at Google, I can ’ t say what I want to say, ” he said. “I have a lot of good things to say about Google, and it would be more convincing if I wasn ’ t at Google. ”
Who is the godfather of AI computer scientist Geoffrey Hinton?
Hinton pioneered the basic technology of AI systems and became interested in artificial neural networks when he was a graduate student at the University of Edinburgh in 1972. In 2018, he and two experts in the field of deep learning were awarded the Turing Award, known as the “Nobel Prize in Computing ”.
What are the main concerns of “AI Godfather ” Geoffrey Hinton about the development of artificial intelligence?
He believes that the most direct impact is to promote the dissemination of false information and the loss of employment opportunities, and also worries about the use of this tool for evil, such as influencing elections and using it in war.

What does Hinton warn "bad actors" could use AI for?

To win wars or manipulate the electorate.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

Experts, including OpenAI co-founder Altman, have acknowledged AI's potential risks and called for more transparency and regulation.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Hinton's warnings have sparked a debate about the need for more careful management and regulation of AI development.

Title:

Content: The ‘Godfather of AI’ warns about potential dangers of the technology as he quits Google

British-Canadian computer scientist Geoffrey Hinton admits he has fears for the future of AI

In a Frankenstein-esque tale of maker and master, Geoffrey Hinton, 75, dubbed ‘the godfather of AI’, has left Google with a parting warning over the dangers of artificial intelligence.

In 2012, the British-Canadian computer scientist invented technology with two students at University of Toronto that would become the intellectual foundation for AI systems. Google purchased the rights to this neural network tech to the tune of $44 million, which also propelled Dr Hinton to receive the Turing Award in 2018, considered the Nobel Prize of computing.

Read More
The ultimate part-AI girl? One Tatler correspondent entrusts ChatGPT with her next assignment

ChatGPT’s the new It Girl in Town and now she’s got all the gossip, writes Dora Davies-Evitt in the April issue

Yet now, Dr Hinton has packed in the day job at Google to join a chorus of anxious experts demanding a rollback of AI research until more robust safety measures are designed and deployed. Dr Hinton told the BBC: ‘Right now, they’re not more intelligent than us, as far as I can tell. But I think they soon may be.’

While many look upon AI as a natural technological development akin to the internet that could lead to exciting breakthroughs for humanity, there are growing fears that AI is a Pandora’s box. Reflecting on the effects of his work, Dr Hinton said: ‘I console myself with the normal excuse: If I hadn’t done it, somebody would have,’ as he admitted, ‘it is hard to see how you can prevent the bad actors from using it for bad things.’

Read More
Cyber Society: Meet the NFT duo dominating the metaverse

Old Etonian digital artists Dominic Smith and Joe Carnell have caught the attention of Brooklyn Beckham, Steve Aoki and Jaden Smith

The scientist went on to warn that AI could be taught to ‘create sub-goals like “I need to get more power”’, and be harnessed by nefarious actors to wreak havoc. With innovation driven forward by the unstoppable competition between behemoths like Google and Microsoft, Dr Hinton warned innovation will only increase exponentially in the coming years.

There are those who are trying to apply the brakes to this runaway train. In March, an open letter was signed by over 1,000 tech leaders and researchers, including Elon Musk and fellow Turing Award winner Yoshu Bengio, calling for a six-month moratorium on AI development. A few days later, 19 leaders of the Association for the Advancement of Artificial Intelligence released their own letter on the risks of AI. The signatures included that of Eric Horvitz, chief scientific officer at Microsoft.

The main outcry over AI lies in its ability to create and disseminate false news and images, which the public may find increasingly hard to identify. AI also poses a threat to academia and careers (see: Tatler’s foray into the world of ChatGPT). Dr Hinton believes that AI will fundamentally disrupt the workplace and take over the ‘drudge work’.

Read More
Lady Meta: my stratospheric rise through the metaverse

The Crypto Fashion Week debutante on becoming VR’s favourite It Girl

However Google’s chief scientist, Jeff Dean, offered words of comfort, adding: 'We remain committed to a responsible approach to AI. We’re continually learning to understand emerging risks while also innovating boldly.’

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

The European Parliament approved an AI regulation bill in 2023 to mitigate AI development risks.

Hinton believes AI can contribute to many fields if developed and used responsibly.

Title:

Content: Wednesday, December 13, 2023
Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors

John Riopelle — obituary

Riopelle, John William It is with great sadness...

A.I. doesn’t bleed

by John Clinton, Ramsay New knowledge merges with...

Breakfast at the Legion, December 16

At the Almonte Legion Sat. December 16 Eggs to...
Science & NatureA.I. doesn't bleed

A.I. doesn’t bleed

by John Clinton, Ramsay

New knowledge merges with old; what you know shapes what you learn. Artificial neural networks have been studied and computer algorithms have been generated to understand how artificial, computer-generated, neurons, would store a concept, and how it would revise that concept if it was flawed.

Geoffrey Hinton, a computer scientist often called ‘the godfather of AI,’ is a leading figure in neural networks; studies inspired by the way neurons are connected in the human brain. A New Yorker magazine piece describes his collaborative work in the 1960s and 1970s developing neural nets that couldn’t do anything better than a child. The technology suddenly improved about a decade ago with the large increase in processing speed and Internet data availability.

According to Google Scholar, Hinton is the second most cited researcher among psychologists and the most cited among computer and cognitive scientists.

Hinton has been worried about the potential of AI to do harm and he often talks about the existential threat that AI might pose to the human species. He has used OpenAI’s ChatGPT and this has made him uneasy. He wrote “Fox News is an oxymoron” asking ChatGPT to explain the joke. (Initial reading of this caused me to ponder – a moron full of oxygen??) The first reply told him that this implied Fox News was fake news. When he called attention to the space between oxy and moron, it explained that Fox News was addictive, like the drug OxyContin. To him, this level of understanding represents a new era in AI.

In nature, wildlife learns how to be intelligent without access to concepts expressed in words. They learn to be smart (survive) through experience. Learning, not knowledge, is the engine of intelligence. There is no use trying to explain complicated ideas that you do not understand. First, you must understand how something works. Otherwise, you just produce nonsense.

Because neural networks are so strange, no one can predict how useful – or dangerous – AI will become. OpenAI’s GPT models involve billions of artificial neurons (data) which are profoundly different than biological brains. They are not alive. Our intuitions tell us that nothing resident in a browser tab could really be thinking in the way we do.

Because a human brain can run on oatmeal, the world can support billions of brains, all different. Each brain can learn continuously, rather than being trained once, then pushed out into the world (ship it!).

If the brain dies, the knowledge dies. If a computer dies, load up another computer. Ten thousand neural nets can learn ten thousand different things at the same time and share what they have learned. This immortality (knowledge perpetuity) and replicability suggest we should be concerned about digital intelligence taking over from biological intelligence.

Current AI technology is talkative and intellectual. The problems of physical intuition will be the challenge of the next decade says Yann LeCun, a French computer scientist. A teenager can learn to drive a car in twenty hours of practice with little supervision. AI systems don’t come close to doing this – except self-driving cars – and they are over-engineered, requiring the mapping of whole cities, hundreds of engineers, and hundreds of thousands of hours of training.

And then there is the problem of what some researchers call AI ‘hallucination’, which Hinton names ‘confabulation.’ AI systems confabulate by making up plausible answers to questions that stump them. In the human mind, there is no boundary between just making it up and telling the truth. Telling the truth is just making it up correctly. ChatGPT’s ability to make things up is a flaw, but also a sign of its humanlike intelligence.

When Hinton began his research, no one thought the technology would succeed. When it started to succeed, no one thought it would succeed so quickly. He expects AI will contribute to many fields, but he fears what will happen when powerful people abuse it. Think autonomous weapons. Hinton warns that even benign autonomous systems could wreak havoc. Yann LeCun has said there is an idea that if a system is intelligent it is going to want to dominate. But the desire to dominate has nothing to do with intelligence – it has to do with testosterone.

Recently, Hinton did not sign a popular petition that called for at least a six-month pause in AI research.

“China is not going to stop development for six months.”

“So what should we do?”

“I don’t know. If this were like climate change where we either must stop burning carbon or find a way to remove carbon from the atmosphere, we know what the solution looks like. Here, with AI, it’s not like that.”

Think of the AI story in which our intuitions about the specialness of the human mind are being dislodged by thinking machines, or, having stolen fire, we risk being burned.

Are we fooling ourselves, being taken in by our own machines and the companies that hope to profit from them? By seeking to re-create the knowledge systems in our heads, have we seized the forbidden apple? Have we risked exile from our charmed world? But who would choose not to know how knowing works?

Related

FOLLOW US

Latest

From the Archives

Hinton estimates a 10% chance of AI causing human extinction as it rapidly evolves and raises societal concerns.

Title:

Content: Report highlights the seriousness of artificial intelligence and warns of the threat of human extinction with a call for America to intervene
The world.
Publish
9 minutes read
(CNN) -- A new report commissioned by the State Department paints a worrying picture of the "catastrophic" national security risks posed by rapidly evolving artificial intelligence and warns the federal government is running out of time to avert disaster.
The findings were based on interviews with more than 200 people over more than a year, including senior executives from leading AI companies, cybersecurity researchers, weapons of mass destruction experts, and national security officials within the government.
The report, released this week by AI Gladstone, categorically suggests that more advanced AI systems could, in the worst case scenario, “pose an extinction-level threat to the human race. ”
The US State Department did not respond to a request for comment.
The warning in the report is another reminder that while the potential of AI continues to captivate investors and the public, there are real risks as well.
Jeremy Harris, CEO and co-founder of Gladstone AI, told CNN on Tuesday: “Artificial intelligence is already an economically transformative technology.
It can allow us to cure diseases, make scientific discoveries, and overcome challenges we once thought insurmountable. ”
"But it could also bring serious risks, including catastrophic risks, that we should be aware of."
“A growing body of evidence – including empirical research and analysis published at the world ’ s most important AI conferences – suggests that above a certain threshold of capability, AI systems are likely to become out of control. ”
White House spokeswoman Robin Patterson said President Joe Biden ’ s executive order on AI was “the most significant action any government in the world has taken to deliver on the promise and manage AI risk. ”
“The President and Vice President will continue to work with our international partners and urge Congress to pass bipartisan legislation to manage the risks associated with these emerging technologies, ” Paterson said.
A clear and urgent need to intervene
Researchers warn of two major dangers posed by large-scale artificial intelligence.
First, Gladstone AI said the most advanced AI systems could be armed to cause irreparable damage.
Second, there are particular concerns within AI labs that they may at some point “lose control ” over the very systems they are developing, with“ potentially devastating consequences for global security. ”
"The rise of artificial intelligence and artificial general intelligence has the potential to destabilize global security in ways reminiscent of the introduction of nuclear weapons," the report said, adding that there is a risk of an AI "arms race", conflict and "deadly accidents the size of weapons of mass destruction."
The Gladstone AI report calls for radical new steps aimed at countering this threat, including the launch of a new AI agency, the imposition of “emergency ” regulatory safeguards and restrictions on how much computer power can be used to train AI models.
The authors wrote in the report: "There is a clear and urgent need for the intervention of the United States government."
The report notes that although the work was produced for the State Department, its views “do not reflect the views ” of the agency or the U.S. government in general.
A government notice issued in 2022 by the State Department ’ s Nonproliferation and Disarmament Fund Office shows that the government is offering to pay up to $250,000 for an assessment of “proliferation and security risks ” associated with advanced AI.
Safety Concerns
Harris, Gladstone ’ s executive director of artificial intelligence, said his team ’ s “unprecedented level of access ” to public and private officials had led to startling conclusions.
Gladstone AI said it spoke to technical and leadership teams from chat owner OpenAI, Google DeepMind, Facebook parent company Meta and Anthropic.
In a video posted on Gladstone AI ’ s website announcing the report, Harris said: “Along the way, we ’ ve learned some disturbing things.
Behind the scenes, the safety and security situation in advanced AI seems largely inadequate compared to the national security risks that AI may soon pose somewhat. ”
The Gladstone AI report said competitive pressures were driving companies to accelerate AI development “at the expense of safety and security, ” increasing the likelihood that more advanced AI systems would be“ stolen ” and “weaponized ” against the United States.
The findings add to a growing list of warnings about the existential risks posed by AI — including from even some of the industry ’ s most powerful figures.
Nearly a year ago, Jeffrey Hinton, known as the “godfather of artificial intelligence, ” quit his job at Google and sounded the alarm about the technology he helped develop.
Hinton said there is a 10% chance that artificial intelligence will lead to human extinction within the next three decades.
Hinton and dozens of AI industry leaders, academics and others signed a statement in June saying that “mitigating the extinction risk of AI must be a global priority. ”
Business leaders are increasingly concerned about these risks – even as they invest billions of dollars in AI.
Last year, 42% of CEOs surveyed at last year ’ s Yale CEO Summit said AI has the potential to destroy humanity five to ten years from now.
abilities similar to human abilities to learn.
Gladstone AI in its report pointed to some prominent individuals who have warned about the existential risks posed by artificial intelligence, including Elon Musk, Federal Trade Commission Chairman Lena Khan, and a former senior executive at OpenAI.
Some employees at AI companies share similar concerns privately, according to Gladstone AI.
“An individual at one of the well-known AI labs expressed the view that if a specific next-generation model of AI were launched without access restrictions, it would be ‘ very bad ’, because the model ’ s potentially convincing ability could ‘ break democracy ’ if leveraged in areas such as election interference or voter manipulation, ” the report said.
Gladstone said she had asked AI experts in some labs to share their personal estimates privately about the likelihood that an AI incident could lead to “irreversible global effects ” in 2024.
Estimates ranged from 4 percent to as much as 20 percent, according to the report, which notes that the estimates were informal and likely to be heavily biased.
One of the biggest surprises is how quickly artificial intelligence is evolving — specifically artificial general intelligence (AGI), a hypothetical form of artificial intelligence that has a human-like or even superhuman learning ability.
The report says AI is seen as “the main driver of catastrophic risks caused by loss of control, ” and notes that OpenAI, Google DeepMind, Anthropic, and Nvidia have all publicly stated access to AI by 2028 — though others believe it ’ s far beyond.
Gladstone AI points out that disagreements over AI timelines make it difficult to develop policies and safeguards, and there is a risk of a slowdown in regulation as technology evolves.

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

Hinton has advised governments to manage AI risks and suggested measures like universal basic income to mitigate its negative employment effects.

Title:

Content: Information Technology
The father of artificial intelligence urges governments to face its risks before disaster
Jeffrey Hinton, described as the father of artificial intelligence, on Wednesday urged governments to intervene to ensure that machines do not control society.
Hinton made headlines in May when he announced his resignation from Google to speak more freely about the dangers of artificial intelligence, shortly after the launch of ChatGPT, which captivated the world.
The artificial intelligence scientist, who is studying at the University of Toronto, spoke to a crowd at the Collagen Technology Conference in the Canadian city.
The conference attracted more than 30,000 startup founders, investors and tech workers, most of whom were eager to learn how to ride the wave of artificial intelligence rather than hear lessons about its risks or calls for governments to intervene.
“Before AI becomes smarter than us, I think the people who develop it should be encouraged to put a lot of effort into understanding how it can try to take control of us, ” Hinton said.
“Now there are 99 highly intelligent people trying to make AI better, and one very intelligent person trying to figure out how to stop it from taking control, and maybe we should be more balanced. ”
Hinton warned that the dangers of artificial intelligence must be taken seriously.
“I think it ’ s important for people to understand that this is not science fiction or just fear, ” he said, adding:“ It ’ s a real risk that we have to think about, and we have to figure out how to deal with it first. ”
Hinton expressed concern that AI would deepen inequality, as the vast gains from its productivity would go to the rich, not the workers.
“Wealth will not go to the people who work, it will make the rich richer, not the poor, and this is a very bad society, ” he said.
He also pointed to the danger of “fake news ” that can be created by robots such as ChatGPT, hoping to mark the content generated by artificial intelligence programs as central banks mark coins.
He stressed that it is important to “try, for example, to distinguish everything that is fake as fake, ” and said,“ I don ’ t know if we can do it technically or not. ”
“The Island Net ”

What risks did Hinton associate with AI's rapid advancement?

The EU's Artificial Intelligence Act establishes a risk-based approach to AI governance.

Title:

Content: EU AI Regulations

AI REGULATION IN THE EU

The EU AI Act (COM/2021/206) is hailed as the first comprehensive regulation on AI. It represents a significant milestone in AI governance via legislation. It aims to establish a harmonised framework for AI regulation across EU member states.

The Act's key provisions include a risk-based approach to AI governance. Specifically, with stringent requirements for high-risk AI systems to undergo conformity assessments. These assessments are conducted by notified bodies accredited by EU member states, instilling accountability and oversight in the development and deployment of high-risk AI applications.

Additionally, the Act imposes strict prohibitions on certain AI applications deemed unacceptable. Social scoring systems and real-time biometric identification in public spaces are a good example of this. By delineating clear boundaries on permissible AI applications, the EU aims to safeguard fundamental rights, including privacy, non-discrimination, and autonomy, while fostering public trust in AI technologies.

To facilitate effective implementation and enforcement of the AI Act, the legislation establishes the European Artificial Intelligence Board (EAIB). Comprising representatives from EU member states, the EAIB is tasked with providing guidance, monitoring compliance, and fostering international cooperation on AI governance. Furthermore, the Act empowers national competent authorities to enforce regulatory requirements and impose sanctions for non-compliance, ensuring robust enforcement mechanisms across the EU.

The EU AI Act (COM/2021/206) is hailed as the first comprehensive regulation on AI. It represents a significant milestone in AI governance via legislation. It aims to establish a harmonised framework for AI regulation across EU member states.

The Act's key provisions include a risk-based approach to AI governance. Specifically, with stringent requirements for high-risk AI systems to undergo conformity assessments. These assessments are conducted by notified bodies accredited by EU member states, instilling accountability and oversight in the development and deployment of high-risk AI applications.

Additionally, the Act imposes strict prohibitions on certain AI applications deemed unacceptable. Social scoring systems and real-time biometric identification in public spaces are a good example of this. By delineating clear boundaries on permissible AI applications, the EU aims to safeguard fundamental rights, including privacy, non-discrimination, and autonomy, while fostering public trust in AI technologies.

To facilitate effective implementation and enforcement of the AI Act, the legislation establishes the European Artificial Intelligence Board (EAIB). Comprising representatives from EU member states, the EAIB is tasked with providing guidance, monitoring compliance, and fostering international cooperation on AI governance. Furthermore, the Act empowers national competent authorities to enforce regulatory requirements and impose sanctions for non-compliance, ensuring robust enforcement mechanisms across the EU.

US AI Regulations

In contrast, the AI regulatory landscape in the US is characterised by a patchwork of laws and guidelines. As usual, reflecting a more decentralised and sector-specific approach. Federal agencies such as the Federal Trade Commission (FTC) and the National Highway Traffic Safety Administration (NHTSA) have issued guidelines and regulations addressing specific aspects of AI, such as consumer protection and autonomous vehicles. However, comprehensive federal legislation on AI remains elusive, with regulatory efforts primarily focused on addressing sector-specific challenges.

The Department of Defence (DoD) is actively engaged in regulating AI technologies. In particular, within the context of national security and defence applications. The DoD has issued guidelines and policies for the ethical development and use of AI in military operations, including principles for AI governance, human-AI collaboration, and risk management. It also collaborates with industry partners and academia to advance AI research while ensuring national security interests are upheld.

Beyond the FTC, NHTSA, and DoD, several other federal agencies are involved in regulating AI technologies within their respective domains. The Food and Drug Administration (FDA) oversees the regulation of AI-driven medical devices and diagnostic tools, ensuring safety, efficacy, and accuracy standards are met. Similarly, the Department of Homeland Security (DHS) addresses AI-related cybersecurity threats, while the Department of Justice (DOJ) focuses on legal and ethical considerations in AI applications, such as predictive policing and criminal justice reform.

Challenges and Disparities

AI REGULATION

The result is a heterogeneous system of laws and regulations. Against this backdrop, businesses, developers, and policymakers face the challenge of navigating a complex and evolving regulatory landscape. While the EU AI Act provides a comprehensive framework for AI governance in the EU, the regulatory environment in the UnS remains fragmented, with varying approaches across states and sectors. This disparity poses challenges for multinational companies operating in both jurisdictions, as they must reconcile conflicting regulatory requirements and ensure compliance with evolving standards.

UK AI Regulations

AI REGULATION in the UK

The AI Sector Deal is the UK government's strategic initiative to grow their AI legislative scope. It represents a concerted effort to position the UK as a global leader in AI innovation, research, and development. It was released in 2018 as part of the Industrial Strategy, aiming to leverage the transformative potential of AI technologies to drive economic growth, improve public services, and address societal challenges.

Key components of the Deal include substantial public and private sector investments, primarily in AI research, initiatives to foster AI talent development, and measures to promote ethical and responsible uses of AI technologies. Furthermore, the deal emphasises collaboration between industry, academia, and government to accelerate AI innovation and adoption across various sectors.

This outlines the UK's commitment to invest in AI research and innovation. In fact, the government pledged to invest £603 million in AI-related initiatives; with an additional £342 million in private sector investment, totalling £945 million. This underscores the government's recognition of AI as a strategic priority for economic growth and improving societal outcomes.

Moreover, the Deal places a strong emphasis on skills development and education. This aims to ramp up the UK workforce, giving them the necessary tools to thrive in an AI-driven economy.

Initiatives such as the AI Skills and Talent Package aim to support a wide-range development of AI skills. In fact various educational levels are included, from primary schools to universities; promoting diversity and inclusivity in the AI workforce.

In addition to fostering innovation and talent development, the AI Sector Deal underscores the importance of ethical and responsible AI development and deployment. It includes provisions for establishing an AI Council to provide guidance on AI policy and ethics, as well as initiatives to develop standards and best practices for AI governance and regulation.

Navigating the AI Frontier: Conclusion

AI REGULATION

While western governments are starting to take AI seriously, diverging legislations in a globalised world pose a daunting challenge. As businesses, developers, and policymakers navigate the complex and evolving regulatory landscape, they must reconcile differing approaches and ensure compliance with evolving standards. Multinational companies operating across jurisdictions face challenges in navigating regulatory disparities. However, initiatives such as the EU AI Act and the UK's AI Sector Deal provide guiding frameworks for responsible AI governance, fostering innovation while safeguarding societal interests.

The content of this article is intended to provide a general guide to the subject matter. Specialist advice should be sought about your specific circumstances.

International cooperation on AI regulation is crucial, with organizations like the EU and US government playing a key role.

Title:

Content: AI Regulation: Senators Unveil AI Plan, Open AI CEO Wants International Agency

A growing chorus of lawmakers and technology leaders are calling for new regulations to govern the rapid rise of artificial intelligence (AI) as the transformative but largely unchecked technology permeates more aspects of daily life.

On Wednesday (May 15), a bipartisan group of senators unveiled a long-awaited plan to bolster U.S. AI efforts, calling for a significant funding boost while largely deferring on the thorny issue of regulating the rapidly advancing technology.

The legislative blueprint, laid out in a 20-page document titled “Driving U.S. Innovation in Artificial Intelligence,” urges ramping up government and private-sector AI research and development to $32 billion annually by 2026.

The plan was introduced by Senate Majority Leader Chuck Schumer, D-N.Y., and three colleagues.

National Movement for AI Regulations

U.S. politicians have been calling for more AI regulations for some time.

Sen. Mitt Romney demanded last month increased federal regulation of AI. However, such efforts are likely to encounter obstacles due to the technology’s rapid development and broad applications, making effective oversight a complex challenge, according to experts. While many acknowledged the potential risks associated with AI, they emphasized the difficulty in determining which AI systems require stringent regulation and underscore the need to strike a balance between fostering technological innovation and mitigating those risks.

AI regulation is facing headwinds at the state level. Colorado and Connecticut introduced legislation this year to become national leaders in regulating artificial intelligence, targeting companies that develop and utilize AI systems and prohibiting discrimination in critical services such as healthcare, employment and housing. However, Connecticut’s efforts collapsed after a veto threat from the Democratic Governor, citing concerns about stifling the nascent industry. At the same time, Colorado’s bill faces intense pressure from the tech lobby, arguing against a state-by-state regulatory approach, leaving lawmakers nationwide closely monitoring the outcome.

The national movement to rein in AI is part of a larger global effort. The U.S. and China are set to engage in their first high-level talks on AI, which experts believe could significantly impact the future of international commerce. The discussions aim to establish a foundation for managing AI technology and regulation, shaping policies, cooperation and safeguards against accidental mismanagement or deliberate weaponization that could devastate markets, industries and security systems.

OpenAI CEO Wants a Global AI Agency

The private sector is also pushing for change.

OpenAI CEO Sam Altman has expressed support for establishing an international agency to regulate artificial intelligence, citing concerns about the potential for “significant global harm” from advanced AI systems shortly.

Speaking on the “All-In” podcast on Friday (May 10), Altman emphasized the need for a balanced approach to regulation, cautioning against excessive and insufficient oversight. He believes that AI systems could soon have negative impacts that transcend national borders, necessitating an international regulatory body to ensure the safety of the most potent AI models.

“I think there will come a time in the not-so-distant future — like we’re not talking decades and decades from now — where frontier AI systems are capable of causing significant global harm,” Altman said on the podcast.

He said he believes AI systems will have a “negative impact way beyond the realm of one country” and wants to see them regulated by “an international agency looking at the most powerful systems and ensuring reasonable safety testing.”

Experts agree that decisive action is needed to address AI risks.

Title:

Content: Presented By
Getty Images
Ideas
Jan Brauner is a Ph.D. researcher in Artificial Intelligence at the University of Oxford, focusing on the safety of AI systems and their application in public health.
Alan Chan is a Ph.D. student at Mila, a research institute in Montreal focusing on AI, where he works on technical and socio-technical problems in AI safety. He's particularly interested in evaluation and AI regulation.

In May, more than 100 artificial intelligence (AI) professors, including some of the field's leading experts, scholars from other areas, and AI executives signed a one-sentence statement: "Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war.” Many signing researchers have explained their reason for worry: the risk that we might build powerful AI systems that we cannot control within this decade or the next ones.

Some have suggested the statement is an industry ploy to hype up AI companies’ products or influence regulation, ignoring that most of the signatories—ourselves included—are academics who do not work for industry. But the most common concern we have heard is that, by focusing on the risk of extinction, the statement distracts from present-day AI harms. As volunteers involved in collecting signatures for and constructing the statement, we disagree because both problems share a common core. The false dichotomy between ongoing harms and emergent risks makes it needlessly difficult to address common root causes.

AI poses many ongoing problems. AI systems can sustain human rights abuses, perpetuate systemic discrimination, and entrench power imbalances. Because AI systems are often widely deployed, harms can reach massive scales. For example, tens of thousands of families were pushed into poverty when the Dutch Tax and Customs Administration wrongly accused them of fraud and requested they pay back large sums of money, based on risk profiles created with AI systems.

The root causes of AI harm

There are several root causes that contribute to many instances of the harm caused by AI. One is that we do not know how to design AI systems that reliably behave exactly as we intend them to. For example, a health system was designed to allocate care based on need but discriminated against Black hospital patients. It turned out the algorithm used health care costs as a proxy for need, but institutionalized racism means that less money has been spent on Black patients historically. In many similar cases, companies do not explicitly set out to build harmful AI systems. Instead, creating state-of-the-art AI systems requires vast amounts of data, and the AI systems unintendedly inherit the biases encoded in this data.

Another cause is competitive pressures and limited accountability. There is often a strong economic incentive to deploy AI systems without sufficient safety checks. For example, Microsoft rushed the release of the Bing chatbot, which resulted in the chatbot threatening and insulting users. When the Dutch Tax Administration replaced human judgment with AI systems, this, too, happened in the name of efficiency.

Without decisive action to address these root causes, increasingly powerful and widely deployed AI systems will cause even more pervasive and significant harm. Many experts believe future AI systems may outmatch humans in crucial cognitive skills, such as social persuasion, planning, and development of novel technologies. Just as these cognitive abilities enabled humanity to control the fate of other species, the same skills could enable smarter AI systems to out-perform us. Given competition and limited accountability, there would be pressure on organizations to replace expensive human labor with AI systems. Economic forces encourage the rapid deployment of new AI systems (at the cost of safety testing), making them ever more powerful, building general (and potentially more powerful) systems rather than narrow (and potentially more controllable) systems, and increasing the autonomy of AI systems to take action in the world. AI systems could increasingly control our society's key productive, managerial, and military capacities. By then, we must have figured out how to design systems that always and truly behave as we intend. Otherwise, powerful AI systems that pursue goals at odds with humanity could lead to human marginalization or even extinction.

Read More: An AI Pause is Humanity's Best Bet for Preventing Extinction

Moreover, many researchers expect us to develop such advanced AI systems very soon. Companies are pouring more money and talent into AI development while the cost of computing power is decreasing. Simply using more computing power and data has reliably produced more capable AI systems, while AI algorithms have also improved. After seeing the rapid progress in AI over the past five years, Geoffrey Hinton, a founding father of modern AI, now expects that AI could broadly surpass human cognitive abilities—such as persuasion, planning, and scientific reasoning—within five to 20 years. Such time horizons are shared by many in the AI research community.

Twenty years is short; in discussions about the climate crisis, we regularly consider effects on such timescales. And just as climate change requires us to face air pollution and ongoing natural disasters as well as prevent future, even more, extreme weather events, we must tackle various AI risks and harms simultaneously. Even if we might be a couple of decades away from AI systems that are smarter than humans, that is little time to create the complex global governance structures necessary for this technology.

Work to address ongoing harms sometimes differs from work to manage extinction risk. We do not wish to erase nuance or potential differences between the perspectives. Yet, given common root causes, there is much room for collaboration and cooperation.

Four possible interventions

Many interventions could address the root problems. First, the public currently has little to no say over what models are built and how they are deployed. For example, those most affected by welfare systems have had little say in their automation. Private companies decide which risks are acceptable, as they have free rein over computing power and data, the key levers of AI development. Stronger democratic oversight over the supply of computing power and data would enhance public control over AI development and associated risks. For example, governments can monitor when large amounts of computing power are being used and for what purpose.

Second, a strong auditing regime, where independent third-parties would scrutinize the practices and development processes of AI labs, would help reduce risks overall. Auditing has already surfaced previously overlooked harms, such as bias in facial recognition, and could catch future failure modes like AI systems subverting human control or replicating autonomously. A standards body could ensure  AI systems, both before and after deployment, meet specified safety guidelines. Domestic agencies could enforce compliance, while an international organization would create universal standards.

Third, we should require meaningful human oversight of critical AI decisions, and avoid very-high-risk use cases such as lethal autonomous weapons. Uncertainty about AI systems' current and near-future capabilities means we should proceed cautiously around their deployment in critical domains.

Fourth, we should rebalance the  funding going into AIs and urge companies to spend less on making them smarter while increasing funding into making them safer, more transparent, and studying their social impacts. While it is good that industry labs are funding such research, this funding is liable to change with market conditions. Much more public funding for non-industry groups is required.

The development of increasingly powerful AI systems poses increasingly vast societal-scale risks. The complexity of these risks requires cooperation between people with potentially different motivations but with a shared interest in ensuring that AI development proceeds in a just and beneficial way.

More Must-Reads From TIME

Contact us at letters@time.com.

You May Also Like
EDIT POST

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

Governments and companies must collaborate to establish AI regulations, allocating at least one third of funding to safety and ethics.

Title:

Content: Governments, firms should spend more on AI safety, top researchers say

By

'At least one third of their AI research and development funding'.

Artificial intelligence companies and governments should allocate at least one third of their AI research and development funding to ensuring the safety and ethical use of the systems, top AI researchers said in a paper.

The paper, issued a week before the international AI Safety Summit in London, lists measures that governments and companies should take to address AI risks.

"Governments should also mandate that companies are legally liable for harms from their frontier AI systems that can be reasonably foreseen and prevented," according to the paper written by three Turing Award winners, a Nobel laureate, and more than a dozen top AI academics.

Currently there are no broad-based regulations focusing on AI safety, and the first set of legislation by the European Union is yet to become law as lawmakers are yet to agree on several issues.

"Recent state of the art AI models are too powerful, and too significant, to let them develop without democratic oversight," said Yoshua Bengio, one of the three people known as the godfather of AI.

"It (investments in AI safety) needs to happen fast, because AI is progressing much faster than the precautions taken," he said.

Authors include Geoffrey Hinton, Andrew Yao, Daniel Kahneman, Dawn Song and Yuval Noah Harari.

Since the launch of OpenAI's generative AI models, top academics and prominent CEOs such as Elon Musk have warned about the risks on AI, including calling for a six-month pause in developing powerful AI systems.

Some companies have countered this, saying they will face high compliance costs and disproportionate liability risks.

"Companies will complain that it's too hard to satisfy regulations - that 'regulation stifles innovation' - that's ridiculous," said British computer scientist Stuart Russell.

"There are more regulations on sandwich shops than there are on AI companies."

Got a news tip for our journalists? Share it with us anonymously here.
Tags:

Most Read Articles

Services Australia's digital credential sharing with NSW on ice

CBA to test products and messaging on AI-created 'customers'

Australian Federal Police officers using more online face search tools

ANZ targets 3000 engineers to use GitHub Copilot

Log In

  |  Forgot your password?

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

The public should carefully consider AI development's potential risks and benefits.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.