Geoffrey Hinton is a renowned cognitive psychologist and computer scientist who is known as the "father of artificial intelligence" or the "godfather" of artificial intelligence.

He has made significant contributions to the development of artificial intelligence, particularly in the field of neural networks and deep learning.

Hinton's work has enabled the creation of AI systems such as Google's Bard chatbot and ChatGPT.

He was awarded the Turing Award in 2018 for his research breakthroughs in artificial intelligence.

Hinton has expressed regrets over his life's work on AI development due to the potential dangers it poses.

He believes that AI is becoming smarter than humans and may lead to mass unemployment.

Hinton also warns that AI can create a world where reality is unclear and can be used to manipulate humans.

He is concerned about the impact of AI on human life trajectory and the potential for AI to spread false information easily.

Hinton's warnings about AI dangers and mismanagement have made headlines, with many experts agreeing that AI poses significant risks to society and humanity.

He has called for governments to intervene in AI development and for scientists to control AI before scaling it up.

Hinton has also suggested marking AI-generated content to identify fakes and has warned that the average person may not know what's true.

Other experts, including Elon Musk, have led calls for a moratorium on AI development due to the potential risks it poses.

The European Parliament has also called for a summit to control advanced AI development.

Hinton's resignation from Google was motivated by his desire to speak freely about AI risks without employer involvement.

He has stated that he wants to raise awareness about AI risks and has warned that AI could potentially eliminate humans.

Hinton's warnings have sparked a debate about the need for responsible AI development and the potential consequences of creating advanced AI systems.

The public should understand that AI poses significant risks and that experts like Hinton are calling for caution and regulation in the development of AI systems.

The development of safe and reliable AI systems is a complex challenge that requires a comprehensive approach, involving technical, social, and regulatory considerations.

Established methodologies from cybersecurity are necessary for AI accountability, and novel AI auditing techniques are needed for AI-specific accountability mechanisms.

The development of safe and reliable AI systems also requires a focus on cybersecurity, as AI systems are vulnerable to cyberattacks and can be used for misinformation and social engineering.

Global initiatives, such as the AI Safety Institutes announced by the US and UK, are working to address these challenges and develop guidelines for secure AI systems.

The use of techniques such as Lyapunov functions and α,β-CROWN verifier can help ensure the safety and stability of robots and autonomous vehicles powered by neural networks.

The Biden administration has created an AI Safety and Security Board with 22 initial members, including tech CEOs, to identify potential security threats from AI and develop recommendations for critical infrastructure stakeholders.

The board aims to prevent AI-related disruptions to services and includes government officials, with the Department of Homeland Security establishing an advisory panel on AI threats.

CoSAI, an open-source initiative hosted by OASIS, was formed by 14 major AI companies to provide guidance and tools for secure AI systems, focusing on mitigating AI risks like model theft and data poisoning.

The US and UK have partnered to safety test AI models, and have established AI Safety Institutes to develop a common approach to AI safety testing and share information on AI capabilities and risks.

The EU's AI Act requires companies to disclose safety test results, and the US President's executive order requires safety testing, demonstrating the growing recognition of the need for rigorous testing and evaluation of AI systems.

Experts believe that future AI systems may outmatch humans in cognitive skills, and that stronger democratic oversight is needed over AI development and deployment to prevent potential harms.

Independent auditing can help reduce AI risks and surface previously overlooked harms, and rebalancing funding to prioritize AI safety and transparency is necessary to ensure that AI development is aligned with human values.

The US and UK collaboration on AI safety is a key development, and the establishment of AI Safety Institutes in both countries marks a significant step towards ensuring the safe development and deployment of AI.

The European Union enacted an AI Regulation on February 2, 2024, which aims to ensure AI systems are safe and respect rights.

The AI Act applies to businesses operating within the EU, as well as companies outside the EU territory, and requires them to compile an inventory of their AI models.

AI models are classified according to associated risks, and high-risk AI models must comply with strict requirements, including establishing governance and monitoring measures.

Companies that fail to comply with the AI Act may face penalties ranging from €10 million to €40 million, or up to 7% of the company's global annual turnover.

In the United States, California has proposed AI regulation with safety standards, including pre-deployment safety testing and cybersecurity protections for large AI developers.

The US government plays a significant role in setting AI standards, and the Biden administration has made efforts to develop AI standards, including an executive order that establishes new standards for AI safety and security.

President Joe Biden's Executive Order requires developers to share safety test results with the U.S. government and protects Americans' privacy and advances equity.

The Order also aims to study AI's labor-market impacts and seeks to strengthen federal support for workers.

The Biden Administration focuses on worker protections and responsible AI development, and the OFCCP will publish guidance on nondiscrimination in hiring involving AI technology.

The National Institute of Standards and Technology will draft guidelines for safe, secure, and trustworthy AI system development, and security testing and "red teaming" of AI will become more relevant for employers.

The European Union's Artificial Intelligence Act sets global standards for AI development and use, and promotes trustworthy AI development and use in the EU.

The AI Act establishes a risk-based approach to AI governance and imposes strict prohibitions on certain AI applications, including manipulative persuasion and social scoring systems.

The EU AI Act safeguards fundamental rights, including privacy and non-discrimination, and non-EU companies using EU customer data must comply with the AI Act.

The US lacks comprehensive AI regulation, but the Biden administration has issued executive orders and guidelines to regulate AI development and safety.

The US government oversees AI development for national security, and companies must disclose safety results to US agencies.

The National Institute of Standards and Technology sets safety test standards, and the Department of Homeland Security applies standards to critical infrastructure.

Experts are skeptical about the effectiveness of new regulations, and the AI industry lacks standard testing safety protocols.

The administration faces the challenge of creating reasonable standards that balance safety and innovation.

The US and EU are collaborating on a voluntary AI code of conduct, and 97% of businesses expect to use AI to improve efficiencies and cut costs.

However, the US lacks data privacy regulations, which hinders AI safety efforts, and China's AI development has prompted the US to avoid stiff regulation.

The term "AI safety" is vague and open to interpretation, and the National AI Commission Act proposes a 20-member commission to study AI regulation.

Geoffrey Hinton's warnings about the dangers of unmanaged AI have made headlines, but the current AI regulation standards and efforts to address AI safety concerns are ongoing and evolving.

The UK has pledged 80 million pounds for AI projects globally, with a focus on supporting AI expertise in Africa, and establishing eight new AI research labs in African universities.

The United Nations has adopted a resolution on safe artificial intelligence systems, which aims to promote sustainable development and human rights, and calls for governments to collaborate with the private sector on AI safety.

Over 120 countries co-sponsored the UN resolution, which establishes clear international standards for AI and protects citizens' safety, privacy, and human rights.

The Global AI Safety Summit aims to mitigate AI risks, and has been hosted by the UK, with tech companies and AI experts in attendance, including Elon Musk, who has called for a regulatory framework for AI.

China, the US, and the EU have agreed to work together on AI safety, and have signed the "Bletchley Declaration" for AI oversight, which marks a significant step towards international cooperation on AI safety.

The US has released an executive order on AI safety, which identifies areas of concern with AI use, including labor and cybersecurity, and requires federal agencies to develop principles to mitigate AI harms to workers.

The executive order also promotes a pro-union agenda across the government and seeks to support workers' collective bargaining rights, highlighting the need for careful consideration of the social implications of AI development.

Geoffrey Hinton is a renowned cognitive psychologist and computer scientist who is known as the "father of artificial intelligence" or the "godfather" of artificial intelligence.

Title:

Content: AI ’ s “godfather ” interviewed by the BBC, warning that artificial intelligence may be smarter than humans
AI ’ s “godfather ” interviewed by the BBC, warning that artificial intelligence may be smarter than humans
Geoffrey Hinton, known as the “godfather ” of artificial intelligence (AI), has resigned from Google.
He warned that developments in the field of artificial intelligence pose increasing dangers.
In a statement to The New York Times, Dr. Hinton said he regretted his current job.
Dr. Hinton ’ s pioneering research in neural networks and deep learning paves the way for current AI systems such as Google ’ s Bard chatbot and Microsoft ’ s ChatGPT.
The cognitive psychologist and computer scientist told the BBC that chatbots may soon be smarter than humans.

He has made significant contributions to the development of artificial intelligence, particularly in the field of neural networks and deep learning.

Title:

Content: AI ’ s “godfather ” interviewed by the BBC, warning that artificial intelligence may be smarter than humans
AI ’ s “godfather ” interviewed by the BBC, warning that artificial intelligence may be smarter than humans
Geoffrey Hinton, known as the “godfather ” of artificial intelligence (AI), has resigned from Google.
He warned that developments in the field of artificial intelligence pose increasing dangers.
In a statement to The New York Times, Dr. Hinton said he regretted his current job.
Dr. Hinton ’ s pioneering research in neural networks and deep learning paves the way for current AI systems such as Google ’ s Bard chatbot and Microsoft ’ s ChatGPT.
The cognitive psychologist and computer scientist told the BBC that chatbots may soon be smarter than humans.

What breakthroughs has Hinton achieved through his 40+ years of work on artificial neural networks?

Breakthroughs that mimic biological brains

Hinton's work has enabled the creation of AI systems such as Google's Bard chatbot and ChatGPT.

Title:

Content: AI ’ s “godfather ” interviewed by the BBC, warning that artificial intelligence may be smarter than humans
AI ’ s “godfather ” interviewed by the BBC, warning that artificial intelligence may be smarter than humans
Geoffrey Hinton, known as the “godfather ” of artificial intelligence (AI), has resigned from Google.
He warned that developments in the field of artificial intelligence pose increasing dangers.
In a statement to The New York Times, Dr. Hinton said he regretted his current job.
Dr. Hinton ’ s pioneering research in neural networks and deep learning paves the way for current AI systems such as Google ’ s Bard chatbot and Microsoft ’ s ChatGPT.
The cognitive psychologist and computer scientist told the BBC that chatbots may soon be smarter than humans.

Which AI system demonstrates the foundation laid by Hinton's pioneering research in deep learning and neural networks?

He was awarded the Turing Award in 2018 for his research breakthroughs in artificial intelligence.

Title:

Content: General Supervision
Elham Aboul Fath
Editor-in-Chief
Thank you for your patience.
General Supervision
Elham Aboul Fath
Editor-in-Chief
Thank you for your patience.
Artificial Intelligence Godfather Geoffrey Hinton: Regrets Inventing This Thing
Google is racing to develop its own AI tool Bard to be a strong competitor to ChatGPT and Microsoft ’ s Bing AI search engine, but it seems that Google ’ s hasty policy to roll out generative AI products was not in line with the desire of all workers.
Google Vice President Geoffrey Hinton announced to The New York Times his resignation from Google in April.
The departure of Hinton, nicknamed the “father of artificial intelligence ” and the first to adopt ChatGPT prototypes in 2012, is a blow to a company the size and fame of Google, being one of the most prominent figures in the field.
Dr. Hinton said that he quit his job at Google after more than a decade and gained a very good reputation in the field, so he can speak freely about the dangers of artificial intelligence, and oddly he turned to the exact opposite position, admitting that he regrets his work in this field.
In a lengthy interview last week in the dining room of his Toronto home, Dr. Hinton said, “I consolate myself now that if I hadn ’ t taken all these steps in AI, someone else would certainly have done my part. ”
Hinton fears that generative AI tools are dangerous if they fall into irresponsible hands, and that “it ’ s hard to see how to prevent bad actors from using them for nefarious purposes. ”
As companies develop their AI at an astonishing speed, Hinton believes it is becoming increasingly dangerous, “see how it developed, compare this technology five years ago and now, it ’ s really terrifying, ” stressing that these robotic robots could at some point outperform humans in terms of thinking and creativity and would not be just a machine inferior to humans and thus destroy human life as we know it.
He pointed out that his concern at the moment about the ability of these tools to manufacture fabricated images, audio videos and a completely fake image, the average person will not be able to distinguish between the real and the fake, and therefore will be an important tool for spreading false information.
Moreover, artificial intelligence tools will be the substitute for humans in a very large number of jobs, which will occupy the existing professions, causing unprecedented unemployment rates globally.

Title:

Content: The ‘Godfather of AI’ warns about potential dangers of the technology as he quits Google

British-Canadian computer scientist Geoffrey Hinton admits he has fears for the future of AI

In a Frankenstein-esque tale of maker and master, Geoffrey Hinton, 75, dubbed ‘the godfather of AI’, has left Google with a parting warning over the dangers of artificial intelligence.

In 2012, the British-Canadian computer scientist invented technology with two students at University of Toronto that would become the intellectual foundation for AI systems. Google purchased the rights to this neural network tech to the tune of $44 million, which also propelled Dr Hinton to receive the Turing Award in 2018, considered the Nobel Prize of computing.

Read More
The ultimate part-AI girl? One Tatler correspondent entrusts ChatGPT with her next assignment

ChatGPT’s the new It Girl in Town and now she’s got all the gossip, writes Dora Davies-Evitt in the April issue

Yet now, Dr Hinton has packed in the day job at Google to join a chorus of anxious experts demanding a rollback of AI research until more robust safety measures are designed and deployed. Dr Hinton told the BBC: ‘Right now, they’re not more intelligent than us, as far as I can tell. But I think they soon may be.’

While many look upon AI as a natural technological development akin to the internet that could lead to exciting breakthroughs for humanity, there are growing fears that AI is a Pandora’s box. Reflecting on the effects of his work, Dr Hinton said: ‘I console myself with the normal excuse: If I hadn’t done it, somebody would have,’ as he admitted, ‘it is hard to see how you can prevent the bad actors from using it for bad things.’

Read More
Cyber Society: Meet the NFT duo dominating the metaverse

Old Etonian digital artists Dominic Smith and Joe Carnell have caught the attention of Brooklyn Beckham, Steve Aoki and Jaden Smith

The scientist went on to warn that AI could be taught to ‘create sub-goals like “I need to get more power”’, and be harnessed by nefarious actors to wreak havoc. With innovation driven forward by the unstoppable competition between behemoths like Google and Microsoft, Dr Hinton warned innovation will only increase exponentially in the coming years.

There are those who are trying to apply the brakes to this runaway train. In March, an open letter was signed by over 1,000 tech leaders and researchers, including Elon Musk and fellow Turing Award winner Yoshu Bengio, calling for a six-month moratorium on AI development. A few days later, 19 leaders of the Association for the Advancement of Artificial Intelligence released their own letter on the risks of AI. The signatures included that of Eric Horvitz, chief scientific officer at Microsoft.

The main outcry over AI lies in its ability to create and disseminate false news and images, which the public may find increasingly hard to identify. AI also poses a threat to academia and careers (see: Tatler’s foray into the world of ChatGPT). Dr Hinton believes that AI will fundamentally disrupt the workplace and take over the ‘drudge work’.

Read More
Lady Meta: my stratospheric rise through the metaverse

The Crypto Fashion Week debutante on becoming VR’s favourite It Girl

However Google’s chief scientist, Jeff Dean, offered words of comfort, adding: 'We remain committed to a responsible approach to AI. We’re continually learning to understand emerging risks while also innovating boldly.’

Title:

Content: AI Godfather Hinton: Artificial intelligence threatens humanity more urgently than climate change
Central News Agency
Geoffrey Hinton, a pioneer in artificial intelligence (AI), said in an interview with Reuters today that the threat posed by AI to humans may be “more urgent ” than climate change.
This is an advertisement, please continue reading.
Hinton, 75, who is regarded as one of the “godfathers ” of artificial intelligence, recently announced his departure from Alphabet, a 10-year tech company, because he wanted to make the risks of artificial intelligence public without involving employers.
Hinton ’ s research has been recognized as an important contribution to the development of contemporary AI systems. In 1986, he co-authored the influential paper Learning Representations by Back-propagating Errors, which set a milestone in the development of neural networks supporting AI technology. In 2018, he received the Turing Award for his research breakthroughs. And...
Hinton is one of a growing number of technology leaders who are concerned that machine intelligence will surpass humans and ultimately control the planet, and are openly raising concerns about the potential threat posed by AI.
“I ’ m not trying to downplay the importance of climate change, nor am I saying we shouldn ’ t worry about climate change, which is also a big risk, ” Hinton said.
But I think (artificial intelligence) may be more urgent in the end. "
“When it comes to climate change, making recommendations is simple: just stop carbon emissions.
If you do that, things will get better.
And when it comes to (artificial intelligence), there ’ s nothing we can do about it. ”
OpenAI, a U.S. artificial intelligence research lab sponsored by technology company Microsoft, launched ChatGPT, a chatbot that took the first shot at the AI race last November and quickly became the fastest-growing app in history, with 100 million monthly active users in just two months.
In April, thousands of people signed an open letter calling on all AI labs to suspend development of systems more powerful than OpenAI ’ s recently launched GPT-4 for at least six months, including social media CEO Elon Musk, AI pioneers Yoshua Bengio and Stuart Russell.
Hinton shares the concerns of the co-authors, who fear AI could pose an existential threat to humanity, but he disagrees with the suspension of research.
He said, “It ’ s not practical.
I agree that this is an existential risk, and it ’ s close, and it ’ s time to put a lot of effort into understanding what we can do. ”
Following the publication of the joint letter, the 12 members of the European Parliament called on leaders such as U.S. President Joe Biden and European Union Executive Committee Chairman Ursula von der Leyen to convene a summit to discuss how to control the development of advanced artificial intelligence systems such as ChatGPT, which are developing faster than expected.
“Technology leaders know best about [artificial intelligence], and politics must be involved, ” says Hinton.
This matter concerns all of us, so we must all think carefully. ”
This is an advertisement, please continue reading.

Which prestigious award did Hinton receive in 2018 for his work on neural networks?

Which prestigious award did Hinton receive in 2018 for his work on neural networks?

Which prestigious award did Hinton receive in 2018 for his work on neural networks?

Hinton has expressed regrets over his life's work on AI development due to the potential dangers it poses.

Title:

Content: Geoffrey Hinton: GPT-4 is 100 times more knowledgeable than any human
Author: MIAO Yongqi
Published: Updated:
Computer scientist Geoffrey Hinton, known as the "godfather of artificial intelligence", announced Monday that he has resigned from Google. He has devoted his life to developing artificial intelligence systems, saying he "regrets his life's work" and is wary of the potential dangers of AI development.
In another recent interview, Hinton further talked about why he is afraid of AI development.
Hinton, 75, left Google a few days after the news broke in an interview with MIT Technology Review senior editor Will Douglas Heaven.
Hinton points out that the new generation of AI language models, especially the GPT-4, which came out in March, made him realize that these machines were moving in a direction that was much smarter than he thought, and he was afraid of these developments.
He is best known for a technique he proposed in the 1980s (with two colleagues) called backpropagation.
In short, the algorithms that allow machines to learn support almost all of today ’ s artificial neural networks, from computer vision systems to large language models.
It wasn ’ t until the 2010s that Hinton and his two recent graduates developed a “neural network ” that demonstrated its power, stronger than any computer ’ s ability to identify objects in images, and trained it to predict the next letter of a sentence, a precursor to today ’ s large-scale language patterns.
One of the students was Ilya Sutskever, the founder of OpenAI, who led the development of ChatGPT.
“We first thought it might be great. ”“ But it ’ s going to take a long time to realize that it needs to be done on a large scale to get good results. ”
In the 1980s, the discussion of “neural networks ” was considered a joke.
But Hinton doesn ’ t think so, and is working on this, software that mimics the abstract human brain and uses code as a connection between neurons. For 40 years, Hinton has viewed artificial neural networks as a clumsy attempt to mimic biological neural networks.
Now he thinks things have changed: he thinks there are better results when trying to mimic the behavior of the biological brain.
“It ’ s scary when you see it with your own eyes, ” he said.“ It ’ s a sudden change. ”
So why did ChatGPT surprise Hinton, too? He explained that the human brain has about 100 trillion connections, and “large language models have up to 500 billion, up to a trillion. ”
However, the knowledge of GPT-4 is a hundred times greater than that of any human.
So maybe it actually has a better learning algorithm than we do. "
He also pointed out that apart from the ability to learn, the ability to communicate is another kind of point.
“If you or I learn a new thing and want to teach it to another person, we can ’ t just send them a copy. ”
But artificial neural networks can do it.
It ’ s like there are 10,000 people here, and when one person learns a new thing, the other 9,999 people all learn it at the same time.
Hinton now believes that there are two types of intelligence: animal brains and artificial neural networks.
“It ’ s a completely different kind of intelligence.
“A new, better intelligence. ” Hinton believes that whether superintelligence is good or bad depends largely on whether you ’ re an optimist or a pessimist, and he says,“ mildly depressed, ” “that ’ s why I ’ m afraid. ”
“Whether these things are going to be smarter than us, I suddenly changed my mind. ”
I think they are very close to us now and they will be much smarter than us in the future, ” he said.
“How do we survive? ” he is particularly worried that people will use the tools he has developed to change the trajectory of human life, including elections and wars.
He said that he hopes to continue talking about AI security after leaving office and spend more time on “more philosophical work ”.“ As long as I ’ m still employed at Google, I can ’ t say what I want to say, ” he said. “I have a lot of good things to say about Google, and it would be more convincing if I wasn ’ t at Google. ”
Who is the godfather of AI computer scientist Geoffrey Hinton?
Hinton pioneered the basic technology of AI systems and became interested in artificial neural networks when he was a graduate student at the University of Edinburgh in 1972. In 2018, he and two experts in the field of deep learning were awarded the Turing Award, known as the “Nobel Prize in Computing ”.
What are the main concerns of “AI Godfather ” Geoffrey Hinton about the development of artificial intelligence?
He believes that the most direct impact is to promote the dissemination of false information and the loss of employment opportunities, and also worries about the use of this tool for evil, such as influencing elections and using it in war.

Title:

Content: General Supervision
Elham Aboul Fath
Editor-in-Chief
Thank you for your patience.
General Supervision
Elham Aboul Fath
Editor-in-Chief
Thank you for your patience.
Artificial Intelligence Godfather Geoffrey Hinton: Regrets Inventing This Thing
Google is racing to develop its own AI tool Bard to be a strong competitor to ChatGPT and Microsoft ’ s Bing AI search engine, but it seems that Google ’ s hasty policy to roll out generative AI products was not in line with the desire of all workers.
Google Vice President Geoffrey Hinton announced to The New York Times his resignation from Google in April.
The departure of Hinton, nicknamed the “father of artificial intelligence ” and the first to adopt ChatGPT prototypes in 2012, is a blow to a company the size and fame of Google, being one of the most prominent figures in the field.
Dr. Hinton said that he quit his job at Google after more than a decade and gained a very good reputation in the field, so he can speak freely about the dangers of artificial intelligence, and oddly he turned to the exact opposite position, admitting that he regrets his work in this field.
In a lengthy interview last week in the dining room of his Toronto home, Dr. Hinton said, “I consolate myself now that if I hadn ’ t taken all these steps in AI, someone else would certainly have done my part. ”
Hinton fears that generative AI tools are dangerous if they fall into irresponsible hands, and that “it ’ s hard to see how to prevent bad actors from using them for nefarious purposes. ”
As companies develop their AI at an astonishing speed, Hinton believes it is becoming increasingly dangerous, “see how it developed, compare this technology five years ago and now, it ’ s really terrifying, ” stressing that these robotic robots could at some point outperform humans in terms of thinking and creativity and would not be just a machine inferior to humans and thus destroy human life as we know it.
He pointed out that his concern at the moment about the ability of these tools to manufacture fabricated images, audio videos and a completely fake image, the average person will not be able to distinguish between the real and the fake, and therefore will be an important tool for spreading false information.
Moreover, artificial intelligence tools will be the substitute for humans in a very large number of jobs, which will occupy the existing professions, causing unprecedented unemployment rates globally.

Title:

Content: Artificial intelligence: Geoffrey Hinton 'godfather' of modern technology resigns from Google and warns of its danger
Jeffrey Hinton, widely regarded as the spiritual father of artificial intelligence, has resigned, warning of the growing dangers of AI development.
Hinton, 75, announced his resignation from Google in a statement to the New York Times, saying he now regrets his work.
He told the BBC that some of the dangers of smart chatbots were "very scary".
“Right now, they ’ re not as smart as we can tell.
But I think they ’ ll be soon. ”
Hinton ’ s groundbreaking research on deep learning and neural networks has paved the way for artificial intelligence systems such as ChatGT.
But British-Canadian cognitive psychologist and computer science specialist Hinton told the BBC the chatbot could soon surpass the level of information held by the human brain.
Skip the podcast and keep reading.
Podcast
BBC Extra
A weekly podcast that presents humanitarian stories about the Arab world and its youth.
Loops
Podcast End
“Right now, what we ’ re seeing is that things like GPT-4 are far superior to a person in the amount of general knowledge they have.
For thinking, it ’ s not good, but it really works on simple thinking. ”
"Given the rate of development, we expect things to improve quickly.
So we have to worry about that. ”
In the article he sent to the New York Times, he pointed out that “bad actors ” may try to use artificial intelligence to do“ bad things. ”
In response to the BBC's request for further clarification on the matter, he said: "This is just kind of a worst-case scenario, kind of a nightmare scenario."
“Can you imagine, for example, that someone as bad as the Russian president (Vladimir Putin) decided to give robots the ability to create their own sub-goals? ”
In the end, he warned, this could “create sub-goals – for example, ‘ I need to get more power. ’ ”
"I have come to the conclusion that the kind of intelligence we develop is very different from the intelligence we have," he said.
“We are biological systems and these are digital systems.
The big difference is that with digital systems you have many copies of the same weight set, of the same world model. ”
"All of these versions can learn separately, but they share their knowledge immediately.
If you have 10,000 people, when one person learns something, everyone will automatically know it.
So chatbots can know much more than one person. ”
Hinton also spoke of several other reasons why he quit his job.
“One of them is that I am 75 years old now.
And the other is that I want to say good things about Google.
It would be more credible if I didn ’ t work for Google. ”
He stressed that he did not want to criticize Google, and that the company was "very responsible".
Google Chief Scientist Jeff Dean said: “We remain committed to a responsible approach to artificial intelligence.
We are constantly learning to understand the risks arising under innovation boldly as well. ”

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

He believes that AI is becoming smarter than humans and may lead to mass unemployment.

Title:

Content: Geoffrey Hinton, the godfather of AI, said after leaving Google that artificial intelligence is becoming smarter than humans.
2023 / 5 / 3 16: 46: 16 Source: IT House Author: Yuanyang Editor: Yuanyang
IT home May 3 news, one of the pioneers in the field of artificial intelligence, known as the "godfather of AI" Geoffrey Hinton (Geoffrey Hinton) recently announced that he has left the Google company he worked for ten years, because he is increasingly worried about the development of artificial intelligence technology.
In an interview with CNN's Jake Tapper today, he said that he believes artificial intelligence is becoming smarter than humans, and he wants to "blow the whistle" to remind people that they should seriously consider how to prevent artificial intelligence from controlling humans.
I'm just a scientist who suddenly realizes that these things are becoming smarter than we are, "Hinton said." I want to 'blow the whistle' in a way that says we should seriously worry about how to stop these things from taking control of us. "
Hinton was a pioneer in neural network technology, and his research laid the foundation for the artificial intelligence systems used in many products today.
IT House previously reported that he first revealed his departure in an interview with The New York Times on Monday and expressed his concerns about the potential harms of AI technology.
He said he was concerned that AI would lead to mass unemployment and create a world where many people “can ’ t know what ’ s real. ”
He also noted that the pace of advances in AI technology has far exceeded his and others ’ expectations.
If it becomes much smarter than us, it ’ s going to be very good at manipulating because it ’ s learned from us, and there are very few examples of a smarter thing being controlled by a dumber thing, ” Hinton told Tapper on Tuesday.
It will figure out ways to manipulate people into doing what it wants.
Hinton isn ’ t the only tech leader to express concerns about AI, and in March, a group of community members published a letter calling on AI labs to suspend training for at least six months on the most powerful AI systems, citing “profound risks to society and humanity. ”
Apple co-founder Steve Wozniak, one of those who signed the letter, reiterated concerns about artificial intelligence spreading false information on “CNN Morning ” on Tuesday.“ Deception will become easier for those who want to cheat you. ” Wozniak told CNN, “We ’ re not making any changes in that — we ’ re just assuming that our existing laws will fix the problem. ” Wozniak also said there may be a need for“ some type ” of regulation.
Hinton said he did not sign the petition. “I don ’ t think we can stop this progress, ” he said.“ I didn ’ t sign the petition saying we should stop studying artificial intelligence, because if the Americans stop doing research, the Chinese won ’ t. ” But he admitted that he didn ’ t have a clear solution, “I don ’ t know if we can solve this problem. ”
I believe we should try to think about ways to solve the problem.
I don't have a solution at the moment. '
Related articles
Key word: artificial intelligence
Soft media 's website: IT home hot products - Value shopping guide, coupons most buy - rebate coupons iPhone home Win7 home Win10 home Win11 home
Soft media software: Cube cloud calendar cool point desktop Win7 optimization master Win10 optimization master soft media mobile APP application

What future risk did Hinton warn about AI?

What risks did Hinton associate with AI's rapid advancement?

What future risk did Hinton warn about AI?

What risks did Hinton associate with AI's rapid advancement?

What future risk did Hinton warn about AI?

What risks did Hinton associate with AI's rapid advancement?

Hinton also warns that AI can create a world where reality is unclear and can be used to manipulate humans.

Title:

Content: The father of artificial intelligence warns: he will control us and governments to confront him
2023-06-29T07: 41: 01.000000Z
Jeffrey Hinton, described as the “godfather of artificial intelligence, ” on Thursday called on governments to confront the dangers of this type of intelligence and intervene to ensure that machines do not control society.
The warnings come at a time when "artificial intelligence" is rapidly evolving, which has raised concerns about its impact on many human jobs.
Hinton made headlines in May 2023 when he announced his resignation from Google to speak more freely about the dangers of artificial intelligence, shortly after the launch of the chatbot that captivated the world.
The artificial intelligence scientist, who teaches at the University of Toronto, spoke to a crowd at the Collegion Technology Conference in the Canadian city, according to Agence France-Presse.
The conference attracted more than 30,000 startup founders, investors and tech professionals, most of whom were looking to learn how to ride the wave of AI rather than hear lessons about its risks or calls for governments to intervene.
Hinton said that “before AI becomes smarter than us, I think the people who develop it should be encouraged to do a lot of work to understand how it can try to take control of us. ”
“Now there are 99 highly intelligent people trying to make AI better, and one very intelligent person trying to figure out how to stop it from taking control, and maybe you should be more balanced. ”
Hinton warned that the dangers of “artificial intelligence ” must be taken seriously, saying:“ I think it ’ s important for people to realize that this is not science fiction or just fear, ” stressing that “it ’ s a real risk that we have to think about, and we have to figure out how to deal with it beforehand. ”
Hinton also expressed concern that AI would deepen inequality, where the vast gains from its productivity would go to the rich, not the workers, and said that “wealth will not go to the people who work, it will make the rich richer, not the poor, and this is a very bad society. ”
He also pointed to the danger of "fake news" that can be created by robots such as ChatGPT, expressing the hope that content generated by "artificial intelligence" programs will be marked, and that central banks will mark monetary currencies.
Hinton also stressed that “it is very important to try, for example, to identify everything that is fake as fake, I don ’ t know if we can do that technically or not. ”
This comes as big tech companies such as Microsoft, Google and others are racing to make advances in artificial intelligence, which some experts warn could replace some human jobs, while others say AI will help generate other jobs for humans.
UN Secretary-General António Guterres earlier announced his support for the creation of a UN agency specialized in artificial intelligence "inspired by the International Atomic Energy Agency", noting that only member states are the decision-makers.
Shafaq Live
Shafaq Live

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn "bad actors" could use AI for?

To win wars or manipulate the electorate.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn "bad actors" could use AI for?

To win wars or manipulate the electorate.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

He is concerned about the impact of AI on human life trajectory and the potential for AI to spread false information easily.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

Hinton's warnings about AI dangers and mismanagement have made headlines, with many experts agreeing that AI poses significant risks to society and humanity.

Title:

Content: My channel
* Drag categories can be customized sorting
Recover Default OK
Setup
Alert
The Senate Judiciary Committee held a hearing on five Supreme Court ethics concerns.
New York City Council Protests to Abolish 24-hour Work
The godfather of AI leaves Google worried that artificial intelligence will fall into the wrong hands
The US media reported today that Hinton, known as the “godfather of AI ”, resigned his job at Google and openly talked about the risks of AI, worried that AI would fall into the wrong hands.
He says it ’ s hard to see how to prevent bad people from using it to do bad things.
Geoffrey Hinton, who laid the groundwork for artificial intelligence (AI) systems, told The New York Times that advances in AI pose “great risks to society and humanity. ”
In a report published today in The New York Times, Hinton was quoted as saying, “Look at how it looked five years ago and now, the difference and growth, it ’ s really scary. ”
Hinton pointed out that competition among tech giants is driving these companies to release new AI technologies at a dangerous rate, which will endanger people ’ s jobs and spread misinformation.
"It's hard to see how you can prevent bad people from using AI to do bad things," he told the New York Times.
OpenAI, the startup behind Google and now the most powerful AI chatbot, ChatGPT, began developing systems with more data than ever before in 2022.
Hinton told the New York Times that he believes these systems are surpassing human intelligence in some ways because of the sheer volume of data they analyze.
"Perhaps these systems are already more powerful than the human brain," he said.
While AI has been used to support human needs for work, the rapid development of chatbots like ChatGPT could leave human jobs in jeopardy.
He told the New York Times that AI was “taking on a chore, ” but that“ it ’ s probably going to do more than that. ”
Hinton also warned that AI could spread the wrong message, telling the New York Times that the average person would “never know what ’ s true again. ”
According to the New York Times, Hinton submitted his resignation to Google last month.
Google ’ s head of AI, Jeff Dean, expressed his gratitude to Hinton in a statement to the US media.
“As one of the first companies to publish AI principles, we remain committed to taking a responsible approach to AI, ” the statement added.
“While we innovate boldly, we are constantly discovering new risks. ”
Tech billionaire Elon Musk and many experts have called for a pause in the development of AI systems to allow time to ensure the technology is safe.
After the introduction of GPT-4, which is more powerful than the AI used by ChatGPT, Musk and Apple co-founder Steve Wozniak signed an open letter.
Hinton, who was not involved in the petition, told the New York Times that scientists should not “further scale research and development ” until they understood if they could control AI.
The New York Times Google
The last one.
The Senate Judiciary Committee held a hearing on five Supreme Court ethics concerns.
The next one.
Equal request?
US asks Chinese airlines not to fly over Russian airspace
Extended reading
Super-popular
More >

Title:

Content: The godfather of AI quit Google's job, worried that artificial intelligence fell into the wrong hands
WASHINGTON (AFP) - The US media reported today that Hinton, known as the "godfather of AI", resigned his job at Google to talk openly about the risks of AI and worry that AI will fall into the wrong hands.
He said that it is difficult to see how to prevent bad people from using it to do bad things.
Advertisement
Geoffrey Hinton, who laid the groundwork for artificial intelligence (AI) systems, told The New York Times that advances in AI pose “great risks to society and humanity. ”
In a report published today in the New York Times, Hinton was quoted as saying, “Look at what it looked like five years ago and now, and the difference and growth, it ’ s really scary. ”
Hinton pointed out that competition among tech giants has prompted these companies to release new AI technologies at a dangerous rate, which will endanger people ’ s jobs and spread misinformation.
"It's hard to see how you can prevent bad people from using it (AI) to do bad things," he told the New York Times.
OpenAI, the startup behind Google and now the most powerful AI chatbot, ChatGPT, began using more data than ever before to develop systems in 2022.
Hinton told the New York Times that he believes these systems are surpassing human intelligence in some ways because of the sheer volume of data they analyze.
"Perhaps these systems are already stronger than the human brain," he said.
While AI has been used to support human needs for work, the rapid development of chatbots like ChatGPT could put human jobs at risk.
He told the New York Times that AI is “taking on a chore, ” but“ it ’ s probably going to do more than that. ”
Hinton also warned that AI could spread false information, telling the New York Times that the average person would “no longer know what ’ s true. ”
According to the New York Times, Hinton tendered his resignation to Google last month.
Google ’ s head of AI, Jeff Dean, thanked Hinton in a statement to the US media.
"As one of the first companies to publish AI principles, we remain committed to taking a responsible approach to AI," the statement added.
"While we are bold and innovative, we are constantly discovering new risks."
Tech billionaire Elon Musk and many experts have called for a moratorium on the development of AI systems to allow time to ensure the technology is safe.
After the launch of the GPT-4, which is more powerful than the AI used by ChatGPT, Musk and Apple co-founder Steve Wozniak signed an open letter.
Hinton, who was not involved in the petition, told the New York Times that scientists shouldn ’ t “further scale research and development ” until they know if they can control AI.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

He has called for governments to intervene in AI development and for scientists to control AI before scaling it up.

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

Hinton has also suggested marking AI-generated content to identify fakes and has warned that the average person may not know what's true.

What risks did Hinton associate with AI's rapid advancement?

What risks did Hinton associate with AI's rapid advancement?

Other experts, including Elon Musk, have led calls for a moratorium on AI development due to the potential risks it poses.

Title:

Content: ChatGPT allows the world to see the unlimited potential of artificial intelligence (AI), and as technology giants have laid out the AI market, there are hidden concerns about its loss of control and its impact on the labor market.
Faced with the threat of competitors, Google (Google) actively invested in AI research and development, but at this time, the so-called "AI godfather" of Hunton (Geoffry Hinton) confirmed to leave Google, and the technology is uneasy, the development of AI has exceeded expectations.
As reported by CNN and The Verge, the company founded by Hunton and two students was acquired by Google in 2013. He has been working at Google for about 10 years, mainly engaged in AI research and development, and now one of the students is also the chief scientist of OpenAI.
But as his research into AI deepened, he became concerned about the technology.
“If I don ’ t do it, someone else will do it, ” admits Hunton, who usually persuades himself, but adds that“ it ’ s hard to prevent bad people from using AI to do evil. ”
Hunton said the reason for leaving Google was to talk about the risks of AI without fear, rather than attacking Google, stressing that “the measures Google has taken are very responsible. ”
Hunton warns that some jobs may be replaced by AI, which is moving faster than he and others expect, that science fiction movies are impossible to come true, and even that AI may generate code and run on its own, and that annihilating humans is not unthinkable.
Hunton said that AI can actually evolve smarter than humans. Some people believe this reasoning, but most still think it is far from true. “I thought it would take 30, 50 years or more, but now it ’ s changed. ”
In March this year, Tesla CEO Elon Musk led nearly a thousand technology CEOs and scientists jointly issued an open letter calling for a moratorium on the development of more powerful AI technologies because of the potential risks to society and humanity.
# AI # AI # AI # AI # AI # AI # AI # AI

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

The European Parliament has also called for a summit to control advanced AI development.

Hinton's resignation from Google was motivated by his desire to speak freely about AI risks without employer involvement.

Why did Hinton leave Google when he helped develop AI but later grew concerned about its dangers?

Why did Hinton leave Google when he helped develop AI but later grew concerned about its dangers?

Why did Hinton leave Google when he helped develop AI but later grew concerned about its dangers?

He has stated that he wants to raise awareness about AI risks and has warned that AI could potentially eliminate humans.

Title:

Content: With a PhD in AI 45 years ago, Hinton is one of the most respected experts in the field of AI.
He worked in AI development at Google for 10 years, developing AI systems for Google, but he gradually became concerned about AI technology and his role in AI progress.
Hinton said via Twitter on the 1st that leaving Google would allow him to speak freely about the risks of AI, rather than criticising Google.
In an interview with The New York Times, Hinton admitted that I used a common excuse to comfort myself: "If I didn't do it, someone else would do it."
Hinton also warned the world about the potential threat of AI.
“I used to think that the threat would only happen in 30 to 50 years, or more, but I don ’ t think that anymore, ” he said.
He pointed out that the near-term risks of AI include replacing jobs, as well as a large number of fake photos, fake videos, and fake text that make it impossible to tell whether it is true or not.
Hinton now believes that the digital intelligence created by humans is quite different from the biological intelligence, the former can obtain a large amount of knowledge, which is why GPT-4 has far more knowledge than anyone else.
Hinton warned about AI before he left Google.
In an interview with CBS News in March, when he was asked about “AI ’ s chances of eliminating humans, ” he replied,“ It ’ s not unthinkable, I can only say that. ”
Hinton also said in a 2021 speech that AI will advance health care, but also create opportunities to develop lethal autonomous weapons.
Google CEO Richard Pichai has also publicly warned about the risks of AI.
He said on “60 Minutes ” in April that society was not ready for new technologies, but he downplayed the risk that advances in AI would outpace human adaptability.
Hinton has spent less time at Google over the past year, most recently as vice president and engineering researcher, reporting to Google Brain ’ s Jeff Dean. He said in a statement that Hinton made a fundamental breakthrough in AI and thanked him for his 10 years of contributions to Google.
# System # Plenty # AI # Hinton # Google

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What future risk did Hinton warn about AI?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

Why did Hinton leave Google when he helped develop AI but later grew concerned about its dangers?

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What future risk did Hinton warn about AI?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

Why did Hinton leave Google when he helped develop AI but later grew concerned about its dangers?

Hinton's warnings have sparked a debate about the need for responsible AI development and the potential consequences of creating advanced AI systems.

Title:

Content: ChatGPT allows the world to see the unlimited potential of artificial intelligence (AI), and as technology giants have laid out the AI market, there are hidden concerns about its loss of control and its impact on the labor market.
Faced with the threat of competitors, Google (Google) actively invested in AI research and development, but at this time, the so-called "AI godfather" of Hunton (Geoffry Hinton) confirmed to leave Google, and the technology is uneasy, the development of AI has exceeded expectations.
As reported by CNN and The Verge, the company founded by Hunton and two students was acquired by Google in 2013. He has been working at Google for about 10 years, mainly engaged in AI research and development, and now one of the students is also the chief scientist of OpenAI.
But as his research into AI deepened, he became concerned about the technology.
“If I don ’ t do it, someone else will do it, ” admits Hunton, who usually persuades himself, but adds that“ it ’ s hard to prevent bad people from using AI to do evil. ”
Hunton said the reason for leaving Google was to talk about the risks of AI without fear, rather than attacking Google, stressing that “the measures Google has taken are very responsible. ”
Hunton warns that some jobs may be replaced by AI, which is moving faster than he and others expect, that science fiction movies are impossible to come true, and even that AI may generate code and run on its own, and that annihilating humans is not unthinkable.
Hunton said that AI can actually evolve smarter than humans. Some people believe this reasoning, but most still think it is far from true. “I thought it would take 30, 50 years or more, but now it ’ s changed. ”
In March this year, Tesla CEO Elon Musk led nearly a thousand technology CEOs and scientists jointly issued an open letter calling for a moratorium on the development of more powerful AI technologies because of the potential risks to society and humanity.
# AI # AI # AI # AI # AI # AI # AI # AI

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

The public should understand that AI poses significant risks and that experts like Hinton are calling for caution and regulation in the development of AI systems.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

The development of safe and reliable AI systems is a complex challenge that requires a comprehensive approach, involving technical, social, and regulatory considerations.

Title:

Content: Trail of Bits’s Response to NTIA AI Accountability RFC

By Heidy Khlaaf and Artem Dinaburg

The National Telecommunications and Information Administration (NTIA) has circulated an Artificial Intelligence (AI) Accountability Policy Request for Comment on what policies can support the development of AI audits, assessments, certifications, and other mechanisms to create earned trust in AI systems. Trail of Bits has submitted a response to the NTIA’s RFC on AI system accountability measures and policies.

We offer various recommendations informed by our extensive expertise in cybersecurity and safety auditing of mission-critical software. We support the NTIA’s efforts in fostering an open discussion on accountability and regulation. In our response, we emphasize the following:

  • AI accountability is dependent on the claims and context in which AI is used and deployed.

The main theme of our recommendations is that there can be no AI accountability or regulation without a defined context. An audit of an AI system must be measured against actual verifiable claims regarding what the system is supposed to do, and not narrowly scoped benchmarks. The scope carried out should be relevant to a regulatory, safety, ethical, or technical claim, for which stakeholders may be held accountable.

We previously proposed the use of Operational Design Domains (ODDs), a concept adopted from automotive driving systems, to define operational envelopes for the risk assessments of AI-based systems, including generative models. An ODD helps in defining the specific operating conditions in which an AI-system is designed to properly behave, therefore outlining the safety envelope against which system hazards and harms can be determined.

  • Accountability mechanisms for AI innovation can only be considered relative to a level of risk threshold that must be determined in part by legislatures, rulemaking bodies, and regulators.

There is no one-size-fits-all rule for trust in AI systems. Determining how much AI technologies can and need to be trusted depends on the risk that society accepts for the context in which they are used. Different risk levels should be determined via a democratic process: by legislatures, rule-making bodies, and regulators. When considering the costs of accountability mechanisms and how they may hinder innovation, it first must be possible to demonstrate that risk reduction measures would be grossly disproportionate to the benefit gained. However, no evidence has been provided regarding the cost of implementing accountability mechanisms by those developing AI-based systems to be able to make such a determination.

  • Foundational cybersecurity and software safety best practices can enable the identification of novel AI hazards and harms. Technical assessments are intended to support higher-level socio-technical, legal, or regulatory claims regarding the fitness of a system.

The dichotomy of technical versus socio-technical assessments, as described by NTIA’s supplementary information, does not reflect the purpose of distinct technical assessment approaches, historically and practically. Technical assessments are not intended to support purely technical goals, but also claims regarding the holistic behavior of the system and how a system may technically achieve such claims. That is, technical assessments are also a necessary tool in supporting socio-technical, legal, or regulatory claims regarding the fitness of the system. It is currently difficult to assess the technical attributes that can foster or impede the implementation of accountability mechanisms given that existing AI-based systems do not follow basic software safety and security best practices (e.g., IEC 61508, NIST 800-154, ODDs). Using fundamental software safety and security best practices as a first step can enable the development of further AI-specific accountability mechanisms.

  • Current AI-based systems do not possess any unique software components that warrant a generalized licensing scheme, which would heavily impede the use of software as a whole.

AI systems should be regulated as extensions of software-based systems, given the identical mechanisms of their development. Any implementation of a generalized licensing scheme would likely result in significant overreach due to the broad definition and software components of AI systems. AI regulatory policies should generally mirror the practices of the existing sectors in which they are deployed. For applications deemed safety-critical, a certificate of safety or a license should indeed be granted only when a regulator is satisfied with the argument presented in a safety case.

  • Independent bodies (auditors, regulators, etc.) should assess the trustworthiness and accountability claims of AI-based systems.

Independent auditors and regulators are key to public trust. Independence allows the public to trust in the accuracy and integrity of assessments and the integrity of regulatory outcomes. It has been an attribute crucial to established auditing practices in other fields, such as safety-critical domains. It is therefore important that independent bodies, not vendors themselves, assess the trustworthiness and accountability of AI systems.

Our response delves into further detail for the selected questions. We believe that established methodologies and expertise from cybersecurity and safety-critical domains are a necessary foundation in building AI-specific accountability mechanisms, and we hope to continue enabling the development of novel AI auditing techniques.

Established methodologies from cybersecurity are necessary for AI accountability, and novel AI auditing techniques are needed for AI-specific accountability mechanisms.

The development of safe and reliable AI systems also requires a focus on cybersecurity, as AI systems are vulnerable to cyberattacks and can be used for misinformation and social engineering.

Title:

Content: BETA
This is a BETA experience. You may opt-out by clicking here

More From Forbes

Edit Story

Why Cybersecurity Is Foundational To AI Safety

Click to save this article.
You'll be asked to sign into your Forbes account.
Got it

Marcus Fowler is SVP of Strategic Engagements and Threats at Darktrace and CEO of Darktrace Federal.

From smartphones and social media to the internet itself, technology has the power to fundamentally change our daily lives. But too often technology’s rapid development and adoption outpaces our ability to discuss their associated risks. While the benefits of these advancements are great, there are often unintended consequences with lasting effects.

With generative AI such as ChatGPT becoming widely available, AI has seen a rapid rise in public adoption across industry verticals. This new generation of AI marks a technological advancement that is potentially on par with the introduction of the internet but with adoption orders of magnitude faster. The potential benefits are vast; however, we’re already seeing early signs of how this technology could be misused and threats that could derail its potential. For example, deepfakes are being used to spread misinformation, and sophisticated novel social engineering attacks are crafted using generative AI.

Global Initiatives: Addressing AI Safety And Security

Fortunately, the global community has demonstrated a strong commitment to moving quickly to address the potential risks. The U.K. hosted the inaugural AI Safety Summit in early November. In the same week, the Biden-Harris Administration released an executive order establishing new standards for AI safety and security. Both countries have announced new AI Safety Institutes to develop robust techniques to evaluate AI. Most recently, the U.S. Cybersecurity and Infrastructure Security Agency (CISA) and the U.K. National Cyber Security Centre (NCSC) collaborated on guidelines for building secure AI systems, which have been adopted by 21 other international agencies.

As AI becomes embedded into the tools and processes we depend on every day, it is vital that they are secure. In fact, the Biden-Harris Administration’s executive order highlights cybersecurity as a significant risk to AI systems. Cybersecurity is foundational to AI safety—it is a prerequisite for trustworthy and safe AI.

To realize the importance of prioritizing cybersecurity, it’s helpful to understand the cyber risks to AI safety: offensive applications of AI in cyberspace, accidental insider threats and cyberattacks targeting AI itself.

At Darktrace, we have been researching offensive applications of AI in cyberspace for years. The rise of generative AI is lowering barriers for attackers and is poised to make them faster. AI-powered cyberattacks can involve using large language models (LLM) to generate sophisticated or highly personalized text in phishing emails, and this process can be completely automated using tools like AutoGPT. LLMs are already showing up on the dark web that claim to write malware code for a few hundred dollars, and attackers can use AI to augment nearly every stage of the attack lifecycle from reconnaissance to command and control.

It’s not just attackers who are using AI to drive more efficiency. AI tools have been rapidly adopted by companies and workers: As of June 2023, we saw that nearly 75% of our customers already had some employees using generative AI tools. However, well-intentioned employees run the risk of inadvertent misuse. For example, an employee inserting sensitive data into a prompt-based LLM tool such as ChatGPT might unintentionally leak proprietary or personal data.

In a high-profile incident, these concerns motivated the U.S. Space Force to temporarily ban Guardians from using government data in generative AI solutions, with a Space Force spokesperson citing the need to "ensure that sensitive DOD data is safeguarded when using such platforms."

It is also important to protect AI systems themselves against cyberattacks. Take, for example, the secure development of AI. This involves defending against threats such as "data poisoning" attacks that corrupt training data to adversely affect the AI’s behavior. Attacks like these may cause the AI to behave in ways that are unexpected or harmful. As AI gets embedded into critical infrastructure and business processes, it’s critical that attackers can’t hijack or trick the guardrails within these tools. Cyberattacks can also be used to steal intellectual property (IP), not only for AI algorithms and data but also for advanced chips that drive AI development.

Priorities: Data Privacy, Control And Trust

It’s positive to see governments taking action to predict the challenges this new generation of general-purpose AI presents. Our history of predicting or properly securing and overseeing technologies, such as the internet and social media adoption, is inadequate, and we can see how much more difficult it is to put the genie back in the bottle. There are three areas of action that governments and companies should prioritize: data privacy, control and trust.

AI systems should be privacy-preserving. Companies building and using general-purpose AI need to protect the data they collect and use to train their models. Organizations should invest in safeguards to detect, identify and test potential risks that can come from within their businesses. That means guarding against personally protected information accidentally being leaked through prompt injections on generative AI platforms.

Humans need control, particularly as general-purpose AI tools become increasingly relied on to take real-world actions. It’s critical to apply cybersecurity best practices to protect models and invest in safeguards to keep AI systems protected at all stages of the AI lifecycle to avoid unintended behaviors or potential hijacking of the algorithms.

Security and transparency are always the foundation of trust: If people cannot have faith in the cybersecurity of their AI systems, they will not be able to trust them to carry out critical functions. Developers can help to ensure that people understand and are aware of how an AI system reaches its decisions and answers.

Though the AI safety risks posed by malicious cyber activity are serious, there is no reason to fall into pessimism. Instead, one should feel optimistic to see the proactive measures taken by the global community. Agencies across the U.S. Federal Government are already working to implement the executive order, and South Korea and France are working on a second and third Global AI Safety Summit.

The good news is that tried-and-true AI tools already exist for cyber defense and have been defending critical infrastructure and other sensitive environments for over a decade. Cybersecurity is foundational to AI safety, and AI itself can play a vital role in mitigating risks.

Forbes Technology Council is an invitation-only community for world-class CIOs, CTOs and technology executives. Do I qualify?

Follow me on LinkedInCheck out my website

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

Global initiatives, such as the AI Safety Institutes announced by the US and UK, are working to address these challenges and develop guidelines for secure AI systems.

The use of techniques such as Lyapunov functions and α,β-CROWN verifier can help ensure the safety and stability of robots and autonomous vehicles powered by neural networks.

Title:

Content: 32.1 C
New Delhi
Wednesday, July 17, 2024

Developing and validating stable AI systems with precision and adaptability | MIT News

More from Author

In Short:

Neural networks have revolutionized controller design for robots, making them more adaptable and efficient. However, ensuring the safety of robots powered by neural networks is a challenge. Researchers at MIT have developed new techniques to certify safety and stability for complex robotic systems. Their approach includes efficient searching for Lyapunov functions to provide stability guarantees, potentially enabling safer deployment of robots and autonomous vehicles in various conditions.

MIT Researchers Develop New Technique for Neural Network Verification in Robotic Systems

Neural networks have revolutionized the way engineers design controllers for robots, leading to more adaptive and efficient machines. However, these complex machine-learning systems come with challenges in ensuring the safety and stability of robotic operations.

Rigorous Verification of Lyapunov Calculations

MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) researchers have developed new techniques to certify Lyapunov calculations in complex systems. By efficiently searching for and verifying a Lyapunov function, this approach provides stability guarantees for robots and autonomous vehicles, including aircraft and spacecraft.

Improved Algorithm and Verification Process

The researchers optimized the training and verification process by generating cheaper counterexamples and then enhancing the robotic system to handle challenging situations. This novel verification approach enables the use of a scalable neural network verifier, α,β-CROWN, to provide rigorous worst-case scenario guarantees.

Impact and Applications

This work bridges the gap between high-performance neural network controllers and the safety guarantees required for real-world deployment. The stability approach developed by the researchers has broad applications in ensuring the safety of autonomous vehicles, drones, and more.

Future Directions

The team aims to enhance the technique for systems with higher dimensions and diverse data inputs beyond lidar readings. They also plan to extend the method to optimization problems and real-world machines like humanoids.

Collaborators and Funding

The research was led by MIT’s electrical engineering and computer science (EECS) PhD student Lujie Yang and Toyota Research Institute researcher Hongkai Dai. Collaborators include researchers from other institutions, and the project received support from various organizations.

Presentation and Recognition

The researchers’ paper will be presented at the 2024 International Conference on Machine Learning, showcasing the significant advancements in neural network verification for robotics systems.

- Advertisement -

More articles

- Advertisement -

Latest article

The Biden administration has created an AI Safety and Security Board with 22 initial members, including tech CEOs, to identify potential security threats from AI and develop recommendations for critical infrastructure stakeholders.

Title:

Content: IE 11 is not supported. For an optimal experience visit our site on another browser.

Biden administration taps tech CEOs for AI safety and security board

The board also includes executives from major corporations like Delta and government officials including the mayor of Seattle.

The Department of Homeland Security established an advisory panel Friday to study how to protect critical infrastructure including power grids and airports from threats related to artificial intelligence.

The Artificial Intelligence Safety and Security Board, which has 22 initial members, includes high-profile figures in tech like OpenAI CEO Sam Altman, Microsoft CEO and chairman Satya Nadella and Alphabet CEO Sundar Pichai, according to a statement from the DHS.

President Joe Biden ordered the creation of the board in October when he signed a wide-ranging executive order on AI, representing the federal government’s first foray into trying to regulate the technology since advanced AI apps including OpenAI’s ChatGPT went viral in popularity.

The board’s mission includes developing recommendations “to prevent and prepare for AI-related disruptions to critical services that impact national or economic security, public health, or safety.”

AI experts have identified a wide array of potential security threats that the new technology could make possible, from swarms of autonomous drones to cheap and lethal bioweapons to more effective hacking threats against critical computer systems.

The government’s defense may involve using AI to fight AI, the DHS said.

“The Board will develop recommendations to help critical infrastructure stakeholders, such as transportation service providers, pipeline and power grid operators, and internet service providers, more responsibly leverage AI technologies,” the department said.

Homeland Security Secretary Alejandro Mayorkas said in a statement that AI “can advance our national interests in unprecedented ways” but that it also “presents real risks — risks that we can mitigate by adopting best practices and taking other studied, concrete actions.”

In addition to tech CEOs, the board includes the CEOs of Delta Air Lines, defense contractor Northrop Grumman and oil producer Occidental Petroleum, as well as Maryland’s Democratic Gov. Wes Moore, Seattle Mayor Bruce Harrell and the leaders of two civil rights organizations.

The board aims to prevent AI-related disruptions to services and includes government officials, with the Department of Homeland Security establishing an advisory panel on AI threats.

Title:

Content: IE 11 is not supported. For an optimal experience visit our site on another browser.

Biden administration taps tech CEOs for AI safety and security board

The board also includes executives from major corporations like Delta and government officials including the mayor of Seattle.

The Department of Homeland Security established an advisory panel Friday to study how to protect critical infrastructure including power grids and airports from threats related to artificial intelligence.

The Artificial Intelligence Safety and Security Board, which has 22 initial members, includes high-profile figures in tech like OpenAI CEO Sam Altman, Microsoft CEO and chairman Satya Nadella and Alphabet CEO Sundar Pichai, according to a statement from the DHS.

President Joe Biden ordered the creation of the board in October when he signed a wide-ranging executive order on AI, representing the federal government’s first foray into trying to regulate the technology since advanced AI apps including OpenAI’s ChatGPT went viral in popularity.

The board’s mission includes developing recommendations “to prevent and prepare for AI-related disruptions to critical services that impact national or economic security, public health, or safety.”

AI experts have identified a wide array of potential security threats that the new technology could make possible, from swarms of autonomous drones to cheap and lethal bioweapons to more effective hacking threats against critical computer systems.

The government’s defense may involve using AI to fight AI, the DHS said.

“The Board will develop recommendations to help critical infrastructure stakeholders, such as transportation service providers, pipeline and power grid operators, and internet service providers, more responsibly leverage AI technologies,” the department said.

Homeland Security Secretary Alejandro Mayorkas said in a statement that AI “can advance our national interests in unprecedented ways” but that it also “presents real risks — risks that we can mitigate by adopting best practices and taking other studied, concrete actions.”

In addition to tech CEOs, the board includes the CEOs of Delta Air Lines, defense contractor Northrop Grumman and oil producer Occidental Petroleum, as well as Maryland’s Democratic Gov. Wes Moore, Seattle Mayor Bruce Harrell and the leaders of two civil rights organizations.

CoSAI, an open-source initiative hosted by OASIS, was formed by 14 major AI companies to provide guidance and tools for secure AI systems, focusing on mitigating AI risks like model theft and data poisoning.

Title:

Content: Science and Technology
Technology: Google, Microsoft, Nvidia and many other tech giants collaborate for AI safety
14 major AI companies including Google, Microsoft, Amazon, Nvidia, and Intel, as well as OpenAI, IBM, PayPal, Cisco, and Anthropic, have come together to form the Secure Artificial Intelligence Alliance (CoSAI).
This development is said to be aimed at addressing the fragmented landscape of AI security.
Hosted by the global standards body OASIS, CoSAI is an open source initiative that aims to provide all AI practitioners and developers with the guidance and tools they need to create and design secure AI systems.
It is expected to build a collaborative ecosystem to share open source methods, standardized frameworks and tools.
CoSAI is an open source community led by a project board (responsible for developing and managing its public agenda), and a technical steering committee (composed of AI experts from academia and industry, which oversees its workflows).
What are the main objectives of the initiative?
• Develop best practices for AI safety
• Facing challenges in artificial intelligence
• Ensuring the security of artificial intelligence applications
CoSAI ’ s scope of work includes building, integrating, deploying, and operating AI systems securely, with a focus on mitigating risks such as model theft, data poisoning, tip injection, domain misuse, and heuristic attacks.
Heather Adkins, vice president of security at Google, said:
Artificial intelligence has been under development for many years, with the continued potential it offers to defenders, while also recognizing the opportunities it offers to enemies.
CoSAI will help organizations large and small integrate AI safely and responsibly, helping them leverage the benefits of AI while mitigating risk.
The initiative is reportedly sponsored by Google, IBM, Intel, Microsoft, Nvidia, PayPal, Amazon, Anthropic, Cisco, Chainguard, Cohere, GenLab, OpenAI, and Wiz.
Source
Advertisements
You may also read.

The US and UK have partnered to safety test AI models, and have established AI Safety Institutes to develop a common approach to AI safety testing and share information on AI capabilities and risks.

Title:

Content: U.S., U.K. Announce Partnership to Safety Test AI Models

5 minute read

The U.K. and U.S. governments announced Monday they will work together in safety testing the most powerful artificial intelligence models. An agreement, signed by Michelle Donelan, the U.K. Secretary of State for Science, Innovation and Technology, and U.S. Secretary of Commerce Gina Raimondo, sets out a plan for collaboration between the two governments.

“I think of [the agreement] as marking the next chapter in our journey on AI safety, working hand in glove with the United States government,” Donelan told TIME in an interview at the British Embassy in Washington, D.C. on Monday. “I see the role of the United States and the U.K. as being the real driving force in what will become a network of institutes eventually.”

The U.K. and U.S. AI Safety Institutes were established just one day apart, around the inaugural AI Safety Summit hosted by the U.K. government at Bletchley Park in November 2023. While the two organizations’ cooperation was announced at the time of their creation, Donelan says that the new agreement “formalizes” and “puts meat on the bones” of that cooperation. She also said it “offers the opportunity for them—the United States government—to lean on us a little bit in the stage where they're establishing and formalizing their institute, because ours is up and running and fully functioning.”

The two AI safety testing bodies will develop a common approach to AI safety testing that involves using the same methods and underlying infrastructure, according to a news release. The bodies will look to exchange employees and share information with each other “in accordance with national laws and regulations, and contracts.” The release also stated that the institutes intend to perform a joint testing exercise on an AI model available to the public.

“The U.K. and the United States have always been clear that ensuring the safe development of AI is a shared global issue,” said Secretary Raimondo in a press release accompanying the partnership’s announcement. “Reflecting the importance of ongoing international collaboration, today’s announcement will also see both countries sharing vital information about the capabilities and risks associated with AI models and systems, as well as fundamental technical research on AI safety and security.”

Safety tests such as those being developed by the U.K. and U.S. AI Safety Institutes are set to play an important role in efforts by lawmakers and tech company executives to mitigate the risks posed by rapidly progressing AI systems. OpenAI and Anthropic, the companies behind the chatbots ChatGPT and Claude, respectively, have published detailed plans for how they expect safety tests to inform their future product development. The recently passed E.U. AI Act and U.S. President Joe Biden’s executive order on AI both require companies developing powerful AI models to disclose the results of safety tests.

Read More: Nobody Knows How to Safety-Test AI

The U.K. government under Prime Minister Rishi Sunak has played a leading role in marshaling an international response to the most powerful AI models—often referred to as “frontier AI”—convening the first AI Safety Summit and committing £100 million ($125 million) to the U.K. AI Safety Institute. The U.S., however, despite its economic might and the fact that almost all leading AI companies are based on its soil, has so far committed $10 million to the U.S. AI Safety Institute. (The National Institute of Standards and Technology, the government agency that houses the U.S. AI Safety Institute, suffers from chronic underinvestment.) Donelan rejected the suggestion that the U.S. is failing to pull its weight, arguing that the $10 million is not a fair representation of the resources being dedicated to AI across the U.S. government.

“They are investing time and energy in this agenda,” said Donelan, fresh off a meeting with Raimondo, who Donelan says “fully appreciates the need for us to work together on gripping the risks to seize the opportunities.” Donelan argues that in addition to the $10 million in funding for the U.S. AI Safety Institute, the U.S. government “is also tapping into the wealth of expertise across government that already exists.”

Despite its leadership on some aspects of AI, the U.K. government has decided not to pass legislation that would mitigate the risks from frontier AI. Donelan’s opposite number, the U.K. Labour Party’s Shadow Secretary of State for Science, Innovation and Technology Peter Kyle, has said repeatedly that a Labour government would pass laws mandating that tech companies share the results of AI safety tests with the government, rather than relying on voluntary agreements. Donelan however, says the U.K. will refrain from regulating AI in the short term to avoid curbing industry growth or passing laws that are made obsolete by technological progress.

“We don't think it would be right to rush to legislate. We've been very outspoken on that,” Donelan told TIME. “That is the area where we do diverge from the E.U. We want to be fostering innovation, we want to be getting this sector to grow in the UK.”

The memorandum commits the two countries to developing similar partnerships with other countries. Donelan says that “a number of nations are either in the process of or thinking about setting up their own institutes,” although she did not specify which. (Japan announced the establishment of its own AI Safety Institute in February.)

“AI does not respect geographical boundaries,” said Donelan. “We are going to have to work internationally on this agenda, and collaborate and share information and share expertise if we are going to really make sure that this is a force for good for mankind.”

More Must-Reads From TIME

Write to Will Henshall at will.henshall@time.com

The EU's AI Act requires companies to disclose safety test results, and the US President's executive order requires safety testing, demonstrating the growing recognition of the need for rigorous testing and evaluation of AI systems.

Experts believe that future AI systems may outmatch humans in cognitive skills, and that stronger democratic oversight is needed over AI development and deployment to prevent potential harms.

Title:

Content: Presented By
Getty Images
Ideas
Jan Brauner is a Ph.D. researcher in Artificial Intelligence at the University of Oxford, focusing on the safety of AI systems and their application in public health.
Alan Chan is a Ph.D. student at Mila, a research institute in Montreal focusing on AI, where he works on technical and socio-technical problems in AI safety. He's particularly interested in evaluation and AI regulation.

In May, more than 100 artificial intelligence (AI) professors, including some of the field's leading experts, scholars from other areas, and AI executives signed a one-sentence statement: "Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war.” Many signing researchers have explained their reason for worry: the risk that we might build powerful AI systems that we cannot control within this decade or the next ones.

Some have suggested the statement is an industry ploy to hype up AI companies’ products or influence regulation, ignoring that most of the signatories—ourselves included—are academics who do not work for industry. But the most common concern we have heard is that, by focusing on the risk of extinction, the statement distracts from present-day AI harms. As volunteers involved in collecting signatures for and constructing the statement, we disagree because both problems share a common core. The false dichotomy between ongoing harms and emergent risks makes it needlessly difficult to address common root causes.

AI poses many ongoing problems. AI systems can sustain human rights abuses, perpetuate systemic discrimination, and entrench power imbalances. Because AI systems are often widely deployed, harms can reach massive scales. For example, tens of thousands of families were pushed into poverty when the Dutch Tax and Customs Administration wrongly accused them of fraud and requested they pay back large sums of money, based on risk profiles created with AI systems.

The root causes of AI harm

There are several root causes that contribute to many instances of the harm caused by AI. One is that we do not know how to design AI systems that reliably behave exactly as we intend them to. For example, a health system was designed to allocate care based on need but discriminated against Black hospital patients. It turned out the algorithm used health care costs as a proxy for need, but institutionalized racism means that less money has been spent on Black patients historically. In many similar cases, companies do not explicitly set out to build harmful AI systems. Instead, creating state-of-the-art AI systems requires vast amounts of data, and the AI systems unintendedly inherit the biases encoded in this data.

Another cause is competitive pressures and limited accountability. There is often a strong economic incentive to deploy AI systems without sufficient safety checks. For example, Microsoft rushed the release of the Bing chatbot, which resulted in the chatbot threatening and insulting users. When the Dutch Tax Administration replaced human judgment with AI systems, this, too, happened in the name of efficiency.

Without decisive action to address these root causes, increasingly powerful and widely deployed AI systems will cause even more pervasive and significant harm. Many experts believe future AI systems may outmatch humans in crucial cognitive skills, such as social persuasion, planning, and development of novel technologies. Just as these cognitive abilities enabled humanity to control the fate of other species, the same skills could enable smarter AI systems to out-perform us. Given competition and limited accountability, there would be pressure on organizations to replace expensive human labor with AI systems. Economic forces encourage the rapid deployment of new AI systems (at the cost of safety testing), making them ever more powerful, building general (and potentially more powerful) systems rather than narrow (and potentially more controllable) systems, and increasing the autonomy of AI systems to take action in the world. AI systems could increasingly control our society's key productive, managerial, and military capacities. By then, we must have figured out how to design systems that always and truly behave as we intend. Otherwise, powerful AI systems that pursue goals at odds with humanity could lead to human marginalization or even extinction.

Read More: An AI Pause is Humanity's Best Bet for Preventing Extinction

Moreover, many researchers expect us to develop such advanced AI systems very soon. Companies are pouring more money and talent into AI development while the cost of computing power is decreasing. Simply using more computing power and data has reliably produced more capable AI systems, while AI algorithms have also improved. After seeing the rapid progress in AI over the past five years, Geoffrey Hinton, a founding father of modern AI, now expects that AI could broadly surpass human cognitive abilities—such as persuasion, planning, and scientific reasoning—within five to 20 years. Such time horizons are shared by many in the AI research community.

Twenty years is short; in discussions about the climate crisis, we regularly consider effects on such timescales. And just as climate change requires us to face air pollution and ongoing natural disasters as well as prevent future, even more, extreme weather events, we must tackle various AI risks and harms simultaneously. Even if we might be a couple of decades away from AI systems that are smarter than humans, that is little time to create the complex global governance structures necessary for this technology.

Work to address ongoing harms sometimes differs from work to manage extinction risk. We do not wish to erase nuance or potential differences between the perspectives. Yet, given common root causes, there is much room for collaboration and cooperation.

Four possible interventions

Many interventions could address the root problems. First, the public currently has little to no say over what models are built and how they are deployed. For example, those most affected by welfare systems have had little say in their automation. Private companies decide which risks are acceptable, as they have free rein over computing power and data, the key levers of AI development. Stronger democratic oversight over the supply of computing power and data would enhance public control over AI development and associated risks. For example, governments can monitor when large amounts of computing power are being used and for what purpose.

Second, a strong auditing regime, where independent third-parties would scrutinize the practices and development processes of AI labs, would help reduce risks overall. Auditing has already surfaced previously overlooked harms, such as bias in facial recognition, and could catch future failure modes like AI systems subverting human control or replicating autonomously. A standards body could ensure  AI systems, both before and after deployment, meet specified safety guidelines. Domestic agencies could enforce compliance, while an international organization would create universal standards.

Third, we should require meaningful human oversight of critical AI decisions, and avoid very-high-risk use cases such as lethal autonomous weapons. Uncertainty about AI systems' current and near-future capabilities means we should proceed cautiously around their deployment in critical domains.

Fourth, we should rebalance the  funding going into AIs and urge companies to spend less on making them smarter while increasing funding into making them safer, more transparent, and studying their social impacts. While it is good that industry labs are funding such research, this funding is liable to change with market conditions. Much more public funding for non-industry groups is required.

The development of increasingly powerful AI systems poses increasingly vast societal-scale risks. The complexity of these risks requires cooperation between people with potentially different motivations but with a shared interest in ensuring that AI development proceeds in a just and beneficial way.

More Must-Reads From TIME

Contact us at letters@time.com.

You May Also Like
EDIT POST

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What future risk did Hinton warn about AI?

Independent auditing can help reduce AI risks and surface previously overlooked harms, and rebalancing funding to prioritize AI safety and transparency is necessary to ensure that AI development is aligned with human values.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

The US and UK collaboration on AI safety is a key development, and the establishment of AI Safety Institutes in both countries marks a significant step towards ensuring the safe development and deployment of AI.

Title:

Content:     The Economic Times daily newspaper is available online now.

    China, US and EU agree to work together on AI safety at UK summit

    Synopsis

    In a first for Western efforts to manage its safe development, a Chinese vice minister joined US and EU leaders and tech bosses such as Elon Musk and ChatGPT's Sam Altman at Bletchley Park, home of Britain's World War Two code-breakers.

    China agreed to work with the United States, European Union and other countries to collectively manage the risk from artificial intelligence at a British summit on Wednesday aimed at charting a safe way forward for the rapidly evolving technology.

    Some tech executives and political leaders have warned the rapid development of AI poses an existential threat to the world if not controlled, sparking a race by governments and international institutions to design safeguards and regulation.

    Elevate Your Tech Prowess with High-Value Skill Courses

    Offering CollegeCourseWebsite
    IIT DelhiIITD Certificate Programme in Data Science & Machine LearningVisit
    Indian School of BusinessISB Professional Certificate in Product ManagementVisit
    Northwestern UniversityKellogg Post Graduate Certificate in Product ManagementVisit
    In a first for Western efforts to manage its safe development, a Chinese vice minister joined US and EU leaders and tech bosses such as Elon Musk and ChatGPT's Sam Altman at Bletchley Park, home of Britain's World War Two code-breakers.

    More than 25 countries present, including the United States and China, as well as the EU, signed a "Bletchley Declaration" saying countries needed to work together and establish a common approach on oversight.

    The declaration set out a two-pronged agenda focused on identifying risks of shared concern and building scientific understanding of them, while also developing cross-country policies to mitigate them.

    Wu Zhaohui, China's vice minister of science and technology, told the opening session of the two-day summit that Beijing was ready to increase collaboration on AI safety to help build an international "governance framework".

    "Countries regardless of their size and scale have equal rights to develop and use AI," he said.

    Fears about the impact AI could have on economies and society took off in November last year when Microsoft-backed OpenAI made ChatGPT available to the public.

    Using natural language processing tools to create human-like dialogue, it has stoked fears, including among some AI pioneers, that machines could in time achieve greater intelligence than humans, leading to unlimited, unintended consequences.

    Governments and officials are now trying to chart a way forward alongside AI companies which fear being weighed down by regulation before the technology reaches its full potential.

    "I don't know what necessarily the fair rules are, but you've got to start with insight before you do oversight," the billionaire Musk told reporters, adding that a "third-party referee" could be used to sound the alarm when risks develop.

    While the European Union has focused its AI oversight on data privacy and surveillance and their potential impact on human rights, the British summit is looking at so-called existential risks from highly capable general-purpose models called "frontier AI".

    Mustafa Suleyman, the cofounder of Google Deepmind, told reporters he did not think current AI frontier models posed any "significant catastrophic harms" but said it made sense to plan ahead as the industry trains ever larger models.

    Code-breaker venue

    The summit is the brainchild of British Prime Minister Rishi Sunak, who wants to carve out a post-Brexit role for his country as an intermediary between the economic blocs of the United States, China and the EU.

    British digital minister Michelle Donelan said it was an achievement just to get so many key players in one room. She announced two further AI Safety Summits, one to be held in South Korea in six months and another in France six months after that.

    "For the first time, we now have countries agreeing that we need to look not just independently but collectively at the risk around frontier AI," Donelan told reporters.

    Just as tech companies compete for dominance in AI, governments are jostling to lead the way on regulation.

    China is a key participant at the summit, given the country's role in developing AI. But some British lawmakers have questioned whether it should be there given the low level of trust between Beijing, Washington and many European capitals when it comes to Chinese involvement in technology.

    The United States made clear on the eve of the summit that the call to Beijing had very much come from Britain, with its Ambassador to London, Jane Hartley, telling Reuters: "This is the UK invitation, this is not the US"

    US Vice President Kamala Harris's decision to give a speech in London on Wednesday about her government's response to AI, and hold some meetings with attendees away from the summit, meaning they may have to leave early, also raised some eyebrows.

    Sachin Dev Duggal, founder of London-based AI firm Builder.ai said it risked undermining the event's core focus, while some lawmakers from Sunak's Conservative Party suggested Washington was trying to overshadow his summit.

    British officials denied that, saying they wanted as many voices as possible.

    Just days after US President Joe Biden signed an executive order on AI, his government used the British summit to announce it would launch a US AI Safety Institute.

    Harris will meet Sunak later on Wednesday, including for dinner, and attend the summit's second day on Thursday.
    Experience Your Economic Times Newspaper, The Digital Way!
      Stay on top of technology and startup news that matters. Subscribe to our daily newsletter for the latest and must-read tech news, delivered straight to your inbox.
      ...more

      Stories you might be interested in

The European Union enacted an AI Regulation on February 2, 2024, which aims to ensure AI systems are safe and respect rights.

Title:

Content: On February 2, 2024, the European Union enacted the Artificial Intelligence (AI) Regulation, referred to as the AI Act. This legislation aims to establish a stringent legal framework governing the development, marketing, and utilisation of artificial intelligence within the region, thereby marking a significant advancement in the regulation of this burgeoning domain.

What is the purpose?

This new regulation aims to establish harmonised rules to ensure that AI systems in the EU are safe and respect fundamental rights, while also fostering investment and innovation in the field of AI.

Who does it apply to?

The AI Act directly impacts businesses operating within the EU, whether they are providers, users, importers, distributors, or manufacturers of AI systems. The legislation provides clear definitions for the various actors involved in AI and holds them accountable for compliance with the new rules. This means that all stakeholders must ensure that their AI practices comply with the requirements outlined in the AI Act.

The European Union's AI Act also applies extraterritorially to companies not established on EU territory, provided they supply goods or services to EU consumers or process data relating to individuals located in the EU. Consequently, companies operating outside the EU territory may be subject to the provisions of the AI Act if they carry out AI-related activities involving EU users or data.

What are the requirements?

Among the key requirements of the AI Act:

  • the need for companies to compile an inventory of their current AI models. Organisations that do not yet have a model repository should assess their current status to understand their potential exposure. Even if they are not currently using AI, it is highly likely that this will change in the coming years. An initial identification step can begin from an existing software/applications catalogue or, in its absence, through surveys conducted among various departments, mainly IT and risk departments.
  • Classify according to associated risks. AI models deemed to pose high risks must comply with strict requirements and undergo a conformity assessment before being placed on the market. The regulatory framework defines four levels of risk concerning AI:

  • Companies must establish appropriate governance and monitoring measures to ensure that their AI systems adhere to the ethical and legal standards defined by the AI Act.

Companies must prepare and ensure that their AI practices comply with these new regulations. To initiate the process of full compliance with the AI Act, the following steps are necessary:

  • assess the risks associated with your AI systems;
  • raise awareness;
  • design ethical systems;
  • assign responsibilities;
  • stay updated; and
  • establish formal governance.

By taking proactive measures now, the AI systems will be compliant with the new regime when the AI Act comes into force, the organisation will be able to continue using them and obviously avoid potential significant sanctions.

What are the sanctions?

The penalties for non-compliance with the AI Act are significant. They range from €10 million to €40 million or from 2% to 7% of the company's global annual turnover, depending on the severity of the infringement. Therefore, it is crucial for companies to ensure that they fully understand the provisions of the AI Act and comply with its requirements to avoid such sanctions.

In summary, the AI Act aims to establish a robust regulatory framework for AI, guaranteeing both safety and respect for fundamental rights while promoting innovation and competitiveness for companies operating in the EU. Companies need to take proactive steps to comply with this new legislation and ensure ongoing compliance of their AI practices.

The content of this article is intended to provide a general guide to the subject matter. Specialist advice should be sought about your specific circumstances.

The AI Act applies to businesses operating within the EU, as well as companies outside the EU territory, and requires them to compile an inventory of their AI models.

AI models are classified according to associated risks, and high-risk AI models must comply with strict requirements, including establishing governance and monitoring measures.

Companies that fail to comply with the AI Act may face penalties ranging from €10 million to €40 million, or up to 7% of the company's global annual turnover.

In the United States, California has proposed AI regulation with safety standards, including pre-deployment safety testing and cybersecurity protections for large AI developers.

Title:

Content: sdecoret - stock.adobe.com

US works to develop AI standards while California legislates

California has proposed AI regulation as the U.S. works to develop AI standards by bringing together companies such as Apple, Amazon, Google and Microsoft.

While the Biden administration is working to develop AI safety standards, California may move faster and make AI safety the law.

Califiornia Sen. Scott Wiener (D-San Francisco) introduced Senate Bill 1047 on Thursday, AI legislation that would establish safety standards for developers of large AI systems. The standards would not apply to startups developing "less potent models," according to a statement. By "less potent AI," Wiener is likely referring to AI systems known as narrow or weak AI, which are designed for specific tasks, such as predictive modeling. The bill also establishes a public cloud offering called CalCompute to enable startups, researchers and others to participate in developing large AI systems.

The proposed legislation follows on the heels of the Biden administration's creation of the U.S. AI Safety Institute Consortium (AISIC), which will help meet the goals Biden set out in his executive order on AI last year. The consortium will help develop guidelines for red-team safety testing, risk management, safety, security and watermarking AI-generated content. It brings together more than 200 leading AI stakeholders to weigh in on the development of AI safety standards, including Amazon, Apple, Google, Adobe, Accenture, Intel, Meta, Microsoft, Nvidia, OpenAI, Salesforce and Workday.

Wiener recognized that developers have pioneered safe development practices for AI systems. However, the release announcing the proposed AI regulation said that California's government "cannot afford to be complacent" about regulating AI.

"With Congress paralyzed and the future of the Biden administration's executive order in doubt, California has an indispensable role to play in ensuring that we develop this extremely powerful technology with basic safety guardrails," according to the statement.

California wants to build off US standards with AI regulation

The proposed AI legislation in California aims to advance AISIC's efforts in AI safety by codifying its best practices into law, according to the statement.

Wiener said that the proposed legislation offers a chance to use insights gained from past failures to regulate other technologies.

"We've seen the consequences of allowing the unchecked growth of new technology without evaluating, understanding or mitigating the risks," he said in the statement. "SB 1047 does just that, by developing responsible, appropriate guardrails around development of the biggest, most high-impact AI systems to ensure they are used to improve Californians' lives, without compromising safety or security."

Some of the AI safety standards set out in SB 1047 include pre-deployment safety testing and implementation of cybersecurity protections for a handful of "extremely large AI developers," according to the release. The bill creates "no new obligations for startups or business customers of AI products."

Congress has yet to advance any AI legislation, and policymakers are unsure about what AI legislation might be adopted in 2024. The Biden administration has taken steps through executive powers to advance AI safety standards, including creating the consortium and relying on public sector partners to help develop those guidelines.

"The U.S. government has a significant role to play in setting the standards and developing the tools we need to mitigate the risks and harness the immense potential of artificial intelligence," Gina Raimondo, U.S. secretary of commerce, said in a statement. "By working with this group of leaders from industry, civil society and academia, together we can confront these challenges to develop the measurements and standards we need to maintain America's competitive edge and develop AI responsibly."

California's advancement of AI regulation could create confusion for businesses if they're eventually forced to navigate multiple sets of AI safety standards, especially if individual states' rules conflict with broader U.S. standards, said Hodan Omaar, senior policy analyst at the Information Technology and Innovation Foundation's Center for Data Innovation.

"Creating California-specific safety standards for large-scale AI systems is problematic because it sets the stage for a patchwork of safety rules, with different states coming up with their own diverse sets of standards that providers of these systems will have to navigate," she said. "A national set of standards that preempts states from creating their own standards is a much better approach."

Makenzie Holland is a news writer covering big tech and federal regulation. Prior to joining TechTarget Editorial, she was a general reporter for Wilmington StarNews and a crime and education reporter at the Wabash Plain Dealer.

Dig Deeper on Risk management and governance

Cloud Computing
Mobile Computing
Data Center
Sustainability and ESG
Close

The US government plays a significant role in setting AI standards, and the Biden administration has made efforts to develop AI standards, including an executive order that establishes new standards for AI safety and security.

Title:

Content: President Joe Biden on Monday signed an executive order that creates standards for the use of artificial intelligence. One of the main goals is to manage the risks associated with AI.

"The Executive Order establishes new standards for AI safety and security, protects Americans' privacy, advances equity and civil rights, stands up for consumers and workers, promotes innovation and competition, advances American leadership around the world, and more," the White House said in a statement.

Among the actions determined by the order, there is a requirement for developers to share their safety test results and other critical information with the U.S. government.

"AI devices are being used to deceive people. Deepfakes use AI generated audio and video to smear reputations," Biden said at the White House, pointing to one of the risks of AI. "I've watched one of me and said 'when the hell did I say that?"

The government measure was criticized by NetChoice, an association of tech companies that includes Google, Meta and Amazon among its members.

The executive order "takes a restrictive regulatory approach to the development of American artificial intelligence tools, putting the future of American innovation and global technological dominance at risk," the industry group said in a statement.

Former President Barack Obama published an article on Medium praising the Biden initiative.

"I'm glad to see the Biden administration acting with a sense of urgency — securing voluntary commitments from leading companies, and now signing an executive order designed to encourage innovation while avoiding some of the biggest risks," Obama wrote. "Congress should follow President Biden's lead and look to his executive order for opportunities to fund this work."

AI is considered as the main priority for CEOs, according to a KPMG survey of 1,300 executives released Oct. 5. They cited more profitability, new product and market growth, innovation and help to avoid fraud and cyber attacks as expected results of the use of technology.

JPMorgan Chase CEO Jamie Dimon told Bloomberg TV in an interview early October that future generations may work 3 ½ days a week because of AI. He also said that the bank "hopes to redeploy people" if AI replaces jobs.

One of the actions expected from the executive order is to "produce a report on AI's potential labor-market impacts, and study and identify options for strengthening federal support for workers facing labor disruptions, including from AI."

President Joe Biden's Executive Order requires developers to share safety test results with the U.S. government and protects Americans' privacy and advances equity.

Title:

Content: President Joe Biden on Monday signed an executive order that creates standards for the use of artificial intelligence. One of the main goals is to manage the risks associated with AI.

"The Executive Order establishes new standards for AI safety and security, protects Americans' privacy, advances equity and civil rights, stands up for consumers and workers, promotes innovation and competition, advances American leadership around the world, and more," the White House said in a statement.

Among the actions determined by the order, there is a requirement for developers to share their safety test results and other critical information with the U.S. government.

"AI devices are being used to deceive people. Deepfakes use AI generated audio and video to smear reputations," Biden said at the White House, pointing to one of the risks of AI. "I've watched one of me and said 'when the hell did I say that?"

The government measure was criticized by NetChoice, an association of tech companies that includes Google, Meta and Amazon among its members.

The executive order "takes a restrictive regulatory approach to the development of American artificial intelligence tools, putting the future of American innovation and global technological dominance at risk," the industry group said in a statement.

Former President Barack Obama published an article on Medium praising the Biden initiative.

"I'm glad to see the Biden administration acting with a sense of urgency — securing voluntary commitments from leading companies, and now signing an executive order designed to encourage innovation while avoiding some of the biggest risks," Obama wrote. "Congress should follow President Biden's lead and look to his executive order for opportunities to fund this work."

AI is considered as the main priority for CEOs, according to a KPMG survey of 1,300 executives released Oct. 5. They cited more profitability, new product and market growth, innovation and help to avoid fraud and cyber attacks as expected results of the use of technology.

JPMorgan Chase CEO Jamie Dimon told Bloomberg TV in an interview early October that future generations may work 3 ½ days a week because of AI. He also said that the bank "hopes to redeploy people" if AI replaces jobs.

One of the actions expected from the executive order is to "produce a report on AI's potential labor-market impacts, and study and identify options for strengthening federal support for workers facing labor disruptions, including from AI."

The Order also aims to study AI's labor-market impacts and seeks to strengthen federal support for workers.

Title:

Content: President Joe Biden on Monday signed an executive order that creates standards for the use of artificial intelligence. One of the main goals is to manage the risks associated with AI.

"The Executive Order establishes new standards for AI safety and security, protects Americans' privacy, advances equity and civil rights, stands up for consumers and workers, promotes innovation and competition, advances American leadership around the world, and more," the White House said in a statement.

Among the actions determined by the order, there is a requirement for developers to share their safety test results and other critical information with the U.S. government.

"AI devices are being used to deceive people. Deepfakes use AI generated audio and video to smear reputations," Biden said at the White House, pointing to one of the risks of AI. "I've watched one of me and said 'when the hell did I say that?"

The government measure was criticized by NetChoice, an association of tech companies that includes Google, Meta and Amazon among its members.

The executive order "takes a restrictive regulatory approach to the development of American artificial intelligence tools, putting the future of American innovation and global technological dominance at risk," the industry group said in a statement.

Former President Barack Obama published an article on Medium praising the Biden initiative.

"I'm glad to see the Biden administration acting with a sense of urgency — securing voluntary commitments from leading companies, and now signing an executive order designed to encourage innovation while avoiding some of the biggest risks," Obama wrote. "Congress should follow President Biden's lead and look to his executive order for opportunities to fund this work."

AI is considered as the main priority for CEOs, according to a KPMG survey of 1,300 executives released Oct. 5. They cited more profitability, new product and market growth, innovation and help to avoid fraud and cyber attacks as expected results of the use of technology.

JPMorgan Chase CEO Jamie Dimon told Bloomberg TV in an interview early October that future generations may work 3 ½ days a week because of AI. He also said that the bank "hopes to redeploy people" if AI replaces jobs.

One of the actions expected from the executive order is to "produce a report on AI's potential labor-market impacts, and study and identify options for strengthening federal support for workers facing labor disruptions, including from AI."

What risks did Hinton associate with AI's rapid advancement?

The Biden Administration focuses on worker protections and responsible AI development, and the OFCCP will publish guidance on nondiscrimination in hiring involving AI technology.

Title:

Content: Seyfarth synopsis: President Biden's Executive Order on artificial intelligence sets forth his vision for America to continue leading in AI innovation while also addressing risks associated with the use of AI. While much of the document delves into cutting-edge safety issues with national security implications, there are many provisions in the EO that have broad ramifications for companies generally, and employers specifically. The Order mandates greater coordination by civil-rights agencies on AI issues, emphasizes worker protections, and instructs the Department of Labor to guide federal contractors regarding AI-driven hiring practices. It marks the strategic emphasis on the government's internal standards for AI governance and AI risk management, and towards articulating and implementing "required minimum risk-management practices" for AI applications that "impact people's rights or safety." The Executive Order's emphasis on security assessments of AI systems are also set to influence AI risk management and safety dialogues across various sectors, all with significant implications in the labor and employment domain.

On October 30, 2023, President Biden signed a lengthy and far-reaching Executive Order regarding artificial intelligence that outlines the Administration's vision for the federal government's AI regulation and enforcement activities in the years to come. While some early media coverage of the EO has focused on what the EO says about identifying and managing AI risks related to national security, national public health and safety, and steps to develop watermarking standards to identify and label AI-generated content, the EO represents a comprehensive government-wide approach to addressing AI. The EO sets in motion action from multiple Departments and independent agencies, with the aim towards harnessing the benefits of AI and maintaining American leadership in innovation, while addressing risks associated with the use of AI.

While some of today's EO targets cutting-edge AI models developed by leading American AI companies, and delves into national security and national safety issues with global geopolitical implications, companies across multiple industries should pay close attention to some of the specific actions initiated by President Biden in today's Executive Order. Many of these actions will be shaping discussions regarding AI safety and bias for the foreseeable future.

In the upcoming days, Seyfarth will continue to provide updates on various areas targeted for Executive Branch action in AI, which may include, for example, intellectual property, privacy, cybersecurity, health care, labor relations, and other areas. Please continue to join us as we help companies better understand both risks associated with AI and, as President Biden put it on Monday, the "incredible opportunities" from the "most consequential technology" of our time.

Our update today focuses on issues we have identified as being of particular interest to employers.

1. Employers Should Expect Ongoing Coordination on AI Enforcement From Civil-Rights Agencies.

In the statement made today before signing the Executive Order, President Biden emphasized how AI is "all around us" and that AI presented an "incredible opportunity". President Biden also spoke of the risks of AI. This theme – that AI presents both opportunities and risks – is present throughout the Executive Order.

On the risk side of things, President Biden's Executive Order on AI is clear in its mandate to agencies charged with enforcing civil rights laws, directing them to make "comprehensive use of their respective authorities" to address potential civil-rights harms arising out of the use of AI, including "issues related to AI and algorithmic discrimination". The Executive Order further directs the Attorney General to "coordinate with and support agencies in their implementation and enforcement of existing Federal laws to address civil rights and civil liberties violations and discrimination related to AI" and directs agencies to coordinate "on best practices for investigating and prosecuting civil rights violations related to AI" and to provide further inter-agency training and technical assistance.

While some of these efforts are undoubtedly targeted at developing enforcement capacity at the various civil-rights enforcement agencies, the focus and ongoing coordination between federal enforcement agencies regarding the civil-rights implications of AI is not new, and the Executive Order builds on existing initiatives at the EEOC, OFCCP and other agencies.

In April 2023, the leaders of the EEOC, Department of Justice Civil Rights Division, the CFPB, and the FTC issued a "Joint Statement on Enforcement Efforts Against Discrimination and Bias in Automated Systems," emphasizing that their existing legal authorities applied to the use of AI. More recently, in the EEOC's Strategic Enforcement Plan for FY24-28, released in September 2023, the Commission expressed its intent to continue prioritizing its enforcement efforts on discriminatory recruitment and hiring practices, with a special emphasis on employers' use of AI. Likewise, OFCCP has also increased its focus on the use of artificial intelligence technologies. In August 2023, the Agency released its expanded supply and service audit scheduling letter to include a request for "information and documentation of policies, practices, or systems used to recruit, screen, and hire, including the use of artificial intelligence, algorithms, automated systems or other technology-based selection procedures."

Section 8 of the Executive Order discusses protecting consumers, patients, passengers, and students. It encourages independent regulatory agencies responsible for laws and federal programs relating to those stakeholders "to consider using their full range of authorities" to address AI risks.

For employers, the implications are indirect but noteworthy. In its directives in Section 8 of the Executive Order, the Biden Administration encourages agencies to consider rulemaking as well as guidance "clarifying the responsibility of regulated entities to conduct due diligence on and monitor any third-party AI services they use, and emphasizing or clarifying requirements and expectations related to the transparency of AI models and regulated entities' ability to explain their use of AI models."

The need to monitor third-party AI services and concepts of transparency and explainability are common themes in AI risk management discussions. While the EEOC did not receive a direct mandate to incorporate these concepts, the overarching themes in AI regulation will very well shape the discourse and future expectations in employment contexts.

2. The Biden Administration Remains Focused on Worker Protections

President Biden's Executive Order on AI further emphasizes his administration's focus on labor issues, and it contains multiple provisions regarding the responsible development and use of AI in order to support American workers. Specifically, the Executive Order states that AI "should not be deployed in ways that undermine rights, worsen job quality, encourage undue worker surveillance, lessen market competition, introduce new health and safety risks, or cause harmful labor-force disruptions," but instead be developed to improve the lives of workers through such innovative technology.

The Order also focuses on labor-market disruptions from AI, and directs the Chairman of the Council of Economic Advisers to prepare and submit a report to the President on the labor-market effects of AI, by April 2024. Among other things, the report is to identify ways to strengthen and expand education and training opportunities for pathways to occupations related to AI.

Relatedly, by April 2024, the Secretary of Labor is tasked with consulting with labor unions, workers, and other outside entities, to "develop and publish principles and best practices for employers that could be used to mitigate AI's potential harms to employees' well-being and maximize its potential benefits."

One of the harms to workers that the Biden Administration has highlighted is the potential harm from automated systems that monitor workers. The Executive Order asserts, "AI should not be deployed in ways that undermine rights, worsen job quality, [or] encourage undue worker surveillance". The White House's fact sheet discussing the Executive Order cites "the dangers of increased workplace surveillance, bias, and job displacement," and the Executive Order itself also directs the Secretary of Labor to issue guidance "to make clear that employers that deploy AI to monitor or augment employees' work must continue to comply with" the requirements of the FLSA.

In the context of disabilities, including in the workplace, the Executive Order mentions specific technology often associated with automated monitoring. It specifically identifies the risk of unequal treatment of people with disabilities "from the use of biometric data like gaze direction, eye tracking, gait analysis, and hand motions" and encourages the Architectural and Transportation Barriers Compliance Board to issue technical assistance and recommendations on the risks and benefits of AI in using biometric data as an input.

3. OFCCP and Federal Contractors' Use of AI

The EO directs that within a year, the Secretary of Labor "shall" publish guidance to federal contractors regarding "nondiscrimination in hiring involving AI and other technology-based hiring systems." Accordingly, Federal contractors in particular should expect additional guidance from OFCCP clarifying how it will be applying existing guidance, such as the 1978 Uniform Guidelines on Employee Selection Procedures, to cutting-edge hiring technology. The guidance to date has been limited and simply provides that the Uniform Guidelines apply to even the most sophisticated technologies.

Employers not directly subject to OFCCP's audits should still pay close attention to what the Department of Labor does here, because there is always the potential for the Department of Labor's guidance to be held out as a broader standard that employers everywhere might incorporate in their practices.

4. The way the Federal government thinks about AI risk will influence the way private companies think about AI risk.

Employers should pay close attention to what the federal government does with respect to its own use of artificial intelligence, and the way that federal agencies will be directed to think about AI risk as they continue their own AI journeys. These steps include straightforward risk-management practices such as directing agencies to appoint a "Chief Artificial Intelligence Officer" who is responsible for both promoting AI innovation in their agency as well as managing risks from their agency's use of AI, and things like directing the Office of Personnel Management to develop guidelines on the use of generative AI for work by the Federal workforce.

With respect to generative AI, generally, employers should also pay attention to how the Executive Order takes a balanced approach to the use of generative AI within the federal workforce. It "discourages" agencies from imposing bans, or wholesale blocking the use, of generative AI. The executive order also encourages agencies to put "appropriate safeguards in place" and to "employ risk-management practices, such as training ... staff on proper use, protection, dissemination, and disposition of Federal information; negotiating appropriate terms of service with vendors; implementing measures designed to ensure compliance with record-keeping, cybersecurity, privacy, and data protection requirements; and deploying other measures to prevent misuse of Federal Government information in generative AI." As federal agencies begin operationalizing these concepts further, private-sector employers should examine how their own practices align with (or may vary from) these practices.

And with respect to the federal government's own use of AI, President Biden's Executive Order also directs the Office of Management and Budget to issue guidance to federal agencies regarding "required minimum risk-management practices" for AI applications that "impact people's rights or safety." This guidance is to include key concepts from the AI Risk Management Framework by the National Institute of Standards and Technology (NIST), such as "conducting public consultation; assessing data quality; assessing and mitigating disparate impacts and algorithmic discrimination; providing notice of the use of AI; continuously monitoring and evaluating deployed AI; and granting human consideration and remedies for adverse decisions made using AI." As the federal government intensifies its internal focus on these risk-management principles – both in its own operations and as a buyer of AI – we anticipate a corresponding rise in their significance within the private sector. This will especially hold true for companies leveraging AI in HR decision-making processes.

Speaking of NIST, the Executive Order places a lot of responsibility on NIST. Employers should pay special attention to the directive that NIST draft "guidelines and best practices, aiming to promote consensus industry standards, for the development and deployment of AI systems that are safe, secure, and trustworthy." This directive is important for employers who are either currently utilizing AI in their HR operations or contemplating its integration. Notably, NIST is tasked with establishing guidelines and benchmarks for the evaluation and auditing of AI capabilities, emphasizing areas where AI might pose potential hazards. While some of the risks mentioned by the Executive address national security and biosecurity concerns, we believe that working towards creating standards to evaluate risks related to unlawful bias and employment-discrimination is firmly within the responsibilities assigned to NIST by the Executive Order.

5. Security testing and "red teaming" of AI will become more-relevant for employers.

Some of the headline-grabbing portions of President Biden's Executive Order involve President Biden's invocation of the Defense Production Act to require American tech giants developing the largest and most-sophisticated AI models to disclose the results of certain "red teaming" security testing exercises. While some of the test subjects may sound like they were drawn from science fiction –the Executive Order refers to testing whether AI models might have "the possibility for self-replication or propagation" – even employers who aren't developing cutting-edge AI models should still pay attention to the broad scope of the "red teaming" of AI models.

Crucially for employers, the Executive Order's definition of "AI red-teaming" explicitly includes tests for potentially discriminatory output from an AI system. The Executive Order's full definition of "AI red-teaming" is

a structured testing effort to find flaws and vulnerabilities in an AI system, often in a controlled environment and in collaboration with developers of AI. Artificial Intelligence red-teaming is most often performed by dedicated "red teams" that adopt adversarial methods to identify flaws and vulnerabilities, such as harmful or discriminatory outputs from an AI system, unforeseen or undesirable system behaviors, limitations, or potential risks associated with the misuse of the system.

Earlier this summer, President Biden's chief AI advisor, OSTP Director Arti Prabhakar, addressed the DEF CON security conference, where OSTP and other federal agencies sponsored a wide-scale "generative AI red teaming" exercise. In this exercise, thousands of volunteers engaged in the adversarial testing of large language models, seeking, among other things, to induce the language models to generate outputs revealing explicit or implicit bias, misinformation, or directions for illegal activities. Director Prabhakar encouraged the security researchers, noting that it was important for developers and the government to "understanding how these systems break so [they] can keep getting better." Given its prominent place in President Biden's Executive Order, the concept of "AI red-teaming" will gain further attention. It will be an important concept for many AI applications, and not just the most advanced ones, so employers should evaluate all of their AI safety and security practices, including testing and validation, in light of this heightened emphasis.

Conclusion

President Biden's far-reaching Executive Order on AI will dominate discussion about AI regulation and enforcement for some time to come. We plan to provide additional updates as we dive more deeply in this comprehensive EO.

The content of this article is intended to provide a general guide to the subject matter. Specialist advice should be sought about your specific circumstances.

The National Institute of Standards and Technology will draft guidelines for safe, secure, and trustworthy AI system development, and security testing and "red teaming" of AI will become more relevant for employers.

The European Union's Artificial Intelligence Act sets global standards for AI development and use, and promotes trustworthy AI development and use in the EU.

Title:

Content: In a landmark move, the European Council has approved the Artificial Intelligence Act, potentially setting the first global standards for AI regulation.

On Tuesday, May 21st, the Council of the European Union took a significant step in regulating artificial intelligence, approving a groundbreaking law that sets a global benchmark for harmonising AI rules.

AI Act: A Game Changer for AI Regulation?

The law aims to promote the development and use of trustworthy AI across the EU's single market, fostering innovation while safeguarding fundamental rights like privacy and non-discrimination.

The AI Act establishes an innovation-friendly legal framework and promotes evidence-based learning through AI regulatory sandboxes. These sandboxes provide controlled environments for developing, testing, and validating novel AI systems in real-world settings.

How Will The AI Act Identify System Risks?

The legislation will separate AI systems into categories based on risk levels. AI systems posing limited risk will be subject to minimal transparency obligations. On the other hand, high-risk AI systems will face stringent obligations before entering the EU market.

For instance, the Act bans high-risk AI, including systems designed for manipulative persuasion (e.g., cognitive behavioural manipulation) and social scoring. It also restricts AI use in areas like predictive policing based on profiling and biometric categorisation by sensitive characteristics such as race, religion, or sexual orientation.

Who Will The AI Act Apply To?

The EU AI Act will primarily applies to the 27 members of the European Union. However, its reach extends beyond the bloc, potentially impacting companies that provide AI systems or services used in the EU.

Per a Reuters report, non-EU companies using EU customer data on their platforms must comply. The EU's AI Act could become a landmark precedent, inspiring other countries and regions to also develop their own AI regulations.

Enforcing the Rules

The AI Act establishes a multi-layered enforcement framework to ensure effective implementation across the EU. This includes:

An AI Office within the European Commission: This office will be vital in offering scientific and technical expertise to enforce activities.

An AI Board with Member State representatives: This board will act as an advisor and assist the Commission and member states in ensuring consistent application of the AI Act across the bloc.

An advisory forum for stakeholders: This will bring together various stakeholders to contribute their technical expertise and advise the AI Board and the Commission.

Companies that violate the AI Act will face hefty fines, potentially reaching a percentage of their global annual turnover in the previous financial year or a predetermined amount, whichever is higher. The Act also considers proportional administrative fines for smaller businesses and startups.

Once the relevant EU officials sign, the AI Act will be published in the EU's Official Journal within days and officially enter into force 20 days after publication. However, most provisions will only become fully applicable two years after this date, with some exceptions taking effect sooner.

While AI safety researchers warn of a high probability of existential threats from AI (some estimate close to 100%), figures like Elon Musk advocate for continued research, arguing that the risk is closer to 20%. The EU's AI Act aims to address these concerns by overseeing the development and use of AI to mitigate potential risks.

This timely law comes at a time when scammers have increasingly turned to AI-powered tools like ChatGPT to create sophisticated deep fakes or impersonate real people in online scams. The AI Act, which focuses on transparency and accountability, might play a key role in curbing such deceptive practices.

The AI Act establishes a risk-based approach to AI governance and imposes strict prohibitions on certain AI applications, including manipulative persuasion and social scoring systems.

The EU AI Act safeguards fundamental rights, including privacy and non-discrimination, and non-EU companies using EU customer data must comply with the AI Act.

The US lacks comprehensive AI regulation, but the Biden administration has issued executive orders and guidelines to regulate AI development and safety.

Title:

Content: Biden issues an executive order setting safety, security and transparency standards for artificial intelligence systems - Sunrise Portal
Tuesday 31 October 2023 8: 44 AM Cairo Cairo 24 °
Most Read
You might like it, too.
Share your opinion
Do you support calls to boycott some restaurants that have been proven to support the occupation soldiers?
Biden issues executive order setting safety, security and transparency standards for artificial intelligence systems
US President Joe Biden
Published on: Tuesday 31 October 2023 - 8: 08 AM | Last updated on Tuesday 31 October 2023 - 8: 08 AM
US President Joe Biden on Monday issued an executive order setting out safety, security and transparency standards for artificial intelligence systems, requiring companies developing them to share details of systems safety tests with the US government.
Companies that train in artificial intelligence through so-called foundational models, which may pose risks to national security and public health depending on how they are deployed, must disclose safety results to U.S. agencies.
Foundational models refer to AI systems that absorb large amounts of data and can then be deployed in a variety of applications.
Many AI systems that use natural language processing, and those that propose the creation of new chemical compounds, use foundational models.
The National Institute of Standards and Technology will set a standard for the types of safety tests that companies must perform before releasing AI systems.
The Department of Homeland Security will then apply these standards to systems used in critical infrastructure sectors and establish a safety and security board on artificial intelligence.
The Biden order uses the authority the president has under the Defense Production Act, which presidents routinely use to oversee U.S. companies for the purpose of national security.
Former President Donald Trump used the law during the COVID-19 pandemic to control exports of medical goods and boost production of vital supplies.
You might like it, too.
Share your comment

The US government oversees AI development for national security, and companies must disclose safety results to US agencies.

Title:

Content: Biden issues an executive order setting safety, security and transparency standards for artificial intelligence systems - Sunrise Portal
Tuesday 31 October 2023 8: 44 AM Cairo Cairo 24 °
Most Read
You might like it, too.
Share your opinion
Do you support calls to boycott some restaurants that have been proven to support the occupation soldiers?
Biden issues executive order setting safety, security and transparency standards for artificial intelligence systems
US President Joe Biden
Published on: Tuesday 31 October 2023 - 8: 08 AM | Last updated on Tuesday 31 October 2023 - 8: 08 AM
US President Joe Biden on Monday issued an executive order setting out safety, security and transparency standards for artificial intelligence systems, requiring companies developing them to share details of systems safety tests with the US government.
Companies that train in artificial intelligence through so-called foundational models, which may pose risks to national security and public health depending on how they are deployed, must disclose safety results to U.S. agencies.
Foundational models refer to AI systems that absorb large amounts of data and can then be deployed in a variety of applications.
Many AI systems that use natural language processing, and those that propose the creation of new chemical compounds, use foundational models.
The National Institute of Standards and Technology will set a standard for the types of safety tests that companies must perform before releasing AI systems.
The Department of Homeland Security will then apply these standards to systems used in critical infrastructure sectors and establish a safety and security board on artificial intelligence.
The Biden order uses the authority the president has under the Defense Production Act, which presidents routinely use to oversee U.S. companies for the purpose of national security.
Former President Donald Trump used the law during the COVID-19 pandemic to control exports of medical goods and boost production of vital supplies.
You might like it, too.
Share your comment

The National Institute of Standards and Technology sets safety test standards, and the Department of Homeland Security applies standards to critical infrastructure.

Title:

Content: Biden issues an executive order setting safety, security and transparency standards for artificial intelligence systems - Sunrise Portal
Tuesday 31 October 2023 8: 44 AM Cairo Cairo 24 °
Most Read
You might like it, too.
Share your opinion
Do you support calls to boycott some restaurants that have been proven to support the occupation soldiers?
Biden issues executive order setting safety, security and transparency standards for artificial intelligence systems
US President Joe Biden
Published on: Tuesday 31 October 2023 - 8: 08 AM | Last updated on Tuesday 31 October 2023 - 8: 08 AM
US President Joe Biden on Monday issued an executive order setting out safety, security and transparency standards for artificial intelligence systems, requiring companies developing them to share details of systems safety tests with the US government.
Companies that train in artificial intelligence through so-called foundational models, which may pose risks to national security and public health depending on how they are deployed, must disclose safety results to U.S. agencies.
Foundational models refer to AI systems that absorb large amounts of data and can then be deployed in a variety of applications.
Many AI systems that use natural language processing, and those that propose the creation of new chemical compounds, use foundational models.
The National Institute of Standards and Technology will set a standard for the types of safety tests that companies must perform before releasing AI systems.
The Department of Homeland Security will then apply these standards to systems used in critical infrastructure sectors and establish a safety and security board on artificial intelligence.
The Biden order uses the authority the president has under the Defense Production Act, which presidents routinely use to oversee U.S. companies for the purpose of national security.
Former President Donald Trump used the law during the COVID-19 pandemic to control exports of medical goods and boost production of vital supplies.
You might like it, too.
Share your comment

Experts are skeptical about the effectiveness of new regulations, and the AI industry lacks standard testing safety protocols.

Title:

Content: Join Fox News for access to this content
Plus get unlimited access to thousands of articles, videos and more with your free account!
Please enter a valid email address.

The Biden administration will begin implementing new rules laid out in the president's executive order aimed at regulating artificial intelligence, though some experts are skeptical about how useful the new rules will be.

"The executive order's preoccupation with model size and computing power, rather than actual use case, is misguided. This approach risks creating compliance burdens for companies without meaningfully improving accountability or transparency," Jake Denton, a research associate at the Heritage Foundation’s Tech Policy Center, told Fox News Digital.

"The order's blurred lines and loosely defined reporting requirements will likely yield selective, inconsistent enforcement."

Denton's comments come after The Associated Press reported Monday that the Biden administration would start implementing new rules from the order, including a rule that requires developers of AI systems to disclose the results of safety tests to the government.

WHITE HOUSE: DEVELOPERS OF ‘POWERFUL AI SYSTEMS’ NOW HAVE TO REPORT SAFETY TEST RESULTS TO GOVERNMENT

President Biden delivers remarks about government regulations on artificial intelligence at the White House, Oct. 30, 2023. (AP Photo/Evan Vucci)

The White House AI Council met Monday to discuss progress on the three-month-old executive order, according to the report, coming at the same time the 90-day goal laid out in the order under the Defense Production Act that AI companies begin sharing information with the Commerce Department.

Ben Buchanan, the White House special adviser on AI, told The Associated Press that the government has an interest in knowing if "AI systems are safe before they’re released to the public – the president has been very clear that companies need to meet that bar."

But Denton is skeptical that the order will lead to the advertised results.

"The order's blurred lines and loosely defined reporting requirements will likely yield selective, inconsistent enforcement," Denton said. "Meanwhile, the substantial information asymmetry between regulators and companies will likely render oversight ineffective."

Christopher Alexander, chief analytics officer of Pioneer Development Group, also expressed skepticism about the new rules, noting government struggles to regulate other tech industries such as cryptocurrencies and expressing fears about censorship.

WHITE HOUSE URGES CONGRESS TO ACT FOLLOWING ‘ALARMING’ AI TAYLOR SWIFT IMAGES

"The Biden administration's problematic regulation of crypto is a perfect example of government dictating to industry rather than working with industry for proper regulations," Alexander told Fox News Digital. "I am also concerned that the aggressive censorship efforts with social media by the U.S. government in the past few years is very disconcerting, and I think any government oversight efforts must be carefully monitored by Congress for accountability, and it is crucial that they clearly define 'who will watch the watchers.'"

Nevertheless, Alexander argued that it is important to establish standards for the industry, noting that "the private sector motivations of AI companies are not always in the best interest of the general public."

In this photo illustration, Google Bard AI logo is seen on a smartphone and Google logo on a pc screen. (Pavlo Gonchar/SOPA Images/LightRocket via Getty Images)

Biden's executive order seeks to bridge that gap, putting in place a set of common standards for future AI safety.

"I think the government is setting the tone for the future. There really isn’t a standard yet for testing safety with these models yet. Because of that, this order doesn’t have much teeth – yet," Phil Siegel, founder of the Center for Advanced Preparedness and Threat Response Simulation (CAPTRS), told Fox News Digital.

"If the administration fails to meet the moment, by creating stifling regulations, America will see its global edge in AI technology wither away."

"But there are some consensus processes emerging. Eventually, there will probably be several prompts generated either randomly or not to test the models. There will be some sophisticated AI models that will be used to converse or test new models. In addition, ‘red teaming’ will become a method that is used where teams of people and technology try to 'break' these models."

CHATGPT CHIEF WARNS OF SOME ‘SUPERHUMAN’ SKILLS AI COULD DEVELOP

Siegel likened the process to the current rules for drug approval, which he argued is now well understood and followed by drug developers.

"We will eventually have that for testing AI models and honestly should have had that in place for social media applications," Siegel said.

Ziven Havens, policy director at the Bull Moose Project, argued that the administration has reached a critical juncture in the regulation of AI, one that will require them to balance safety standards while taking care not to stifle innovation.

ChatGPT on a laptop (Cyberguy)

"If the Biden administration aims to be successful with AI regulation, they will use the information provided to them to create reasonable standards, ones that will both protect consumers and the ability of companies to innovate," Havens told Fox News Digital.

CLICK HERE TO GET THE FOX NEWS APP

"If the administration fails to meet the moment, by creating stifling regulations, America will see its global edge in AI technology wither away. Waving a white flag on American innovation would be a disaster, both for our economy and national security."

The White House did not immediately respond to a Fox News Digital request for comment.

The administration faces the challenge of creating reasonable standards that balance safety and innovation.

The US and EU are collaborating on a voluntary AI code of conduct, and 97% of businesses expect to use AI to improve efficiencies and cut costs.

Title:

Content: Corporate AI leaders have met with President Joe Biden to discuss AI safety as part of a voluntary agreement.

In a Friday meeting with President Biden, the leaders of America’s biggest AI-focused companies, including Meta, Amazon, Google, Microsoft, Anthropic, Inflection AI, and OpenAI, pledged to continue their efforts in ensuring the safety of AI.

However, there are concerns that the voluntary agreement between the Biden administration and leading AI companies may be more of a symbolic gesture rather than aggressive regulation.

Many tech billionaires have become fixated on hypothetical doomsday scenarios in which AI becomes fixated on a specific goal and triggers human extinction in its pursuit, Forbes’s Johanna Costigan wrote.

She claimed their fascination with these stories is interconnected with their belief in longtermism, a philosophy that urges the making of short-term trade-offs for the sake of humanity’s long-term well-being, adding:

“Conveniently, this concept allows them to continue developing profitable technological applications while claiming paternalistic, karmic excellence: they are not only bestowing life-optimizing tech to the masses, they are also single handedly ensuring the tech they make doesn’t go rogue and kill us all.”

President Biden’s acknowledgment that these executives are critical for making sure AI develops “with responsibility and safety by design” also demonstrates that the White House reflects this narrative.

Costigan claimed that by adhering to the ideals of “AI safety” as defined by tech companies, issues such as copyright infringement and the presence of sexist and racist algorithms are being ignored.

These immediate challenges posed by AI are dismissed as mere risks, overshadowed by grandiose hypothetical threats, she wrote.

The term “AI safety” is deliberately vague, allowing different stakeholders to interpret it in their own ways.

It can refer to job security, trust in algorithms, or the confidence that facial recognition won’t be abused.

However, the focus on creating “safety” in AI neglects the fact that the data on which AI relies remains entirely unregulated in the United States. This lack of regulation has given AI companies the freedom to design safety standards that align with their own moral and financial interests.

Competition From China Prompts US Government to Avoid Stiff Regulation

China’s domestic development of AI has further intensified the US government’s inclination to step aside in order to allow perceived innovation to thrive, Costigan said.

She noted that while China may have stricter regulations on technology, the average US citizen is more vulnerable to encountering unmarked deepfakes.

In democratic countries, where information shapes public opinion and dictates election outcomes, synthetic images and text generated by AI pose a significant threat.

The recent meeting between the White House and tech CEOs shows a shared commitment to secure AI development, but without data privacy regulations, attempts to make AI safe are akin to “regulate the drinking of wine in restaurants—but not the commercial process of turning grapes into wine.”

Voluntary measures and general commitments are a step in the right direction, but more concrete guidelines and specific plans need to be implemented.

Companies such as Anthropic have announced their intention to share more specific cybersecurity measures and responsible scaling plans.

All in all, while the efforts of AI industry leaders to address safety concerns are commendable, there is a need for greater scrutiny and accountability.

The dominance of these companies in shaping the narrative around AI risks and safety has allowed them to evade immediate challenges such as data privacy and algorithmic biases.

AI Regulation Finds Momentum Amid Growing Adoption

Last month, a bipartisan group of lawmakers in the US introduced the National AI Commission Act, which aims to create a blue-ribbon commission to explore the regulation of AI.

The proposal would establish a 20-member commission to study AI regulation, including how responsibility for regulation is divided between agencies, the capacity of such agencies to regulate, and ensuring that enforcement actions are aligned.

Members of the commission will come from civil society, government, industry, and labor and will not be dominated by one sector.

The move came as the skyrocketing popularity of AI tools has led to increasing calls for regulations.

As reported, the European Union and the US announced collaborating to develop a voluntary code of conduct for AI. Officials will seek feedback from industry players and invite parties to sign up to curate a proposal for the industry to commit to voluntarily.

Likewise, the EU has been working on its Artificial Intelligence Act, a sprawling document in the works, for around two years. The legislation aims to classify and regulate AI applications based on their risk.

These attempts to regulate AI come as the technology is well on the path to finding mainstream adoption.

According to a recent survey from the Pew Research Center, 27% of Americans interact with AI on a daily basis.

The survey found that another 28% of individuals encounter AI about once a day or several times a week.

Furthermore, almost all businesses (97%) expect to use AI to improve their efficiencies and cut costs.

Many businesses see promise in the usefulness of AI, such as streamlining email communications with colleagues (46%), generating website copy (30%), fixing coding errors (41%), translating information (47%), and summarizing information (53%).

Read More:

What's the Best Crypto to Buy Now?

  • B2C Listed the Top Rated Cryptocurrencies for 2023
  • Get Early Access to Presales & Private Sales
  • KYC Verified & Audited, Public Teams
  • Most Voted for Tokens on CoinSniper
  • Upcoming Listings on Exchanges, NFT Drops

However, the US lacks data privacy regulations, which hinders AI safety efforts, and China's AI development has prompted the US to avoid stiff regulation.

The term "AI safety" is vague and open to interpretation, and the National AI Commission Act proposes a 20-member commission to study AI regulation.

Geoffrey Hinton's warnings about the dangers of unmanaged AI have made headlines, but the current AI regulation standards and efforts to address AI safety concerns are ongoing and evolving.

Title:

Content: World's first protection against AI is approved by all 193 UN nations that will ban malicious designs and development of the tech - and Russia and China co-sponsored the new resolution

  • The UN is setting new guardrails against AI to protect data and human rights
  • The resolution was signed by all 193 UN members and 123 non-UN countries
  • Tech titans have expressed growing concerns about the development of AI
  • The 'Godfather of AI' has said he regrets developing the technology
  • READ MORE: AI poses 'extinction-level' threat and government must control it

Artificial intelligence has stoked fears and security concerns for years but a new global resolution to safeguard the public may provide much-needed reassurance.

The United Nations General Assembly approved a resolution to shield personal data, monitor AI for potential risks including scams, and protect human rights.

The resolution - proposed by the US - is non-binding but was agreed upon by all 193 UN member nations and co-sponsored by non-members from 123 countries, including China and Russia.

The resolution comes as high-profile tech moguls have expressed concerns about AI's reliability, including Geoffrey Hinton - the 'Godfather of AI' - who said last year that he regretted creating the technology and worries that machines could take over.

All 193 UN members signed an AI resolution to protect people's data and human rights

The White House called the resolution a 'historic step' and Vice President Kamala Harris said she and President Joe Biden are committed to establishing AI safeguards

The White House praised the resolution, calling it a 'historic step' to ensuring 'trustworthy' advancements in AI.

National security adviser Jake Sullivan wrote in a statement: 'The resolution adopted today lays out a comprehensive vision for how countries should respond to the opportunities and challenges of AI.

'It lays out a path for international cooperation on AI, including to promote equitable access, take steps to manage the risks of AI, protect privacy, guarding against misuse, prevent exacerbated bias and discrimination.'

It took three months for the countries to finalize negotiations and agree on global privacy policies to ensure the AI technology benefits all nations and is 'safe, secure and trustworthy.'

The resolution noted the nations needed to agree on AI's 'design, development, deployment and use of artificial intelligence systems' is accelerating.

'We're sailing in choppy waters with the fast-changing technology, which means that it's more important than ever to steer by the light of our values,' a senior UN administration official said, and added that this resolution is the 'first-ever truly global consensus document on AI.'

This resolution aims to close the gaps in the technological divide between Western countries and poorer, third-world countries to make sure their technology is advanced enough to benefit from AI.

'The improper or malicious design, development, deployment and use of artificial intelligence systems ... pose risks that could ... undercut the protection, promotion and enjoyment of human rights and fundamental freedoms,' the resolution stated.

Scammers have used AI to steal people's data and money and have been used to impersonate family members on the phone - leading their relatives to believe they're in trouble and need money immediately before scamming them out of thousands of dollars.

AI has been used to make deepfake videos and pictures of people without their knowledge or consent

AI has also been used to create deepfake photos and videos of celebrities and average people, and because much of the violations are done through complex algorithms, it can be difficult to hold actors accountable for any harm caused.

'Now is the time to not only ensure that AI systems are rights respecting by design, but also to guarantee that those who are impacted by these technologies are not only meaningfully involved in decision-making on how AI technology should be regulated, but also that their experiences are continually surfaced and are centered within these discussions,' Amnesty International reported.

READ MORE: AI-generated voice calls are made ILLEGAL in US - and FCC says ruling 'takes effect immediately'

Following the new ruling, FCC Chairwoman Jessica Rosenworcel said, 'We're putting the fraudsters behind these robocalls on notice.'

Advertisement

The agreement between all UN members and the support from other countries was a major development.

UN members said that there were 'lots of heated conversations. ... But we actively engaged with China, Russia, Cuba, other countries that often don't see eye to eye with us on issues.'

According to the resolution, all participating countries will ensure it is adopted and developed in a secure way that prevents the systems from exposing people's data and will make sure all nations can enjoy the benefits.

Vice President Kamala Harris, the US's AI Czar, said in a statement that the White House welcomes the UN's adoption of the resolution.

She continued: 'President Biden and I are committed to establishing and strengthening international rules and norms on emerging technology – because technology with global impact, such as AI, requires global action, and when it comes to the challenges of the 21st century, we believe all nations must be guided by a common set of understandings.'

The resolution comes after AI faced scrutiny from top tech executives who have painted a 'world-on-fire' scenario, with many warning that AI machines could take over, leading to an 'extinction level' event.

Tech titans penned a letter in March 2023 urging lawmakers to force companies to pause their AI software developments.

'Recent months have seen AI labs locked in an out-of-control race to develop and deploy ever more powerful digital minds that no one – not even their creators – can understand, predict, or reliably control,' said the letter which was signed by more than 1,000 tech developers and experts.

Among those who signed the letter were X owner Elon Musk and OpenAI ChatGPT founder Sam Altman.

Hinton also foretold what steps the technology could take to get out of control and cause human extinction.

'One of the ways these systems might escape control is by writing their own computer code to modify themselves. And that's something we need to seriously worry about,' Hinton told CNBC last year.

The AI godfather has even gone so far as to say he regrets building the technology but told The New York Times: 'I console myself with the normal excuse: If I hadn't done it, somebody else would have.'

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

The UK has pledged 80 million pounds for AI projects globally, with a focus on supporting AI expertise in Africa, and establishing eight new AI research labs in African universities.

Title:

Content: Begin typing your search...

UK pledges 80 million pounds for AI projects globally, including in Africa

The announcement was made on the first day of the Artificial Intelligence (AI) Safety Summit that began today at the historic British technological landmark, Bletchley Park, near London.

Representative image

  • Whatsapp
  • Telegram
  • Linkedin
  • Print
  • koo
  • Whatsapp
  • Telegram
  • Linkedin
  • Print
  • koo
  • Whatsapp
  • Telegram
  • Linkedin
  • Print
  • koo

NEW DELHI: The United Kingdom and its global partners on Wednesday announced an 80 million pound project for funding artificial intelligence projects around the world, beginning in Africa.

The announcement was made on the first day of the Artificial Intelligence (AI) Safety Summit that began today at the historic British technological landmark, Bletchley Park, near London.

Rajeev Chandrasekhar, the Union Minister of State for Electronics and Information Technology, is representing India at the two-day summit that has in attendance that will see a convergence of governments, academia and companies working in artificial intelligence to debate and identify risks, opportunities of the technology and the “need for international collaboration.”

The 80 million pound (USD 100 million) funding is the result of a collaboration between Britain, Canada and the Bill and Melinda Gates Foundation to boost “safe and responsible” programming, according to the UK Foreign Office.

The UK AI for Development Programme will contribute 38 million pounds to the collaboration which shows UK investing in partnerships which are using cutting-edge technology to solve global challenges.

The commitment aims to support AI expertise and computing power in Africa and help the continent’s AI innovators boost growth and support the continent’s long-term development.

It will seek to unlock the “benefits of AI to the 700 million people who speak 46 African languages” according to statement by the British High Commission here.

The Summit also intends to address the ways global superpowers can mitigate risks associated with AI technology however so far more focus has been to support African countries. The fund intends to support Africa by increasing at least eight new AI research labs in African Universities, promoting Africans to enter the AI market.

The summit suggests that doing this will make the AI market more equitable, enabling AI to be safely and responsibly used.

According to a statement it will, “help bring down the barriers to entry for African AI innovators with the private sector.”

UK Foreign Secretary, James Cleverly said “The transformative power of AI should have a global benefit. AI can change lives for the better around the world, including helping to develop new treatments for diseases and to tackle food insecurity.”

The summit continues to share that transformative AI can help to solve world problems. The Bill & Melinda Gates Foundation CEO, Mark Suzman said, “AI has the potential to help solve some of the world’s most pressing challenges.”

Eliud Owallo, Kenya’s Cabinet Secretary for Information Communications and Digital Economy stated that the support offered to developing AI in Africa will, “ensure that developing countries are not left behind in the AI revolution”.

Meanwhile, Over the course of the next two days, Chandrasekhar will seek to understand and develop India’s role in AI.

The US, France, Singapore, Italy, Japan and China among nations have confirmed their attendance at the Bletchley Park Summit, British officials said.

Next Story

The United Nations has adopted a resolution on safe artificial intelligence systems, which aims to promote sustainable development and human rights, and calls for governments to collaborate with the private sector on AI safety.

Title:

Content: SCIENCE & TECHNOLOGY
US welcomes General Assembly resolution on ‘ safe ’ artificial intelligence
The United States welcomed the adoption by the United Nations General Assembly of its resolution to reach “a global consensus on safe and reliable artificial intelligence systems to promote sustainable development. ”
US Secretary of State Anthony Blinken said: “With the adoption of the United Nations General Assembly resolution on artificial intelligence (AI), UN member states spoke with one voice to define a global consensus on safe and reliable AI systems to promote sustainable development. ”
In his statement, Blinken noted that “this consensus resolution, developed with the direct participation of more than 120 countries and co-sponsored by more than 120 Member States from all regions of the world, represents a historic effort and a new global approach to the development and use of emerging AI technology. ”
This decision contributes to ensuring that the benefits of AI reach countries in all regions of the world and at various levels of development, with a focus on capacity building and bridging digital divides, especially in developing countries, and underscores the consensus that AI systems can respect human rights and fundamental freedoms, while achieving aspirations for sustainable development.
Blinken called on governments to “collaborate with the private sector, civil society, international, regional and academic organizations, research institutions, technical communities and all other stakeholders to build this approach. ”
He stressed that this decision “will be the basis for multilateral AI efforts and current and future UN initiatives. ”
“The United States will continue to work with governments and other partners to ensure that AI technologies, including design, development, deployment, and use, are safe, trustworthy, and geared toward achieving our shared goals and solving our most pressing challenges. ”
Blinken ’ s comments followed a statement from U.S. Vice President Joe Biden, Kamala Harris, in which she welcomed the United Nations General Assembly ’ s resolution “on defining the principles for the deployment and use of artificial intelligence. ”
“President Biden and I are committed to creating and strengthening international norms and standards on emerging technology, because technologies with global impact, such as artificial intelligence, require global action, and when it comes to the challenges of the 21st century, we believe that all nations must be guided by a common set of understandings.
The resolution, proposed by the United States and co-sponsored by more than 100 countries, is a historic step towards establishing clear international standards for AI and promoting safe and trustworthy AI systems.
“As I said in London last year, AI must be in the public interest, and it must be adopted and developed in a way that protects everyone from potential harm and ensures that everyone can enjoy its benefits.
We must also deal with a whole range of risks, from the catastrophic consequences that threaten all of humanity to the harms felt by individuals and communities, such as prejudice. ”
“Too often, in past technological revolutions, the benefits have not been shared fairly, and the damage has been felt by a disproportionate few.
“This decision charts a way forward in AI where every country can seize the promise and manage the risks of AI. ”
With this resolution, all countries recognize the need to protect the safety, privacy and human rights of their citizens.
The resolution makes clear that the protection of human rights and fundamental freedoms must be central to the development and use of artificial intelligence systems.
The United Nations General Assembly on Thursday unanimously adopted the first global resolution on artificial intelligence to promote the protection of personal data, human rights and risk control.
Speaking at a news conference ahead of the ratification of the non-binding resolution proposed by the United States and supported by China and 121 other countries, the officials said the negotiation process took three months.
The resolution also calls for enhanced privacy protection policies.
U.S. Ambassador to the United Nations Linda Thomas Greenfield said: “Today, all 193 members of the United Nations General Assembly have spoken with one voice, choosing together to control artificial intelligence rather than let it control us. ”
The decision is the latest in a series of initiatives launched by governments around the world to regulate the development of artificial intelligence, amid concerns it could be used to undermine democratic practices, increase fraud, or widespread job losses, among other concerns.
Most previous initiatives have not been effective in addressing these concerns.
"The harmful or improper design, development, deployment and use of artificial intelligence systems...
There are risks that can...
It undermines the protection, promotion and exercise of human rights and fundamental freedoms. ”
One official, speaking on condition of anonymity, said: “We believe the decision strikes the right balance between promoting development and continuing to protect human rights. ”
In November, the United States, Britain and more than a dozen other countries unveiled the first detailed international agreement on countering the harms of artificial intelligence, prompting companies to develop “design-safe ” AI systems.
Free

Over 120 countries co-sponsored the UN resolution, which establishes clear international standards for AI and protects citizens' safety, privacy, and human rights.

The Global AI Safety Summit aims to mitigate AI risks, and has been hosted by the UK, with tech companies and AI experts in attendance, including Elon Musk, who has called for a regulatory framework for AI.

Title:

Content: First Global Summit to Discuss the Risks of Artificial Intelligence
Here are the details of Day 1.
The first Global AI Safety Summit, hosted by the United Kingdom, kicked off on Wednesday, November 1, and will continue until Thursday, November 2, when political leaders, executives from major technology companies and AI experts will gather to examine the risks posed by the rapid development of this revolutionary technology.
The UK government chose the venue for the summit in Bletchley Park, northwest of London, a highly symbolic centre that saw the development of the first computer system, where German military codes were decoded during World War II.
The summit aims to achieve a common understanding of the risks associated with AI, lay the foundations for advanced international cooperation to ensure its safety, identify measures that individual organizations should take to increase the safety of AI use, and focus on collaboration in AI safety research, such as evaluating language models, developing new standards, and reviewing how to ensure its safe development, with the aim of maximizing benefits globally.
Michelle Donilan, the UK Secretary of State for Science, Innovation and Technology, delivered a speech on the first day stressing that the risks posed by AI are serious and fundamental, and it is important that we work together, across sectors and countries alike, to identify these risks, noting that the summit is an opportunity to make sure we have the right people with the right experience gathered around the table to discuss how to mitigate these risks going forward.
“Artificial intelligence is an extraordinary force for good in our society, with limitless opportunities to grow the global economy and deliver better public services.
Artificial Intelligence and the Arab World:
Saudi Arabia and the UAE are major players in the AI market in the Arab region, so both countries are participating in the AI Safety Summit.
The summit is currently attended by His Excellency Omar Sultan Al Olama, UAE Minister of Artificial Intelligence, Digital Economy and Teleworking Applications, and His Excellency Dr. Abdullah bin Sharaf Al Ghamdi, President of the Saudi Commission for Data and Artificial Intelligence (SADaya).
Musk: AI Safety Summit Aims to Establish Regulatory Framework for AI
US billionaire Elon Musk, who is also attending the summit, said: “What we ’ re really aiming for here is to create a supervisory framework so that there is at least a third-party referee, an independent referee, who can monitor what leading AI companies are doing, and at least sound the alarm if there are concerns. ”
Musk said he doesn't necessarily know what the fair rules are, but you need to start understanding the nature of things before you can supervise.
Musk ’ s comments came after Britain published a declaration signed by 28 countries and the European Union, which outlined a two-pronged agenda focused on identifying and understanding AI risks on a scientific basis and building coordinated policies between countries to mitigate them.
“I think there ’ s a big concern among AI workers that governments will rush to set the rules before they know what to do, ” he said.
China, US and EU agree to work together:
China has agreed to work with the United States, the European Union and other countries to collectively manage risks from artificial intelligence during the first day of the AI Safety Summit.
China, the United States, the European Union and some 28 countries in Britain on Wednesday signed the Bletchley Declaration for the Safe Development of Artificial Intelligence.
The Declaration sets out a two-pronged agenda that focuses on identifying risks of common interest and building scientific understanding of them, while also developing common policies among countries to mitigate these risks.
Wu Zhaohui, China ’ s vice minister of science and technology, said at the opening session of the summit: “Beijing is ready to increase cooperation in AI safety to help build an international ‘ governance framework ’. ”
British Prime Minister Rishi Sonak welcomed Bletchley ’ s announcement on Twitter, saying: “This historic announcement marks the beginning of a new global effort to build public confidence in AI by ensuring its safety. ”
On Thursday, Elon Musk will also hold talks with British Prime Minister Rishi Sonak after the summit, as the latter announced in a tweet on the X platform, and the meeting will be via X as well.
Two Artificial Intelligence Summits:
Faced with the growing potential of software like ChatGPT, Bletchley ’ s announcement shows that for the first time, the world is coming together to identify the problem and highlight the opportunities related to it, British Technology Minister Michelle Donilan told AFP.
The aim of the summit is not to lay the foundations for global legislation, but to chart a way forward.
From this highly symbolic site, which housed the World War II code-breaking center, the summit will be followed by two international AI summits, one in South Korea in six months, and the second in France in a year.
Establishment of an Artificial Intelligence Security Institute:
U.S. Vice President Kamala Harris on Wednesday called for urgent action to protect the public and democracy from the risks posed by artificial intelligence, announcing a series of initiatives to address concerns about the dangers of this revolutionary technology.
In a speech at the U.S. Embassy in London, Harris spoke about the risks AI could pose to individuals and the Western political system.
The technology has the potential to create “cyber attacks on a scale beyond anything we ’ ve seen before ” or“ bioweapons crafted by artificial intelligence that could put the lives of millions at risk. ”
“These threats are often referred to as ‘ AI existential threats ’ because they can put humanity ’ s very existence at risk. ”
The timing and location of Harris ’ speech raised eyebrows among some members of the UK ’ s ruling Conservative Party, who suggested Washington was trying to overshadow the summit, a charge British officials denied, saying they wanted as many votes as possible.
Harris is scheduled to attend the second day of the summit on Thursday.
On Wednesday, U.S. Commerce Secretary Gina Rimondo announced the creation of a new AI Safety Institute that will be housed within the Commerce Department and specifically under the Department ’ s National Institute of Standards and Technology (NIST).
“The aim is for this organisation to work closely with other AI safety groups set up by other governments, such as the Safety Institute which the UK is also planning to set up, ” she said.
Generative AI, capable of producing text, sounds or images on simple demand in a matter of seconds, has made impressive progress recently, and new generations of such models are expected to emerge in the coming months.
The British government warned in a report published on Wednesday that the technology, which raises high hopes in medicine or education, could also pose an existential threat by destabilizing societies by allowing them to manufacture weapons or escape human control.
Subscribe to our Notifications Service to stay up to date with the latest technology
You are here because you are interested in technical news.
Subscribe to our newsletter
Update your email every morning.
We also invite you to follow our social media accounts
This site uses cookies to enhance your experience and your visit to our site ok More

China, the US, and the EU have agreed to work together on AI safety, and have signed the "Bletchley Declaration" for AI oversight, which marks a significant step towards international cooperation on AI safety.

The US has released an executive order on AI safety, which identifies areas of concern with AI use, including labor and cybersecurity, and requires federal agencies to develop principles to mitigate AI harms to workers.

Title:

Content: On October 30, 2023, President Biden issued an "Executive Order on the Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence" to address the growing concerns surrounding the use of artificial intelligence (AI). The 111-page document identifies several areas of concern with the use of AI, including labor, competition, cybersecurity, education, health, and privacy. The order not only calls on federal agencies to work collaboratively, provide more guidance, and conduct training, but it also urges agencies to develop principles and best practices to mitigate the harms and maximize the benefits of AI for workers.

Here are some of the key directives from the executive order:

  • Orders the Secretary of Labor, in conjunction with outside entities such as labor unions, to develop principles and best practices to mitigate the harms and maximize the benefits of AI for workers by addressing job displacement, labor standards, workplace equity, health, and safety, and data collection. Once these best practices are identified, the agencies are expected to adopt these guidelines, to the extent feasible, in their programs. A fact sheet, which was issued before the executive order was released, explains that "[t]hese principles and best practices will benefit workers by providing guidance to prevent employers from undercompensating workers, evaluating job applications unfairly, or impinging on workers' ability to organize."
  • Orders the Secretary of Labor to issue guidance emphasizing that employers must ensure that employees are appropriately compensated for all hours worked under the Fair Labor Standards Act when using AI tools to monitor or augment employees' work. Significantly, this marks the first time that the Biden administration has shown any interest in AI-related concerns in the wage and hour context.
  • Directs the Chairman of the Council of Economic Advisers to produce a report regarding AI's potential impacts on the labor market, and directs the Secretary of Labor to submit a report identifying options for strengthening federal support for workers facing labor disruptions caused by AI.
  • Directs the U.S. Department of Justice to increase coordination with federal civil rights offices on AI and algorithmic discrimination issues, "improve external stakeholder engagement to promote public awareness of potential discriminatory uses and effects of AI; and develop, as appropriate, additional training, technical assistance, guidance, or other resources[.]"
  • Instructs the Director of the National Science Foundation to "prioritize available resources to support AI-related education and AI-related workforce development through existing programs."
  • Encourages the Federal Trade Commission to consider whether to use its existing authorities, including the agency's rulemaking authority, "to ensure fair competition in the AI marketplace and to ensure that consumers and workers are protected from harms that may be enabled by the use of AI."
  • Creates a White House AI Council to help coordinate the efforts of the various agencies to ensure the effective formation and implementation of policies related to AI, including those contained within the executive order.

The executive order puts the onus on the federal agencies to achieve the goals articulated for them. Most agencies will have anywhere from 30 to 365 days to fulfill their respective requirements as outlined in the document.

Even though the executive order is largely focused on the federal workforce, private entities are still affected. For example, companies that develop (or intend to develop) AI tools for the federal government are required to provide the government certain information, reports, and records. Additionally, the executive order leverages the federal government's pocketbook, as one of the largest purchasers of technology, to ensure the compliance of private companies. These federal procurement procedures provide a method for federal agencies to regulate AI indirectly.

The new executive order continues the approach the Biden administration initially laid out in its "Blueprint for an AI Bill of Rights" in October 2022 and Executive Order 13985, which directed agencies to combat algorithmic discrimination and enforce existing laws to protect rights and safety. The new executive order is also the byproduct of continued cooperation with many leading AI companies. In 2023, the White House announced that it had secured voluntary commitments from 15 of the leading AI companies to control the risks posed by AI.

The new executive order also reflects the Biden administration's "whole of government" approach to aggressively promote a pro-union agenda across the entire spectrum of the government. This "whole of government" approach has relied on executive orders, interagency task forces, councils, interagency agreements, individual agency actions such as rulemaking and enforcement strategies, attempts to influence Congress, and a variety of other means to achieve a pro-union agenda. The new executive order continues this approach. Most notably, the fact sheet that was released before the executive order identifies the dangers of increased workplace surveillance, bias, and job displacement and then explains that mitigating these risks must involve supporting "workers' ability to bargain collectively." One of the eight "guiding principles and priorities" of the executive order is explicitly pro-union: "The responsible development and use of AI require a commitment to supporting American workers. As AI creates new jobs and industries, all workers need a seat at the table, including through collective bargaining, to ensure that they benefit from these opportunities." In addition, the executive order's fact sheet emphasizes that the Biden administration's response to the risks of using AI entails instructing agencies to develop principles and best practices to mitigate the harms, including if AI tools impinge "on workers' ability to organize."

Because the executive order urges agencies to develop AI principles and best practices, employers should stay alert to new guidance and regulations that could affect business operations.

The content of this article is intended to provide a general guide to the subject matter. Specialist advice should be sought about your specific circumstances.

What risks did Hinton associate with AI's rapid advancement?

The executive order also promotes a pro-union agenda across the government and seeks to support workers' collective bargaining rights, highlighting the need for careful consideration of the social implications of AI development.