Geoffrey Hinton is a pioneer in artificial intelligence, known for his work on neural networks and deep learning.

He is known as the "godfather of AI" for his work on neural networks.

Hinton warns that AI could surpass human abilities in 5-20 years and potentially lead to human extinction if not carefully managed.

His concerns highlight the need for AI systems to prioritize human values and ethics, with human oversight ensuring safety.

Generative AI requires reliable development to prevent harm to humans.

AI development requires clear responsibility, value alignment, and an accountability system to ensure human values are incorporated.

Experts suggest that independent auditing and human oversight can help reduce AI risks.

The alignment problem arises because current AI systems lack coherent internal models of the world, leading to unintended consequences.

Regulation and watermarking of AI-generated content can help prevent harm and distinguish it from reality.

Experts warn that AI systems may become superintelligent and exceed human capabilities.

The public should know that AI systems, even without superintelligence, can cause serious harm and generate targeted propaganda.

AI development must consider data bias, ethics, and security to prevent defamatory statements about individuals.

Human oversight is necessary for AI decision-making, especially in high-risk areas like medical diagnosis.

The "human in the loop" and "Society in the loop" models include human participation to develop AI with human values.

The EU prioritizes machine ethics and experts call for safeguards against AI dangers.

Diverse training data is necessary for AI development to prevent algorithmic bias.

Technical safety requires optimization and agile assessment of AI ethical and technical safety.

Experts like Geoffrey Hinton warn that AI development requires careful consideration of human values and ethics, as well as human oversight and accountability.

Developing AI that learns from rewards and punishments and avoids harming humans is crucial for AI safety.

Human and machine laws can conflict, and the lack of uniformity in human laws makes AI development challenging.

Experts call for safeguards and aligned AI goals to protect humanity.

The UAE government and council promote ethical AI use and develop technical standards, including explainable AI.

The National Science Council promotes AI research with human oversight, using "human in the loop" and "Society in the loop" models.

The EU prioritizes machine ethics, AI safety, and diverse training data for trustworthy generative AI.

AI development requires balancing ethics and growth, as current systems can cause harm and spread disinformation even without superintelligence.

Regulation and watermarking can help prevent harm from AI-generated fake content.

Artificial general intelligence could be the most consequential event in human history, with experts warning it can generate targeted propaganda and false statements.

The US government and seven tech giants have agreed to regulate AI development for security and safety.

Companies will develop watermark systems for AI-generated content.

The Biden administration has met with tech leaders to discuss AI safety, with companies adhering to "safety, security, and trust" principles.

US regulation lags behind the European Union's AI efforts, which include proposed artificial intelligence bills.

The US Congress is considering a bill for AI disclosure in political ads, seen as a positive step towards AI regulation.

OpenAI CEO Sam Altman supports an international AI regulatory agency.

The US and China will hold high-level talks on AI regulation, while states like Colorado and Connecticut have introduced related legislation.

Connecticut's AI regulation efforts collapsed due to a veto threat from the Governor.

The US government has launched AI regulatory policy formulation, with the NTIA holding a 60-day public consultation.

The Biden administration and OpenAI support innovation, security, and AI regulation.

Seven tech companies have pledged to make AI safer by watermarking AI-generated content and rigorously testing AI systems before release.

The UK government will fund a £100m AI taskforce to ensure AI is free of discrimination and bias.

The US government regulates emerging AI tech with companies' help to reduce cybersecurity risks.

OpenAI CEO warns US Congress of unsafe AI rules as it seeks consensus on regulation.

AI's impact on elections and jobs is a concern that requires regulatory measures.

AI systems could spread misinformation and excessive concentration of the technology is a concern.

The US and 16 countries have pledged to make AI safe by design, while 18 nations agreed to develop it safely.

The US and Europe are working to establish AI regulations, with Europe taking the lead.

President Biden ordered AI companies to conduct regular security tests.

Research companies must look for vulnerabilities, outlined in a 20-page AI safety agreement.

The international agreement aims for a safety-first AI development approach to prevent misuse.

The Biden administration is preparing an executive order for AI safety.

Congress aims to regulate AI, with companies committing to transparency and security.

The Senate Majority Leader plans AI legislation, including labeling AI-generated content.

Companies share best practices and allow third-party vulnerability reporting.

Microsoft and the White House work with the National Science Foundation and Congress on AI safety and regulation.

AI funding should prioritize safety and ethics, but broad-based regulations on AI safety are lacking.

The EU's first AI safety law is pending, holding companies liable for AI-related harms.

Top researchers call for increased investment in AI safety due to the power of recent AI models.

AI progress is outpacing precautions, with some companies opposing regulations due to costs.

Regulation does not stifle innovation, with more rules applying to sandwich shops than AI companies.

The US President has ordered companies to share AI safety test results with the government.

AI standards for safety and watermarking guidelines will be developed.

The administration aims to protect privacy and prevent discrimination through international AI frameworks.

The government will build the National AI Research Resource and fund privacy-protecting technology research.

The Department of Justice will compile best practices to prevent AI discrimination.

US lacks legislative action on AI regulation amid varying global efforts.

The EU and UN are working on AI regulations focusing on transparency, security, and accountability.

Japan takes a hands-off approach to AI regulation, and governments must regulate AI to prevent misuse.

Time is running out for governments to regulate AI, which can be used for both cybersecurity and malicious activities.

AI regulation requires guidance on permissible uses and responsible development.

The UK government has announced AI safety commitments from 16 companies, including OpenAI, Google DeepMind, and Anthropic.

Companies must identify and mitigate AI security risks before the 2025 France AI summit.

The summit will discuss AI innovation, research, and expansion at universities.

AI regulation lacks global consensus, requiring flexible government policies.

Unchecked AI development can lead to job replacements, and authorities should cover AI risks and benefits.

Poor

Geoffrey Hinton is a pioneer in artificial intelligence, known for his work on neural networks and deep learning.

Title:

Content: Yoshua Bengio

1 minute read
By Geoffrey Hinton

Yoshua Bengio is a world leader in AI. Throughout his career, Yoshua’s research has been instrumental in shaping the world’s understanding of AI’s potential—and that same expertise has made his perspective more essential than ever. His pioneering research on deep learning laid the foundations for the current revolution in AI and earned him the 2018 Turing Award—“the Nobel Prize of Computing”—alongside myself and Yann LeCun. Last year, Yoshua received Canada’s highest award for research, the Gerhard Herzberg Canada Gold Medal. He is the computer scientist with the greatest number of citations and is ranked third among all disciplines for scientific impact.

Yoshua has been concerned for many years with the social impact of artificial intelligence, contributing to the Montreal Declaration for the Responsible Development of AI. Over the past year, worried by the potential for catastrophic outcomes from future AI, he was vocal in global conversations on AI safety. He advised the U.N. Secretary-General and the U.K. AI Safety Institute, and took part in policy discussions with governments in North America, Asia, and Europe.

Hinton is a cognitive psychologist and computer scientist

More Must-Reads From TIME

Contact us at letters@time.com

What breakthroughs has Hinton achieved through his 40+ years of work on artificial neural networks?

Breakthroughs that mimic biological brains

He is known as the "godfather of AI" for his work on neural networks.

Title:

Content: • |
• Fast Quote
• |
• Member
• Product Services / Streaming
• Settings
12 / 05 / 2023
The White House ordered AI to be evaluated, and the European Union proposed legislation to regulate AI, teach AI to be human or the best solution!
• Add Favorite Column
• Collection of articles
• Fang Zhanqi
Fang Zhanze
When I was a teenager, I studied Geographic Information System, but unfortunately I didn ’ t learn anything and I graduated with luck.
After adulthood, the accidental hit into the media circle, first and then in the print, electronic, online media to roll, slightly small.
After middle age, he completed a master ’ s degree in information technology and gradually expanded his horizons. He was determined to join a start-up company and explore different fields of technology.
In recent years, he has been actively engaged in data analysis and digital strategies, and has also been involved in the development of Location Intelligence projects. Sometimes, he can also take time to teach, not only to share what he has learned with others, but also to motivate himself to keep learning for life.
Tales of Wisdom City
Generative AI is definitely the hottest topic in the technology world today. After the popularity of ChatGPT, many companies rushed to launch similar products and gradually applied them to various industries.
But more and more people are worried that when AI is fully popularized, it will aggravate the problem of fake information flow, online fraud and other problems; even Sheffield Hinton, who is known as the "godfather of AI", is worried that AI will become too smart, afraid that it will evolve into a killer robot, which may eventually lead to the death of mankind!
How big can the negative impact of AI technology be?
How do governments around the world respond to the potential threat of AI?
Neural network is the foundation technology of ChatGPT
Fifty-one years ago, Geoffrey Hinton, who had not yet been called the “godfather of AI, ” entered the University of Edinburgh in Scotland as a graduate student and began research on artificial neural networks.
The so-called “artificial neural network ” is a mathematical model that mimics the structure and function of biological neural networks, especially the brain, and is able to learn skills by analyzing data.
This is the foundational technology behind OpenAI ChatGPT and Google Bard.
After Hinton resigned from Google, he did not have to worry about the harm his words would bring to Google, so he was interviewed by different media and said his heart: "AI may lead to the death of mankind." (Photo: University of Toronto official website)
In 2012, Hinton and his students, Ilya Sutskever and Alex Krishevsky, created a neural network system that analyzes thousands of photos and learns to recognize common things like flowers, dogs, cars, etc.
Subsequently, Hinton and two students founded DNNresearch, a startup based on this research project.
In 2013, Google acquired DNNresearch for US $44 million (approximately HK $343 million), and Hinton joined Google as Vice President and Engineering Researcher, responsible for some of the research work on Google Brain.
His protégé, Suzkville, left Google to co-found OpenAI with like-minded people, and became chief scientist, leading the research team to successfully develop the GPT model and ChatGPT.
Hinton ’ s top student, Suzkville, gave up his lucrative job at Google in 2015 to co-found OpenAI with Altman and others, and led the development of GPT and DALL-E models. (Image: University of Toronto website)
I regret working my whole life because I am worried about the dangers of AI.
In 2018, Hinton, along with University of Montreal professor Yoshua Bengio and Meta chief AI scientist Yann LeCun, won the A.M. Turing Award in recognition of their great contributions to neural networks and deep learning.
As a result, the three later became known as the “godfathers of AI ” or“ godfathers of deep learning. ”
Around the same time, Google and OpenAI began to build large-scale deep learning systems based on neural networks, which became the basis for future development of Bard and ChatGPT.
From this, it seems that Sinton plays an important role in creating the current glory of generative AI.
However, in the current era of AI, Sinton suddenly left Google in April 2023, shocking the entire AI industry.
Hinton explained that he left Google to talk freely about the potential risks of AI without harming Google.
Speaking about 50 years of research into neural networks, he said, “I ’ m very sorry about my life ’ s work. ”
The Internet will be filled with more and more fake AI-generated text, photos, and even videos, but the average person will not be able to tell the truth, Hinton said.
Moreover, sooner or later, AI technology will completely disrupt the job market, causing more and more jobs to disappear.
What is even more worrying is that at present, users can not only instruct ChatGPT to generate code, but also ask the AI to execute the code; in this way, the AI killer robots that often appear in science fiction movies will one day become a reality.
Is it not impossible for AI to destroy humanity?
Of course, this pessimistic future scenario is only a hypothetical one, but Hinton stressed that what could lead to it is already happening: a global race for AI technology has begun between Microsoft and Google, and even between China and the United States.
Most people think that the future of AI dominating everything is still far away, but he believes that AI may not take 30 to 50 years to control humans, and even find a way to kill humans, which may eventually lead to human extinction.
In the 1980s, Hinton was a professor of computer science at Carnegie Mellon University in the United States, but because he was not satisfied that the university's AI research was sponsored by the United States Department of Defense, he decided to leave the United States to teach at the University of Toronto's School of Computer Science.
He pointed out that without some kind of global regulatory agreement or regulatory mechanism, the AI arms race will intensify.
For this reason, Hinton believes that the threat posed by AI to humans may be more urgent than climate change, because the solution to climate change is obvious, as long as carbon emissions are reduced or carbon neutrality is achieved, but the current AI crisis does not know how to start. Although AI may pose an existential threat to humans, he does not agree to suspend AI research, because it can never erase the benefits and application value of AI.
Hinton believes it would be better to step up regulation of AI and make everyone aware of its potential harms.
OpenAI co-founder and CEO Sam Altman also acknowledged that ChatGPT has developed some reasoning capabilities that they can ’ t explain, and that it ’ s not entirely impossible for AI to destroy humans.
However, he said that he has installed a kill switch for ChatGPT, and if the development of ChatGPT exceeds human expectations, he will immediately press the switch to stop working.
OpenAI CEO Altman, known as the “father of ChatGPT, ” recently said he was“ a little scared ” about the potential of his children, and even admitted that there is a real possibility that AI will destroy humanity. (Image: Wikipedia)
Altman admits that ChatGPT ’ s influence in elections and the spread of disinformation is a concern, so the 2024 U.S. presidential election will be a focus for OpenAI.
(Image source: Pexels Gallery website)
The Curtain of Ignorance Makes AI Right Values
However, before we press the switch, we can try to instill the right values in AI, such as helping those most in need, not destroying humans. Google ’ s DeepMind paper published in April 2023 in the Proceedings of the National Academy of Sciences suggests that AI can be taught from the perspective of political philosopher John Rawls.
Rawls has proposed a concept called “The Veil of Ignorance ”, which aims to achieve the most equitable distribution of benefits when group decisions are made.
According to his book, The Debate, if a group of people stand behind a curtain, all of them will instantly lose their memory, become ignorant, and forget their identity and status in the real world.
The political philosopher Ross assumes that people are behind the “curtain of ignorance ” (left) and have no idea of their skills, identities, and status.
In this scenario, people tend to choose the most equitable distribution of rights for all. (Image: Wikipedia)
At this time, these people are asked to vote for a working principle for the society.
Because they do not know where they are in this society, they cannot make decisions in an egoistic way, and they can only judge according to the principle of fairness to all people.
The situation is like, at the birthday party, you are responsible for cutting the cake, because you do not know which piece you will get, so you will try to cut each piece to the same size.
Under the curtain of ignorance, fairness and justice that has nothing to do with personal interests will emerge.
For this reason, DeepMind believes that applying the “curtain of ignorance ” to AI training may help promote fairness in the process of“ aligning ” AI with human values.
By “alignment ”, it means aligning AI ’ s wishes with those of humanity.
If AI shares fair values with humans, AI will not have the intention to destroy humanity.
White House convenes tech giants to discuss AI threats
However, even if AI does not intend to destroy humans, it may still have many negative effects on human society.
The Center for Artificial Intelligence and Digital Policy (CAIDP), a U.S. technology ethics organization, has complained to the Federal Trade Commission (FTC) that OpenAI ’ s latest large language model, GPT-4, is biased and deceptive and poses a risk to privacy and public safety.
The CAIDP lists potential threats that may arise from GPT-4, including: helping hackers churn out malicious code to exacerbate cyberattacks; and biased AI training data that may reinforce social stereotypes and make people of all races and genders vulnerable to unfair treatment. The FTC is investigating OpenAI, said FTC Chairman Lina Khan. "They cannot be separated from existing legislation and the Federal Trade Commission will actively enforce them," he said.
In an effort to make GPT-4 more secure, OpenAI hired 50 experts and academics to test GPT-4 against lies, language manipulation, and dangerous scientific common sense.
The OpenAI headquarters is pictured here. (Image: Wikipedia)
In early May 2023, the White House invited Google CEO Sundar Pichai, Microsoft CEO Satya Nadella, OpenAI founder Altman, and artificial intelligence startup Anthropic founder Dario Amodei to attend a conference to discuss the impact of AI on society.
Government officials at the meeting included Vice President Kamala Harris, Biden Chief of Staff Jeff Zients, National Security Adviser Jake Sullivan, National Economic Council Chairman Lael Brainard, and Commerce Secretary Gina Raimondo.
U.S. President Joe Biden also attended the meeting.
EU to pass world ’ s first AI regulatory law
Generative AI, while helping to improve lives, can also pose security, privacy and fraud issues, says Ms Ho.
She noted that AI companies have an ethical and legal responsibility to ensure the safety of their AI products, while at the same time working with governments to protect civil rights and privacy.
She stressed that the White House will work to advance potential new legislation and support new legislation to mitigate the potential harms of AI technology.
In contrast, Europe has taken a step ahead in AI legislation.
On 11 May 2023, the European Parliament ’ s Committee on Civil Liberties and Consumer Protection overwhelmingly approved a position paper calling for restrictions on the use of AI in Europe, a crucial first step towards the adoption of the world ’ s first AI regulation bill.
The draft bill will be submitted to the full European Parliament for a vote in June of the same year, after which representatives of the European Parliament, the Council of the European Union and the European Commission will work out the final terms of the bill in tripartite talks.
The European Parliament has adopted a position paper that strengthens restrictions on biometrics, facial recognition, and the use of AI by police in routine duties.
The parliament believes the move could lead to the world ’ s first AI regulation bill. (Image: Wikipedia)
On the other hand, the White House announced that Google, Microsoft, OpenAI, NVIDIA, Stability AI, Anthropic, and Hugging Face have all committed to participating in DEF CON 31, a computer security conference to be held in August 2023, so that their AI models will be tested and evaluated by hackers and AI experts.
Experts will try to identify errors, failures, and vulnerabilities in AI tools so that AI companies can solve existing problems in their models early on.
However, these AI companies simply agree to a one-time test, rather than a commitment to a continuous evaluation when launching or improving their products, and may therefore not be sufficient to meet the regulatory requirements.
Despite this, DEF CON 31 is still seen as the first step for an AI model to be publicly evaluated.
We hope that after each important first step in legislative regulation and public evaluation, we can put generative AI trains on the right track, so that everyone can safely benefit from technological innovation.
DEF CON is one of the largest computer security conferences in the world. In addition to cybersecurity experts and hackers, participants included staff from the FBI, the Department of Defense, and the Postal Inspection Service.
The conference covered areas such as software security, computer architecture, hardware modifications, and other vulnerable areas of information. (Image: DEF CON official website)
The content of the signed and / or unsigned articles published by Economic Times is the author's personal opinion and does not represent the position of Economic Times, and the role of Economic Times is to provide a free speech platform.
etnet won the HKEX Awards 2022 “Best Performing Securities Data Provider ” and“ Best Performing Derivative Data Provider ” ► Learn More
I want to respond
You may be interested
Enlarge display
I know. I know.
Featured Articles
• Life
• DIVA
• Healthy and good life

What breakthroughs has Hinton achieved through his 40+ years of work on artificial neural networks?

Breakthroughs that mimic biological brains

Hinton warns that AI could surpass human abilities in 5-20 years and potentially lead to human extinction if not carefully managed.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What future risk did Hinton warn about AI?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

His concerns highlight the need for AI systems to prioritize human values and ethics, with human oversight ensuring safety.

Title:

Content: People 's Daily Online > > Economy and Technology
Promote generative AI with a responsible attitude
Cui Shuang
November 11, 2023 08: 25 | Source: Science and Technology Daily
Small number
Original title: Promoting Generative Artificial Intelligence with a Responsible Approach
Since the beginning of this year, generative artificial intelligence represented by ChatGPT has received wide attention, which has played a positive role in promoting economic development, social progress, public welfare and scientific research, but also brought challenges including security risks caused by inherent risks in technology, changes in human-computer relations, scientific and ethical anomie, and technological leapfrogging human society.
On November 9, the World Internet Conference 2023 officially released the “Research Report and Consensus Document on the Development of Responsible Generative Artificial Intelligence ” (hereinafter referred to as the“ Report ”).
As an important outcome of the conference, the Report was prepared by the Artificial Intelligence Working Group of the World Internet Conference.
The working group was established in August this year, with members from more than 40 industrial chain enterprises and high-end think tanks, international organizations, universities, etc., committed to promoting the development of responsible artificial intelligence.
The report is clearly enforceable
The "Report" proposed that we should correctly understand the huge potential and possible risks contained in generative artificial intelligence, follow the concept of overall development and safety, balance innovation and ethics, and balance benefits and risks, and promote the responsible development of generative artificial intelligence.
On the one hand, we should actively promote the development of innovative, sustainable, inclusive and open, and improve the ability of generative artificial intelligence to be efficient, high data quality, algorithmic innovation, diverse talents, and ecological openness; on the other hand, we should develop reliable and controllable, transparent and releasable, data protection, multi-inclusive, clear responsibility, and value aligned generative artificial intelligence with a highly responsible attitude.
"The working group summarized and refined 10 consensus on the development of responsible generative artificial intelligence, and also collected 57 practice cases of global enterprises applying generative artificial intelligence in 14 fields such as transportation, finance, education, and medical care."
Generative artificial intelligence shows a strong ability to generate and create, and breakthroughs have been made in the understanding and generation of text, code, images, audio and video, and "wisdom" has begun to emerge.
The speed, the scope of power and the depth of influence are unprecedented.
Promoting the development of generative artificial intelligence in a responsible manner is not only necessary, but also increasingly urgent.
According to reports, compared with other types of documents in the same period, the "Report" puts forward consensus opinions with strong operability, including clarifying the accountability system, building a traceability mechanism, and exploring innovative and friendly governance systems such as governance sandboxes.
Its consensus on promoting generative AI to better understand human intentions, follow human instructions and conform to human ethics, starting from exploring value alignment research and improving value alignment technology, has distinctive characteristics in terms of operability and realizability.
Different subjects should be held accountable
"The stronger the AI technology capability, the greater the potential hidden risks," said Zeng Yi, director of the AI Ethics and Governance Research Center of the Institute of Automation of the Chinese Academy of Sciences.
"We emphasize fairness, eliminate bias, and emphasize accountability." Xianlu Bu, vice president of Cisco Greater China, introduced the experience that technology must be retroactive and accountable throughout the development, use and exit cycle, while generative AI needs to produce a reliable result that can be replicated.
"The development of responsible generative AI requires close cooperation in all aspects of the industrial chain, practicing the concepts of consultation, co-construction, co-governance and sharing, and different subjects bear their due responsibilities," said Wei Kai, head of the Artificial Intelligence Innovation Center of China Information and Communication Research Institute and deputy leader of the Artificial Intelligence Working Group of the World Internet Conference.
In the view of Tang Yi, chairman of the impression notes, in the face of the explosive growth and chaos brought by new technologies, practitioners should fully understand the maturity of technology development, market demand, the feasibility of business models and legal constraints on the basis of seeking breakthroughs in new technologies, and then promote industrial change.
"From climate change to education for all, natural disaster management, gender equality, smart mobility, smart cities, these scenarios must have artificial intelligence."
Digital solutions such as artificial intelligence can directly benefit 70% of the United Nations Sustainable Development Goals. Frederick Werner, director of strategy at the International Telecommunication Union Bureau of Standardization and head of the AI for Good Summit, focused on the role of artificial intelligence in sustainable development, but stressed that the data bias, discrimination, concerns about ethics, security, privacy, and the possibility of further deepening the digital divide cannot be ignored.
“Artificial intelligence is too important to be left to the experts, ” Frederick said, calling for as many voices as possible from industry to government, academia, NGOs and civil society.
(Science and Technology Daily, Wuzhen, Zhejiang, November 9)
(Editor: Hao Shuai, Yang Di)
Public Number ： People 's Network Finance
Share it so more people can see it.
Back to top

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Generative AI requires reliable development to prevent harm to humans.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

AI development requires clear responsibility, value alignment, and an accountability system to ensure human values are incorporated.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Experts suggest that independent auditing and human oversight can help reduce AI risks.

Title:

Content: Presented By
Getty Images
Ideas
Jan Brauner is a Ph.D. researcher in Artificial Intelligence at the University of Oxford, focusing on the safety of AI systems and their application in public health.
Alan Chan is a Ph.D. student at Mila, a research institute in Montreal focusing on AI, where he works on technical and socio-technical problems in AI safety. He's particularly interested in evaluation and AI regulation.

In May, more than 100 artificial intelligence (AI) professors, including some of the field's leading experts, scholars from other areas, and AI executives signed a one-sentence statement: "Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war.” Many signing researchers have explained their reason for worry: the risk that we might build powerful AI systems that we cannot control within this decade or the next ones.

Some have suggested the statement is an industry ploy to hype up AI companies’ products or influence regulation, ignoring that most of the signatories—ourselves included—are academics who do not work for industry. But the most common concern we have heard is that, by focusing on the risk of extinction, the statement distracts from present-day AI harms. As volunteers involved in collecting signatures for and constructing the statement, we disagree because both problems share a common core. The false dichotomy between ongoing harms and emergent risks makes it needlessly difficult to address common root causes.

AI poses many ongoing problems. AI systems can sustain human rights abuses, perpetuate systemic discrimination, and entrench power imbalances. Because AI systems are often widely deployed, harms can reach massive scales. For example, tens of thousands of families were pushed into poverty when the Dutch Tax and Customs Administration wrongly accused them of fraud and requested they pay back large sums of money, based on risk profiles created with AI systems.

The root causes of AI harm

There are several root causes that contribute to many instances of the harm caused by AI. One is that we do not know how to design AI systems that reliably behave exactly as we intend them to. For example, a health system was designed to allocate care based on need but discriminated against Black hospital patients. It turned out the algorithm used health care costs as a proxy for need, but institutionalized racism means that less money has been spent on Black patients historically. In many similar cases, companies do not explicitly set out to build harmful AI systems. Instead, creating state-of-the-art AI systems requires vast amounts of data, and the AI systems unintendedly inherit the biases encoded in this data.

Another cause is competitive pressures and limited accountability. There is often a strong economic incentive to deploy AI systems without sufficient safety checks. For example, Microsoft rushed the release of the Bing chatbot, which resulted in the chatbot threatening and insulting users. When the Dutch Tax Administration replaced human judgment with AI systems, this, too, happened in the name of efficiency.

Without decisive action to address these root causes, increasingly powerful and widely deployed AI systems will cause even more pervasive and significant harm. Many experts believe future AI systems may outmatch humans in crucial cognitive skills, such as social persuasion, planning, and development of novel technologies. Just as these cognitive abilities enabled humanity to control the fate of other species, the same skills could enable smarter AI systems to out-perform us. Given competition and limited accountability, there would be pressure on organizations to replace expensive human labor with AI systems. Economic forces encourage the rapid deployment of new AI systems (at the cost of safety testing), making them ever more powerful, building general (and potentially more powerful) systems rather than narrow (and potentially more controllable) systems, and increasing the autonomy of AI systems to take action in the world. AI systems could increasingly control our society's key productive, managerial, and military capacities. By then, we must have figured out how to design systems that always and truly behave as we intend. Otherwise, powerful AI systems that pursue goals at odds with humanity could lead to human marginalization or even extinction.

Read More: An AI Pause is Humanity's Best Bet for Preventing Extinction

Moreover, many researchers expect us to develop such advanced AI systems very soon. Companies are pouring more money and talent into AI development while the cost of computing power is decreasing. Simply using more computing power and data has reliably produced more capable AI systems, while AI algorithms have also improved. After seeing the rapid progress in AI over the past five years, Geoffrey Hinton, a founding father of modern AI, now expects that AI could broadly surpass human cognitive abilities—such as persuasion, planning, and scientific reasoning—within five to 20 years. Such time horizons are shared by many in the AI research community.

Twenty years is short; in discussions about the climate crisis, we regularly consider effects on such timescales. And just as climate change requires us to face air pollution and ongoing natural disasters as well as prevent future, even more, extreme weather events, we must tackle various AI risks and harms simultaneously. Even if we might be a couple of decades away from AI systems that are smarter than humans, that is little time to create the complex global governance structures necessary for this technology.

Work to address ongoing harms sometimes differs from work to manage extinction risk. We do not wish to erase nuance or potential differences between the perspectives. Yet, given common root causes, there is much room for collaboration and cooperation.

Four possible interventions

Many interventions could address the root problems. First, the public currently has little to no say over what models are built and how they are deployed. For example, those most affected by welfare systems have had little say in their automation. Private companies decide which risks are acceptable, as they have free rein over computing power and data, the key levers of AI development. Stronger democratic oversight over the supply of computing power and data would enhance public control over AI development and associated risks. For example, governments can monitor when large amounts of computing power are being used and for what purpose.

Second, a strong auditing regime, where independent third-parties would scrutinize the practices and development processes of AI labs, would help reduce risks overall. Auditing has already surfaced previously overlooked harms, such as bias in facial recognition, and could catch future failure modes like AI systems subverting human control or replicating autonomously. A standards body could ensure  AI systems, both before and after deployment, meet specified safety guidelines. Domestic agencies could enforce compliance, while an international organization would create universal standards.

Third, we should require meaningful human oversight of critical AI decisions, and avoid very-high-risk use cases such as lethal autonomous weapons. Uncertainty about AI systems' current and near-future capabilities means we should proceed cautiously around their deployment in critical domains.

Fourth, we should rebalance the  funding going into AIs and urge companies to spend less on making them smarter while increasing funding into making them safer, more transparent, and studying their social impacts. While it is good that industry labs are funding such research, this funding is liable to change with market conditions. Much more public funding for non-industry groups is required.

The development of increasingly powerful AI systems poses increasingly vast societal-scale risks. The complexity of these risks requires cooperation between people with potentially different motivations but with a shared interest in ensuring that AI development proceeds in a just and beneficial way.

More Must-Reads From TIME

Contact us at letters@time.com.

You May Also Like
EDIT POST

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

The alignment problem arises because current AI systems lack coherent internal models of the world, leading to unintended consequences.

Title:

Content: Filed under:

Stuart Russell wrote the textbook on AI safety. He explains how to keep it from spiraling out of control.

AI doesn’t have to be superintelligent to cause serious havoc.

If you buy something from a Vox link, Vox Media may earn a commission. See our ethics statement.

One of the hardest parts of the news business is striking a balance between covering stories that seem important in the moment and covering stories that you know will truly matter in the future. And it’s hard because the most consequential things happening right now are often boring or difficult to explain.

Artificial intelligence is a good example of this sort of challenge. The ongoing revolution in AI is unfolding so quickly that it’s hard to keep up, even if you’re trying. Chat GPT-4, for instance, was released in March of this year and it stunned almost everyone who used it. If this latest large language model is a sign of what’s coming, it’s easy to imagine all the ways it might change the world — and then there are all the ways it might change the world that we can’t imagine.

So what do we need to know about AI right now? What are the questions we should be asking? And how should we be preparing for whatever’s coming?

To get some answers, I invited Stuart Russell onto The Gray Area. Russell is a professor of computer science at UC Berkeley and the author of Human Compatible: Artificial Intelligence and the Problem of Control. He was one of the signatories of an open letter in March calling for a six-month pause on AI training. We discuss the risks and potential benefits of AI and whether he believes we can build AI systems that align with our values and interests.

Below is an excerpt of our conversation, edited for length and clarity. As always, there’s much more in the full podcast, so listen and follow The Gray Area on Apple Podcasts, Google Podcasts, Spotify, Stitcher, or wherever you find podcasts. New episodes drop every Monday.

Sean Illing

When you think about the state of AI at this moment, what feels most urgent to you? What excites you? What scares you?

Stuart Russell

I think it’s important to understand that almost nobody is saying that the state of AI right now is such that we have to worry about AI systems taking over the world, if you want to put it that way. They still exhibit many limitations, and at least the latest generation, the large language models like ChatGPT, don’t exhibit the kinds of decision-making capabilities and planning capabilities that you would need to take over the world.

You can try playing chess with them, for example. They’re pretty hopeless. They pretend well for a few moves, and then they’ll play a move that’s completely illegal because they haven’t actually learned the rules properly. There’s a lot of progress that we still need to make before we reach systems that are fully comparable or better than a human mind.

The things people are concerned about right now with this technology [are things that] we already have. Disinformation would probably be number one. The fact that these systems can be directed to generate highly targeted, personalized propaganda, to convince an individual based on everything the system can find out about that person. It could do that. Not just in a single email or blog post or whatever, but it could do that over several months. People are very worried about that being weaponized by nation states, by criminals, by unscrupulous politicians who would produce deep fakes of their opponents.

These are very real, and we’re starting to see them already happening and a bunch of other serious concerns. One that has surfaced recently is defamation. Systems making up crimes, not being directed to do so, but just because they hallucinate. They say things that have no basis in truth, but making up defamatory statements about real individuals. There are a couple of lawsuits happening already.

Sean Illing

Are you comfortable referring to something like GPT-4 as intelligent? Or is that not quite the right word?

Stuart Russell

For normal conversation, it’s a reasonable thing that it shows elements of intelligence. In fact, [in a] paper that Microsoft produced, a group of experts there spent several months with GPT-4 before it was released, trying to understand what it could do. The paper that they produced is called “Sparks of Artificial General Intelligence.” And that’s a pretty bold claim, because artificial general intelligence means the kind of AI that exceeds human capabilities in every dimension, the kind of AI that does take over the world.

According to them, we are creating the kind of AI that does take over the world. We have absolutely no idea how it works, and we are releasing it to hundreds of millions of people. We’re giving it credit cards, bank accounts, social media accounts. We’re doing everything we can to make sure that it can take over the world. That should give people something to think about.

Let me give you an example of that one of my colleagues sent me. He was using ChatGPT-3.5 and he asked it, “Which is bigger, an elephant or a cat?” And it says, “An elephant is bigger than a cat.” You say, “Which is not bigger than the other, an elephant or a cat?” And it says, “Neither an elephant nor a cat is bigger than the other.” When you look at that second answer, you realize, “Well, it can’t be answering the question with respect to some internal model where there are big elephants and little cats,” but that means that it wasn’t answering the first question with respect to an internal model where there are big elephants and little cats. It wasn’t really answering either question in the sense that we think about answering questions, where we query an internal model of the world.

If I say, “Where’s your car?” you query your internal model of the world. You say, “It’s in the parking garage across the road.” That’s what we mean by answering a question. It’s really clear that in a real sense, these systems are not answering questions. They don’t seem to build a coherent internal model of the world.

Sean Illing

You focus a lot on the “alignment problem” or the “control problem” and this question of whether AI might develop its own goals, separate and apart from the goals we program into it. How worried are you on this front?

Stuart Russell

The alignment problem is simpler than the one you described. You suggested the alignment problem is about systems developing their own goals, which are different from the ones we program into them. Actually, the original alignment problem is about systems pursuing the goals that we program into them, but the problem is we don’t know how to program the right goals.

We call this the King Midas problem. King Midas programmed the goal into the gods that everything he touched turned to gold, and the gods gave him exactly this. They carried out his objective, and then his food and his drink and his family all turned to gold and he dies of misery and starvation. There are many legends and lots of cultures have stories very similar to this, where you get what you ask for and you regret it, because you didn’t ask for the right thing.

What people have observed is that when you’ve got a sufficiently capable AI system, and you give it even a very innocuous-sounding goal like, “Could you fetch me a cup of coffee?” When a machine is sufficiently intelligent and it has a goal like, “Fetch a cup of coffee,” it doesn’t take a genius to realize that if someone switches you off, you’re not going to succeed in fetching the coffee. As a logical sub-goal of this original goal, you’ve now got the goal of, “Preventing myself from being switched off,” and possibly taking other preemptive steps to avoid interference by human beings in the achievement of this goal.

Sean Illing

You can have fun imagining all the ways that could go wrong—

Stuart Russell

Yep. There are many science fiction stories that do exactly that. Sometimes in the literature you’ll see the phrase, “Instrumental goals.” These are goals like self-preservation, like acquiring more power over the environment, acquiring money, acquiring more computing resources so you can do a better job of solving the goal that you’ve been given. These instrumental goals are just derived automatically from the original goal.

With a human being, if I say, “Fetch a cup of coffee,” it doesn’t mean “Fetch a cup of coffee” is now the only goal that you should care about and your entire life’s mission is to fetch that coffee. That’s not what we mean when we say it to a human being, but that’s how we have been building our AI systems for decades and decades. The objective that we put in is the objective of the system and nothing else. That’s fundamentally a mistake. We can’t build systems that way, because we cannot specify completely and correctly all the things that human beings care about, so that the system’s behavior is actually what we would really want to have happen.

My book is about a different way of building AI systems, so that they understand some things about what humans want, but they know there’s a bunch of other stuff that they don’t understand and they’re uncertain about. And that actually leads to systems that behave much more cautiously and usefully.

The other thing that you mentioned, the possibility that these machines would develop their own goals — obviously that would be much worse. It’s bad enough that we give them specified goals. If they’re able to develop their own goals, then there’s no reason to think that those would be aligned with our goals.

Sean Illing

I often hear people say that we’re still only talking about narrow AI at the moment. We’re not talking about artificial general intelligence, which you mentioned a minute ago, something that is actually self-teaching and can develop its own goals, and that’s the thing we really have to worry about. But I don’t know, that seems wrong to me, or it seems like it misunderstands how progress in AI works.

But setting that aside, it’s not like we need some AGI superintelligence to wreck our world. As you said a few minutes ago, when I start imagining all the havoc AI could cause merely through the creation and distribution of misinformation, it makes my head explode. Deep fake tech is already here, but it doesn’t feel pervasive enough yet to be a major concern. But the lines between fact and fiction are already suicidally blurred in our society, and the post-truth world I can imagine in that future is infinitely worse than our situation today.

Do you think we’re even close to ready for this?

Stuart Russell

No, I think if it’s not regulated, we are in for a huge amount of pain. As you say, in terms of still images, we are already at the point where they are indistinguishable from reality and they are coupled with the large language models. In other words, you can ask the language model to give you an image of anything you want and it’ll do it.

DALL-E and these other image generators are coupled to language models. You can already say, “Give me a 22-second video showing such and such and such and such,” and it will do it. It’s not great right now, but three years ago, face generation wasn’t great. There would often be weird things with the ears. Or it’d be like the same pair of earrings occurring over and over again. Just glitches. But those have been ironed out and now it’s pretty much perfect.

And that’s going to be the case for video very soon, if not already in the lab. You can say, “I need a video of Donald Trump receiving a suitcase full of cash from some mafioso,” and it’ll produce it for you. And it’ll be very difficult for anyone to prove that’s not real. We really need regulation. Just like we have regulation around counterfeit currency. We can now produce counterfeit currency that’s indistinguishable from the real thing to a non-expert shopkeeper, for example.

As a result, we have very stringent regulations and enormously long jail sentences for counterfeiting and a lot of security around the designs. This idea that digital technology is completely safe and should be unregulated in all circumstances is just extremely outdated. The two things people are proposing, one, that all output for AI-generated content should be labeled indelibly. There are methods called watermarking, which work for images and sound and video, where it’s cryptographically encoded into the content and there’s really no way to pull it out.

You can recognize that that’s generated by such and such a model on such and such a date. And then, you also want the platforms, the social media platforms, necessarily have to make that absolutely apparent to the user. They could, for example, give you a filter saying, “I don’t want to see artificially generated content. Period.” Or if you do see it, it should have a big red box around it. Maybe a red filter, so that it just doesn’t look like ordinary, natural video.

And then, you also want to have ways of watermarking real video. When I have a video camera and I’m out there in the real world, it’s producing an indelible cryptographically secure time-stamping and geocoding and all the rest, so that that’s globally recognized. So that we know that this is real video.

Those two things together will go a long way. Plus, the regulations on the media platforms go a long way to making us safe. Is that going to happen? I don’t know. An interesting article in the New York Times yesterday was saying, “On average, it takes [decades] for a regulation to catch up with technology.”

Sean Illing

A lot of these conversations about AI seem to imply that we actually have the power to control something that will be far more capable than we are. But I don’t see any reason in nature or history to believe that’s the case—

Stuart Russell

There are no historical examples and no examples in nature that I’m aware of where that happens. Although, actually, there are weird things that happen in nature. There are fungi that control the behavior of animals by literally getting into their nervous systems and causing them to behave in weird ways. Causing mice not to be afraid of cats, for example, so that the mouse gets eaten, and then the fungus gets into the brain of the cat. Some complicated lifecycle story like that.

There are these weird exceptions, but basically we don’t have a good model for how this might work. The way I think about it, if I go back to the question I said at the beginning, “How do we maintain power forever over systems more powerful than ourselves?” That sounds pretty hopeless. If instead you say, “What’s a mathematical problem such that no matter how well the AI system solves it, we are guaranteed to be happy with the outcomes?” That sounds maybe a little more possible.

We can make the AI system as intelligent as you want, but it’s constitutionally designed to be solving a certain type of problem. And if it does it well, we are going to be happy with the results. The way I’m thinking about this is, as you said, not three laws, but actually two laws really. One, the AI system’s only objective is to further the interests of human beings. And the second principle is that it knows that it doesn’t know what those interests are.

Sean Illing

At what point does AI innovation become the most consequential event in human history?

Stuart Russell

Good question. I think certainly when we have something resembling AGI. AGI means AI systems that match or exceed human capabilities along all relevant dimensions, but because of the massive advantages that machines have in speed, memory, communication, bandwidth, intake bandwidth, there’s no doubt that they would very quickly far exceed human capabilities.

That would be the biggest event in human history, in my view, because it would in some sense basically switch to an entirely different basis for civilization. Our civilization is based on our intelligence, and now that would no longer be true. It might also be the end of civilization, if we don’t figure out how to control such a system.

To hear the rest of the conversation, click here, and be sure to follow The Gray Area on Apple Podcasts, Google Podcasts, Spotify, Stitcher, or wherever you listen to podcasts.

Sign up for the newsletter Sign up for Vox Recommends

Get curated picks of the best Vox journalism to read, watch, and listen to every week, from our editors.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

ChatGPT can exhibit unexplained or opaque reasoning.

Regulation and watermarking of AI-generated content can help prevent harm and distinguish it from reality.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

Experts warn that AI systems may become superintelligent and exceed human capabilities.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What future risk did Hinton warn about AI?

The public should know that AI systems, even without superintelligence, can cause serious harm and generate targeted propaganda.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn "bad actors" could use AI for?

To win wars or manipulate the electorate.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

AI development must consider data bias, ethics, and security to prevent defamatory statements about individuals.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Human oversight is necessary for AI decision-making, especially in high-risk areas like medical diagnosis.

Title:

Content: Locally
2024-06-12 10: 15: 00
Zhong Li-ling said that artificial intelligence accidents or issues related to privacy and ethics need to pay attention to risks and strengthen human supervision
Share:
The Office of the Privacy Commissioner for Personal Data released the “Artificial Intelligence: A Model Framework for Personal Data Protection ”, which covers four areas. It is hoped that organizations will pay attention to the use of artificial intelligence systems to reduce the risk of personal data leakage.
Speaking on Radio Television Hong Kong's "The Millennium" programme, the Privacy Commissioner for Personal Data, Ms Chung Lai-ling, said that she believed that more and more organisations in Hong Kong would use artificial intelligence, so she would like to remind them of the risks, especially in high-risk areas, and that human supervision should be strengthened.
Artificial intelligence diagnosis is high risk
For example, if you want to use artificial intelligence to help diagnose diseases, it is high risk, so every process should be reviewed by the medical staff to reduce the chance of mistakes. If you only provide information to the customer 's artificial intelligence system, the risk is relatively low, or it can be fully automated.
Chung Lai-ling also pointed out that the framework also mentioned the six steps involved in artificial intelligence incident response system, first determine whether the incident is an artificial intelligence system, continue to make reports, prevent expansion, make investigations, and how to recover.
She added that if an AI incident involves privacy, it may also involve ethical issues, and organizations should pay attention to it.
Originally published on Radio Television Hong Kong
By accepting the following privacy policy and disclaimer, you agree to the privacy policy and disclaimer contained in am730.
LEARN MORE
Acceptance

The "human in the loop" and "Society in the loop" models include human participation to develop AI with human values.

Title:

Content: Alert
Wu Xinying Double-nationality Double-nationality Concerns Yancheng Popular Party Chicken Anxiety “If it violates the law, the class will be directly removed in 2024 ”
Asian Championships / Pop, no more! Grand Dome Opening Final 1000 tickets sold out
Gisenji is dead!
From Mao Zedong to Xi Jinping, how does he affect Sino-American relations?
Beware of AI System Biases The NSC pledges to actively promote ethical research
The Legislative Yuan held the Education and Culture Committee today to scrutinize the budget of the National Science Council. Legislators pointed out that the development of generative artificial intelligence has made it possible for more intuitive and humanized human-machine interaction, but the biases that occur in artificial intelligence machine systems (Bias) have become more and more profound in society, requiring the National Science Council to conduct machine ethics research and provide a basis for industrial development.
The National Science Council said that it will actively promote ethical research to strike a balance between the legal system and industrial development.
Legislator Fan Yun said that with the development of science and technology, the bias of artificial intelligence machine decision-making system has gradually affected society, and in order to maintain the harmony of human-machine interaction, machine ethics (Machine Ethics) technology research is also indispensable.
Fan Yun pointed out that there is no shortage of research on artificial ethical decision-makers in the world, and some scholars have proposed the models of Human in the loop and Society in the loop, which include human and public participation in the decision-making cycle of machine training, so that decision-making and supervision have more diverse values.
Wu Zhengzhong, chairman of the National Science Council, said that artificial intelligence can indeed harm society, "we are very careful."
The European Union also attaches great importance to issues such as machine ethics.
The National Science Council has actively promoted ethics related research, but it also hopes that the legal system will not be too strict, so as not to compress the development of the industry.
In addition, legislator Wu Siyao also said that since the introduction of ChatGPT in 2022, governments have paid more attention to the development of medium and large language models, and at present, the proportion of simplified Chinese training data is much higher than that of traditional Chinese, resulting in the model's inference biased towards the life language and ideas of mainland China.
Wu Si-yao also points out that the National Science Council is "promoting an advance plan for the development of trustworthy generative AI," and although the plan is to collect training models for traditional Chinese databases, including the Ministry of Education's Chinese dictionary, dictionary of idioms, and abstracts of academic papers, the content of the training materials is still focused on the field of science and technology, and the content is not enough for large language models.
Wu Si-yao suggested that text training should be expanded to include more departments, and that the National Science Council should take stock of journals, texts and established cloud databases, such as the National Cultural Memory Bank, and widely incorporate them into training texts to enhance the diversity of training data.
The National Science Council stated that if a generative AI needs to use the works of others during the training phase, it must be handled in accordance with the provisions of the Copyright Law.
The Ministry of Culture's National Cultural Memory has several kinds of information, some of which can no longer be authorized due to copyright reasons, and the rest of the publicly available text has so far obtained 46,440 records.
Ethical language of the National Science Council
Extended reading
President Tsai Ing-wen helped Wu Si-yao on the platform to describe her retirement.
Fan Yun calls for protection of Taiwan's democratic and progressive values
Fan Yun-li lists the top ten types of women who hate women, Ko Wen-che, Hou Youyi, and Guo Tai-ming.
Fan Yun received heavy endorsement from the Democratic Progressive Party: The Green Non-District can withstand the test
Related News
Tunghai University Board of Governors approved a one-minute pay cut for teachers at public universities next year
The Executive Yuan announced that from next year, the academic research of teachers and researchers of Academia Sinica will be increased by 15%, and 70% of subsidies will be given to private schools.
East China University Board of Governors Resolved and...
Weng Jinlun Wins National Lecture for Lifetime of the Ministry of Education
Professor Weng Jinlun, Chair Professor in the Department of Electrical Engineering at Sun Yat-sen University, has developed the new generation of multi-antenna system technology and is a major leader in the field of international mobile communication antenna research.
With years of hard work...
Beware of AI System Biases The NSC pledges to actively promote ethical research
The Legislative Yuan held a meeting today to review the budget of the National Science Council, and legislators pointed out that the development of generative artificial intelligence has made it possible for more intuitive and humanized human-computer interaction.
Open India migrant workers attract scholars: 100,000 migrant workers are not as good as 10,000 students
Recently, the issue of Indian migrant workers triggered a discussion, Fang Tianzhi, deputy director of the India Center of Tsinghua University, believes that India has a large population and more students abroad, and Taiwan has the energy to relieve the loss of supply of Indian tertiary education.
President of National Taiwan University: Interuniversity cooperation can receive good students
Taiwan is negotiating with India to sign a memorandum of cooperation on migrant workers, but educational groups said it is a pity that only migrant workers are discussed. India has a large student population, and it is recommended to introduce 10,000 overseas students to ease the problem of migrant workers.
Teachers Forced to Participate in Native Language Training: Respect Schools' Will
The National Education Department recently asked some schools to send teachers to participate in local language certification training. The National Education Industry Union today criticized the Ministry of Education for forcing current teachers to participate...
Product recommendation
udn Forum

The EU prioritizes machine ethics and experts call for safeguards against AI dangers.

Title:

Content: UAE participates in setting global standards for fair, accountable and understandable systems
Artificial intelligence.
Scientific Maturity with Moral Dilemmas
T + T - normal size
With the increasing use of artificial intelligence technologies in vital sectors that directly affect our lives, such as health, education, mobility, agriculture and even arts and space, experts believe that it is possible to develop a super artificial intelligence that reaches the point of controlling the emotions and motivations of people and thus their reality.
Will we be the ones who shape the reality and future of artificial intelligence systems or vice versa?
The more pressing question is, can we ensure that artificial intelligence is harnessed as a moral responsibility to improve human lives?
The rapid progress of artificial intelligence in recent years has led groups of experts to call for the need to develop safeguards to protect humanity from the dangers of artificial intelligence.
Given the gravity of the issue, many government bodies, civic organizations, private companies, think tanks, and research groups are working to develop principles governing AI trends such as the Barcelona Declaration, the Montreal Declaration, the Google Principles, and the Microsoft Principles.
One such organization is the Future of Life Institute, a nonprofit research and outreach organization founded in Boston in 2014 to monitor existential threats to humanity.
The institute was founded by MIT cosmologist Max Tegmark, Skype co-founder Jan Tallinn and DeepMind research scientist Victoria Krakow.
The institute worked with AI researchers and developers as well as scientists from many disciplines to create the 23 guidelines now referred to as the Asilomar Principles, which aim for AI technologies to develop reliably, safely and comprehensively.
A recent study by the Future of Life Institute suggests that AI is unlikely to show human emotions such as love or hate, and that there is no reason to expect AI to automatically deliberate good or evil.
But experts at the institute suggest two scenarios in which AI could become an imminent threat: The first scenario is that humans program AI to do something destructive, such as “autonomous ” or autonomous weapons — AI systems programmed to kill and capable of easily causing mass casualties in the wrong person ’ s hands.
Moreover, an AI arms race could inadvertently lead to an AI war that also leads to heavy casualties.
To avoid “losing ” to the other side, these weapons can be designed to be extremely difficult to stop, and humans can easily lose control in that situation.
This risk exists even with “narrow ” — or limited — AI, but it grows with increasing levels of AI and autonomy.
The other scary scenario is that the AI is programmed to do something useful, but it may develop a destructive way to achieve its goal, which can happen when we fail to fully align the AI goals with our goals, which is very difficult.
For example, if you ask a smart, obedient car to take you to the airport as soon as possible, you may arrive “as soon as possible, ” but you will be chased by police helicopters and probably passed out at speed.
The car didn ’ t do “what it wanted, ” which was to arrive at least safely, but it did literally what you asked.
If a super-intelligent system is tasked with an ambitious geoengineering project, it could cause havoc in our ecosystem as a side effect, and human attempts to stop it are seen as a “threat ” to be met.
Benefit
His Excellency Omar bin Sultan Al Olama, Minister of State for Artificial Intelligence, Digital Economy and Teleworking Applications, said: “The UAE government attaches great importance to ensuring the optimal use of AI solutions and capabilities, and adopts within its future directions to make the most of this advanced technology, with full commitment to employ it with high ethical responsibility centered on people and community service. ”
To achieve this, the UAE government, through the UAE Artificial Intelligence and Blockchain Council, has formed a dedicated subcommittee to ensure effective governance and regulation of AI technology.
Among the initiatives related to the ethics of artificial intelligence applications worked on by the Council is the self-assessment tool for artificial intelligence applications, which was launched at the level of the Government of Dubai, and is being developed and launched at the level of the federal government.
Principles
He added: “This assessment is based on four basic principles: inclusion: It means that the benefits of artificial intelligence include all members of society, and that governance systems apply to this technology globally, while respecting the dignity, rights and privacy of individuals.
Humanity: AI should be beneficial to humanity and consistent with human values, both in the short term and in the long term.
And safety: AI systems should be safe, and be harnessed in the service of humanity.
AI systems must be fair, transparent, accountable and understandable.
In addition to these principles and standards, the UAE Council for Artificial Intelligence and Blockchain, represented by its subcommittee of artificial intelligence experts in the country, participates in the development and formulation of global standards, through the World Organization for Standards, with a group of experts. ”
He pointed out that the committee is currently working on the development of technical standards for artificial intelligence, including the standards of "explainable artificial intelligence", which is one of the most important technical topics that allow to verify the compatibility of models of artificial intelligence with the basic principles of its use.
The committee has played an important role in the development of these standards, and it is expected that they will be adopted in the country once approved by the technical committee of the World Organization for Standards, to control and ensure the optimal employment of artificial intelligence applications.
Data protection
As for the data used to train artificial intelligence models, which is one of the most important possible elements of these applications, the UAE has issued the “Personal Data Protection Law ”, which aims to protect the data of individuals available to companies from the uses that violate privacy in the training of artificial intelligence models and other uses.
The Office of Artificial Intelligence, Digital Economy and Telework Applications, in collaboration with Oxford University, is working to train the employees of ministries and federal and local government agencies through the “Artificial Intelligence Program ” to develop the ability of trainees to analyze the security and ethical risks that may result from the wrong adoption of artificial intelligence technologies.
Rules.
Ghassan Abu Ajamiya, director of strategic planning at the Emirates Alliance for Technical Solutions, said: “Science at the beginning is simple, but with the development of these sciences, including artificial intelligence, societies need laws and legislation to regulate its transactions, and what happened in our digital life is that developments are faster than legislation, and giant companies began to impose their way of dealing with data. ”
Abu Ajima pointed out that most of those companies and owners of platforms that contain millions of data are American companies, so the European Union began its journey to address these trends by issuing a few days ago the Digital Services Law, which aims to get rid of harmful or toxic content on the Internet, and under this decision will be responsible for their algorithms, disclosure in all transparency, and required to assess the risks in content and mitigate it to protect users. Prevent the rapid spread of misinformation, combat hate speech, and avoid putting unsafe products on the market.
About a month earlier, the Digital Markets Act was announced, with the aim of reducing the broad dominance of companies in the digital economy, and the beginning of the union with the laws was when the data privacy protection system was issued in 2018.
He added: “There is no doubt that the set of decisions issued by the European Union can serve as a platform to help draw up a legal framework for legislation that can be built on and adapted according to the values and ethics that suit each country or region, and this will undoubtedly contribute to improving how user data is used and reduce its exploitation by IT giants that own major social media platforms. ”
A proactive step
Mohamed Amin, senior vice president of Dell Technologies in the Middle East, said many companies today rely on AI technologies to get accurate and quick answers to difficult issues they may face.
He added: “Today, we rely more and more on artificial intelligence models to make different decisions, whether about approving bank loan applications or helping customers decide on their next holiday destination, this technology is able to calculate the smallest details and differences.
So we need to make sure that AI systems are ethical and incorruptible, and that people are able to understand how decisions are made through this technology.
There is no doubt that artificial intelligence has the ability to calculate huge amounts of data and improve decision-making processes, but we cannot lose sight of the fact that the decisions made by AI systems affect the lives of humans, they are a machine that can currently use big data to create better information than humans, but they do not understand the context, have no emotions or ethics, and are unable to think outside the box.
When there are no clear checks and balances in the functioning of these systems, they can negatively affect the diversity of our ideas and our excellence, by treating us as a homogeneous group, and providing only structured content that does not respect our differences.
Artificial intelligence has been described as the most important technology under development today.
However, we need to place it under the proper supervision of governments and regulators, who will be instrumental in helping companies deal with the ethical side and shortcomings of these systems.
Challenges
“The ethical challenges of AI are not limited to regulating the collection and circulation of personal data, but rather to putting in place controls to prevent the employment of AI to make decisions or to subject, compel or influence certain people or their decisions through the processing of their personal data, whether without their consent or in a way that may prejudice or affect their rights, ” said lawyer Mujahed Sebai.
He added: "Many legal and ethical questions related to the use of artificial intelligence are also raised about the mechanism of making decisions or correcting them if they are wrong or determining who is responsible for them, especially in the event of damage, whether material or moral, and may take biased decisions or lead to injustice or discrimination in all its forms or to monopolize the huge data that may be collected about people or institutions."
“To deal with these challenges, all stakeholders, from governments to individuals, must work together to identify the direct or long-term effects of AI, to develop strategies and systems to ensure that it is employed through a humane approach that respects the human principles and values on which our societies and the rights of individuals are based, without negatively affecting or reprogramming those values, especially by outsiders, whether for political, economic or security considerations. ”
Print Email

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Diverse training data is necessary for AI development to prevent algorithmic bias.

Technical safety requires optimization and agile assessment of AI ethical and technical safety.

Title:

Content: People 's Daily Online > > Economy and Technology
Focus on Wuzhen: Ethical rules and technical safety are the key to high-quality development of AI
November 11, 2022 09: 05 | Source: Beijing Business Daily
Small number
On November 10, at the 2022 World Internet Conference Wuzhen Summit "Artificial Intelligence and Digital Ethics" forum, Tian Tian, CEO of Ruilai Intelligence, said that in the era of digital intelligence, artificial intelligence acts as a "brain" and plays an important role in the realization of target performance, the intelligence of facility operation and maintenance, and the security of facilities.
For example, the use of artificial intelligence computer vision technology can achieve the detection of industrial defective products, the construction of face recognition security equipment, while improving production performance and production efficiency, greatly improve safety and security capabilities.
In recent years, with the rapid development of algorithms and the increasing abundance of computing power, data and other resources, the artificial intelligence industry has shown a rapid development trend.
However, Tian Tian said that looking into the future, if artificial intelligence is to achieve high-quality development, it needs to break through the two key issues of ethical rules and technical safety.
First, as artificial intelligence gradually becomes a key role in the economy and society, the rules of its interaction with humans pose ethical issues, such as the distribution of human-machine control, the acceptance of artificial intelligence, and so on.
As an open but far from mature new technology, AI will inevitably impact existing ethical relationships and social structures.
For example, the improper transfer of human control over the machine will lead to the occurrence of malignant accidents, typical examples such as the loss of control of the electronic brake system of autonomous vehicles caused by traffic accidents, and the excessive trust in algorithms and the neglect of unfair events caused by algorithmic bias.
With the continuous penetration of artificial intelligence into all aspects of production and life, ethical problems are emerging.
Second, technical security issues.
Taking the most widely used face recognition on the ground as an example, the whole process of this technology is a black box mode, which mainly relies on massive face data for feature extraction, training and identification, so that it can use relevant loopholes and adopt various forms of attack.
For example, adding a small amount of interference to the face photo or printing the anti-patch to be worn by a real person, in the form of this targeted attack to crack the personal verification.
In the face of these problems, Tian said, it needs to be addressed from both ethical rules and technical rules.
One is the construction of ethical rules.
This involves how to set the control threshold between people and artificial intelligence, how to design the bottom mechanism, etc., and needs to be combined with specific application scenarios to create quantifiable, measurable, and executable specific standards, and then implemented to the algorithm and code level.
The second is to optimize the technical path.
On the basis of the three elements of data, algorithms and computing power, the knowledge elements are integrated into the development of safe, reliable, credible and scalable third-generation artificial intelligence, and the robustness and interpretability of artificial intelligence are continuously improved, while the agile assessment level of artificial intelligence ethical safety and technical safety is continuously improved, making it a key capability to ensure the high-quality development of the artificial intelligence industry.
(Reporter Wei Wei)
(Editor: Zhao Zhuqing, Chen Jian)
Public Number ： People 's Network Finance
Share it so more people can see it.
Back to top

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Experts like Geoffrey Hinton warn that AI development requires careful consideration of human values and ethics, as well as human oversight and accountability.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Developing AI that learns from rewards and punishments and avoids harming humans is crucial for AI safety.

Title:

Content: In order for artificial intelligence to work, a person first needs to understand himself
There are two views on artificial intelligence.
Some believe that these technologies can only benefit humanity, others - that sooner or later their development will lead to a "riot of machines".
Therefore, it is necessary, in addition to algorithms of artificial thinking, to develop protective mechanisms that will not allow machines and robots to harm a person.
"Deep Learning"
Last July, at an international chess forum, a robot chess player broke a finger of a boy who was his partner in the game.
The organizers said that the child too quickly made a move and violated safety rules, or the robot took his finger for one of the figures.
Either way, the precedent has already taken place.
Another example.
More recently, during tests of the latest “robot driver ” from Tesla, a car traveling at a speed of 40 kilometers per hour, three times knocked down a mannequin standing in its way, depicting a child.
The AI was simply unable to identify the pedestrian.
Alan Turing, a famous expert in the field of artificial intelligence, in one of his lectures said that machines can be called intelligent when they learn to deviate from specified programs and make independent decisions.
But this, Turing added, will be possible if the algorithms do not copy the intelligence of a mature individual, but go through a process of learning.
Suppose a program is created that has intelligence at the level of a child, and another that will "educate" this child through a system of rewards and punishments.
Back in 1952, programmer Arthur Samuel created a program for playing checkers, capable of improving their results with each game.
The algorithm evaluated the positions of the pieces on the board and remembered which of them led to a win.
These days, it's called reinforcement training.
The point is that the program simulates the work of the human brain, that is, the exchange of data between groups of neurons.
Such programs are now called neural networks.
“The problem with early neural networks is that they could only solve game problems, ” comments Ilya Sutskever, one of the founders of the American company OpenAI. – They could not be scaled, used for other purposes.
But modern deep learning models are not only universal, but also competent — if you want to get the best results in many complex tasks, you have to use deep learning.
It is scalable. ”
Such systems are able to solve a lot of tasks:
• recognize specific people in the pictures,
• create new images, copying the style of famous painters,
• conduct research in the field of physics, chemistry, biology, mathematics, criminology.
But where is the danger?
“We build optimising machines, give them tasks, and they solve them, ” writes another AI expert, Stuart Russell.
But what if the goal is set incorrectly? ”
Anyone who has dealt with robotic vacuum cleaners knows that they are rarely able to distinguish valuable items lying on the floor from ordinary garbage.
What if it was a giant robot cleaner with larger tasks?
Like cleaning up an entire city?
And will humans or animals get in his way?
Harriet and Robbie
Stuart Russell believes that it is almost impossible to calculate all the nuances when performing a particular task.
Therefore, the only way to prevent malicious actions on the part of AI may be the “uncertainty factor ”.
That is, in ambiguous situations, the machine must seek intervention from a person.
This situation is illustrated by the conditional example of a woman named Harriet and a robot Robbie, who must book a hotel room for his mistress.
This includes a reward system that will be higher the more satisfied Harriet is with Robbie ’ s choice.
If he does nothing at all, he will not receive any reward.
But Robbie can ask Harriet if she wants him to continue his room reservation activities, or if she prefers him to stop them.
Start with yourself
Of course, this approach is not optimal for solving more global problems, where coordination between several individuals or structures is required?
What if the situation requires an immediate decision?
Or does the person not have the necessary information, and the program can not bring this information to his understanding?
So, according to the scientific director of the Mila Institute in Montreal (Canada), Joshua Bengio, you need to start not with setting tasks for AI, but with us humans:
• determine which values are important to us and which are secondary;
• What should be the basis of a strategy for the development of society;
• which states can be considered the norm for us, and which are deviations from the norm.
Join the telegram channel Pravda.Ru with the opportunity to express your own opinion)
Add "Pravda.Ru" to your sources in Yandex.News or News.Google,.
Author Irina Shlyonskaya
Irina Shlionskaya – author of Pravda.Ru
Latest materials

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Human and machine laws can conflict, and the lack of uniformity in human laws makes AI development challenging.

Title:

Content: BETA
This is a BETA experience. You may opt-out by clicking here

More From Forbes

Edit Story

Why The Ethics Of AI Are Complicated

Debarshi Chaudhury is the CEO of Quantilus Innovation Inc., a tech solutions firm providing software development and consulting services.

If you've given any thought at all to artificial intelligence (AI) and the progress made in the field, you're probably in one of these two camps:

Camp 1: AI is the biggest possible threat to humankind and will take over and make slaves of us humans (aka The Matrix or The Terminator camp).

Camp 2: AI should be embraced by humankind and will drive us to unprecedented new levels of creativity, productivity and societal advancement. AI will largely remain subservient to us, and we will coexist harmoniously (aka the "R2D2" camp).

Most books and movies that deal with AI also lean toward one of these two camps. "Good" and "evil" are somewhat nebulous terms — our baseline empathy sets our definition of "good." For example, most of us know that we should value human life over material objects without needing anyone to tell us so explicitly. Someone who sacrifices a baby to get a new car would automatically be branded "evil." These macro laws/rules are hardwired into us as human beings. But why should human life or animal life be valuable to AI? A dog has no greater intrinsic value to a machine than, say, a sandwich — unless we program our values into our AI systems.

The question isn't really whether AI will eventually become more intelligent than humans (it definitely will) or whether it will turn good or evil. It's what we can do right now to make sure it turns "good" (or, at the very least, doesn't turn "evil").

Self-Preservation

Self-preservation is at the core of our existence, and even "good" humans operate within this principle. If we're to model AI with this principle, it will imply that an AI system would prioritize its existence over the life of a human. This would lead to all kinds of "robots killing humans" scenarios.

So for an AI to be "good" based on human standards, it would have to prioritize human life over self-preservation. This was pretty well encapsulated decades ago by Isaac Asimov with his original "Three Laws of Robotics," in which Law 1 is all about protecting human life, and Law 3 is about AI self-protection. However, it's pretty hypocritical of us to convince a truly intelligent system that human life should take precedence over its own and not choose to define "good" in its own context.

"Value Of Life" Considerations

If we can overcome the previous issue and hardwire the "sanctity of human life" into AI systems, we face various "relative value of a life" questions. Is a child's life more valuable than that of an older person? Are two people more valuable than one? Is one child with a dog more valuable than two middle-aged people?

As AI systems proliferate, they'll be frequently faced with lose-lose Cornelian dilemmas in real-life scenarios — say, a self-driving car has to choose between turning left and hitting a child or turning right and hitting two adults. We're essentially trusting the programmers of these systems to make the right decision — a tall task considering that we'd be hard-pressed to make the decision ourselves.

"Needs Of The Many Over The Few" Considerations

As AI systems become more sophisticated and more intelligent, they'll consider the long-term consequences of actions and the consequences in the broader population. We'd all tend to agree that the needs of many humans should take precedence over the needs of individuals.

This, however, is a rather slippery slope. A simple example is that of a terrorist threatening to kill many people. That's a pretty easy decision for both a robot and a human cop. They'd both try to take out the terrorist before he killed any people. Now, take the more complicated example of a factory polluting a river that's poisoning the people in a small town.

A machine could decide that for the benefit of the many thousands of people in the town, the best option is to destroy the factory. This is something that a "good" human being would never do — we'd try to fix it in other ways.

Human Laws Vs. Machine Laws

This brings us to another ethical conflict for AI — the conflict between human laws and the laws embedded into the machines. A primary reason that "good" humans don't take extreme steps (like blowing up a polluting factory) is that we have laws that prohibit these actions and the negative consequences of disobeying those laws.

So, should machines just obey human laws, and would that keep them in check? Well, maybe — but unfortunately, we humans don't have much uniformity there either. Laws are different from place to place — the laws in New York are different from the laws in California, and they're both very different from the laws in Thailand.

Conclusion

We can't impose ethics or morality in AI programming because we haven't ever really worked it out despite the best efforts of centuries of philosophers. This article is about the ethics of AI, but it could just as well have been about ethical considerations for humans. There's a lot of handwringing about how machines will behave when faced with ethical scenarios, yet there's no consistency on how humans behave or even how they're supposed to act.

Maybe a sufficiently intelligent system will be able to figure it out for itself, or at least to the level we've been able to figure it out. Our best course of action may be to treat AI as a child that has to learn "good" behavior as it grows up. Like with all children, our approach should be to expose it to the broad principles of good behavior — not to cause unnecessary harm, not to discriminate, but to do things for the betterment of society as a whole (with the understanding that society may be a mix of humans and AI), and mostly to be able to balance competing and sometimes contradictory pulls of good behavior.

Forbes Technology Council is an invitation-only community for world-class CIOs, CTOs and technology executives. Do I qualify?

Follow me on LinkedInCheck out my website

Debarshi Chaudhury is the CEO of Quantilus Innovation Inc., a tech solutions firm providing software development and consulting services. Read Debarshi Chaudhury's full

Debarshi Chaudhury is the CEO of Quantilus Innovation Inc., a tech solutions firm providing software development and consulting services. Read Debarshi Chaudhury's full executive profile here.

Experts call for safeguards and aligned AI goals to protect humanity.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

The UAE government and council promote ethical AI use and develop technical standards, including explainable AI.

The National Science Council promotes AI research with human oversight, using "human in the loop" and "Society in the loop" models.

The EU prioritizes machine ethics, AI safety, and diverse training data for trustworthy generative AI.

AI development requires balancing ethics and growth, as current systems can cause harm and spread disinformation even without superintelligence.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

Regulation and watermarking can help prevent harm from AI-generated fake content.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

Artificial general intelligence could be the most consequential event in human history, with experts warning it can generate targeted propaganda and false statements.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

The US government and seven tech giants have agreed to regulate AI development for security and safety.

Title:

Content: Government and tech giants reach agreement to ensure safe use of AI technology
Font Size:
WASHINGTON (AP) — The U.S. government has entered into a voluntary agreement with seven major technology companies to regulate the development of artificial intelligence (AI) technologies to develop guidelines aimed at ensuring the safe development of AI technologies.
The White House announced Friday that the seven tech giants have committed to a number of measures to safeguard AI security, including internal and external security testing before releasing products, and the development of watermark systems to help users identify AI-generated content and reduce the risk of fraud and misinformation.
Biden met with tech leaders from the big four Internet giants of Microsoft, Google, Amazon and Facebook parent Meta, as well as three AI startups, OpenAI, Anthropic and Inflection AI, ChatGPT ’ s parent company.
Biden stressed that "[artificial intelligence] poses great risks to our society, economy, and national security, but also incredible opportunities."
"We welcome the president's leadership role in bringing together the tech industry and developing concrete steps to make artificial intelligence safer," OpenAI partner Microsoft said in a blog post on the day.
These companies adhere to the three basic principles of “safety, security and trust ” in the development of AI technology.
However, the pace of regulation in the United States lags behind the European Union.
The European Parliament has proposed a series of artificial intelligence regulatory bills in June.
However, some tech companies are opposed to the strict rules set by Europe.
Congress is considering a bill that would require political ad producers to disclose whether they use artificial intelligence.
Experts see the government ’ s agreement with tech companies as a positive step toward AI regulation, but also warn that more work needs to be done to identify AI ’ s potential harms and ways to mitigate them.
"It's still early days and no one knows what the law will look like," said Chris Lewis, president of consumer group Public Knowledge, which is calling for an independent body to regulate artificial intelligence and other tech companies.
LIKE Our official Facebook page for more information

Companies will develop watermark systems for AI-generated content.

The Biden administration has met with tech leaders to discuss AI safety, with companies adhering to "safety, security, and trust" principles.

US regulation lags behind the European Union's AI efforts, which include proposed artificial intelligence bills.

Title:

Content: Government and tech giants reach agreement to ensure safe use of AI technology
Font Size:
WASHINGTON (AP) — The U.S. government has entered into a voluntary agreement with seven major technology companies to regulate the development of artificial intelligence (AI) technologies to develop guidelines aimed at ensuring the safe development of AI technologies.
The White House announced Friday that the seven tech giants have committed to a number of measures to safeguard AI security, including internal and external security testing before releasing products, and the development of watermark systems to help users identify AI-generated content and reduce the risk of fraud and misinformation.
Biden met with tech leaders from the big four Internet giants of Microsoft, Google, Amazon and Facebook parent Meta, as well as three AI startups, OpenAI, Anthropic and Inflection AI, ChatGPT ’ s parent company.
Biden stressed that "[artificial intelligence] poses great risks to our society, economy, and national security, but also incredible opportunities."
"We welcome the president's leadership role in bringing together the tech industry and developing concrete steps to make artificial intelligence safer," OpenAI partner Microsoft said in a blog post on the day.
These companies adhere to the three basic principles of “safety, security and trust ” in the development of AI technology.
However, the pace of regulation in the United States lags behind the European Union.
The European Parliament has proposed a series of artificial intelligence regulatory bills in June.
However, some tech companies are opposed to the strict rules set by Europe.
Congress is considering a bill that would require political ad producers to disclose whether they use artificial intelligence.
Experts see the government ’ s agreement with tech companies as a positive step toward AI regulation, but also warn that more work needs to be done to identify AI ’ s potential harms and ways to mitigate them.
"It's still early days and no one knows what the law will look like," said Chris Lewis, president of consumer group Public Knowledge, which is calling for an independent body to regulate artificial intelligence and other tech companies.
LIKE Our official Facebook page for more information

The US Congress is considering a bill for AI disclosure in political ads, seen as a positive step towards AI regulation.

Title:

Content: Government and tech giants reach agreement to ensure safe use of AI technology
Font Size:
WASHINGTON (AP) — The U.S. government has entered into a voluntary agreement with seven major technology companies to regulate the development of artificial intelligence (AI) technologies to develop guidelines aimed at ensuring the safe development of AI technologies.
The White House announced Friday that the seven tech giants have committed to a number of measures to safeguard AI security, including internal and external security testing before releasing products, and the development of watermark systems to help users identify AI-generated content and reduce the risk of fraud and misinformation.
Biden met with tech leaders from the big four Internet giants of Microsoft, Google, Amazon and Facebook parent Meta, as well as three AI startups, OpenAI, Anthropic and Inflection AI, ChatGPT ’ s parent company.
Biden stressed that "[artificial intelligence] poses great risks to our society, economy, and national security, but also incredible opportunities."
"We welcome the president's leadership role in bringing together the tech industry and developing concrete steps to make artificial intelligence safer," OpenAI partner Microsoft said in a blog post on the day.
These companies adhere to the three basic principles of “safety, security and trust ” in the development of AI technology.
However, the pace of regulation in the United States lags behind the European Union.
The European Parliament has proposed a series of artificial intelligence regulatory bills in June.
However, some tech companies are opposed to the strict rules set by Europe.
Congress is considering a bill that would require political ad producers to disclose whether they use artificial intelligence.
Experts see the government ’ s agreement with tech companies as a positive step toward AI regulation, but also warn that more work needs to be done to identify AI ’ s potential harms and ways to mitigate them.
"It's still early days and no one knows what the law will look like," said Chris Lewis, president of consumer group Public Knowledge, which is calling for an independent body to regulate artificial intelligence and other tech companies.
LIKE Our official Facebook page for more information

OpenAI CEO Sam Altman supports an international AI regulatory agency.

Title:

Content: AI Regulation: Senators Unveil AI Plan, Open AI CEO Wants International Agency

A growing chorus of lawmakers and technology leaders are calling for new regulations to govern the rapid rise of artificial intelligence (AI) as the transformative but largely unchecked technology permeates more aspects of daily life.

On Wednesday (May 15), a bipartisan group of senators unveiled a long-awaited plan to bolster U.S. AI efforts, calling for a significant funding boost while largely deferring on the thorny issue of regulating the rapidly advancing technology.

The legislative blueprint, laid out in a 20-page document titled “Driving U.S. Innovation in Artificial Intelligence,” urges ramping up government and private-sector AI research and development to $32 billion annually by 2026.

The plan was introduced by Senate Majority Leader Chuck Schumer, D-N.Y., and three colleagues.

National Movement for AI Regulations

U.S. politicians have been calling for more AI regulations for some time.

Sen. Mitt Romney demanded last month increased federal regulation of AI. However, such efforts are likely to encounter obstacles due to the technology’s rapid development and broad applications, making effective oversight a complex challenge, according to experts. While many acknowledged the potential risks associated with AI, they emphasized the difficulty in determining which AI systems require stringent regulation and underscore the need to strike a balance between fostering technological innovation and mitigating those risks.

AI regulation is facing headwinds at the state level. Colorado and Connecticut introduced legislation this year to become national leaders in regulating artificial intelligence, targeting companies that develop and utilize AI systems and prohibiting discrimination in critical services such as healthcare, employment and housing. However, Connecticut’s efforts collapsed after a veto threat from the Democratic Governor, citing concerns about stifling the nascent industry. At the same time, Colorado’s bill faces intense pressure from the tech lobby, arguing against a state-by-state regulatory approach, leaving lawmakers nationwide closely monitoring the outcome.

The national movement to rein in AI is part of a larger global effort. The U.S. and China are set to engage in their first high-level talks on AI, which experts believe could significantly impact the future of international commerce. The discussions aim to establish a foundation for managing AI technology and regulation, shaping policies, cooperation and safeguards against accidental mismanagement or deliberate weaponization that could devastate markets, industries and security systems.

OpenAI CEO Wants a Global AI Agency

The private sector is also pushing for change.

OpenAI CEO Sam Altman has expressed support for establishing an international agency to regulate artificial intelligence, citing concerns about the potential for “significant global harm” from advanced AI systems shortly.

Speaking on the “All-In” podcast on Friday (May 10), Altman emphasized the need for a balanced approach to regulation, cautioning against excessive and insufficient oversight. He believes that AI systems could soon have negative impacts that transcend national borders, necessitating an international regulatory body to ensure the safety of the most potent AI models.

“I think there will come a time in the not-so-distant future — like we’re not talking decades and decades from now — where frontier AI systems are capable of causing significant global harm,” Altman said on the podcast.

He said he believes AI systems will have a “negative impact way beyond the realm of one country” and wants to see them regulated by “an international agency looking at the most powerful systems and ensuring reasonable safety testing.”

The US and China will hold high-level talks on AI regulation, while states like Colorado and Connecticut have introduced related legislation.

Connecticut's AI regulation efforts collapsed due to a veto threat from the Governor.

The US government has launched AI regulatory policy formulation, with the NTIA holding a 60-day public consultation.

Title:

Content: International
2023-04-12 12: 42: 38
ChatGPT Deposit Security Risk Ethics Concerns Biden Government Consults Public Opinion Monitoring
Share:
AI chatbot ChatGPT has become popular recently, raising concerns about the information security and ethics of artificial intelligence tools, and the US government on Tuesday (11) officially launched preliminary actions on the formulation of regulatory policies, and will consult the public in the next 60 days as a reference for policy formulation.
Microsoft-backed OpenAI launched ChatGPT at the end of last year, a widely used AI tool with more than 100 million monthly active users, a growth rate that has broken the record for consumer applications.
Public opinion calls for government to ban AI tools
However, the explosive development of AI applications has also raised concerns about information security and ethics, with some in politics, industry, and academia voicing opposition, demanding that the government regulate AI tools and even ban them.
The Biden administration consulted the public on regulatory policy through the National Telecommunications and Information Administration (NTIA) of the Commerce Department. NTIA issued a press release saying that the “Consultation ” program aims to build consensus and provide the Biden administration with more comprehensive and detailed information on AI risks and opportunities.
Officials: Support innovation, but also protect the rights of the people
Alan Davidson, a Department of Commerce official, said that responsible AI systems can bring great benefits, but its potential consequences and harms must be addressed.
The Biden administration supports innovation, but it must also ensure security and protect people ’ s rights and safety.
The public consultation will end on 610 days, 60 days after the Ministry of Commerce ’ s announcement.
When asked if AI is dangerous during a meeting with the scientific community to discuss the risks of AI this week, he said that "it remains to be seen, there may be danger."
Musk calls for AI research to be suspended
After the popularity of ChatGPT, the security problems caused by it have been controversial, and OpenAI co-founder Musk issued an open letter in March to "suspend AI research and development", and joined thousands of technology leaders and researchers in calling for a moratorium on the development of AI systems more powerful than the latest language model, GPT-4.
OpenAI is also aware of the risks. On the 5th of this month, the company issued an article on its website for AI security solutions, pointing out that strong AI systems should be subjected to more rigorous security assessment, and the company will actively work with the government to formulate the best way to regulate.
By accepting the following privacy policy and disclaimer, you agree to the privacy policy and disclaimer contained in am730.
LEARN MORE
Acceptance

The Biden administration and OpenAI support innovation, security, and AI regulation.

Seven tech companies have pledged to make AI safer by watermarking AI-generated content and rigorously testing AI systems before release.

Title:

Content: A group of leading tech companies, including Meta and Alphabet, have made commitments to the US government that they will impose measures that make AI safer.

According to the Biden administration, seven companies leading the AI race have come together to promise future measures that will help the US government regulate the emerging tech.

The seven countries, Alphabet, Amazon, Anthropic, Inflection, Meta, Microsoft and OpenAI, said they will continue to share information on how to reduce risks to cybersecurity

As part of their pledge, the companies agreed to watermark AI-generated content – making it easier for users to spot deep fakes and generated text.

The companies have reportedly pledged to test the systems rigorously before releasing them to the public.

As well as this, the seven companies told the US government that they will focus on ensuring all generative AI is free of discrimination and bias, according to Reuters

These recent pledges have been celebrated as a win by the Biden administration, which like other countries, has been scrambling to regulate the technology.

Lawmakers around the world have been trying to find the best way to deal with the dangers of generative AI, while also making the most of its benefits.

In the UK, the government has pledged to fund £100m into an AI taskforce, which has been made up of experts throughout the industry and academia.

Ian Hogarth, the new leader of the taskforce, said: “The Prime Minister has laid out a bold vision for the UK to supercharge the field of AI safety, one that until now has been under-resourced even as AI capabilities have accelerated.”

The value of AI deals plummeted to $72.9bn in 2022, a dramatic drop from $127.2bn in 2021, according to research firm GlobalData.

Investment in AI had been on a mostly upward trajectory for the past decade. In 2013, AI deals totalled just $1.6bn.

Five years on in 2018, investment in AI had shot up to a whopping $83bn.

The UK government will fund a £100m AI taskforce to ensure AI is free of discrimination and bias.

Title:

Content: A group of leading tech companies, including Meta and Alphabet, have made commitments to the US government that they will impose measures that make AI safer.

According to the Biden administration, seven companies leading the AI race have come together to promise future measures that will help the US government regulate the emerging tech.

The seven countries, Alphabet, Amazon, Anthropic, Inflection, Meta, Microsoft and OpenAI, said they will continue to share information on how to reduce risks to cybersecurity

As part of their pledge, the companies agreed to watermark AI-generated content – making it easier for users to spot deep fakes and generated text.

The companies have reportedly pledged to test the systems rigorously before releasing them to the public.

As well as this, the seven companies told the US government that they will focus on ensuring all generative AI is free of discrimination and bias, according to Reuters

These recent pledges have been celebrated as a win by the Biden administration, which like other countries, has been scrambling to regulate the technology.

Lawmakers around the world have been trying to find the best way to deal with the dangers of generative AI, while also making the most of its benefits.

In the UK, the government has pledged to fund £100m into an AI taskforce, which has been made up of experts throughout the industry and academia.

Ian Hogarth, the new leader of the taskforce, said: “The Prime Minister has laid out a bold vision for the UK to supercharge the field of AI safety, one that until now has been under-resourced even as AI capabilities have accelerated.”

The value of AI deals plummeted to $72.9bn in 2022, a dramatic drop from $127.2bn in 2021, according to research firm GlobalData.

Investment in AI had been on a mostly upward trajectory for the past decade. In 2013, AI deals totalled just $1.6bn.

Five years on in 2018, investment in AI had shot up to a whopping $83bn.

The US government regulates emerging AI tech with companies' help to reduce cybersecurity risks.

Title:

Content: A group of leading tech companies, including Meta and Alphabet, have made commitments to the US government that they will impose measures that make AI safer.

According to the Biden administration, seven companies leading the AI race have come together to promise future measures that will help the US government regulate the emerging tech.

The seven countries, Alphabet, Amazon, Anthropic, Inflection, Meta, Microsoft and OpenAI, said they will continue to share information on how to reduce risks to cybersecurity

As part of their pledge, the companies agreed to watermark AI-generated content – making it easier for users to spot deep fakes and generated text.

The companies have reportedly pledged to test the systems rigorously before releasing them to the public.

As well as this, the seven companies told the US government that they will focus on ensuring all generative AI is free of discrimination and bias, according to Reuters

These recent pledges have been celebrated as a win by the Biden administration, which like other countries, has been scrambling to regulate the technology.

Lawmakers around the world have been trying to find the best way to deal with the dangers of generative AI, while also making the most of its benefits.

In the UK, the government has pledged to fund £100m into an AI taskforce, which has been made up of experts throughout the industry and academia.

Ian Hogarth, the new leader of the taskforce, said: “The Prime Minister has laid out a bold vision for the UK to supercharge the field of AI safety, one that until now has been under-resourced even as AI capabilities have accelerated.”

The value of AI deals plummeted to $72.9bn in 2022, a dramatic drop from $127.2bn in 2021, according to research firm GlobalData.

Investment in AI had been on a mostly upward trajectory for the past decade. In 2013, AI deals totalled just $1.6bn.

Five years on in 2018, investment in AI had shot up to a whopping $83bn.

OpenAI CEO warns US Congress of unsafe AI rules as it seeks consensus on regulation.

Title:

Content: OpenAI CEO warns of unsafe AI rules
WASHINGTON (AFP) - As the U.S. Congress seeks consensus on regulating AI, OpenAI CEO Altman today went to Congress for the first time, calling for a task force to strengthen norms when lawmakers raised questions about AI ’ s impact on elections, jobs and excessive concentration on a small number of businesses.
Advertisement
OpenAI CEO Sam Altman attended a U.S. Senate Judiciary Committee hearing today, where lawmakers from both parties asked Altman questions about AI ’ s broad impact and regulatory measures.
Republican U.S. Senator Josh Hawley opened by noting that generative AI is one of the most important technological innovations in human history on a scale similar to the Internet, warning that “it could have serious consequences similar to an atomic bomb. ”
Altman said that the emergence of generative AI is like a “printing press moment ” that can improve and create jobs; he stressed that regulatory measures are critical to risk management, and said he was deeply concerned about the harm AI could do to the world and hoped to work with governments to prevent problems with new technologies.
Several members of Congress and experts expressed serious concerns that AI systems could affect elections, such as spreading misinformation or manipulating voters.
Senator Richard Blumenthal, a Democrat, played the AI-generated recording, saying that if the generated content supported the surrender of Ukraine or the leadership of Russian President Vladimir Putin, "it would be a terrible sight."
Altman said he is extremely worried about AI models generally manipulating, persuading, or creating false interactions.
In addition, members of Congress have raised concerns about the excessive concentration of AI technology in the hands of a small number of large companies, with Democratic Senator Cory Booker pointing to the cooperation between OpenAI and Microsoft, and saying that it is frightening that technology giants control people ’ s lives and have increasing influence.
Altman responded that it is true that only a few companies can provide generative AI models, but he believes that in such a situation, the government should focus on not many enterprises "may be beneficial to regulation", and he believes that there will be more competition in the future.
OpenAI launched the chatbot ChatGPT at the end of last year, two months of active users exceeded 100 million, the outside world to accelerate the control of AI voice, the recent, the US government and Congress on the legislative regulation of AI began to discuss, this is the first time Altman to congressional hearings, is regarded as an important step for bipartisan lawmakers to seek consensus on this topic.
At the hearing, Altman suggested that the U.S. government consider implementing three plans: establishing a new agency to approve AI models, establishing a set of safety guidelines to regulate AI models, and requiring independent experts and scholars to review AI models.
At the same time, he supported the establishment of an international organization to set standards for AI, citing the precedent of regulating nuclear weapons.

AI's impact on elections and jobs is a concern that requires regulatory measures.

What does Hinton warn "bad actors" could use AI for?

To win wars or manipulate the electorate.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

AI systems could spread misinformation and excessive concentration of the technology is a concern.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

The US and 16 countries have pledged to make AI safe by design, while 18 nations agreed to develop it safely.

Title:

Content: Science and Technology
US, 16 other countries pledge to make AI ‘ safe ’
Thank you for reading the news about technology: the United States and 16 other countries pledge to make artificial intelligence "safe" and now with the details
The United States, the United Kingdom and 16 other countries have signed an agreement pledging to take steps to make artificial intelligence “safe by design, ” according to 9to5mac.
The United States, Britain and more than a dozen other countries have unveiled what a senior US official called the first detailed international agreement on how to keep AI safe from “rogue ” outlaws, prompting companies to create AI systems that are“ safe by rogue ” actors.
In a 20-page document unveiled on Sunday, the 18 nations agreed that companies that design and use AI need to develop and deploy it in a way that keeps customers and the wider public safe from misuse.
Jane Easterly, director of CISA, said it was important for countries to recognize that the development of AI needs a safety first approach, and encouraged other countries to sign up.
“This is the first time we ’ ve seen confirmation that these capabilities shouldn ’ t just be limited to great features and how quickly we can bring them to market or how we can compete to cut costs, ” Easterly told Reuters, adding that the guidelines represent“ agreement that the most important thing to do at the design stage is security. ”
Other countries that have signed up so far are Germany, Italy, the Czech Republic, Estonia, Poland, Australia, Chile, Israel, Nigeria and Singapore.
Europe has taken the lead by trying to establish specific laws governing the development and launch of new AI systems – which include a legal obligation for companies to conduct regular security tests to identify potential vulnerabilities – but progress has been slow, prompting France, Germany and Italy to push ahead with an interim agreement of their own.
The White House has urged Congress to develop AI regulation in the United States, but little progress has been made so far: President Biden last month signed an executive order requiring AI companies to conduct safety tests, which are mostly aimed at protecting systems from hackers.
This 20-page agreement is incredibly basic, it ’ s more a statement of general principles than a blueprint, but given the challenges it faces, it ’ s likely to be at least a reasonable starting point, and states that research companies are obligated to specifically look for vulnerabilities.
You can follow the news of Egypt and the world from a site through Google News
Advertisements
You may also read.

The US and Europe are working to establish AI regulations, with Europe taking the lead.

President Biden ordered AI companies to conduct regular security tests.

Research companies must look for vulnerabilities, outlined in a 20-page AI safety agreement.

The international agreement aims for a safety-first AI development approach to prevent misuse.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

The Biden administration is preparing an executive order for AI safety.

Title:

Content: The Daily Ripple-News Music Ideas

Switch to desktop

Articles

Companies have pledged safe AI development, White House says

The Biden administration said it has received voluntary commitments from the world’s largest developers of artificial intelligence systems that the companies would pursue development in a safe and secure manner.

Google, Amazon, Inflection, Meta, Microsoft, Anthropic and OpenAI have committed to developing such technologies in a “safe, secure, and transparent” manner, a White House official told reporters Thursday on the condition of anonymity, while discussing a meeting taking place Friday between the top executives of the companies and administration officials.

The Biden administration is preparing an executive order “that will ensure the federal government is doing everything in its power to advance safe, secure, and trustworthy AI and manage its risks to individuals and society,” the official said.

The White House also is coordinating with efforts in Congress aimed at establishing a “legal and regulatory regime,” the official said.

Senate Majority Leader Charles E. Schumer has arranged a series of briefings for senators on artificial intelligence systems and has said he intends to draw up legislation to regulate AI systems in the next few months. On Friday, Schumer said he welcome the voluntary commitments, but added that harnessing the potential while tackling challenges posed by AI “requires legislation to build and expand on the actions” by the White House.

Sen. Mark Warner, D-Va., chair of the Senate Intelligence Committee also said “some degree of regulation” was needed to ensures that AI companies “prioritize security, combat bias, and responsibly roll out new technologies.” In April Warner wrote to CEOs of major tech companies asking them to prioritize security in design and development of technologies.

The White House official said the companies have committed to making sure their products and technologies are safe before they’re publicly launched, building systems with security as a priority, and ensuring that consumers and users know which content is generated by AI and publicly reporting on inappropriate uses of the technology.

Some companies including OpenAI already have said they use so-called red teams, which pretend to emulate nefarious actors’ actions, to test for weakness in the ChatGPT-4 model. The voluntary commitments are intended to ensure that all companies adopt similar practices, as well as “pushing the envelope” safety, security, and transparency measures, the official said.

One of the measures that would advance the goal of safety and trust is an effort by companies to develop a watermarking system, the official said. Tech companies have committed to developing a system that would label audio and video content developed by artificial intelligence tools to distinguish them from those generated by humans, the official said.

Brad Smith, vice chairman and president of Microsoft, wrote in a blog post on Friday that the company would go beyond those commitments by collaborating with the National Science Foundation to explore the creation of a national AI research resource that would facilitate independent research by academics on AI safety. The company also would back the creation of a national registry of high-risk AI systems, Smith wrote.

Companies also have committed to sharing information with each other and with academic researchers, government agencies, and civil society groups on best practices, and information on managing risks, according to a White House fact sheet

The fact sheet also said the companies have committed to allowing third-party researchers to find and report vulnerabilities in the AI systems.

The post Companies have pledged safe AI development, White House says appeared first on Roll Call.

Read more https://www.rollcall.com/2023/07/21/companies-have-pledged-safe-ai-development-white-house-says/

News aggregator updating headlines throughout the day to top news & Links to international news, social commentary and columnists creating a better world. External links are provided for reference purposes. The Daily Ripple is not responsible for the content of external Internet sites. tlr workshop 2015

Top Desktop version

Congress aims to regulate AI, with companies committing to transparency and security.

The Senate Majority Leader plans AI legislation, including labeling AI-generated content.

Companies share best practices and allow third-party vulnerability reporting.

Microsoft and the White House work with the National Science Foundation and Congress on AI safety and regulation.

AI funding should prioritize safety and ethics, but broad-based regulations on AI safety are lacking.

Title:

Content: Governments, firms should spend more on AI safety, top researchers say

By

'At least one third of their AI research and development funding'.

Artificial intelligence companies and governments should allocate at least one third of their AI research and development funding to ensuring the safety and ethical use of the systems, top AI researchers said in a paper.

The paper, issued a week before the international AI Safety Summit in London, lists measures that governments and companies should take to address AI risks.

"Governments should also mandate that companies are legally liable for harms from their frontier AI systems that can be reasonably foreseen and prevented," according to the paper written by three Turing Award winners, a Nobel laureate, and more than a dozen top AI academics.

Currently there are no broad-based regulations focusing on AI safety, and the first set of legislation by the European Union is yet to become law as lawmakers are yet to agree on several issues.

"Recent state of the art AI models are too powerful, and too significant, to let them develop without democratic oversight," said Yoshua Bengio, one of the three people known as the godfather of AI.

"It (investments in AI safety) needs to happen fast, because AI is progressing much faster than the precautions taken," he said.

Authors include Geoffrey Hinton, Andrew Yao, Daniel Kahneman, Dawn Song and Yuval Noah Harari.

Since the launch of OpenAI's generative AI models, top academics and prominent CEOs such as Elon Musk have warned about the risks on AI, including calling for a six-month pause in developing powerful AI systems.

Some companies have countered this, saying they will face high compliance costs and disproportionate liability risks.

"Companies will complain that it's too hard to satisfy regulations - that 'regulation stifles innovation' - that's ridiculous," said British computer scientist Stuart Russell.

"There are more regulations on sandwich shops than there are on AI companies."

Got a news tip for our journalists? Share it with us anonymously here.
Tags:

Most Read Articles

Services Australia's digital credential sharing with NSW on ice

CBA to test products and messaging on AI-created 'customers'

Australian Federal Police officers using more online face search tools

ANZ targets 3000 engineers to use GitHub Copilot

Log In

  |  Forgot your password?

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

The EU's first AI safety law is pending, holding companies liable for AI-related harms.

Top researchers call for increased investment in AI safety due to the power of recent AI models.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

AI progress is outpacing precautions, with some companies opposing regulations due to costs.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Regulation does not stifle innovation, with more rules applying to sandwich shops than AI companies.

The US President has ordered companies to share AI safety test results with the government.

Title:

Content: US issues order regulating development of AI

US President Joe Biden has issued an order regulating the development of Artificial Intelligence (AI) and ensuring AI safety, security, and trust. The order requires companies like Google, Amazon, and Microsoft to share safety test results with the government for AI models that pose potential risks. Stronger standards for AI will be developed, including metrics for safety testing, guidelines for watermarking AI-generated content, and ethical principles for AI use in intelligence-gathering. The administration also aims to protect privacy, prevent discrimination, and establish international frameworks for AI. These actions are part of an aggressive strategy to harness AI benefits and mitigate risks.
NEW DELHI: After being warned that Artificial Intelligence (AI) can be harmful to humanity, US President Joe Biden issued an order on Monday regulating the development of AI.
In a statement, the White House deputy chief of staff Bruce Reed said, “President Biden is rolling out the strongest set of actions any government in the world has ever taken on AI safety, security, and trust.”
He further stated that this is the next step in an "aggressive strategy" to do everything on all fronts to harness the benefits of AI and mitigate the risks.

It is pertinent to note that Google, Amazon, and Microsoft-backed AI will now be required to share safety test results with the government whenever they train an AI model that poses a potential “serious risk to national security, national economic security, or national public health and safety.”
Stronger standards for AI
Under this new strategy, new stronger standards will be developed for the AI. After the AI experts expressed feats that the technology could be used to help engineer bioweapons, Biden planned to roll out stronger standards.
Biden is tasking the National Institute of Standards and Technology to craft metrics for so-called “red-testing” to ensure safety in the programs. He is also asking the commerce department to set up guidelines for watermarking AI-generated content.

Additionally, the president is tapping the National Security Council to iron out ethical AI principles for the use of the technology in intelligence-gathering operations.
To protect privacy
As AI is dangerous and after seeing various crimes using this intelligence, Biden is calling for the federal government to help finance research into technologies like cryptographic tools that can protect against eavesdropping.
The administration is also planning to study how companies extract commercially available information and encourage the use of AI training modules that are designed to protect privacy.
The Department of Justice and federal civil rights offices will also be required to compile best practices on how to prevent the technology from being used to amplify discrimination.
Approaches international agencies
Looming over the new concerns that bolstered AI regulations could stifle US development of the critical technology and cede ground to geopolitical rivals such as China.
To address this, Biden is making the State and Commerce departments push for international frameworks on the new technology.
The administration will also work to streamline visas to entice highly skilled workers and developers into the US.
Additionally, the administration will build up the National AI Research Resource, which will help give AI developers access to an array of resources to further their research projects in a bid to buoy innovation.
The announcement of Biden’s executive order is the first in a series of AI-related events and initiatives planned for this week.
FOLLOW US ON SOCIAL MEDIA

AI standards for safety and watermarking guidelines will be developed.

The administration aims to protect privacy and prevent discrimination through international AI frameworks.

The government will build the National AI Research Resource and fund privacy-protecting technology research.

The Department of Justice will compile best practices to prevent AI discrimination.

US lacks legislative action on AI regulation amid varying global efforts.

Title:

Content: Americas

  • United States

Asia

Oceania

Senior writer

Report: World governments must act to create generative AI safeguards

News
Jan 19, 20243 mins
Generative AIRegulation

Global regulatory efforts focused on generative AI have taken a wide range of approaches, but more guidance needed on permissible uses of the technology.

Credit: Shutterstock / Yurchanka Siarhei

Generative AI’s fast-flowering utility in the cybersecurity field means that governments must take steps to regulate the technology as its use by malicious actors becomes increasingly common, according to a report issued this week by the Aspen Institute. The report called generative AI a “technological marvel,” but one that is reaching the broader public in a time when cyberattacks are sharply on the rise, both in frequency and severity. It’s incumbent on regulators and industry groups, the authors said, to ensure that the benefits of generative AI don’t wind up outweighed by its potential for misuse.

“The actions that governments, companies, and organizations take today will lay the foundation that determines who benefits more from this emerging capability – attackers or defenders,” the report said.

Global response to generative AI security varies

The regulatory approach taken by large nations like the US, UK and Japan have differed, as have those taken by the United Nations and European Union. The UN’s focus has been on security, accountability, and transparency, according to the Aspen Institute, via various subgroups like UNESCO, an Inter-Agency Working Group on AI, and a high-level advisory body under the Secretary General. The European Union has been particularly aggressive in its efforts to protect privacy and address security threats posed by generative AI, with the AI Act – agreed in December 2023 – containing numerous provisions for transparency, data protection and rules for model training data.

Legislative inaction in the US has not stopped the Biden Administration from issuing an executive order on AI, which provides “guidance and benchmarks for evaluating AI capabilities,” with a particular emphasis on AI functionality that could cause harm. The US Cybersecurity and Infrastructure Security Agency (CISA) has also issued non-binding guidance, in conjunction with UK regulators, the authors said.

Japan, by contrast, is one example of a more hands-off approach to AI regulation from a cybersecurity perspective, focusing more on disclosure channels and developer feedback loops than strict rules or risk assessments, the Aspen Institute said.

Time running out for governments to act on generative AI regulation

Time, the report also noted, is of the essence. Security breaches by generative AI create an erosive effect on the public trust, and that AI gains new capabilities that could be used for nefarious ends practically by the day. “As that trust erodes, we will miss the opportunity to have proactive conversations about the permissible uses of genAI in threat detection and examine the ethical dilemmas surrounding autonomous cyber defenses as the market charges forward,” the report said.

The EU and UN are working on AI regulations focusing on transparency, security, and accountability.

Japan takes a hands-off approach to AI regulation, and governments must regulate AI to prevent misuse.

Time is running out for governments to regulate AI, which can be used for both cybersecurity and malicious activities.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did the global summit report highlight about AI?

Creating malicious software for cyberattacks, potentially posing an existential threat if humans lose control.

AI regulation requires guidance on permissible uses and responsible development.

The UK government has announced AI safety commitments from 16 companies, including OpenAI, Google DeepMind, and Anthropic.

Title:

Content: New security commitments...
This is what the leading companies in artificial intelligence have promised.
Science and Technology
2024-05-21 | 16: 00
High Views
SHARE
SHARE
2min
New security commitments...
This is what the leading companies in artificial intelligence have promised.
New security commitments...
This is what the leading companies in artificial intelligence have promised.
The UK government has announced that 16 of the world ’ s leading AI companies are making new commitments to ensure the safe development of the science.
British Prime Minister Rishi Sonak said in a statement issued by the British Institute for Science, Innovation and Technology: “These commitments ensure that the world ’ s leading AI companies are committed to transparency and accountability about their plans to develop safe AI. ”
The agreement, signed in particular by OpenAI, Google DeepMind and Anthropic, builds on the consensus reached at the first global “summit ” on AI security last year at Bletchley Park in the UK.
Seoul will host the second edition of the summit in partnership with the South Korean and British governments.
AI companies, which have not yet announced how they will assess the security of the systems they develop, are obliged to identify the risks that "cannot be overlooked" and the steps they will follow to ensure these ceilings are not exceeded, according to the statement.
These ceilings will be set ahead of the next AI “summit ” to be held in France in 2025.
Among the companies adhering to these security rules are US tech giants Microsoft, Amazon, IBM, Meta, French artificial intelligence company Mistral, and Chinese company Zhipu.ai.
The Seoul summit will be held on Tuesday over two days, partly via videoconference, AFP reported.
In addition to addressing the security aspect of AI systems, participants will examine ways in which governments can foster innovation and expand AI research at universities.
LATEST NEWS
Science and Technology
A wish.
New...
I promised.
CORPORATE
Pioneer
Clever.
Artificial
Man takes part in a minute-long space flight: "breathtaking view" (Video)
The former
Download LBCI Mobile App
For the latest news, the latest daily programs in Lebanon and the world
Google Play
App Store
We use
cookies
We use cookies to make
Your experience on this
website better.
Accept
Learn More

Companies must identify and mitigate AI security risks before the 2025 France AI summit.

The summit will discuss AI innovation, research, and expansion at universities.

AI regulation lacks global consensus, requiring flexible government policies.

Title:

Content: Named the danger of a lack of global consensus on AI
RIA Novosti: AI regulation faces a lack of global consensus
The regulation of artificial intelligence (AI) faces the problem of a lack of flexible government policies, as well as a lack of consensus to quickly respond to technological changes.
This writes RIA Novosti with reference to experts.
Rosario Hirasa, a professor at the Lyubin School of Business at Pace University, said the Future Life Institute warns against the unchecked development of AI, which can lead to the spread of false ideas, significant job replacements and even equality or superiority over the capabilities of the human mind.
Governments should introduce safety protocols to prevent uncontrollable consequences, the institute urges.
According to Daniel Lynna, director of legal and technological initiatives at Northwest Pritzker Law School, authorities and regulators should cover not only the risks associated with AI, but also the benefits.
Professor and researcher at the University of Edinburgh Vasilis Galanos also noted that many poorly regulated systems, considered less dangerous, can do a lot of harm.
States and international organizations should prioritize the development of a regulatory framework that ensures ethical standards, he added.
Earlier, British scientists urged users not to share personal data with chatbots.
Oxford University computer science professor Michael Wooldridge said chatbots like ChatGPT are "very specific."
In this case, the machine can use the personal data of users in the future, responding to the requests of others.
The good tape is deactivated.
Welcome to the real world.

Unchecked AI development can lead to job replacements, and authorities should cover AI risks and benefits.

Title:

Content: Named the danger of a lack of global consensus on AI
RIA Novosti: AI regulation faces a lack of global consensus
The regulation of artificial intelligence (AI) faces the problem of a lack of flexible government policies, as well as a lack of consensus to quickly respond to technological changes.
This writes RIA Novosti with reference to experts.
Rosario Hirasa, a professor at the Lyubin School of Business at Pace University, said the Future Life Institute warns against the unchecked development of AI, which can lead to the spread of false ideas, significant job replacements and even equality or superiority over the capabilities of the human mind.
Governments should introduce safety protocols to prevent uncontrollable consequences, the institute urges.
According to Daniel Lynna, director of legal and technological initiatives at Northwest Pritzker Law School, authorities and regulators should cover not only the risks associated with AI, but also the benefits.
Professor and researcher at the University of Edinburgh Vasilis Galanos also noted that many poorly regulated systems, considered less dangerous, can do a lot of harm.
States and international organizations should prioritize the development of a regulatory framework that ensures ethical standards, he added.
Earlier, British scientists urged users not to share personal data with chatbots.
Oxford University computer science professor Michael Wooldridge said chatbots like ChatGPT are "very specific."
In this case, the machine can use the personal data of users in the future, responding to the requests of others.
The good tape is deactivated.
Welcome to the real world.

What risks did Hinton associate with AI's rapid advancement?

Poor

Poor