Geoffrey Hinton, often called the "godfather of artificial intelligence," has been a pivotal figure in the development of modern AI.

His groundbreaking work in the 1980s on neural networks, specifically the algorithm known as backpropagation, enabled machines to learn from data, forming the foundation for today’s powerful AI systems like ChatGPT and Google Bard.

His contributions helped establish deep learning as a dominant approach in AI research and application.

For this transformative work, Hinton received the prestigious Turing Award in 2018, often regarded as the Nobel Prize in computing .

In 2023, Hinton resigned from his role at Google to express his growing concerns about the rapid advancement of AI technologies.

He warned that AI models, such as GPT-4, are developing intelligence faster than expected, posing risks that society may not be prepared for.

His key worries include AI’s potential to manipulate human behavior, cause widespread unemployment by replacing jobs, facilitate misinformation campaigns, interfere with democratic processes, and be misused in autonomous weapons systems.

Hinton’s resignation was driven by a desire to speak openly about these dangers without harming Google’s public image .

The AI community has responded to Hinton’s warnings with a mix of support and caution.

Some experts, like OpenAI’s Sam Altman, recognize the risks while stressing the importance of safety research and emergency “kill switches” to control AI behavior.

Others, including Microsoft’s Eric Horvitz, suggest accelerating AI development but with strong governance to manage risks.

High-profile tech leaders like Elon Musk and Steve Wozniak have also advocated for temporary pauses in AI progress to ensure these systems can be safely managed.

These discussions have influenced governments in the US, UK, and EU to consider regulations focused on ethical AI development and public safety .

AI’s automation potential could displace many jobs, creating economic and social challenges.

Geoffrey Hinton, often called the "godfather of artificial intelligence," has been a pivotal figure in the development of modern AI.

Title:

Content: Wednesday, December 13, 2023
Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors

John Riopelle — obituary

Riopelle, John William It is with great sadness...

A.I. doesn’t bleed

by John Clinton, Ramsay New knowledge merges with...

Breakfast at the Legion, December 16

At the Almonte Legion Sat. December 16 Eggs to...
Science & NatureA.I. doesn't bleed

A.I. doesn’t bleed

by John Clinton, Ramsay

New knowledge merges with old; what you know shapes what you learn. Artificial neural networks have been studied and computer algorithms have been generated to understand how artificial, computer-generated, neurons, would store a concept, and how it would revise that concept if it was flawed.

Geoffrey Hinton, a computer scientist often called ‘the godfather of AI,’ is a leading figure in neural networks; studies inspired by the way neurons are connected in the human brain. A New Yorker magazine piece describes his collaborative work in the 1960s and 1970s developing neural nets that couldn’t do anything better than a child. The technology suddenly improved about a decade ago with the large increase in processing speed and Internet data availability.

According to Google Scholar, Hinton is the second most cited researcher among psychologists and the most cited among computer and cognitive scientists.

Hinton has been worried about the potential of AI to do harm and he often talks about the existential threat that AI might pose to the human species. He has used OpenAI’s ChatGPT and this has made him uneasy. He wrote “Fox News is an oxymoron” asking ChatGPT to explain the joke. (Initial reading of this caused me to ponder – a moron full of oxygen??) The first reply told him that this implied Fox News was fake news. When he called attention to the space between oxy and moron, it explained that Fox News was addictive, like the drug OxyContin. To him, this level of understanding represents a new era in AI.

In nature, wildlife learns how to be intelligent without access to concepts expressed in words. They learn to be smart (survive) through experience. Learning, not knowledge, is the engine of intelligence. There is no use trying to explain complicated ideas that you do not understand. First, you must understand how something works. Otherwise, you just produce nonsense.

Because neural networks are so strange, no one can predict how useful – or dangerous – AI will become. OpenAI’s GPT models involve billions of artificial neurons (data) which are profoundly different than biological brains. They are not alive. Our intuitions tell us that nothing resident in a browser tab could really be thinking in the way we do.

Because a human brain can run on oatmeal, the world can support billions of brains, all different. Each brain can learn continuously, rather than being trained once, then pushed out into the world (ship it!).

If the brain dies, the knowledge dies. If a computer dies, load up another computer. Ten thousand neural nets can learn ten thousand different things at the same time and share what they have learned. This immortality (knowledge perpetuity) and replicability suggest we should be concerned about digital intelligence taking over from biological intelligence.

Current AI technology is talkative and intellectual. The problems of physical intuition will be the challenge of the next decade says Yann LeCun, a French computer scientist. A teenager can learn to drive a car in twenty hours of practice with little supervision. AI systems don’t come close to doing this – except self-driving cars – and they are over-engineered, requiring the mapping of whole cities, hundreds of engineers, and hundreds of thousands of hours of training.

And then there is the problem of what some researchers call AI ‘hallucination’, which Hinton names ‘confabulation.’ AI systems confabulate by making up plausible answers to questions that stump them. In the human mind, there is no boundary between just making it up and telling the truth. Telling the truth is just making it up correctly. ChatGPT’s ability to make things up is a flaw, but also a sign of its humanlike intelligence.

When Hinton began his research, no one thought the technology would succeed. When it started to succeed, no one thought it would succeed so quickly. He expects AI will contribute to many fields, but he fears what will happen when powerful people abuse it. Think autonomous weapons. Hinton warns that even benign autonomous systems could wreak havoc. Yann LeCun has said there is an idea that if a system is intelligent it is going to want to dominate. But the desire to dominate has nothing to do with intelligence – it has to do with testosterone.

Recently, Hinton did not sign a popular petition that called for at least a six-month pause in AI research.

“China is not going to stop development for six months.”

“So what should we do?”

“I don’t know. If this were like climate change where we either must stop burning carbon or find a way to remove carbon from the atmosphere, we know what the solution looks like. Here, with AI, it’s not like that.”

Think of the AI story in which our intuitions about the specialness of the human mind are being dislodged by thinking machines, or, having stolen fire, we risk being burned.

Are we fooling ourselves, being taken in by our own machines and the companies that hope to profit from them? By seeking to re-create the knowledge systems in our heads, have we seized the forbidden apple? Have we risked exile from our charmed world? But who would choose not to know how knowing works?

Related

FOLLOW US

Latest

From the Archives

His groundbreaking work in the 1980s on neural networks, specifically the algorithm known as backpropagation, enabled machines to learn from data, forming the foundation for today’s powerful AI systems like ChatGPT and Google Bard.

Title:

Content: AI ’ s “godfather ” interviewed by the BBC, warning that artificial intelligence may be smarter than humans
AI ’ s “godfather ” interviewed by the BBC, warning that artificial intelligence may be smarter than humans
Geoffrey Hinton, known as the “godfather ” of artificial intelligence (AI), has resigned from Google.
He warned that developments in the field of artificial intelligence pose increasing dangers.
In a statement to The New York Times, Dr. Hinton said he regretted his current job.
Dr. Hinton ’ s pioneering research in neural networks and deep learning paves the way for current AI systems such as Google ’ s Bard chatbot and Microsoft ’ s ChatGPT.
The cognitive psychologist and computer scientist told the BBC that chatbots may soon be smarter than humans.

What breakthroughs has Hinton achieved through his 40+ years of work on artificial neural networks?

Breakthroughs that mimic biological brains

Which 1986 paper by Hinton became foundational for modern neural networks?

Which AI system demonstrates the foundation laid by Hinton's pioneering research in deep learning and neural networks?

His contributions helped establish deep learning as a dominant approach in AI research and application.

Title:

Content: The field of generative AI has hardly escaped controversy in recent months. Since the release of ChatGPT, the use of generative AI tools has surged worldwide in recent months, with critics raising concerns about the technology, including possible bias, privacy violations, resulting in increased risk of misinformation or fraud.
At the end of March this year, the non-profit organization Future of Life Research published an open letter in late March, saying that the AI lab was “locked in a runaway development and deployment race ” without adequate security protocols, calling for a six-month moratorium on the development of AI systems that are more powerful than OpenAI ’ s GPT-4 launched earlier that month.
The letter was backed by industry insiders and executives such as Musk and Apple co-founder Wozniak.
Recently, Geoffrey Hinton, known as the “godfather of AI ”, left Google and said he was very upset about the speed and direction of AI expansion.
The Godfather ran behind.
As progress in the field of generative AI accelerates, employees at Google and other tech giants have heated discussions internally and externally about the technology that is reshaping their industry.
Google is particularly under pressure because the popularity of ChatGPT has raised concerns that Google may be losing its edge in AI.
Google has long been a leader in this area.
During a recent earnings call, Google CEO Sundar Pichai said that “our investments and breakthroughs in AI over the past decade have put us in a good position, ” noting the company ’ s progress in developing models and working with developers and other partners.
Hinton joined Google a decade ago to help the company develop its AI technology.
As a cognitive psychologist and computer scientist, his pioneering research in deep learning and neural networks has laid the groundwork for current AI systems such as ChatGPT.
In interviews with The New York Times and CNN, Hinton admitted that he left Google in order to be completely free to speak out about the dangers of artificial intelligence, and even said that he regretted his contributions to the field of artificial intelligence.
Hinton said that artificial intelligence will not only cause a large number of jobs to disappear, but also cause people to have no way to know what is real. On the 2nd, he said on CNN program, if artificial intelligence becomes much smarter than humans, it will manipulate humans; artificial intelligence knows how to program, and will find ways to circumvent human restrictions on its settings.
Apple co-founder Steve Wozniak also appeared on CNN to voice his concerns about artificial intelligence spreading disinformation.
"If someone wants to cheat you, using AI technology, it will be much easier to cheat," Wozniak said. "Maybe some kind of regulation" is needed to regulate AI technology.
Pichai has called for regulation of AI in the past, warning that the technology could be “very harmful ” if not deployed in a deliberate way.
When the Big Game goes on.
Microsoft has launched a new Bing search based on OpenAI ’ s GPT-4, and Google released its Bard chatbot that competes with ChatGPT in March.
Recently, in response to Musk and other thousands of people calling for the suspension of advanced artificial intelligence development, Microsoft Chief Scientific Officer Eric Horvitz (Eric Horvitz) gave the opposite view.
He believes that what AI really needs is an acceleration of input, not a pause.
In an interview, Horwitz said that although he respects the people who signed the open letter and understands that people may have concerns about AI, he believes that “acceleration ” is actually necessary, not a pause.“ I really respect the people who signed the open letter, ” he said, “I think people are reasonable to worry … For me, I would like to see more knowledge, or even accelerate R & D, rather than a six-month pause. ”
I'm not sure the suspension is feasible.
In a way, this is a very vague request. "
He continued: “In a broader sense, a six-month suspension makes little sense.
We really need to invest more in understanding, guiding and even regulating the technology, to get involved, not to pause, "he said.
Previously, OpenAI CEO Sam Altman has responded to a joint open letter signed by Musk and other big players.
At a recent event at MIT, he said, “I very much agree with some of the main points of the letter, but there is a lack of technical detail on where the pause is needed. ”
Altman stressed that OpenAI spent six months researching the security of GPT-4, undergoing external audits and internal security testing before it was made public.
Musk, who took the lead in signing the open letter, secretly made a big model.
According to the Wall Street Journal, Musk has set up an artificial intelligence company called X.AI in Nevada, aiming to compete with Open AI, the development company of the chatbot ChatGPT.
Earlier, Musk also launched an artificial intelligence project inside Twitter, and made a big purchase of 10,000 NVIDIA A100 GPUs for one of Twitter ’ s two data centers.
In addition to the high investment, in order to help the research and development of artificial intelligence projects, Musk has also dug LLM experts from Google's AI department, DeepMind, which has successfully dug up about six.
After the launch of ChatGPT, Google had to turn on defense mode.
As one of the leaders in AI, the company has long argued that transparency in research results will incentivize outside researchers to advance areas related to Google ’ s core products.
But now, competitors are using the research to launch products that pose a threat to Google ’ s core business.
In February, longtime Google AI chief Jeff Dean announced a surprising policy shift to employees: they would delay sharing their research with the outside world.
To accelerate progress in AI, Google has also merged Google Brain and DeepMind, formerly independent AI research labs, into a new division called Google DeepMind.
The new division will be headed not by Dean, but by DeepMind ’ s CEO Demis Hassabis.
The "tug of war" between the government and the giants or officially launched
Since the launch of ChatGPT, the use of generative AI tools has soared, and as a result has come under increasing scrutiny.
Policymakers are pressuring companies to implement protective measures against this emerging technology.
Last week, the G7 Digital and Technology Ministers agreed to adopt “risk-based ” regulation of AI.
EU lawmakers have also reached a preliminary agreement on an artificial intelligence bill.
The UK Competition and Markets Authority (CMA) will also launch a review of the AI market.
On May 4, local time, White House officials said that the U.S. government plans to introduce policies to regulate the way federal agencies purchase and use artificial intelligence systems, and the White House Office of Management and Budget is expected to issue guidance in the coming months.
The move could have a significant impact on the market for AI products and limit the way Americans interact with AI on government websites, security checkpoints and other occasions.
Hours after announcing the move, U.S. Vice President Kamala Harris and other government officials met with the CEOs of Google, Microsoft, OpenAI and startup Anthropic.
Chaired by Harris and other officials, the White House conveyed concerns about the technology to tech executives at the meeting, and discussed with these industry leaders the regulatory issues surrounding AI.
As we all know, Microsoft has invested tens of billions of dollars in OpenAI and has integrated ChatGPT into Bing Search.
For Microsoft, ChatGPT is critical to its ability to challenge the hegemony of Google search and artificial intelligence research.
Microsoft chief economist Michael Schwarz said Wednesday that it would be dangerous for artificial intelligence to fall into the hands of unscrupulous people.
Speaking at a panel of the World Economic Forum in Geneva, Schwartz said: “I believe AI will be used by bad actors and will cause real damage … AI will have a lot of negative effects in terms of spammers and elections, for example. ”
AI “clearly ” needs to be regulated, he said, but lawmakers should be cautious and wait until the technology causes“ real harm ” before taking action.
Schwartz believes that regulation should be consistent with the principle that the benefits of regulation to our society should outweigh the costs.
He warned policymakers should be careful not to directly regulate AI training data.
"It would be quite catastrophic," he said. "If we had to make these decisions about the training set, we would have to wish us luck."

For this transformative work, Hinton received the prestigious Turing Award in 2018, often regarded as the Nobel Prize in computing .

Title:

Content: • |
• Fast Quote
• |
• Member
• Product Services / Streaming
• Settings
12 / 05 / 2023
The White House ordered AI to be evaluated, and the European Union proposed legislation to regulate AI, teach AI to be human or the best solution!
• Add Favorite Column
• Collection of articles
• Fang Zhanqi
Fang Zhanze
When I was a teenager, I studied Geographic Information System, but unfortunately I didn ’ t learn anything and I graduated with luck.
After adulthood, the accidental hit into the media circle, first and then in the print, electronic, online media to roll, slightly small.
After middle age, he completed a master ’ s degree in information technology and gradually expanded his horizons. He was determined to join a start-up company and explore different fields of technology.
In recent years, he has been actively engaged in data analysis and digital strategies, and has also been involved in the development of Location Intelligence projects. Sometimes, he can also take time to teach, not only to share what he has learned with others, but also to motivate himself to keep learning for life.
Tales of Wisdom City
Generative AI is definitely the hottest topic in the technology world today. After the popularity of ChatGPT, many companies rushed to launch similar products and gradually applied them to various industries.
But more and more people are worried that when AI is fully popularized, it will aggravate the problem of fake information flow, online fraud and other problems; even Sheffield Hinton, who is known as the "godfather of AI", is worried that AI will become too smart, afraid that it will evolve into a killer robot, which may eventually lead to the death of mankind!
How big can the negative impact of AI technology be?
How do governments around the world respond to the potential threat of AI?
Neural network is the foundation technology of ChatGPT
Fifty-one years ago, Geoffrey Hinton, who had not yet been called the “godfather of AI, ” entered the University of Edinburgh in Scotland as a graduate student and began research on artificial neural networks.
The so-called “artificial neural network ” is a mathematical model that mimics the structure and function of biological neural networks, especially the brain, and is able to learn skills by analyzing data.
This is the foundational technology behind OpenAI ChatGPT and Google Bard.
After Hinton resigned from Google, he did not have to worry about the harm his words would bring to Google, so he was interviewed by different media and said his heart: "AI may lead to the death of mankind." (Photo: University of Toronto official website)
In 2012, Hinton and his students, Ilya Sutskever and Alex Krishevsky, created a neural network system that analyzes thousands of photos and learns to recognize common things like flowers, dogs, cars, etc.
Subsequently, Hinton and two students founded DNNresearch, a startup based on this research project.
In 2013, Google acquired DNNresearch for US $44 million (approximately HK $343 million), and Hinton joined Google as Vice President and Engineering Researcher, responsible for some of the research work on Google Brain.
His protégé, Suzkville, left Google to co-found OpenAI with like-minded people, and became chief scientist, leading the research team to successfully develop the GPT model and ChatGPT.
Hinton ’ s top student, Suzkville, gave up his lucrative job at Google in 2015 to co-found OpenAI with Altman and others, and led the development of GPT and DALL-E models. (Image: University of Toronto website)
I regret working my whole life because I am worried about the dangers of AI.
In 2018, Hinton, along with University of Montreal professor Yoshua Bengio and Meta chief AI scientist Yann LeCun, won the A.M. Turing Award in recognition of their great contributions to neural networks and deep learning.
As a result, the three later became known as the “godfathers of AI ” or“ godfathers of deep learning. ”
Around the same time, Google and OpenAI began to build large-scale deep learning systems based on neural networks, which became the basis for future development of Bard and ChatGPT.
From this, it seems that Sinton plays an important role in creating the current glory of generative AI.
However, in the current era of AI, Sinton suddenly left Google in April 2023, shocking the entire AI industry.
Hinton explained that he left Google to talk freely about the potential risks of AI without harming Google.
Speaking about 50 years of research into neural networks, he said, “I ’ m very sorry about my life ’ s work. ”
The Internet will be filled with more and more fake AI-generated text, photos, and even videos, but the average person will not be able to tell the truth, Hinton said.
Moreover, sooner or later, AI technology will completely disrupt the job market, causing more and more jobs to disappear.
What is even more worrying is that at present, users can not only instruct ChatGPT to generate code, but also ask the AI to execute the code; in this way, the AI killer robots that often appear in science fiction movies will one day become a reality.
Is it not impossible for AI to destroy humanity?
Of course, this pessimistic future scenario is only a hypothetical one, but Hinton stressed that what could lead to it is already happening: a global race for AI technology has begun between Microsoft and Google, and even between China and the United States.
Most people think that the future of AI dominating everything is still far away, but he believes that AI may not take 30 to 50 years to control humans, and even find a way to kill humans, which may eventually lead to human extinction.
In the 1980s, Hinton was a professor of computer science at Carnegie Mellon University in the United States, but because he was not satisfied that the university's AI research was sponsored by the United States Department of Defense, he decided to leave the United States to teach at the University of Toronto's School of Computer Science.
He pointed out that without some kind of global regulatory agreement or regulatory mechanism, the AI arms race will intensify.
For this reason, Hinton believes that the threat posed by AI to humans may be more urgent than climate change, because the solution to climate change is obvious, as long as carbon emissions are reduced or carbon neutrality is achieved, but the current AI crisis does not know how to start. Although AI may pose an existential threat to humans, he does not agree to suspend AI research, because it can never erase the benefits and application value of AI.
Hinton believes it would be better to step up regulation of AI and make everyone aware of its potential harms.
OpenAI co-founder and CEO Sam Altman also acknowledged that ChatGPT has developed some reasoning capabilities that they can ’ t explain, and that it ’ s not entirely impossible for AI to destroy humans.
However, he said that he has installed a kill switch for ChatGPT, and if the development of ChatGPT exceeds human expectations, he will immediately press the switch to stop working.
OpenAI CEO Altman, known as the “father of ChatGPT, ” recently said he was“ a little scared ” about the potential of his children, and even admitted that there is a real possibility that AI will destroy humanity. (Image: Wikipedia)
Altman admits that ChatGPT ’ s influence in elections and the spread of disinformation is a concern, so the 2024 U.S. presidential election will be a focus for OpenAI.
(Image source: Pexels Gallery website)
The Curtain of Ignorance Makes AI Right Values
However, before we press the switch, we can try to instill the right values in AI, such as helping those most in need, not destroying humans. Google ’ s DeepMind paper published in April 2023 in the Proceedings of the National Academy of Sciences suggests that AI can be taught from the perspective of political philosopher John Rawls.
Rawls has proposed a concept called “The Veil of Ignorance ”, which aims to achieve the most equitable distribution of benefits when group decisions are made.
According to his book, The Debate, if a group of people stand behind a curtain, all of them will instantly lose their memory, become ignorant, and forget their identity and status in the real world.
The political philosopher Ross assumes that people are behind the “curtain of ignorance ” (left) and have no idea of their skills, identities, and status.
In this scenario, people tend to choose the most equitable distribution of rights for all. (Image: Wikipedia)
At this time, these people are asked to vote for a working principle for the society.
Because they do not know where they are in this society, they cannot make decisions in an egoistic way, and they can only judge according to the principle of fairness to all people.
The situation is like, at the birthday party, you are responsible for cutting the cake, because you do not know which piece you will get, so you will try to cut each piece to the same size.
Under the curtain of ignorance, fairness and justice that has nothing to do with personal interests will emerge.
For this reason, DeepMind believes that applying the “curtain of ignorance ” to AI training may help promote fairness in the process of“ aligning ” AI with human values.
By “alignment ”, it means aligning AI ’ s wishes with those of humanity.
If AI shares fair values with humans, AI will not have the intention to destroy humanity.
White House convenes tech giants to discuss AI threats
However, even if AI does not intend to destroy humans, it may still have many negative effects on human society.
The Center for Artificial Intelligence and Digital Policy (CAIDP), a U.S. technology ethics organization, has complained to the Federal Trade Commission (FTC) that OpenAI ’ s latest large language model, GPT-4, is biased and deceptive and poses a risk to privacy and public safety.
The CAIDP lists potential threats that may arise from GPT-4, including: helping hackers churn out malicious code to exacerbate cyberattacks; and biased AI training data that may reinforce social stereotypes and make people of all races and genders vulnerable to unfair treatment. The FTC is investigating OpenAI, said FTC Chairman Lina Khan. "They cannot be separated from existing legislation and the Federal Trade Commission will actively enforce them," he said.
In an effort to make GPT-4 more secure, OpenAI hired 50 experts and academics to test GPT-4 against lies, language manipulation, and dangerous scientific common sense.
The OpenAI headquarters is pictured here. (Image: Wikipedia)
In early May 2023, the White House invited Google CEO Sundar Pichai, Microsoft CEO Satya Nadella, OpenAI founder Altman, and artificial intelligence startup Anthropic founder Dario Amodei to attend a conference to discuss the impact of AI on society.
Government officials at the meeting included Vice President Kamala Harris, Biden Chief of Staff Jeff Zients, National Security Adviser Jake Sullivan, National Economic Council Chairman Lael Brainard, and Commerce Secretary Gina Raimondo.
U.S. President Joe Biden also attended the meeting.
EU to pass world ’ s first AI regulatory law
Generative AI, while helping to improve lives, can also pose security, privacy and fraud issues, says Ms Ho.
She noted that AI companies have an ethical and legal responsibility to ensure the safety of their AI products, while at the same time working with governments to protect civil rights and privacy.
She stressed that the White House will work to advance potential new legislation and support new legislation to mitigate the potential harms of AI technology.
In contrast, Europe has taken a step ahead in AI legislation.
On 11 May 2023, the European Parliament ’ s Committee on Civil Liberties and Consumer Protection overwhelmingly approved a position paper calling for restrictions on the use of AI in Europe, a crucial first step towards the adoption of the world ’ s first AI regulation bill.
The draft bill will be submitted to the full European Parliament for a vote in June of the same year, after which representatives of the European Parliament, the Council of the European Union and the European Commission will work out the final terms of the bill in tripartite talks.
The European Parliament has adopted a position paper that strengthens restrictions on biometrics, facial recognition, and the use of AI by police in routine duties.
The parliament believes the move could lead to the world ’ s first AI regulation bill. (Image: Wikipedia)
On the other hand, the White House announced that Google, Microsoft, OpenAI, NVIDIA, Stability AI, Anthropic, and Hugging Face have all committed to participating in DEF CON 31, a computer security conference to be held in August 2023, so that their AI models will be tested and evaluated by hackers and AI experts.
Experts will try to identify errors, failures, and vulnerabilities in AI tools so that AI companies can solve existing problems in their models early on.
However, these AI companies simply agree to a one-time test, rather than a commitment to a continuous evaluation when launching or improving their products, and may therefore not be sufficient to meet the regulatory requirements.
Despite this, DEF CON 31 is still seen as the first step for an AI model to be publicly evaluated.
We hope that after each important first step in legislative regulation and public evaluation, we can put generative AI trains on the right track, so that everyone can safely benefit from technological innovation.
DEF CON is one of the largest computer security conferences in the world. In addition to cybersecurity experts and hackers, participants included staff from the FBI, the Department of Defense, and the Postal Inspection Service.
The conference covered areas such as software security, computer architecture, hardware modifications, and other vulnerable areas of information. (Image: DEF CON official website)
The content of the signed and / or unsigned articles published by Economic Times is the author's personal opinion and does not represent the position of Economic Times, and the role of Economic Times is to provide a free speech platform.
etnet won the HKEX Awards 2022 “Best Performing Securities Data Provider ” and“ Best Performing Derivative Data Provider ” ► Learn More
I want to respond
You may be interested
Enlarge display
I know. I know.
Featured Articles
• Life
• DIVA
• Healthy and good life

Which prestigious award did Hinton receive in 2018 for his work on neural networks?

In 2023, Hinton resigned from his role at Google to express his growing concerns about the rapid advancement of AI technologies.

Title:

Content: Artificial intelligence: Geoffrey Hinton 'godfather' of modern technology resigns from Google and warns of its danger
Jeffrey Hinton, widely regarded as the spiritual father of artificial intelligence, has resigned, warning of the growing dangers of AI development.
Hinton, 75, announced his resignation from Google in a statement to the New York Times, saying he now regrets his work.
He told the BBC that some of the dangers of smart chatbots were "very scary".
“Right now, they ’ re not as smart as we can tell.
But I think they ’ ll be soon. ”
Hinton ’ s groundbreaking research on deep learning and neural networks has paved the way for artificial intelligence systems such as ChatGT.
But British-Canadian cognitive psychologist and computer science specialist Hinton told the BBC the chatbot could soon surpass the level of information held by the human brain.
Skip the podcast and keep reading.
Podcast
BBC Extra
A weekly podcast that presents humanitarian stories about the Arab world and its youth.
Loops
Podcast End
“Right now, what we ’ re seeing is that things like GPT-4 are far superior to a person in the amount of general knowledge they have.
For thinking, it ’ s not good, but it really works on simple thinking. ”
"Given the rate of development, we expect things to improve quickly.
So we have to worry about that. ”
In the article he sent to the New York Times, he pointed out that “bad actors ” may try to use artificial intelligence to do“ bad things. ”
In response to the BBC's request for further clarification on the matter, he said: "This is just kind of a worst-case scenario, kind of a nightmare scenario."
“Can you imagine, for example, that someone as bad as the Russian president (Vladimir Putin) decided to give robots the ability to create their own sub-goals? ”
In the end, he warned, this could “create sub-goals – for example, ‘ I need to get more power. ’ ”
"I have come to the conclusion that the kind of intelligence we develop is very different from the intelligence we have," he said.
“We are biological systems and these are digital systems.
The big difference is that with digital systems you have many copies of the same weight set, of the same world model. ”
"All of these versions can learn separately, but they share their knowledge immediately.
If you have 10,000 people, when one person learns something, everyone will automatically know it.
So chatbots can know much more than one person. ”
Hinton also spoke of several other reasons why he quit his job.
“One of them is that I am 75 years old now.
And the other is that I want to say good things about Google.
It would be more credible if I didn ’ t work for Google. ”
He stressed that he did not want to criticize Google, and that the company was "very responsible".
Google Chief Scientist Jeff Dean said: “We remain committed to a responsible approach to artificial intelligence.
We are constantly learning to understand the risks arising under innovation boldly as well. ”

Why did Hinton leave Google when he helped develop AI but later grew concerned about its dangers?

He warned that AI models, such as GPT-4, are developing intelligence faster than expected, posing risks that society may not be prepared for.

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Poses ethical risks
Becomes uncontrollable

His key worries include AI’s potential to manipulate human behavior, cause widespread unemployment by replacing jobs, facilitate misinformation campaigns, interfere with democratic processes, and be misused in autonomous weapons systems.

Title:

Content: Geoffrey Hinton, the godfather of AI, said after leaving Google that artificial intelligence is becoming smarter than humans.
2023 / 5 / 3 16: 46: 16 Source: IT House Author: Yuanyang Editor: Yuanyang
IT home May 3 news, one of the pioneers in the field of artificial intelligence, known as the "godfather of AI" Geoffrey Hinton (Geoffrey Hinton) recently announced that he has left the Google company he worked for ten years, because he is increasingly worried about the development of artificial intelligence technology.
In an interview with CNN's Jake Tapper today, he said that he believes artificial intelligence is becoming smarter than humans, and he wants to "blow the whistle" to remind people that they should seriously consider how to prevent artificial intelligence from controlling humans.
I'm just a scientist who suddenly realizes that these things are becoming smarter than we are, "Hinton said." I want to 'blow the whistle' in a way that says we should seriously worry about how to stop these things from taking control of us. "
Hinton was a pioneer in neural network technology, and his research laid the foundation for the artificial intelligence systems used in many products today.
IT House previously reported that he first revealed his departure in an interview with The New York Times on Monday and expressed his concerns about the potential harms of AI technology.
He said he was concerned that AI would lead to mass unemployment and create a world where many people “can ’ t know what ’ s real. ”
He also noted that the pace of advances in AI technology has far exceeded his and others ’ expectations.
If it becomes much smarter than us, it ’ s going to be very good at manipulating because it ’ s learned from us, and there are very few examples of a smarter thing being controlled by a dumber thing, ” Hinton told Tapper on Tuesday.
It will figure out ways to manipulate people into doing what it wants.
Hinton isn ’ t the only tech leader to express concerns about AI, and in March, a group of community members published a letter calling on AI labs to suspend training for at least six months on the most powerful AI systems, citing “profound risks to society and humanity. ”
Apple co-founder Steve Wozniak, one of those who signed the letter, reiterated concerns about artificial intelligence spreading false information on “CNN Morning ” on Tuesday.“ Deception will become easier for those who want to cheat you. ” Wozniak told CNN, “We ’ re not making any changes in that — we ’ re just assuming that our existing laws will fix the problem. ” Wozniak also said there may be a need for“ some type ” of regulation.
Hinton said he did not sign the petition. “I don ’ t think we can stop this progress, ” he said.“ I didn ’ t sign the petition saying we should stop studying artificial intelligence, because if the Americans stop doing research, the Chinese won ’ t. ” But he admitted that he didn ’ t have a clear solution, “I don ’ t know if we can solve this problem. ”
I believe we should try to think about ways to solve the problem.
I don't have a solution at the moment. '
Related articles
Key word: artificial intelligence
Soft media 's website: IT home hot products - Value shopping guide, coupons most buy - rebate coupons iPhone home Win7 home Win10 home Win11 home
Soft media software: Cube cloud calendar cool point desktop Win7 optimization master Win10 optimization master soft media mobile APP application

What did Hinton, the renowned British-Canadian expert reveal about AI that caused widespread concern?

Exposed serious AI risks, shocking the tech world and affecting major company stocks.

What does Hinton warn "bad actors" could use AI for?

To win wars or manipulate the electorate.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

What risks did Hinton associate with AI's rapid advancement?

Hinton’s resignation was driven by a desire to speak openly about these dangers without harming Google’s public image .

Why did Hinton leave Google when he helped develop AI but later grew concerned about its dangers?

The AI community has responded to Hinton’s warnings with a mix of support and caution.

Title:

Content: The father of artificial intelligence warns: he will control us and governments to confront him
2023-06-29T07: 41: 01.000000Z
Jeffrey Hinton, described as the “godfather of artificial intelligence, ” on Thursday called on governments to confront the dangers of this type of intelligence and intervene to ensure that machines do not control society.
The warnings come at a time when "artificial intelligence" is rapidly evolving, which has raised concerns about its impact on many human jobs.
Hinton made headlines in May 2023 when he announced his resignation from Google to speak more freely about the dangers of artificial intelligence, shortly after the launch of the chatbot that captivated the world.
The artificial intelligence scientist, who teaches at the University of Toronto, spoke to a crowd at the Collegion Technology Conference in the Canadian city, according to Agence France-Presse.
The conference attracted more than 30,000 startup founders, investors and tech professionals, most of whom were looking to learn how to ride the wave of AI rather than hear lessons about its risks or calls for governments to intervene.
Hinton said that “before AI becomes smarter than us, I think the people who develop it should be encouraged to do a lot of work to understand how it can try to take control of us. ”
“Now there are 99 highly intelligent people trying to make AI better, and one very intelligent person trying to figure out how to stop it from taking control, and maybe you should be more balanced. ”
Hinton warned that the dangers of “artificial intelligence ” must be taken seriously, saying:“ I think it ’ s important for people to realize that this is not science fiction or just fear, ” stressing that “it ’ s a real risk that we have to think about, and we have to figure out how to deal with it beforehand. ”
Hinton also expressed concern that AI would deepen inequality, where the vast gains from its productivity would go to the rich, not the workers, and said that “wealth will not go to the people who work, it will make the rich richer, not the poor, and this is a very bad society. ”
He also pointed to the danger of "fake news" that can be created by robots such as ChatGPT, expressing the hope that content generated by "artificial intelligence" programs will be marked, and that central banks will mark monetary currencies.
Hinton also stressed that “it is very important to try, for example, to identify everything that is fake as fake, I don ’ t know if we can do that technically or not. ”
This comes as big tech companies such as Microsoft, Google and others are racing to make advances in artificial intelligence, which some experts warn could replace some human jobs, while others say AI will help generate other jobs for humans.
UN Secretary-General António Guterres earlier announced his support for the creation of a UN agency specialized in artificial intelligence "inspired by the International Atomic Energy Agency", noting that only member states are the decision-makers.
Shafaq Live
Shafaq Live

Some experts, like OpenAI’s Sam Altman, recognize the risks while stressing the importance of safety research and emergency “kill switches” to control AI behavior.

Title:

Content: Report highlights the seriousness of artificial intelligence and warns of the threat of human extinction with a call for America to intervene
The world.
Publish
9 minutes read
(CNN) -- A new report commissioned by the State Department paints a worrying picture of the "catastrophic" national security risks posed by rapidly evolving artificial intelligence and warns the federal government is running out of time to avert disaster.
The findings were based on interviews with more than 200 people over more than a year, including senior executives from leading AI companies, cybersecurity researchers, weapons of mass destruction experts, and national security officials within the government.
The report, released this week by AI Gladstone, categorically suggests that more advanced AI systems could, in the worst case scenario, “pose an extinction-level threat to the human race. ”
The US State Department did not respond to a request for comment.
The warning in the report is another reminder that while the potential of AI continues to captivate investors and the public, there are real risks as well.
Jeremy Harris, CEO and co-founder of Gladstone AI, told CNN on Tuesday: “Artificial intelligence is already an economically transformative technology.
It can allow us to cure diseases, make scientific discoveries, and overcome challenges we once thought insurmountable. ”
"But it could also bring serious risks, including catastrophic risks, that we should be aware of."
“A growing body of evidence – including empirical research and analysis published at the world ’ s most important AI conferences – suggests that above a certain threshold of capability, AI systems are likely to become out of control. ”
White House spokeswoman Robin Patterson said President Joe Biden ’ s executive order on AI was “the most significant action any government in the world has taken to deliver on the promise and manage AI risk. ”
“The President and Vice President will continue to work with our international partners and urge Congress to pass bipartisan legislation to manage the risks associated with these emerging technologies, ” Paterson said.
A clear and urgent need to intervene
Researchers warn of two major dangers posed by large-scale artificial intelligence.
First, Gladstone AI said the most advanced AI systems could be armed to cause irreparable damage.
Second, there are particular concerns within AI labs that they may at some point “lose control ” over the very systems they are developing, with“ potentially devastating consequences for global security. ”
"The rise of artificial intelligence and artificial general intelligence has the potential to destabilize global security in ways reminiscent of the introduction of nuclear weapons," the report said, adding that there is a risk of an AI "arms race", conflict and "deadly accidents the size of weapons of mass destruction."
The Gladstone AI report calls for radical new steps aimed at countering this threat, including the launch of a new AI agency, the imposition of “emergency ” regulatory safeguards and restrictions on how much computer power can be used to train AI models.
The authors wrote in the report: "There is a clear and urgent need for the intervention of the United States government."
The report notes that although the work was produced for the State Department, its views “do not reflect the views ” of the agency or the U.S. government in general.
A government notice issued in 2022 by the State Department ’ s Nonproliferation and Disarmament Fund Office shows that the government is offering to pay up to $250,000 for an assessment of “proliferation and security risks ” associated with advanced AI.
Safety Concerns
Harris, Gladstone ’ s executive director of artificial intelligence, said his team ’ s “unprecedented level of access ” to public and private officials had led to startling conclusions.
Gladstone AI said it spoke to technical and leadership teams from chat owner OpenAI, Google DeepMind, Facebook parent company Meta and Anthropic.
In a video posted on Gladstone AI ’ s website announcing the report, Harris said: “Along the way, we ’ ve learned some disturbing things.
Behind the scenes, the safety and security situation in advanced AI seems largely inadequate compared to the national security risks that AI may soon pose somewhat. ”
The Gladstone AI report said competitive pressures were driving companies to accelerate AI development “at the expense of safety and security, ” increasing the likelihood that more advanced AI systems would be“ stolen ” and “weaponized ” against the United States.
The findings add to a growing list of warnings about the existential risks posed by AI — including from even some of the industry ’ s most powerful figures.
Nearly a year ago, Jeffrey Hinton, known as the “godfather of artificial intelligence, ” quit his job at Google and sounded the alarm about the technology he helped develop.
Hinton said there is a 10% chance that artificial intelligence will lead to human extinction within the next three decades.
Hinton and dozens of AI industry leaders, academics and others signed a statement in June saying that “mitigating the extinction risk of AI must be a global priority. ”
Business leaders are increasingly concerned about these risks – even as they invest billions of dollars in AI.
Last year, 42% of CEOs surveyed at last year ’ s Yale CEO Summit said AI has the potential to destroy humanity five to ten years from now.
abilities similar to human abilities to learn.
Gladstone AI in its report pointed to some prominent individuals who have warned about the existential risks posed by artificial intelligence, including Elon Musk, Federal Trade Commission Chairman Lena Khan, and a former senior executive at OpenAI.
Some employees at AI companies share similar concerns privately, according to Gladstone AI.
“An individual at one of the well-known AI labs expressed the view that if a specific next-generation model of AI were launched without access restrictions, it would be ‘ very bad ’, because the model ’ s potentially convincing ability could ‘ break democracy ’ if leveraged in areas such as election interference or voter manipulation, ” the report said.
Gladstone said she had asked AI experts in some labs to share their personal estimates privately about the likelihood that an AI incident could lead to “irreversible global effects ” in 2024.
Estimates ranged from 4 percent to as much as 20 percent, according to the report, which notes that the estimates were informal and likely to be heavily biased.
One of the biggest surprises is how quickly artificial intelligence is evolving — specifically artificial general intelligence (AGI), a hypothetical form of artificial intelligence that has a human-like or even superhuman learning ability.
The report says AI is seen as “the main driver of catastrophic risks caused by loss of control, ” and notes that OpenAI, Google DeepMind, Anthropic, and Nvidia have all publicly stated access to AI by 2028 — though others believe it ’ s far beyond.
Gladstone AI points out that disagreements over AI timelines make it difficult to develop policies and safeguards, and there is a risk of a slowdown in regulation as technology evolves.

What did Sam Altman admit about ChatGPT and the potential risks of AI?

Advanced AI could pose an existential risk to humanity.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

Others, including Microsoft’s Eric Horvitz, suggest accelerating AI development but with strong governance to manage risks.

What does Hinton warn could happen to AI if companies and regulators fail to implement effective rules and controls?

High-profile tech leaders like Elon Musk and Steve Wozniak have also advocated for temporary pauses in AI progress to ensure these systems can be safely managed.

Title:

Content: My channel
* Drag categories can be customized sorting
Recover Default OK
Setup
Alert
The Senate Judiciary Committee held a hearing on five Supreme Court ethics concerns.
New York City Council Protests to Abolish 24-hour Work
The godfather of AI leaves Google worried that artificial intelligence will fall into the wrong hands
The US media reported today that Hinton, known as the “godfather of AI ”, resigned his job at Google and openly talked about the risks of AI, worried that AI would fall into the wrong hands.
He says it ’ s hard to see how to prevent bad people from using it to do bad things.
Geoffrey Hinton, who laid the groundwork for artificial intelligence (AI) systems, told The New York Times that advances in AI pose “great risks to society and humanity. ”
In a report published today in The New York Times, Hinton was quoted as saying, “Look at how it looked five years ago and now, the difference and growth, it ’ s really scary. ”
Hinton pointed out that competition among tech giants is driving these companies to release new AI technologies at a dangerous rate, which will endanger people ’ s jobs and spread misinformation.
"It's hard to see how you can prevent bad people from using AI to do bad things," he told the New York Times.
OpenAI, the startup behind Google and now the most powerful AI chatbot, ChatGPT, began developing systems with more data than ever before in 2022.
Hinton told the New York Times that he believes these systems are surpassing human intelligence in some ways because of the sheer volume of data they analyze.
"Perhaps these systems are already more powerful than the human brain," he said.
While AI has been used to support human needs for work, the rapid development of chatbots like ChatGPT could leave human jobs in jeopardy.
He told the New York Times that AI was “taking on a chore, ” but that“ it ’ s probably going to do more than that. ”
Hinton also warned that AI could spread the wrong message, telling the New York Times that the average person would “never know what ’ s true again. ”
According to the New York Times, Hinton submitted his resignation to Google last month.
Google ’ s head of AI, Jeff Dean, expressed his gratitude to Hinton in a statement to the US media.
“As one of the first companies to publish AI principles, we remain committed to taking a responsible approach to AI, ” the statement added.
“While we innovate boldly, we are constantly discovering new risks. ”
Tech billionaire Elon Musk and many experts have called for a pause in the development of AI systems to allow time to ensure the technology is safe.
After the introduction of GPT-4, which is more powerful than the AI used by ChatGPT, Musk and Apple co-founder Steve Wozniak signed an open letter.
Hinton, who was not involved in the petition, told the New York Times that scientists should not “further scale research and development ” until they understood if they could control AI.
The New York Times Google
The last one.
The Senate Judiciary Committee held a hearing on five Supreme Court ethics concerns.
The next one.
Equal request?
US asks Chinese airlines not to fly over Russian airspace
Extended reading
Super-popular
More >

What did the open letter signed by thousands, including Elon Musk, call for in response to AI risks highlighted by Hinton?

Six-month pause on AI systems more powerful than GPT-4

These discussions have influenced governments in the US, UK, and EU to consider regulations focused on ethical AI development and public safety .

AI’s automation potential could displace many jobs, creating economic and social challenges.

What risks did Hinton associate with AI's rapid advancement?