"Voice cloning technology has various uses, including entertainment, accessibility, and interaction, but it also poses risks such as scams, highlighting the need for awareness of its ethical and legal implications."

Voice cloning technology has various potential uses, including entertainment, accessibility, and scams. While it can be used for positive purposes, it also raises concerns about its potential for fraud and exploitation.

"Voice cloning technology has the potential to be used in various applications, including entertainment, accessibility, and scams, but it also raises concerns about its impact on daily decisions and the need for scrutiny. The technology has already been used in fake kidnapping calls and creating fake songs featuring real artists, highlighting its capabilities and risks."

Voice cloning technology has various potential uses, including entertainment, accessibility, and interaction, but also raises concerns about scams and ethical implications.

Voice cloning technology has various potential uses, including entertainment, accessibility, and scams, and is expected to expand possibilities in industries such as publishing, gaming creation, and media.

Voice cloning technology raises concerns about fraud, copyright infringement, personal information security, and scams, highlighting the need for responsible use and guidelines to mitigate its potential misuse.

Voice cloning technology raises concerns about fraud, copyright infringement, personal information security, and legal implications, as it can be used to scam individuals by tricking them into believing they are talking to someone they know.

Voice cloning technology has raised concerns about its potential for fraud, scams, and other malicious activities, with FTC Chair Lina Khan warning that AI tools are supercharging scams and emphasizing the need for vigilance.

Voice cloning technology has raised concerns about fraud, copyright infringement, personal information security, and legal implications due to its ability to create realistic voice clones that can be used for malicious purposes.

Voice cloning technology raises concerns about fraud, copyright infringement, and personal information security, with potential exploitation by fraudsters, highlighting the need for awareness of its ethical and legal implications.

"Voice cloning technology is being used for AI-powered scams, which can be used to dupe users, cause mental stress, and extort money."

"Voice cloning technology is being used for malicious purposes, such as scams, where cybercriminals can clone a person's voice with just three seconds of audio and trick others into believing they are talking to the actual person."

Voice cloning technology is being used to turbocharge scams, with AI-powered voice clones able to copy family members in distress, making it a common use of this technology for fraudulent activities.

"Voice cloning technology is being used for scams, including fake kidnapping calls demanding ransom, by using AI to copy a person's voice and fool others."

Voice cloning technology has the potential to be used for scams, including AI-powered scams, which is a concern as the technology becomes more realistic and accessible.

"Realistic voice cloning is made possible by artificial intelligence and deep learning techniques, which can simulate anyone's voice by analyzing and learning their unique patterns"

Realistic voice cloning is made possible by artificial intelligence and deep learning techniques, which can be used to create convincing audio impersonations, raising both excitement and concern about its potential applications and implications.

Realistic voice cloning is made possible by artificial intelligence and deep learning techniques, with applications in entertainment, accessibility, and scams, prompting warnings from officials about the need for vigilance.

"Realistic voice cloning is made possible by artificial intelligence and deep learning techniques, with applications in entertainment, accessibility, and potential misuse in scams, highlighting the need for scrutiny and regulation."

"Realistic voice cloning is made possible by artificial intelligence and deep learning techniques, allowing for the creation of AI voice cloning tools that can clone voices and generate speech in multiple languages."

"Voice cloning technology poses risks of scams, misinformation, and hacking, which can be exploited by cyber criminals to harm users."

Voice cloning technology can be used for malicious purposes such as scams and misinformation, allowing cybercriminals to clone a person's voice and trick others into providing sensitive information or money.

"Potential negative uses of voice cloning technology include scams and misinformation, highlighting the need for awareness and preventive measures to mitigate such risks."

Voice cloning technology can be used for scams and misinformation, with AI tools supercharging these fraudulent activities, as warned by FTC Chair Lina Khan.

Voice cloning technology has the potential for negative uses, including scams, misinformation, and hacking, which can have serious consequences, such as financial loss and emotional distress.

"Artificial intelligence (AI) is the technology used to create synthetic voices, including fake and cloned voices, which has raised concerns about its potential malevolent uses."

"Artificial intelligence is the technology used to create synthetic voices, enabling the generation of highly realistic voice clones that can simulate human speech patterns."

The technology used to create synthetic voices is artificial intelligence, which has advanced rapidly and is being used for various purposes, including scams.

Artificial intelligence, specifically deep learning, is used to create synthetic voices by training on audio samples and replicating the person's voice.

Artificial intelligence is used to create synthetic voices that can mimic the sound of a real person, making it a powerful tool for various applications, including entertainment, accessibility, and unfortunately, scams.

Individuals can protect themselves from voice cloning scams by being cautious and diligent, such as fact-checking and verifying the authenticity of calls and messages, and following best practices for online security and privacy.

Individuals can protect themselves from voice cloning scams by fact-checking, verifying authenticity, and being cautious of suspicious content, ultimately requiring a critical and informed approach to consuming media.

To protect themselves from voice cloning scams, individuals should fact-check and verify information, and be vigilant when encountering potentially fake audio.

Individuals can protect themselves from voice cloning scams by fact-checking and verifying the authenticity of the voice, being cautious of unsolicited calls or messages, and staying informed about the latest developments in voice cloning technology.

Individuals can protect themselves from voice cloning scams by fact-checking and verifying information, and being cautious with unknown callers.

"Artificial intelligence (AI) is the technology used for voice mimicry, enabling the creation of highly realistic voice clones that can be used for various purposes, including entertainment and scams, raising concerns about its legal and ethical implications."

The technology used for voice mimicry is artificial intelligence (AI), which can create fake and cloned artificial voices, including those of celebrities and politicians, and has implications for voter suppression schemes and other malicious activities.

Artificial intelligence is used for voice mimicry, enabling the production of believable sounds and leading to concerns about fake content and its consequences.

The technology used for voice mimicry is artificial intelligence, which has the potential for various applications, including entertainment and accessibility, but also raises concerns about scams and ethical implications.

Artificial intelligence is used for voice mimicry, utilizing deep learning to replicate a person's voice from a small audio sample.

"Voice cloning tools can simulate anyone's voice, with potential applications in entertainment, accessibility, and education, but also raise concerns about scams and legal implications."

Voice cloning tools utilize machine learning algorithms to simulate anyone's voice, offering potential applications in areas like voice assistants and navigation systems.

"Voice cloning tools can simulate anyone's voice, posing both benefits and risks, and their development and use require careful consideration of ethical and legal implications."

Voice cloning tools can simulate anyone's voice, with potential applications in entertainment, accessibility, and education, but also pose significant risks, such as being used in scams, as highlighted by FTC Chair Lina Khan.

Voice cloning tools can simulate anyone's voice, with potential applications in entertainment, accessibility, and education, but also raise concerns about scams, misinformation, and ethical implications.

AI models for voice cloning can be trained on existing videos, podcasts, and other digital data, allowing scammers to create realistic deepfakes.

AI models for voice cloning are trained using audio samples and text to speech technology, allowing them to replicate a person's voice.

AI models for voice cloning are trained using audio data, which can be sourced from public social media accounts, videos, and other digital texts.

AI models for voice cloning are trained using audio files, which can be as small as a short clip, allowing the AI to match a significant portion of the target's voice.

VALL-E 2 has various potential applications, including education, entertainment, and journalism, making it a versatile tool with significant implications for different industries.

A short audio clip is enough for AI to clone someone's voice, with the AI able to match 95% of the target's voice.

"Voice cloning technology has various uses, including entertainment, accessibility, and interaction, but it also poses risks such as scams, highlighting the need for awareness of its ethical and legal implications."

Title:

Content: The scary side of artificial intelligence

The pros of AI outweigh the Cons or threats in our day-to-day lives, and there’s no magic pill to protect us from the scary threats of AI.

  • Exclusive

It's a free Content, simply login/signup to unlock

Get in-depth Industry Insights and Analysis through our “Exclusive” content, presented to you by our esteemed panel of writers, for free

By continuing, you agree to the Terms & Conditions and acknowledge our Privacy Policy. This same account can be used across all Economic Times B2B portals.

  • Updated On Oct 3, 2023 at 03:02 PM IST

Artificial intelligence (AI), as we all know, is the simulation of human intelligence leveraging computer systems and machines. AI programs can continuously learn and evolve with experience. In technical terms, AI systems render the output by churning and analyzing the data for correlations and patterns and help make future predictions using these patterns.

Advt
Today AI is being used extensively in all facets of our lives starting from lifestyle, e-commerce, home appliances, automobiles, navigation, transport, healthcare, agriculture, education, financial planning, chatbots, marketing, cyber security, virtual assistant, industrial automation and many more.

Clearly, we have and are leveraging the strengths of AI to the fullest to automate the routine tasks and make it auto-learn over a period. There’s no doubt that AI has revolutionized the lives of all – organizations, consumers etc. But as they say, “Everything comes at a price”. This analogy is quite true for AI as well, there have been a lot of threats that have emerged using AI and are being utilized by the Cyber criminals to dupe the ignorant users, cause mental stress and extort money.

continued below

Executive Workshop

I’m not going to delve into all of threats but would like to elucidate some of the real ones that have come to the surface recently:

Voice cloning or mimicry

As the name suggests, it uses machine learning algorithms to simulate anyone’s voice. It requires certain voice data to analyze and learn the specific patterns of any individual. There are certain advantages of cloning a voice that can be used in voice assistants, chatbots, navigation systems and other areas. Voice cloning has existed for a while but was restricted to experts who possess the technical knowledge to be able to use the same. But now AI Voice cloning tools are available on the open Internet that anyone can leverage with literally no technical knowledge or cost to clone anyone’s voice. All you need to do is just Google and it will pop up and get a bunch of both free and paid AI Voice cloning tools.

Advt
In fact, recently one of the global leaders in online protection published a report stating how AI is fueling a rise in online voice scams, with just three seconds of audio required to clone a person’s voice. This is extremely creepy. Just imagine, if a Cyber-criminal clones your voice and tricks your near ones by making them believe that they are talking to you, and request for money due to any distress reasons. In fact, these are not assumptions but real-life incidents that are happening across the world every minute.

Deepfakes AI

Deepfakes AI are being used to impersonate an individual by manipulating videos, images, audios, and other content available on the social media platforms using deep learning techniques. It mainly transforms existing content from one person to another. This is another area that has been exploited by the Cyber criminals in the recent past, and there are a few deepfake cases that have made waves on the Internet. One of the most famous ones being Deepfake created by a VFX artist of one of Hollywood’s most famous male actors. This piece was so well made by rendering thousands of pictures using artificial versions of the actor. There are similar Deepfakes incidents involving other global celebrities and leaders. The damage and misuse of the deepfakes videos could be extremely dangerous for the human society and can be used by terrorists to incite riots and create nuisance.

Creating virtual people

This is another area where AI is being used to create people that do not exist. There are a lot of websites that allow you to generate a random image by just specifying the age group, gender & ethnicity, and you can continue to refresh these images at the click of a button. Be mindful of the fact that these images pertain to people that do not exist in this world. On the similar lines, there’s an emerging trend of AI news anchors that possess a human-like appearance and are fed data that they can read using text-to-speech technology. Recently, there's been a surge of AI-Driven robotic new anchors in multiple language channels. While the main objective of this initiative is to provide royalty free or cost-effective human images for branding and other purposes. However, the overuse of these technologies causes Fear of missing out (FOMO), Feeling of inadequacy, dissatisfaction, and isolation may potentially lead to psychological and emotional vulnerabilities.

One of the Hollywood movies, ‘HER’ portrayed an introverted and lonely writer (Joaquin Phoenix) who purchases an AI virtual assistant personified through a female voice to assist him in his writing job. However, when he finds out about its ability to learn and adapt, he falls in love with it. The film delves into emotional vulnerability and the impact of AI on human relationships.

Needless to say, that the pros of AI outweigh the Cons or threats in our day-to-day lives, and there’s no magic pill to protect us from the scary threats of AI. However, there are certain preventive tips that one can follow to mitigate any such risks. Do spread awareness with your family and friends:

  • Set some code words with family, and friends to verify the identity during emergency circumstances
  • Optimize social media presence by limiting your connections with only known contacts and avoid connecting with any unknown ones
  • Avoid saying ‘Yes’ as a greeting while receiving unknown calls as it can be used to authorize credit card charges or other purposes
  • Continuously update privacy settings on social media to allow viewing by friends and family only
  • Avoid clicking on any suspicious links or calls received without proper due diligence
  • Do not share your passwords and other sensitive information with anyone
  • Verify the credentials of any online information before circulating it through various mediums
  • Avoid public Wi-Fi connections offered at coffee shops or airports, which requires to enter password
  • Closely monitor the time spent by younger generation on social media and online gaming
  • Finally, in case of any suspicion, double check and report it to the host site or concerned authorities
The author is the CIO of MOVIN

Disclaimer: The views expressed are solely of the author and ETCIO does not necessarily subscribe to it. ETCIO shall not be responsible for any damage caused to any person/organization directly or indirectly.

  • Published On Oct 3, 2023 at 03:02 PM IST

Most Read in Artificial Intelligence

Join the community of 2M+ industry professionals

Subscribe to our newsletter to get latest insights & analysis.

Download ETCIO App

  • Get Realtime updates
  • Save your favourite articles

Voice cloning technology has various potential uses, including entertainment, accessibility, and scams. While it can be used for positive purposes, it also raises concerns about its potential for fraud and exploitation.

Title:

Content: Tech
Artificial Intelligence

AI voice clones are turbocharging scams, top FTC official warns

"We need to be vigilant early," FTC Chair Lina Khan said.
By Tim Marcin  on
FTC Chair Lina Khan warned AI is turbocharging scams. Credit: Saul Loeb-Pool/Getty Images

AI tools, particularly voice clones, are supercharging scams, FTC Chair Lina Khan warned.

Speaking at an AI and venture capital event on Thursday, Khan warned officials will have to be proactive to stop AI-powered fraud, Bloomberg reported.(opens in a new tab)

She noted that they are already seeing AI "turbocharge" scams, using voice clones that can copy family members in distress as an example, according to Bloomberg.

"We need to be vigilant early," Khan said, according to Bloomberg. "If anything you need to be especially vigilant on the front-end because it’s much more difficult to solve these problems after."

Voice clones have proven capable of fooling folks. A CNN report (opens in a new tab)noted that fake kidnapping calls demanding ransoms using the tech were becoming more common. Jennifer DeStefano told the outlet her story of getting a call demanding $1 million for their daughter before realizing the caller had used AI to copy her voice.

"The voice sounded just like Brie’s, the inflection, everything," she told CNN.

AI voice clones have even made popular songs featuring fake versions of real artists. Even a relatively easy-to-spot fake image of the Pentagon being attacked caused a real dip in the stock market.

"As this stuff becomes more embedded in how daily decisions are being made, I think they invite and merit a lot of scrutiny," Khan said, according to Bloomberg. "Those problems and concerns are quite urgent and I think enforcers, be it at the state level or the national level, are going to be acting."

Tim Marcin

Tim Marcin is a culture reporter at Mashable, where he writes about food, fitness, weird stuff on the internet, and, well, just about anything else. You can find him posting endlessly about Buffalo wings on Twitter at @timmarcin(opens in a new tab).

Recommended For You
Snapchat's My AI has users reaching their snapping point

Fake Pentagon explosion photo caused a real dip in the stock market

Snapchat's AI chatbot is rolling out to all users globally

6 ways the White House is reining in AI

Trending on Mashable
Wordle today: Here's the answer and hints for June 4

NASA's finally talking about UFOs with Americans. Here's what they said.

Spider-Punk is the real hero of 'Spider-Man: Across the Spider-Verse'

Wordle today: Here's the answer and hints for June 3
The biggest stories of the day delivered to your inbox.
This newsletter may contain advertising, deals, or affiliate links. Subscribing to a newsletter indicates your consent to our Terms of Use(opens in a new tab) and Privacy Policy(opens in a new tab). You may unsubscribe from the newsletters at any time.
Thanks for signing up. See you at your inbox!

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

"Voice cloning technology has the potential to be used in various applications, including entertainment, accessibility, and scams, but it also raises concerns about its impact on daily decisions and the need for scrutiny. The technology has already been used in fake kidnapping calls and creating fake songs featuring real artists, highlighting its capabilities and risks."

What are some risks regarding AI voice clning?

Voice cloning technology has various potential uses, including entertainment, accessibility, and interaction, but also raises concerns about scams and ethical implications.

Title:

Content: Language No Barrier: New AI tool can clone voice and make it say anything in multiple languages

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

Mehul Reuben Das May 03, 2023 13:42:20 IST

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

As advanced as AI-based voice cloning has been, there were a few limitations to it. For example, voice generators were mainly bound by the language of the source they were trained in or rather the language of the prompt that was given to them. Now, ElevenLabs, an American AI software developing company has come up with a tool that does away with that limitation.

ElevenLabs’ new AI tool can clone the voice of a person and make it say anything in a bunch of different languages. All it needs is a clear voice sample of about 3 seconds, although it also suggests that the longer the sample, the better will be the results. The new tool even manages to maintain the speaker’s original tone of voice.

Limitless possibilities
The creators expect that this would ‘extend the possibilities’ in a variety of industries such as publishing, gaming creation, and media. “Introducing Eleven Multilingual v1: Our New Speech Synthesis Model! We’re thrilled to launch our new model supporting seven new languages: French, German, Hindi, Italian, Polish, Portuguese, and Spanish.”

“This advancement expands the horizons for creators, game developers, and publishers, and it paves the way for using generative media to create more localized, accessible, and imaginative content,” the company said.

Following the announcement, Twitter was flooded with comments, with users testing the software on various famous faces.

To demonstrate just how capable the new voice cloning AI tool is, Eluna AI, a platform for AI-content creators experimented with a sample clip of former US President Donald Trump.

In their demo, Eluna AI showcased a small clip of Donald Trump, speaking in his native tongue, English, followed by French, Spanish, German, Hindi and Italian, almost perfectly. The generated samples even gets the accent right, almost if he was a native speaker of the new target language.

Another user changed David Attenborough’s voice to German while the BBC broadcaster discussed the prospects of AI. “With this tool, anyone can do it,” stated the Twitter user. “It’s also worth noting that fraudsters will undoubtedly exploit this one.”

ElevenLabs says that its model was designed to understand the emotion and reasoning underlying words in order to produce natural-sounding and persuasive audio. ElevenLabs has said that some numerals and symbols are currently spoken wrongly, but that it is striving to rectify this.

Who is this new tool meant to help?
The US-based company believes its technology will be valuable in a variety of areas, including education and journalism.

Game developers and publishers can build engaging, localised experiences for worldwide audiences, breaking through language barriers and connecting with players and listeners to maximise engagement and efficiency while maintaining quality and accuracy.

“Educational institutions now have the ability to develop audio content for varied users in their target languages, enhancing language comprehension and even pronunciation abilities, as well as responding to different teaching methods and learning demands,” says the report.

Because of the model’s capacity to produce unique character-like voices, audiobook and content developers may also find it beneficial.

The conundrum of AI voice genertors
Despite its benefits, ElevenLabs’ launch comes amid widespread concern about the wave of new voice cloning technology. An unidentified TikTok user went popular last month after sharing an AI-generated Drake song starring The Weeknd.

It sparked concerns about the grey area of AI-created music and whether it constitutes a copyright violation. Nonetheless, ElevenLabs claims to be ‘fully committed’ to respecting creators’ rights in the midst of technological advancements.

“At Eleven, we think that we should seek to make the best use of emerging technology, but not at any expense,” it stated.

“As we create them, we make every effort to put suitable controls in place that reduce the possibility of detrimental abuse. With this in mind, we are entirely committed to both protecting intellectual property rights and taking action against infringement.”

Read all the Latest NewsTrending NewsCricket NewsBollywood News,
India News and Entertainment News here. Follow us on FacebookTwitter and Instagram.

Updated Date:

also read

World

Music labels are worried because of AI, thanks to a surprising new song ft. Drake X The Weeknd

Someone used AI to create a whole new song featuring Drake and The Weeknd. But because the singers never sang the song, artists and music labels are worried, how AI voice modulation and AI-generated songs can disrupt the industry.

World

Artificial Imposter: 47% of Indian phone users have experienced AI voice scams, highest in the world

About half of Indian adults, or 47%, have experienced AI voice scams, nearly double the global average of 25%. Furthermore, nearly 69% of adults say they can't differentiate between a real and an AI-generated voice.

Voice cloning technology has various potential uses, including entertainment, accessibility, and scams, and is expected to expand possibilities in industries such as publishing, gaming creation, and media.

Voice cloning technology raises concerns about fraud, copyright infringement, personal information security, and scams, highlighting the need for responsible use and guidelines to mitigate its potential misuse.

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

Voice cloning technology raises concerns about fraud, copyright infringement, personal information security, and legal implications, as it can be used to scam individuals by tricking them into believing they are talking to someone they know.

Voice cloning technology has raised concerns about its potential for fraud, scams, and other malicious activities, with FTC Chair Lina Khan warning that AI tools are supercharging scams and emphasizing the need for vigilance.

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

Voice cloning technology has raised concerns about fraud, copyright infringement, personal information security, and legal implications due to its ability to create realistic voice clones that can be used for malicious purposes.

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

Voice cloning technology raises concerns about fraud, copyright infringement, and personal information security, with potential exploitation by fraudsters, highlighting the need for awareness of its ethical and legal implications.

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

"Voice cloning technology is being used for AI-powered scams, which can be used to dupe users, cause mental stress, and extort money."

"Voice cloning technology is being used for malicious purposes, such as scams, where cybercriminals can clone a person's voice with just three seconds of audio and trick others into believing they are talking to the actual person."

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

What is necessary for voice cloning to work?

Voice cloning technology is being used to turbocharge scams, with AI-powered voice clones able to copy family members in distress, making it a common use of this technology for fraudulent activities.

"Voice cloning technology is being used for scams, including fake kidnapping calls demanding ransom, by using AI to copy a person's voice and fool others."

Voice cloning technology has the potential to be used for scams, including AI-powered scams, which is a concern as the technology becomes more realistic and accessible.

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

"Realistic voice cloning is made possible by artificial intelligence and deep learning techniques, which can simulate anyone's voice by analyzing and learning their unique patterns"

Realistic voice cloning is made possible by artificial intelligence and deep learning techniques, which can be used to create convincing audio impersonations, raising both excitement and concern about its potential applications and implications.

What are some risks regarding AI voice clning?

Realistic voice cloning is made possible by artificial intelligence and deep learning techniques, with applications in entertainment, accessibility, and scams, prompting warnings from officials about the need for vigilance.

What are some risks regarding AI voice clning?

"Realistic voice cloning is made possible by artificial intelligence and deep learning techniques, with applications in entertainment, accessibility, and potential misuse in scams, highlighting the need for scrutiny and regulation."

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

"Realistic voice cloning is made possible by artificial intelligence and deep learning techniques, allowing for the creation of AI voice cloning tools that can clone voices and generate speech in multiple languages."

How will AI Voice help educators with building courses?

"Voice cloning technology poses risks of scams, misinformation, and hacking, which can be exploited by cyber criminals to harm users."

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

Voice cloning technology can be used for malicious purposes such as scams and misinformation, allowing cybercriminals to clone a person's voice and trick others into providing sensitive information or money.

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

"Potential negative uses of voice cloning technology include scams and misinformation, highlighting the need for awareness and preventive measures to mitigate such risks."

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

Voice cloning technology can be used for scams and misinformation, with AI tools supercharging these fraudulent activities, as warned by FTC Chair Lina Khan.

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

Voice cloning technology has the potential for negative uses, including scams, misinformation, and hacking, which can have serious consequences, such as financial loss and emotional distress.

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

"Artificial intelligence (AI) is the technology used to create synthetic voices, including fake and cloned voices, which has raised concerns about its potential malevolent uses."

Title:

Content: Moving at rapid speed, the Federal Communications Commission (FCC) has just announced its unanimous adoption of a new Declaratory Ruling finding that voice calls using artificial intelligence (AI)-generated voices fall under the Telephone Consumer Protection Act (TCPA).

The ruling takes effect immediately and gives state attorneys general powerful new tools to go after voice cloning scams. Under FCC rules, telemarketers that use robocalls subject to the TCPA are required to obtain prior express written consent from the consumer unless an exemption applies. The TCPA has always prohibited the use of both prerecorded and artificial voices but advances in AI-generated voices have prompted the FCC to specifically address their use.

In recent years, scammers and other parties have begun using AI to create fake and even "cloned" artificial voices, including those of celebrities, politicians, and even a call recipient's family member. In this election season, there has been increasing concern about the use of voice clones to engage in voter suppression schemes.

Concerned about the potential malevolent uses of these AI-generated voice calls, the FCC issued a Notice of Inquiry (NOI) in November on the topic of "Implications of Artificial Intelligence Technologies on Protecting Consumers from Unwanted Robocalls and Robotexts." In the NOI, the FCC asked questions regarding the use of "AI-influenced" technologies in robocalling. A coalition of 26 state attorneys general, as well as a telecommunication carrier trade group, strongly urged the FCC to take action to give the attorneys general clear authority to act against AI-generated robocall violators.

The FCC now has made clear that the use of voice cloning in telephone calls and texts falls within the FCC's statutory authority under the TCPA. A major intent of the ruling is to communicate that the TCPA "does not allow for any carve-out of technologies that purport to provide the equivalent of a live agent, thus preventing unscrupulous businesses from attempting to exploit any perceived ambiguity in our TCPA rules."

As FCC Chairwoman Jessica Rosenworcel explained, "with this Declaratory Ruling, we will have another tool to go after voice cloning scams and get this junk off the line."

The content of this article is intended to provide a general guide to the subject matter. Specialist advice should be sought about your specific circumstances.

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

"Artificial intelligence is the technology used to create synthetic voices, enabling the generation of highly realistic voice clones that can simulate human speech patterns."

Title:

Content: Acoustic reproduction techniques have developed rapidly and advanced in the past year.
REUTERS
Artificial intelligence is causing a crisis.
Rapid advances in artificial intelligence have made it easier to produce believable sounds that have allowed anyone from foreign actors to music lovers to clone someone ’ s voice, leading to a flood of fake content on the internet, confusion, anger and sowing discord.
Last week, actor Tom Hanks warned his followers on social media that bad actors used his voice to imitate him wrongly as he promoted dental plans.
Hani Farid, a professor of digital forensics at the University of California, says it ’ s not hypothetical, it ’ s about violence, it ’ s about election theft, it ’ s about fraud, and it ’ s about real consequences for individuals, societies, and democracies.
Phonetic cloning techniques have undergone rapid and advanced development in the past year.
The proliferation of cheap tools that are easily accessible online has allowed almost anyone to launch a complex audio campaign from their bedroom.
Tom Hanks Warns Against Advertising Exploited by ‘ Artificial Intelligence ’
It ’ s hard for the average person to spot fake audio campaigns, while photos and videos still have noticeable abnormalities — such as deformed hands and deviant words.
Social media companies are finding it difficult to modify the voice generated by artificial intelligence because human auditors often have a hard time detecting counterfeit products.
At the same time, few software companies have firewalls to prevent illegal use.
In the past, voice cloning software produced unrealistic automated sounds, but computing has become more powerful, and software has become more accurate.
The result was a technique that could clone millions of sounds, identify patterns in primary speech units, called phonetics, and simulate them within seconds.
Source: The Washington Post
Report: Artificial Intelligence Faces a Tough Test in 2024
Most Read
No stories found.
Erm News
www.eremnews.com

What has the US Federal Trade Commission warned about the use of voice cloning tools?

Difficult to distinguish from human voice

The technology used to create synthetic voices is artificial intelligence, which has advanced rapidly and is being used for various purposes, including scams.

Title:

Content: Scammers can use AI tools to clone the voices of you and your family—how to protect yourself

A robocall impersonating President Joe Biden urged New Hampshire voters not to participate in Tuesday's presidential primary — and it probably won't be the last AI voice scam this election season.

"Of course, this will be used by foreign nation states just like the trolling farms they already have. This is just another weapon in the arsenal," Adrianus Warmenhoven, a cybersecurity expert at NordVPN, tells CNBC Make It.

The fraudulent robocall begins by saying, "What a bunch of malarkey," in a voice that sounds like President Biden's, according to NBC News. The call then instructs recipients to "save your vote for the November election" and refrain from participating in the nation's first presidential primary, which is when voters choose which candidate they would like to be their political party's nominee in the general election.

New Hampshire's Attorney General's office says it has launched an investigation following a series of complaints about the robocalls.

"Although the voice in the robocall sounds like the voice of President Biden, this message appears to be artificially generated based on initial indications," the attorney general's office said in a Jan. 22 statement. "These messages appear to be an unlawful attempt to disrupt the New Hampshire Presidential Primary Election and to suppress New Hampshire voters."

Thanks to the rapid development of the type of AI technology used to clone and mimic people's voices, these types of AI-powered schemes are becoming more common — and scammers aren't just spoofing well-known public figures.

In March, the Federal Trade Commission issued a consumer alert warning people that scammers could target them by using AI technology to clone the voice of a family member in order to convince them to send the scammers money.

How to protect yourself from AI voice scams

Although it's getting harder to differentiate between what's real and what may be an AI-generated deepfake, there are a couple of steps you can take to protect yourself.

1. Fact-check and verify

When it comes to AI voice scams like the one involving Biden, you should double check that what you're hearing is actually correct, Warmenhoven says.

Although the spoofed version of President Biden voice told New Hampshire voters to "save" their votes for the November general election, a quick Google search reveals that registered Republicans and undeclared voters could cast their ballot in Tuesday's primary.

If you suspect you're being targeted by a cybercriminal, you can also check online to see if there have been any recent reports of AI-generated voice scams, Warmenhoven says.

2. End the call

If you decide to answer a call from an unknown number and it sounds like a panicked family member is asking you for money, try not to panic yourself.

Instead, end the call and try calling or texting the person using the number they've given you, rather than the one that called, to check that they're OK, Warmenhoven says.

The same goes if you receive a call from a scammer pretending to be your bank. Don't immediately believe their claims. Instead, end the call and call the number listed on your bank's website or on the back or your debit or credit card, he says.

It's especially important to get off the phone with these types of scammers, because they don't need an especially long clip of your voice in order to use AI to clone it.

"Even if you just say 'Hello? Is anybody there ?' or just mumble something, you'll give up lots of words and inflections in your voice and then [a scammer] can clone your voice," Warmenhoven says.

In May, McAfee researchers found that free online tools could be used to clone someone's voice using just three seconds of audio, per the computer software company's "The Artificial Imposter" report.

"Advanced artificial intelligence tools are changing the game for cybercriminals. Now, with very little effort, they can clone a person's voice and deceive a close contact into sending money," Steve Grobman, McAfee's chief technology officer, said in the report. "It's important to remain vigilant and to take proactive steps to keep you and your loved ones safe."

DON'T MISS: Want to be smarter and more successful with your money, work & life? Sign up for our new newsletter!

Want to land your dream job in 2024? Take CNBC's new online course How to Ace Your Job Interview to learn what hiring managers are really looking for, body language techniques, what to say and not to say, and the best way to talk about pay. Get started today and save 50% with discount code EARLYBIRD.

Contact Us

Artificial intelligence, specifically deep learning, is used to create synthetic voices by training on audio samples and replicating the person's voice.

Title:

Content: Aug 31, 2022

Now, software can replicate your boss’s voice and tell you what to do

HTML EMBED:
COPY
"Deepfake" audio technology is here, and scammers are taking advantage.

If you’re listening to or have already listened to the beginning of this episode, you probably noticed that the voice introducing Kimberly Adams sounded a bit off, right?

That’s because it’s an audio “deepfake,” and it was created by Yisroel Mirsky at the Offensive AI Research Lab through a process called voice cloning.

It uses software to study a short sample of someone’s voice and create a deepfake, which in this case took only 15 seconds to generate, according to Mirsky.

It’s far from a perfect replica, but it turns out that scammers recently started to use deepfake audio for telephone scams and in some cases have succeeded.

Marketplace’s Kimberly Adams recently spoke with Kyle Alspach, a cybersecurity reporter with Protocol, about how the tech behind audio deepfakes works and how they’re being used in phone scams. The following is an edited transcript of their conversation.

Kyle Alspach: The technology involves having [artificial intelligence], deep learning, and it takes an audio sample of someone’s voice. It can be as little as three seconds, and it trains itself on the way that this person sounds. And it creates a model that can then be used to replicate that person’s voice. The current way that it works is you have to use text to speech, which is just you type in a phrase, and then it speaks using the cloned voice.

Kimberly Adams: How are these audio deepfakes being used in scams?

Alspach: So they’re, at least we know, being used to target businesses at this point, especially larger businesses. Someone will call up pretending to be someone else with someone else’s voice, typically some kind of executive or someone’s boss, and ask them to transfer funds or ask them for password credentials, that kind of thing. And in some cases, they have been successful.

Adams: Do you have a sense of how common audio deepfakes are now? And where do experts in the industry see it going?

Alspach: You know, among the larger businesses, I think more and more of them are starting to see these because they’re really ripe targets for this kind of thing. But right now, I don’t think that it’s something that a lot of people are seeing, but it is the beginning of this kind of technology being used in this way.

Adams: What do cybersecurity experts suggest that regular people or businesses do to avoid falling for these deepfake audio scams?

Alspach: For business purposes, for instance, if you’re going to transfer money, you might want to add some additional steps to that process and involve someone saying some kind of challenge phrase or something like that, that everyone’s agreed on beforehand, [to] prevent that from happening. But the biggest thing is just to be aware that it might happen to you and to pay attention when someone calls you up and make sure that it actually sounds the way you would expect, and they are asking you for things that they normally would be asking you for. It’s really at this point kind of a low-tech approach to defending against this kind of thing. But really, it’s just creating the possibility in your mind of this happening. And I guess, unfortunately, you kind of have to become more skeptical now when people call you up.

You can read more of Alspach’s reporting on audio deepfakes here.

Yisroel Mirsky told us that the tech he used to generate the deepfake audio for Alspach’s article, and for our show, is “relatively old.”

Alspach also mentioned in his piece that there is an open-source voice cloning tool online that anyone — even scammers can download and potentially use.

But as we found out, getting that software to work isn’t a simple process of downloading and hitting the Install button.

Tech barriers can stop you at a number of steps in the process. Like, if you don’t know the coding language Python or if your computer isn’t powerful enough, you’ll likely be unable to use it, as our producer Daniel Shin discovered.

The future of this podcast starts with you.

Every day, the “Marketplace Tech” team demystifies the digital economy with stories that explore more than just Big Tech. We’re committed to covering topics that matter to you and the world around us, diving deep into how technology intersects with climate change, inequity, and disinformation.

As part of a nonprofit newsroom, we’re counting on listeners like you to keep this public service paywall-free and available to all.

Support “Marketplace Tech” in any amount today and become a partner in our mission.

The team

Michael Lipkin Senior Producer
Stephanie Hughes Producer
Jesus Alvarado Assistant Producer

What is necessary for voice cloning to work?

Artificial intelligence is used to create synthetic voices that can mimic the sound of a real person, making it a powerful tool for various applications, including entertainment, accessibility, and unfortunately, scams.

Title:

Content: Advertisement
Foreign Press
Urgent warning.
This is how artificial intelligence is used to steal your money.
Translated from "Lebanon 24"
|
28-06-2023 | 11: 55
A-
A +
photos 0
A +
A-
There are many forms of fraud, but it usually works the same way: the fraudster pretends to be someone you trust to convince you to send money.
According to the Federal Trade Commission (FTC) website, fraudsters pretend to be an IRS official or a family member among other examples.
Advertisement
According to Insider, “Most scams usually happen over the phone, but they can also happen via social media, text messages or email.
A good example of this is what happened with Google software engineer Richard Mendelstein.
The latter received a call, which he believed was from his daughter Stella, screaming on the phone for help from her father, asking him to withdraw $4,000 in cash as a ransom payment.
It was only after he transferred the money that he realized that he had been scammed and that his daughter was safe at school the whole time and had not been kidnapped.
"Vocal techniques are often used to mysteriously align with a child's age and gender, but using artificial intelligence, the sound on the other end of the phone can now look eerily similar to the sound of a real person."
“Although the AI technology that makes these scams possible is not new, it is becoming better, cheaper and easier to access.
Steve Grubman, chief technology officer at global security software company McAfee, said: “One of the most important things to note this year is that advances in artificial intelligence have made these technologies accessible to many people.
“Artificial intelligence for fraud is easier to use today by cybercriminals than it used to be. ”
Previous phone-call scams relied on the fraudster ’ s acting skills or the victim ’ s level of naivety, but now AI does most of the work.
Through AI platforms such as Murf, Resemble, and ElevenLabs, users can turn text into speech in the voice of the person they want.
“He just has to upload an audio file of the person who wants to use his or her voice to one of these sites (with a small audio clip, the AI can match 95% of the target ’ s voice) and then just write the text he or she wants to use in the scam. ”
"It is difficult to arrest those who commit such fraud.
The victim often has little information to give to the police.
To make matters worse are the logistical and judicial challenges faced by legal agencies, especially as fraudsters are present all over the world.
According to Grubman, if you feel like you ’ re being scammed, you don ’ t have to worry.
All it takes is asking a few questions that only the person whose voice is being used knows the answer to.
The FTC also recommended that if a loved one tells you they need the money, put the call on hold and try calling your family members separately to verify the story.
Security experts also recommend agreeing on a safe word and using it to distinguish between a real emergency and a scam.
“With the spread of artificial intelligence, these kinds of scams are putting the reliability of even our close family members at stake. ”
Advertisement
Our news via your email
SIGN UP
Translated from "Lebanon 24"

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

Individuals can protect themselves from voice cloning scams by being cautious and diligent, such as fact-checking and verifying the authenticity of calls and messages, and following best practices for online security and privacy.

Individuals can protect themselves from voice cloning scams by fact-checking, verifying authenticity, and being cautious of suspicious content, ultimately requiring a critical and informed approach to consuming media.

Title:

Content: Technology

AI-enabled scams will proliferate

Ultra-realistic digital trickery will help fraudsters deceive people on an entirely new scale

Jeff Clune is an associate professor of computer science at the University of British Columbia and Canada CIFAR AI Chair at the Vector Institute.

(This illustration was created by Maclean’s art director Anna Minzhulina using the generative AI image program Imagine. Minzhulina spent weeks feeding prompts into the program, inspired by the essay.)

Money-grabbing scams have been happening for longer than we can remember: con artistry, Ponzi schemes, online phishing, even snail mail gambits. But the advent of more sophisticated artificial intelligence will soon make these tricks far more common, complex and convincing. Knowing who or what to trust online is about to get much more challenging—and we had better be prepared.

Photographs and videos used to be one way of verifying if things are true. Now, AI programs have opened the door to forms of scamming that are much harder to detect. Criminals can simply use software like Midjourney or DALL-E 2 to generate any kind of realistic photos. AI can also mimic someone’s voice, and soon AI-generated videos will be able to clone their appearances and facial expressions too. There are already deepfakes of Elon Musk telling people to invest their money in crypto, Tucker Carlson promoting new trading platforms and Ron DeSantis appearing in an episode of The Office as Michael Scott. We are losing our core methods of verification in ways most of us could not even have imagined just three years ago.

We have to prepare to face elaborate scams that take advantage of our trust. Picture this: in the near future, you might receive a video call from a family member who is asking for money because they are in a tight spot. It probably would not seem possible that you are talking to a deepfake, but this type of trickery—though still rare—is already spreading. Scammers can easily find existing videos or podcasts of somebody online and train an AI on that voice and facial expressions to create an uncanny resemblance. Because it is already possible to imitate my voice on a voice call, I have created a secret password for my family so we can verify each others’ identity if we ever get suspicious of each other over the phone.

The quantity of AI scams will also increase. Back in the ’80s, people would occasionally receive spam letters in snail mail, but those attempts were few and far between because con artists did not want to pay for paper and postage. Email removed the cost of sending mail, and the number of attempted scams skyrocketed. Just like email did a few decades ago, AI is making scamming far easier and cheaper. This could enable disruptive levels of manipulation in the near future. Rather than spending hours trying to defraud one person or paying 1,000 scam employees to work 40-hour weeks, a single scammer could train an AI model to deceive 100 million people simultaneously.

AI-generated, human-sounding robo-calls will contact millions of people at once. Instead of listening to a recorded message, the person will carry on a back-and-forth conversation without realizing the person on the other end of the line is not human. AI scammers will impersonate police officers or civil servants and ask for donations to certain charities, for example. Such scams will also be politically motivated—like an AI calling every Canadian to feed them false information about a political figure, or dictators flooding information channels with fake videos, comments, likes and emojis that subtly, yet relentlessly, repeat the party line. Criminals will wield AI to disrupt finance markets by pumping up worthless penny stocks or driving down the value of other stocks with fake news.

For now, scammers still need to be tech-savvy to create powerful AI-driven schemes. But in technology, what is hard now will be easy soon. As we develop better and more user-friendly AI software, a 12-year-old kid might be able to orchestrate a worldwide phishing attempt from his or her bedroom. Once it becomes cheap, quick and easy to program something that is convincingly human, we are in trouble. It will become incredibly difficult to know which information is trustworthy. Unless we invent technological and sociological solutions to these problems, I am afraid that we will soon not be able to trust most of what we see online, and that makes me deeply concerned about the future of our information landscape.

As we prepare for AI scams to proliferate, the best advice I can offer is for people to seek out and hold onto the sources they trust most—whether that is the New York Times or a particular reporter. But even then they must make sure they are in fact getting information from that source. We can also protect ourselves from scams by better understanding what technology can and cannot do. From now on, we should always second-guess what we see in text, websites and photos. Deepfakes are still rare, and most videos are trustworthy, but that will likely change. If a video seems surprising, do an independent search to see if people are reporting that it is fake. And if you have been scammed, tell others how it happened, so that they do not also fall prey.

Scams work best when they pull on heartstrings—and humans tend to relate and respond to other humans, especially those they know and trust. The better AI can impersonate a flesh-and-blood person, the more turmoil we can expect. As the cost of deception slides towards zero, we will need to build our individual and societal immune systems to handle an army of new threats. As in the real world, an ounce of prevention is worth a pound of cure. The best vaccination for scams is knowledge and a sizable dose of skepticism.

We reached out to Canada’s top AI thinkers in fields like ethics, health and computer science and asked them to predict where AI will take us in the coming years, for better or worse. The results may sound like science fiction—but they’re coming at you sooner than you think. To stay ahead of it all, read the other essays that make up our AI cover story, which was published in the November 2023 issue of Maclean’s.

Looking for more?

Get the Best of Maclean's sent straight to your inbox. Sign up for news, commentary and analysis.
FILED UNDER:

What are some risks regarding AI voice clning?

To protect themselves from voice cloning scams, individuals should fact-check and verify information, and be vigilant when encountering potentially fake audio.

Title:

Content: MOSCOW, July 4 — PRIME.
Fraudsters have learned to use artificial intelligence to deceive citizens in telephone conversations.
What schemes are used by cyber scammers, told the Agency "Prime" head of information security Center digital experts Roskachestvo Sergey Kuzmenko.
Cloning of voice
According to the expert, in this case we are talking not so much about artificial intelligence, but about a neural network with machine learning based on artificial intelligence.
“Thanks to the available technology, hackers only need a 20-second snippet of a conversation taken from a social network to create a clone of any person ’ s voice.
The identity is so striking that even a mother will not be able to distinguish her child ’ s voice from a robot, ” the expert said.
The scheme of deception is the same: the AI calls and asks to transfer money.
Criminals make victims think that they are talking to a relative who suddenly needed money, for example, to compensate for damage as a result of an accident.
Kuzmenko advised immediately to call back his family and friends, from whom the request was received.
It is even better to come up with a code word for your own, so that you can understand: relatives call, not fraudsters.
Imitation of the image
You can fake not only the voice, but also the image.
Using a technique for synthesizing media content based on artificial intelligence, it is possible to impose fake images or videos on real ones.
The technology is called "deepfake" (from the English deepfake - "fake". - Approx. ed.).
Abroad, the attackers tried deepfakes when applying for remote work in the field of IT to gain access to databases.
However, the created video clips give their artificial pace of speech, asynchronous and unnatural emotions.
New technologies are used not only by advanced IT companies, but also by groups of fraudsters.
A wave of deepfakes has already engulfed Southeast Asia and Africa.
It will also certainly reach Russia in the near future and will work according to the scheme of calls from “relatives ”, for example, elderly people, the expert of Roskachestvo warned.
Thus, the moment is not far off when deceptions with calls from law enforcement agencies and bank employees will be fully implemented by software algorithms based on neural networks.
How to recognize deepfake:
• Unnatural facial expressions – the movements of the lips do not fall in time with the spoken words, the same expression of the eyes, no change of emotions is visible.
• Low resolution, pixelation or fuzziness of the image, especially in areas with active facial expressions - eyebrows, corners of the mouth.
• The sound is ahead of the picture or does not keep up with the movements of the character.
The neural networks themselves also help to recognize fakes.
Technologies for creating and detecting deepfakes will be intensively developed in the future.
According to Kuzmenko, for the average user, the best way to protect yourself from deepfakes is to be vigilant, turn to reliable sources of information and follow the development of information technologies.

What are some risks regarding AI voice clning?

Individuals can protect themselves from voice cloning scams by fact-checking and verifying the authenticity of the voice, being cautious of unsolicited calls or messages, and staying informed about the latest developments in voice cloning technology.

Individuals can protect themselves from voice cloning scams by fact-checking and verifying information, and being cautious with unknown callers.

"Artificial intelligence (AI) is the technology used for voice mimicry, enabling the creation of highly realistic voice clones that can be used for various purposes, including entertainment and scams, raising concerns about its legal and ethical implications."

What are some risks regarding AI voice clning?

The technology used for voice mimicry is artificial intelligence (AI), which can create fake and cloned artificial voices, including those of celebrities and politicians, and has implications for voter suppression schemes and other malicious activities.

What are some risks regarding AI voice clning?

Artificial intelligence is used for voice mimicry, enabling the production of believable sounds and leading to concerns about fake content and its consequences.

What are some risks regarding AI voice clning?

The technology used for voice mimicry is artificial intelligence, which has the potential for various applications, including entertainment and accessibility, but also raises concerns about scams and ethical implications.

Artificial intelligence is used for voice mimicry, utilizing deep learning to replicate a person's voice from a small audio sample.

What is necessary for voice cloning to work?

"Voice cloning tools can simulate anyone's voice, with potential applications in entertainment, accessibility, and education, but also raise concerns about scams and legal implications."

Voice cloning tools utilize machine learning algorithms to simulate anyone's voice, offering potential applications in areas like voice assistants and navigation systems.

"Voice cloning tools can simulate anyone's voice, posing both benefits and risks, and their development and use require careful consideration of ethical and legal implications."

What are some risks regarding AI voice clning?

Voice cloning tools can simulate anyone's voice, with potential applications in entertainment, accessibility, and education, but also pose significant risks, such as being used in scams, as highlighted by FTC Chair Lina Khan.

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

Voice cloning tools can simulate anyone's voice, with potential applications in entertainment, accessibility, and education, but also raise concerns about scams, misinformation, and ethical implications.

What are some risks regarding AI voice clning?

AI models for voice cloning can be trained on existing videos, podcasts, and other digital data, allowing scammers to create realistic deepfakes.

What is necessary for voice cloning to work?

AI models for voice cloning are trained using audio samples and text to speech technology, allowing them to replicate a person's voice.

What is necessary for voice cloning to work?

AI models for voice cloning are trained using audio data, which can be sourced from public social media accounts, videos, and other digital texts.

Title:

Content: NewsLocal News

Actions

Convincing 'deepfake' scams mimic voices using AI to try and get money

Posted at 6:35 AM, May 23, 2023
and last updated 2023-05-23 08:35:34-04

SALT LAKE CITY — Scammers are getting smarter with ways to try and trick everyday people and the FBI warns that the newest scam clones voices in order to demand money.

It's a trick that is all too familiar, but with modern technology, it can be harder to determine what's fake and what's real.

"I've had individuals [call and say', 'We've got your son down here in Mexico and would you pay so much money to get him out,'" explained Robert Brundige of Salt Lake City.

Fraudsters will fake a dire situation, such as a medical emergency or intense crisis, then call a loved one, asking for money.

Recently, Utahns have reported getting calls where there are sound effects playing in the background, making a dire situation more believable.

Melissa Goodman was targeted by the scammers and said the fake call was believable.

"There's a person in the background, screaming, crying, hyperventilating. He thought it was me," Goodman explained. "They knew our names, they were calling us by my name, by his name."

Officials with the Taylorsville Police Department have heard about these types of scams from other local departments, where even real recordings are part of the scheme.

"The people did think that their child was with the kidnappers cause they had some kind of audio from a video or something like that," Lt. Aaron Cheshire explained.

The FBI warns that we're entering a new era where AI is used for scams and the result is shocking.

"There's no turning back the clock on this," said Jason Wiese, Assistant Professor at the University of Utah for the School of Computing. "Now that the technology is out there, even if you pass laws, it's not very easy to actually reign this in."

Already in 2023, the world has seen a boom in AI and the technology is so good, it's even stumping internet pros.

An image or recording that's "convincingly altered and manipulated to misrepresent someone as doing or saying something that was not actually done or said" is called a "deepfake."

The only "tell" for these deepfake images and recording is that they can look and sound a little robotic but as technology improves, so will the scams.

"Even if there's a 'tell' today, it may not be something that exists tomorrow as the technology continues to improve," Wiese explained.

The Salt Lake County Aging and Adult Services is constantly educating older Utahns on what to watch out for.

"The best thing to do is hang up the phone and then call that loved one back from your cellphone on their saved contact information," explained Afton January with the department.

So, if you post videos on public social media accounts, be aware that someone could use that audio to trick your loved ones.

"They are often the targets of these types of scams," January said. "And it's really important that we protect them."

But by being aware of the scams and what to watch out for, Utahns of all ages can be prepared for any scam that may come their way.

What is necessary for voice cloning to work?

AI models for voice cloning are trained using audio files, which can be as small as a short clip, allowing the AI to match a significant portion of the target's voice.

What is necessary for voice cloning to work?

VALL-E 2 has various potential applications, including education, entertainment, and journalism, making it a versatile tool with significant implications for different industries.

Title:

Content: What we know about Vall-E 2
According to these claims, Microsoft has developed a new artificial intelligence speech generator that is so adept that it can do more harm than good.
VALL-E 2 voices the text with the voice of a particular person, for which he needs only a few seconds of audio recording of the speech of this person.
Midjourney artificial intelligence has its own version of who is the president of the United States, and it ’ s not Biden
Microsoft researchers said that VALL-E 2 "has reached human parity."
It is capable of generating "accurate, natural speech by the voice of the original announcer, which can be compared to a human voice."
In other words, the new AI voice generator is convincing enough to be mistaken for a living person.
This opens up potentially dangerous opportunities for unscrupulous people.
VALL-E 2 is the latest achievement in speech models of neural codecs and marks an important milestone in text-to-speech (TTS) synthesis.
[...] VALL-E 2 consistently synthesizes high-quality speech, even for sentences that traditionally cause difficulties due to their complexity or repetitive phrases,
The developers write.
We ’ ve already seen examples of neural networks that are able to clone voices based on a multi-second recording, but Microsoft says its technology is superior to anything that has been on the market so far.
"Our experiments conducted on the LibriSpeech and VCTK datasets have shown that the VALL-E 2 is superior to previous TTS-systems [...] in reliability, naturalness and similarity to the speakers.
This is the first of its kind system that has reached parity with a person on these indicators, ” the article says.
The quality of the VALL-E 2 results depends on the length and quality of the speech prompts, as well as environmental factors such as background noise.
See also Google allows you to make your own copy of a celebrity to chat with her in a chatbot
What happens next with the technology
Despite its capabilities, Microsoft will not release VALL-E 2 to the public due to potential abuse risks.
Recently, we have seen a wave of fraud – both at the level of ordinary users, who are deceived by fraudsters, forging the voice of their relatives or friends, and at the level of state leaders who “call ” their voters, and celebrities who allegedly advertise cryptocurrencies and various fraudulent schemes in advertising.
VALL-E 2 is a research project.
We do not plan to include VALL-E 2 in the product or expand access to it for the public.
This may carry potential risks of abuse of the model, such as faking voice identification or impersonating a particular speaker,
The creators of the technology write.
But they suggest that artificial intelligence technology may find practical applications in the future.
VALL-E 2 can synthesize a language that retains the identity of the speaker, and can be used for educational training, entertainment, journalism, author content, accessibility features, interactive voice response systems, translation, chatbots, and more.
But to do this, you need to add a special protective protocol that will ensure that the speaker approves the use of his voice.

A short audio clip is enough for AI to clone someone's voice, with the AI able to match 95% of the target's voice.

What has the US Federal Trade Commission warned about the use of voice cloning tools?

Difficult to distinguish from human voice

What is necessary for voice cloning to work?