Voice cloning technology can mimic real individuals, raising concerns about copyright and rights infringement.

This technology can create "fake music" using voice cloning, violating copyright laws unless the artist gives permission or receives compensation.

Artists own their work and likeness, requiring AI platforms to obtain a license and provide compensation for exact copies.

The Human Artistry Campaign has created principles to protect human creators from AI exploitation, urging lawmakers to prioritize their interests.

AI models shouldn't be trained on copyrighted works without consent, and voice cloning can facilitate election fraud and create undetectable fake audio campaigns.

Law enforcement warns that AI voice cloning can be used for fraud and scams, and OpenAI has apologized for using a voice similar to Scarlett Johansson's without consent.

The US FCC has proposed a ruling to criminalize AI voice cloning, which can mimic voices and is used in robocalls.

AI-generated voice calls, including robocalls, are restricted by the FCC and break US law under the 1991 TCPA.

ElevenLabs' tool can clone voices in multiple languages with a 3-second sample to create localized content.

AI voice scams have affected 47% of Indian phone users, while AI voice cloning can aid in education for creating target language audio content.

China is improving its AI regulatory system, including requiring user consent for synthetic content.

The technology has been used to clone celebrity voices, like Tom Hanks and Emma Watson, without consent, raising copyright concerns.

A few seconds of audio can clone someone's voice, making fake recordings relatively easy to create.

Advances in machine learning and computing power have driven the development of voice cloning technology, enabling faster creation of convincing fake audio recordings.

Voice cloning technology uses AI to imitate a person's voice by training on their recordings with Natural Language Processing.

Voice cloning technology can mimic real individuals, raising concerns about copyright and rights infringement.

Title:

Content: People 's Daily Online > > Economy and Technology
“AI Sun Yanzi ” deceives your ears,“ AI Change Face ” wants to trick your wallet!
May 26, 2023 11: 31 | Source: People's Daily Online
Small number
Recently, there are two hot events about AI: one is the "AI Sun Yanzi" popular network; the other is the "AI Face" scam.
Two seemingly unrelated things have caused the public to think deeply about AI double-edged sword.
"AI Sun Yanzi" explodes network copyright issue caused controversy
First of all, "AI Sun Yanzi" is definitely the hottest Chinese singer in the first half of this year, followed by "AI Zhou Jielun", "AI Lin Junjie" and "AI Wang Xinling".
Before I heard that AI can arrange music and paint, now you will find that the role of big stars on the stage, AI is equally competent.
It doesn ’ t even need to be in person, the singers ’ “new album ” is already flying around.
What the hell is going on here?
It is understood that some people use the existing human voice samples of Sun Yanzi, through AI training timbre, tone quality and pronunciation characteristics, establish its sound model, and then use the generated timbre to cover other songs, there is "AI Sun Yanzi".
This uses an open source AI speech conversion software, the original author has stopped updating and maintaining this year, but there are still many netizens independently developing new features on the current version.
The enthusiasm of netizens for the creation of virtual singers implies the recognition and pursuit of emerging technologies.
As early as ten years ago, the virtual idols represented by "Hatsune Future" and "Luo Tianyi" have gradually entered the public eye, and their voices are made from real human sound source data.
With the iterative development of technology, the "real person double" virtual singer represented by "AI Sun Yan Zi" made a shining debut, "invading" is not only everyone's "childhood memories", but also some legal ambiguity.
The new songs produced by AI sound cloning technology are very similar in sound and style to the singer himself, which has led many netizens to believe that they are true.
Is this impersonation infringing?
The scope of works protected by the Copyright Law includes written works, oral works, music and fine arts, and sound is not listed.
Therefore, the mere imitation of performers' timbre, singing skills and other characteristics, does not belong to the protection of the Copyright Law.
In addition, only on a video platform, the "AI Sun Yanzi" cover works have exceeded a thousand, among which the works of the singer Zhou Jielun's "Hair as Snow" and other works have even won more than two million views.
A number of lawyers said that the works of the virtual singer's cover show the specific song name and singer's name, which is suspected of infringing on the singer's right to name, personality, and the copyright of the song.
Even if some publishers mark the disclaimer of "entertainment only and not for commercial use" in the video, the huge traffic and economic benefits behind it are difficult to be clear, and there is no way to completely discard the infringement issue.
"AI face change" fraud attack someone 10 minutes to be cheated 4.3 million
At present, Sun Yanzi himself has responded to his own "AI version" of music.
However, the concern of netizens about the application of artificial intelligence technology has not stopped.
In May, Apple announced that it plans to embed a new feature in the new version of the software: mobile phone users who have gradually lost their ability to speak for various reasons can create a unique "personal customized voice" by recording 15 minutes of audio, and can still use the phone's call and video functions normally after losing their ability to speak.
In this regard, many users expressed concern that the technology is more likely to be used by criminals, such as through the production of fake videos and audio recordings, for the implementation of telecommunications fraud.
Such fears are not unfounded.
According to the police, not long ago a Fujian boss fell into the "high-end" fraud bureau, because of the credulous use of "AI for face" fraudsters, just 10 minutes lost 4.3 million yuan.
The rapid development of AI has brought not only "unemployment anxiety", but also a new challenge to "true and false discrimination". At present.
A number of EU countries have already begun to review the issue of artificial intelligence feeding data.
In March, foreign publishers protested against the copyrighted content used by ChatGPT in data training, demanding compensation from its company OpenAI.
In China, the regulatory system of the artificial intelligence industry is also being actively improved.
At the end of last year, the State Internet Information Office issued a document requiring that when providing in-depth synthesis services such as synthetic voices, imitation voices, face substitution, and gesture manipulation, users should be prompted to inform the edited individuals according to law and obtain their individual consent; and if the synthetic content may lead to confusion or mistaken recognition, it must be marked in a reasonable position and explain the specific information of the synthetic work.
In April this year, the State Internet Information Office drafted the "Generative Artificial Intelligence Service Management Measures (Draft for Solicitation of Comments)" to clarify the data of pre-training and optimization training, and must not contain content that infringes intellectual property rights.
Producer ： Ye Zhen
General Manager: Luo Hua
Producer ： Sun Haifeng
Producer ： Zhang Feiran
Producer ： Lu Qian
Planning: Chen Jian
Copywriter: SHEN Jiaping
Photographer: Shi Xinpei
Edited by: Wang Kun
Design: Shanshan Lin
Data collation: Liu Wenjing (intern)
Title: The Salt of Money - Your Treasure
(Editor: Shen Jiaping, Lu Qian)
Public Number ： People 's Network Finance
Share it so more people can see it.
Back to top

This technology can create "fake music" using voice cloning, violating copyright laws unless the artist gives permission or receives compensation.

Title:

Content: EXCLUSIVE - Recording exec's warning to top Republican on rise of AI: Expert tells Marsha Blackburn 'fake music' is illegal and may destroy the livelihoods of musicians and artists

  • Chairman and CEO of the Recording Industry Association of America Mitch Glazier spoke with Sen. Marsha Blackburn, R-Tenn., on her 'Unmuted' podcast
  • AI programs are creating new content using 'voice cloning' based off an already-established artist's work without their permission and without compensation

Artificial Intelligence (AI) created 'fake music' using 'voice cloning' technology is beginning to infiltrate the recording industry, negatively impacting artist compensation and poising other challenges to copyright laws, according to a top recording executive.

Chairman and CEO of the Recording Industry Association of America Mitch Glazier spoke with Sen. Marsha Blackburn, R-Tenn., on her 'Unmuted' podcast and outlined a number of issues poised by AI-generated programs.

The clip, first obtained by DailyMail.com, the pair discussed challenges facing the music industry due to the rise of AI programs creating new content using 'voice cloning' based off an already-established artist's work.

Glazier, who has worked for over 20 years on the music industry's transition to streaming services, told Blackburn it is a 'double whammy' that AI programs are able to produce 'fake music' and also steal an artist's unique voice without proper compensation.

Chairman and CEO of the Recording Industry Association of America Mitch Glazier spoke with Sen. Marsha Blackburn, R-Tenn., on her 'Unmuted' podcast

'The artist and their partners should and do own their work. That's the entire constitutional premise that we've all fought for for so long - that this is the sweat of your brow, this is your genius,' Glazier said. 'You get to own this you get to create it, you get to decide who gets to use it and how and when it comes to your voice and your image and your likeness.'

He called it extremely 'personal' that someone can basically steal your essence and put your voice on a song 'you never meant to record' or that doesn't reflect your own experience.

'It can be putting it on something that you definitely wouldn't want to say,' he added.

'And so the the ability of these AI platforms to produce what I would call 'fake music' or inauthentic music at the rate that they do so and then to steal an artists voice to do it. It's almost like a double whammy,' continued Glazier.

Blackburn agreed, saying there are a 'sequence of problems' that are stemming from the unauthorized replication of work, which goes into copyright law issues.

The CEO explained how copyright laws have been violated through the use of AI technologies.

'The AI platform is taking an exact copy - under law we call it a 'reproduction' - which means that a rights been violated and you deserve to be compensated for it,' Glazier told Blackburn.

He said that when making an exact copy, the creator has an 'obligation' to get a license for the use, as YouTube and Spotify do - which is a partnership so both sides thrive.

'You're not supposed to break the law and ask questions later, which is what's happening,' he continued.

Glazier has praised the work of the Human Artistry Campaign, which put together 'principles for AI' that he says will help protect the work of 'human creators.'

He added that not all AI technologies are bad, and often help propel and supplement creative music work.

Sen. Marsha Blackburn, R-Tenn., on her 'Unmuted' podcast outlined a number of issues poised by AI-generated programs

During a Senate Judiciary Committee hearing earlier this month, Blackburn questioned OpenAI CEO Sam Altman about some of the issues facing the music industry

But there are 'basic rules' that need to be followed to ensure artists get the value they are deserved.

'As AI technologies advance, we need basic rules of the road to ensure that artists, creators, performers, and their works are respected and valued,' he tweeted.

The principles note that technology has long 'empowered' human expression and will continue to do so.

It also urges lawmakers to not back any copyright exemptions that might allow AI developers to 'exploit' artists and the interests of creators should be central in any future policy making processes.

During a Senate Judiciary Committee hearing earlier this month, Blackburn questioned OpenAI CEO Sam Altman about some of the issues facing the music industry.

Blackburn pressed Altman during the hearing to commit to not training 'AI models on artists' and songwriters' copyrighted works, or use their voices and their likenesses without first receiving their consent.'

Altman did not directly commit to Blackburn's request.

Sen. Richard Blumenthal, D-Conn., opened the hearing by playing an AI-generation of his own voice.

Recording exec warns top Republican on issues stemming from rise of AI and 'fake music'

The comments below have not been moderated.

The views expressed in the contents above are those of our users and do not necessarily reflect the views of MailOnline.

Artists own their work and likeness, requiring AI platforms to obtain a license and provide compensation for exact copies.

The Human Artistry Campaign has created principles to protect human creators from AI exploitation, urging lawmakers to prioritize their interests.

AI models shouldn't be trained on copyrighted works without consent, and voice cloning can facilitate election fraud and create undetectable fake audio campaigns.

Title:

Content: Acoustic reproduction techniques have developed rapidly and advanced in the past year.
REUTERS
Artificial intelligence is causing a crisis.
Rapid advances in artificial intelligence have made it easier to produce believable sounds that have allowed anyone from foreign actors to music lovers to clone someone ’ s voice, leading to a flood of fake content on the internet, confusion, anger and sowing discord.
Last week, actor Tom Hanks warned his followers on social media that bad actors used his voice to imitate him wrongly as he promoted dental plans.
Hani Farid, a professor of digital forensics at the University of California, says it ’ s not hypothetical, it ’ s about violence, it ’ s about election theft, it ’ s about fraud, and it ’ s about real consequences for individuals, societies, and democracies.
Phonetic cloning techniques have undergone rapid and advanced development in the past year.
The proliferation of cheap tools that are easily accessible online has allowed almost anyone to launch a complex audio campaign from their bedroom.
Tom Hanks Warns Against Advertising Exploited by ‘ Artificial Intelligence ’
It ’ s hard for the average person to spot fake audio campaigns, while photos and videos still have noticeable abnormalities — such as deformed hands and deviant words.
Social media companies are finding it difficult to modify the voice generated by artificial intelligence because human auditors often have a hard time detecting counterfeit products.
At the same time, few software companies have firewalls to prevent illegal use.
In the past, voice cloning software produced unrealistic automated sounds, but computing has become more powerful, and software has become more accurate.
The result was a technique that could clone millions of sounds, identify patterns in primary speech units, called phonetics, and simulate them within seconds.
Source: The Washington Post
Report: Artificial Intelligence Faces a Tough Test in 2024
Most Read
No stories found.
Erm News
www.eremnews.com

What are some risks regarding AI voice clning?

Law enforcement warns that AI voice cloning can be used for fraud and scams, and OpenAI has apologized for using a voice similar to Scarlett Johansson's without consent.

Title:

Content: OpenAI's Johansson gaffe pushes voice cloning into spotlight

Law enforcement warned that AI clones could be used to extort money from loved ones over the phone

By AFP

  • Follow us on

Scarlett Johansson voiced an AI character in the film "Her". — Reuters file

Published: Mon 27 May 2024, 7:51 PM

Last updated: Mon 27 May 2024, 7:52 PM

OpenAI was forced to apologise to actor Scarlett Johansson last week for using her voice -- or something very similar -- on its latest chatbot, throwing the spotlight on to voice-cloning tech.

Although OpenAI denied the voice they used was Johansson's, their case was not helped by CEO Sam Altman flagging the new model with a one-word message on social media -- "Her".

Johansson voiced an AI character in the film "Her", which Altman has previously said is his favourite film about the technology.

Right from the start, AI voice cloning has proved problematic.

Last year, British firm Elevenlabs went viral for all the wrong reasons when it released its voice-cloning software.

Internet pranksters immediately began pushing out deepfaked celebrities -- Harry Potter star Emma Watson was shown reading Hitler's Mein Kampf.

Law enforcement warned that AI clones could be used to extort money from loved ones over the phone.

The technology has developed rapidly in the past year becoming far more realistic and nuanced.

Danish entrepreneur Victor Riparbelli, CEO of British AI firm Synthesia, told AFP it was largely down to a program called Tortoise that was released two years ago.

The program's developers threw thousands of hours of voice data into their model in an unstructured way and discovered it not only learnt what to say but how to say it.

"That was a pretty big paradigm shift," Riparbelli said on the sidelines of last week's VivaTech conference in Paris.

Tortoise was an open source program and Elevenlabs was the first to go to market using it.

OpenAI uses similar systems though they do not release any details.

Much of the controversy around voice cloning has focused on concerns over people misusing the software.

But the claim against OpenAI is unusual because it is the company itself accused of playing fast and loose.

"It was very unfortunate that OpenAI did that -- really not very good," Katya Laine, CEO of TALKR.ai, told AFP at VivaTech.

"If they actually cloned her voice without her knowing then I think that's very very bad," said Riparbelli.

The two entrepreneurs are among hundreds harnessing AI voice programs for uses that they argue will make companies more efficient.

Laine's firm provides virtual voice assistants -- essentially AI customer service agents.

She said her firm's system could now resolve 25 to 30 percent of calls without any human involvement.

Synthesia specialises in video avatars, which Riparbelli said allowed any office worker to turn text or slides into a video performed by a realistic AI.

Both Riparbelli and Laine allow their clients to use their own avatars, off-the-shelf products or those supplied by the likes of OpenAI and Elevenlabs.

Riparbelli said Synthesia used actors whose likenesses and voices were licensed for two years with an option to renew after the initial period.

The problems arise if actors' voices are used without their consent.

The fiasco overshadowed a developer conference in Paris last week when OpenAI was showing off a suite of new tools.

In front of a big screen in an auditorium, Romain Huet, OpenAI's Head of Developer Experience, breezily chatted into his phone.

Seconds later, his short voice sample had been processed and could be heard commentating over a generated video -- in five languages.

The demonstration showed how quickly the field is moving, but the headlines had already been written.

The Washington Post asked in a newsletter "How dumb is OpenAI?", other commentators were suggesting wunderkind Altman was nothing more than a huckster.

Nonetheless, Riparbelli was open to OpenAI's argument that they had used another actor who just sounded liked Johansson.

"If it's not her but someone who sounds a lot like her... where do you draw that line," Riparbelli asked.

"If they're not allowed to use someone who sounds a lot like her, then it sets a very odd precedent."

More news from World

The US FCC has proposed a ruling to criminalize AI voice cloning, which can mimic voices and is used in robocalls.

Title:

Content: 【 Printing 】
【 Page 1 Page 2 Page 3 】
After the "fake Biden call", the United States intends to declare that AI phones are illegal
Related LINKS http: / / www.CRNTT.com 2024-02-03 09: 51: 39
On January 21, local time, some voters in New Hampshire said they received an automated message from "President Biden" telling recipients not to vote in the state's primary election.
(Source: Surging News)
BEIJING, Feb. 3 (Xinhua) -- According to surging news reports, the U.S. Federal Communications Commission will vote in the next few weeks on whether to make it illegal to use AI-generated voice to make robot calls (robocall).
Members will vote on the proposal in the coming weeks.
Experts pointed out that when voice cloning companies develop apps, videos related to celebrities, which are more misleading and have a greater risk of transmission can be designed to strengthen the dominant logo in the transmission process to remind the audience.
“Artificial intelligence is creating confusion by mimicking human beings to deceive consumers with fake voices, pictures, and videos.
Whether it ’ s a celebrity or politician you like to support on the phone, or a relative or relative on the phone who has a relationship with you, we have the potential to be the target of these AI fake calls when they call for help. ”
In response to a number of recent AI deep counterfeiting incidents in the United States, on February 1, local time, Jessica Rosenworcel, chairman of the Federal Communications Commission (FCC), proposed that it would be illegal to use AI-generated speech to make robot calls (robocall).
Previously, AI impersonated US President Joe Biden to call voters, well-known singer Taylor Swift AI false "indecent photos" on the Internet crazy, coinciding with the US election year, a number of AI deep fake incidents caused people to worry about artificial intelligence fraud.
A vote on the proposal in the coming weeks.
Robocalls, also known as pre-recorded calls, use computer-controlled automatic dialing machines to send out pre-recorded messages, like robots, often harassing mobile phone users for the purpose of marketing or disseminating certain information.
According to the FCC, the AI-generated sounds in robotic phones have “escalated over the last few years ” and“ have the potential to confuse consumers by mimicking the voices of celebrities, political candidates, and close family members. ”
Rosenworcel said her proposed Declaratory Ruling would “criminalize this emerging technology under current law, which will provide new tools for our partners in state attorneys general ’ s offices across the country to use to combat scams and protect consumers, ” the report said.
【 Page 1 Page 2 Page 3 】
【 Printing 】
Related News:

AI-generated voice calls, including robocalls, are restricted by the FCC and break US law under the 1991 TCPA.

Title:

Content: AI-generated voices will be restricted by the FCC for robocalls

|
,

Robocalls are some of the worst things you can see come up on your mobile phone. Most of them are annoying sales pitches, or outright scams. But these days, with AI-generated everything, robocalls have the potential to become more of a problem than they already are.

Estimated reading time: 2 minutes

AI-generated voices are a real thing, and AI-generated voices can be made effortlessly. Spend any time on YouTube Shorts and you can find ads showing celebrities like Dwayne Johnson and Oprah, hocking federal tax relief and other scams. These YouTube Shorts use AI-generated voices to try to convince you that these celebrities actually endorse the product shown.

Using this method over the phone is far more effective because you don’t have the visual to help your brain discern that it is fake. According to PC Mag, the FCC has confirmed that AI-generated voice calls can “break an existing US law from 1991 that was designed to protect consumers from pre-recorded automated calls.”

FCC Chair Jessica Rosenworcel said, “The Telephone Consumer Protection Act (TCPA) is the primary law we have to help limit unwanted robocalls. It means that AI tech like voice cloning falls within this law’s existing prohibitions and that calls that use this technology to simulate a human voice are illegal, unless callers have obtained prior express consent.”

According to PC Mag, the FCC’s rule may stop unwanted and spammy robocalls, but it will also affect legit companies that use “AI agents” for certain phone calls. The companies using this technology will then need to receive permission from users before using the technology for their phone calls.

Our AI world is getting wild and soon we may not know what is real and what is not real.

What do you think of AI? The use of AI in phone calls? AI in general? You may comment by using the social media buttons below. Please share on your favorite social media site and tag us on Facebook, X, MeWe, and LinkedIn. Or join our Telegram channel here.

Image Credit: dm.derk from Midjourney
Previous

Ring security basic plan will see a price hike next month

Latest Articles

Share via
Copy link
Powered by Social Snap

ElevenLabs' tool can clone voices in multiple languages with a 3-second sample to create localized content.

Title:

Content: Language No Barrier: New AI tool can clone voice and make it say anything in multiple languages

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

Mehul Reuben Das May 03, 2023 13:42:20 IST

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

As advanced as AI-based voice cloning has been, there were a few limitations to it. For example, voice generators were mainly bound by the language of the source they were trained in or rather the language of the prompt that was given to them. Now, ElevenLabs, an American AI software developing company has come up with a tool that does away with that limitation.

ElevenLabs’ new AI tool can clone the voice of a person and make it say anything in a bunch of different languages. All it needs is a clear voice sample of about 3 seconds, although it also suggests that the longer the sample, the better will be the results. The new tool even manages to maintain the speaker’s original tone of voice.

Limitless possibilities
The creators expect that this would ‘extend the possibilities’ in a variety of industries such as publishing, gaming creation, and media. “Introducing Eleven Multilingual v1: Our New Speech Synthesis Model! We’re thrilled to launch our new model supporting seven new languages: French, German, Hindi, Italian, Polish, Portuguese, and Spanish.”

“This advancement expands the horizons for creators, game developers, and publishers, and it paves the way for using generative media to create more localized, accessible, and imaginative content,” the company said.

Following the announcement, Twitter was flooded with comments, with users testing the software on various famous faces.

To demonstrate just how capable the new voice cloning AI tool is, Eluna AI, a platform for AI-content creators experimented with a sample clip of former US President Donald Trump.

In their demo, Eluna AI showcased a small clip of Donald Trump, speaking in his native tongue, English, followed by French, Spanish, German, Hindi and Italian, almost perfectly. The generated samples even gets the accent right, almost if he was a native speaker of the new target language.

Another user changed David Attenborough’s voice to German while the BBC broadcaster discussed the prospects of AI. “With this tool, anyone can do it,” stated the Twitter user. “It’s also worth noting that fraudsters will undoubtedly exploit this one.”

ElevenLabs says that its model was designed to understand the emotion and reasoning underlying words in order to produce natural-sounding and persuasive audio. ElevenLabs has said that some numerals and symbols are currently spoken wrongly, but that it is striving to rectify this.

Who is this new tool meant to help?
The US-based company believes its technology will be valuable in a variety of areas, including education and journalism.

Game developers and publishers can build engaging, localised experiences for worldwide audiences, breaking through language barriers and connecting with players and listeners to maximise engagement and efficiency while maintaining quality and accuracy.

“Educational institutions now have the ability to develop audio content for varied users in their target languages, enhancing language comprehension and even pronunciation abilities, as well as responding to different teaching methods and learning demands,” says the report.

Because of the model’s capacity to produce unique character-like voices, audiobook and content developers may also find it beneficial.

The conundrum of AI voice genertors
Despite its benefits, ElevenLabs’ launch comes amid widespread concern about the wave of new voice cloning technology. An unidentified TikTok user went popular last month after sharing an AI-generated Drake song starring The Weeknd.

It sparked concerns about the grey area of AI-created music and whether it constitutes a copyright violation. Nonetheless, ElevenLabs claims to be ‘fully committed’ to respecting creators’ rights in the midst of technological advancements.

“At Eleven, we think that we should seek to make the best use of emerging technology, but not at any expense,” it stated.

“As we create them, we make every effort to put suitable controls in place that reduce the possibility of detrimental abuse. With this in mind, we are entirely committed to both protecting intellectual property rights and taking action against infringement.”

Read all the Latest NewsTrending NewsCricket NewsBollywood News,
India News and Entertainment News here. Follow us on FacebookTwitter and Instagram.

Updated Date:

also read

World

Music labels are worried because of AI, thanks to a surprising new song ft. Drake X The Weeknd

Someone used AI to create a whole new song featuring Drake and The Weeknd. But because the singers never sang the song, artists and music labels are worried, how AI voice modulation and AI-generated songs can disrupt the industry.

World

Artificial Imposter: 47% of Indian phone users have experienced AI voice scams, highest in the world

About half of Indian adults, or 47%, have experienced AI voice scams, nearly double the global average of 25%. Furthermore, nearly 69% of adults say they can't differentiate between a real and an AI-generated voice.

What is necessary for voice cloning to work?

AI voice scams have affected 47% of Indian phone users, while AI voice cloning can aid in education for creating target language audio content.

How will educational institutions benefit from developing AI voice audio content for languages learners?

China is improving its AI regulatory system, including requiring user consent for synthetic content.

The technology has been used to clone celebrity voices, like Tom Hanks and Emma Watson, without consent, raising copyright concerns.

Title:

Content: After the Scarlett Johansson incident.
Voice Reproduction by Artificial Intelligence in the Spotlight
T + T - normal size
Voice cloning technology raises many concerns with the adoption of a number of companies, such as OpenAI, the creator of the famous “Chat GBT ” program, who was finally forced to apologize to actress Scarlett Johansson after copying her voice in the latest version of her automated chat program.
OpenAI general manager Sam Altman apologized to the actress and announced the suspension of the voice of the help tool "Sky" on "Chat GBT."
The company made a presentation in September to Scarlett, who lent her voice about a decade ago to an artificial intelligence system in the film "Hair", but the actress refused to be the voice of the system of the new version of "Chat GBT".
OpenAI, for its part, denied that it had cloned Johansson's voice, noting that it had created its instrument using the voice of another actress.
News of acoustic tricks very similar to reality, fraud or misinformation using voice cloning is constantly making headlines, highlighting the ability of artificial intelligence systems to mimic human voices.
Last year, Eleven Labs, a startup working on an AI voice cloning tool, warned against abusive use of its software.
Unidentified users on the 4Chan forum had been circulating messages in which famous voices were cloned and made the voices uttered with inappropriate meanings.
In one audio clip, actress Emma Watson is heard reading a passage from Adolf Hitler ’ s Mein Kampf.
A paradigm shift.
The director of the startup, Danish businessman Viktor Ribarbelli, told AFP that the technology was largely created through an open-source software called Torts that was launched two years ago.
His company transforms text into video using an avatar created by artificial intelligence.
It employs actors whose voice and shape are subject to a two-year contract, with the possibility of renewal, said Ribarbelli, who was interviewed by AFP on the sidelines of the recent Vivatek exhibition of new technologies in Paris.
The Torts machine learning program analyzed thousands of hours of audio recordings and served as a base for the Eleven Labs app.
"It was an important qualitative shift," said Ribarbelli.
OpenAI uses similar software, although it does not disclose details.
With ChatGT4.0, the user can say a few sentences in French in front of the app, which in a matter of minutes can reproduce this audio and use it to narrate a short video in five different languages, OpenAI showed during a demonstration of the program in Paris.
Like this American company, hundreds of companies now offer voice cloning, which has become more realistic and accurate.
Among them is TALKR.ai, a French company for virtual voice assistants created by artificial intelligence.
The service can handle 25% to 30% of customer service calls without any human intervention, according to its president, Katya Linh.
Like Viktor Ribarbelli, Lenny sees the use of actors ’ voices without their consent as a red line.
As for what happened with Scarlett Johansson, Ribarbelli said: “If they clone her voice without her knowledge, it ’ s very bad, but if they don ’ t have the right to use someone ’ s voice that sounds very similar to her, it sets a very strange precedent. ”
Email

Title:

Content: How artificial intelligence visits celebrity voices? | Click | DW | 15.05.2023
1.
Inhalt
2.
Navigation
3.
Weitere Inhalte
4.
Metanavigation
5.
Suche
6.
Choose from 30 Languages
CLICK
How does artificial intelligence influence celebrity voices?
The rapper Drake is one of the artists whose voices have been used in the so-called deep falsification of the voice without their consent.
Technically, it is easy.
But is it legal and moral?

A few seconds of audio can clone someone's voice, making fake recordings relatively easy to create.

Title:

Content: AI Voice Cloning: The Future of Entertainment and Counterfeiting
To copy the voice of one of the characters, it is enough to collect a few minutes of his speech, without any external interference.
The software then creates a model of his voice, allowing it to be used in new content, even in foreign languages.
(Getty)
A French videographer uses Deep Vike to simulate the voices of current and late politicians who are engaged in live dialogue with users on Twitch, including French President Emmanuel Macron and two of his famous predecessors, Charles de Gaulle and Jacques Chirac.
Anis Ayari, an AI engineer and owner of a scientific simplification YouTube channel called Defend Intelligence, was behind his “deep fakes ” as satirical content.
But the experience took on negative dimensions on Tuesday, when a netizen asked an alleged Macron what the worst name was for a French village, and artificial intelligence answered “La Mort-aux-Juifs ” (French for“ Death to Jews ”), a small village in the Lauret region of central France that was renamed in 2015.
This led to the immediate blocking of the canal.
The channel ’ s owner wrote in a message on the platform X (formerly Twitter) that he had filed an appeal against the decision and relaunched the live streaming sessions on the rival platform Kick.com.
Months ago, this expert, who promotes virtual “assistants ” to companies, also used deep fakes to get the French president to sing his voice a song by famous singer Charles Aznavour.
He revealed in a video the techniques he adopted in this video trick.
Finally, Ayari began to clone historical or other current figures such as Elon Musk, engaging them in “discussions ” with current political players.
Anis Ayari says, “We will simulate a political debate and we will see where we get on this. ”
To copy the voice of one of the characters, it is enough to collect a few minutes of his speech, without any external interference.
The software then creates a model of his voice, allowing it to be used in new content, even in foreign languages.
“If we have 15 to 30 seconds of good quality, we start to get remarkable results.
There is no longer any need for knowledge in computer programming. ”
Ayari launched an appeal to fund the live broadcast of his version of the French president.
Ayari asserts that using different information services costs him about 150 euros per day.
Tradition, however, has its limits, as the movement of the lips shows some loopholes.
Faced with absurd questions from some netizens, Emmanuel Macron in the fake version gives strange answers, for example, “The pension system is out of my programming.
Let ’ s talk about more fun topics. ”
As the French president says in the AI-developed version, “My statement about my assets has the same credibility as the promises of a politician in his election campaign. ”
“There was a boom in vote generation last year, and it ’ s accelerating. ”
Several projects are currently underway that allow non-professionals to practice deep fakes in China, South Korea and Japan, where mimicking the sounds of manga characters is popular.
On Twitch ’ s “Trump or Biden 2024, ” two AI-developed versions of current US President Joe Biden and his predecessor, Donald Trump, engaged in a long summer exchange that continues under the watchful eye of hundreds of netizens who can launch topics for discussion in writing.
Musicians have also paid a price for these technologies, as their voices have been reproduced in works of art without charge.
Actors, for their part, are concerned about the use of their images from studios, and the cybersecurity community is seeing a rise in phone-based phishing techniques.
But should we fear a new wave of disinformation using these techniques?
Anis al-Ayari answers, “The more people realize [the spread of deep fakes], the more critical they feel. ”
He says through his channels that the content he publishes is “satirical. ”

Title:

Content: The scary side of artificial intelligence

The pros of AI outweigh the Cons or threats in our day-to-day lives, and there’s no magic pill to protect us from the scary threats of AI.

  • Exclusive

It's a free Content, simply login/signup to unlock

Get in-depth Industry Insights and Analysis through our “Exclusive” content, presented to you by our esteemed panel of writers, for free

By continuing, you agree to the Terms & Conditions and acknowledge our Privacy Policy. This same account can be used across all Economic Times B2B portals.

  • Updated On Oct 3, 2023 at 03:02 PM IST

Artificial intelligence (AI), as we all know, is the simulation of human intelligence leveraging computer systems and machines. AI programs can continuously learn and evolve with experience. In technical terms, AI systems render the output by churning and analyzing the data for correlations and patterns and help make future predictions using these patterns.

Advt
Today AI is being used extensively in all facets of our lives starting from lifestyle, e-commerce, home appliances, automobiles, navigation, transport, healthcare, agriculture, education, financial planning, chatbots, marketing, cyber security, virtual assistant, industrial automation and many more.

Clearly, we have and are leveraging the strengths of AI to the fullest to automate the routine tasks and make it auto-learn over a period. There’s no doubt that AI has revolutionized the lives of all – organizations, consumers etc. But as they say, “Everything comes at a price”. This analogy is quite true for AI as well, there have been a lot of threats that have emerged using AI and are being utilized by the Cyber criminals to dupe the ignorant users, cause mental stress and extort money.

continued below

Executive Workshop

I’m not going to delve into all of threats but would like to elucidate some of the real ones that have come to the surface recently:

Voice cloning or mimicry

As the name suggests, it uses machine learning algorithms to simulate anyone’s voice. It requires certain voice data to analyze and learn the specific patterns of any individual. There are certain advantages of cloning a voice that can be used in voice assistants, chatbots, navigation systems and other areas. Voice cloning has existed for a while but was restricted to experts who possess the technical knowledge to be able to use the same. But now AI Voice cloning tools are available on the open Internet that anyone can leverage with literally no technical knowledge or cost to clone anyone’s voice. All you need to do is just Google and it will pop up and get a bunch of both free and paid AI Voice cloning tools.

Advt
In fact, recently one of the global leaders in online protection published a report stating how AI is fueling a rise in online voice scams, with just three seconds of audio required to clone a person’s voice. This is extremely creepy. Just imagine, if a Cyber-criminal clones your voice and tricks your near ones by making them believe that they are talking to you, and request for money due to any distress reasons. In fact, these are not assumptions but real-life incidents that are happening across the world every minute.

Deepfakes AI

Deepfakes AI are being used to impersonate an individual by manipulating videos, images, audios, and other content available on the social media platforms using deep learning techniques. It mainly transforms existing content from one person to another. This is another area that has been exploited by the Cyber criminals in the recent past, and there are a few deepfake cases that have made waves on the Internet. One of the most famous ones being Deepfake created by a VFX artist of one of Hollywood’s most famous male actors. This piece was so well made by rendering thousands of pictures using artificial versions of the actor. There are similar Deepfakes incidents involving other global celebrities and leaders. The damage and misuse of the deepfakes videos could be extremely dangerous for the human society and can be used by terrorists to incite riots and create nuisance.

Creating virtual people

This is another area where AI is being used to create people that do not exist. There are a lot of websites that allow you to generate a random image by just specifying the age group, gender & ethnicity, and you can continue to refresh these images at the click of a button. Be mindful of the fact that these images pertain to people that do not exist in this world. On the similar lines, there’s an emerging trend of AI news anchors that possess a human-like appearance and are fed data that they can read using text-to-speech technology. Recently, there's been a surge of AI-Driven robotic new anchors in multiple language channels. While the main objective of this initiative is to provide royalty free or cost-effective human images for branding and other purposes. However, the overuse of these technologies causes Fear of missing out (FOMO), Feeling of inadequacy, dissatisfaction, and isolation may potentially lead to psychological and emotional vulnerabilities.

One of the Hollywood movies, ‘HER’ portrayed an introverted and lonely writer (Joaquin Phoenix) who purchases an AI virtual assistant personified through a female voice to assist him in his writing job. However, when he finds out about its ability to learn and adapt, he falls in love with it. The film delves into emotional vulnerability and the impact of AI on human relationships.

Needless to say, that the pros of AI outweigh the Cons or threats in our day-to-day lives, and there’s no magic pill to protect us from the scary threats of AI. However, there are certain preventive tips that one can follow to mitigate any such risks. Do spread awareness with your family and friends:

  • Set some code words with family, and friends to verify the identity during emergency circumstances
  • Optimize social media presence by limiting your connections with only known contacts and avoid connecting with any unknown ones
  • Avoid saying ‘Yes’ as a greeting while receiving unknown calls as it can be used to authorize credit card charges or other purposes
  • Continuously update privacy settings on social media to allow viewing by friends and family only
  • Avoid clicking on any suspicious links or calls received without proper due diligence
  • Do not share your passwords and other sensitive information with anyone
  • Verify the credentials of any online information before circulating it through various mediums
  • Avoid public Wi-Fi connections offered at coffee shops or airports, which requires to enter password
  • Closely monitor the time spent by younger generation on social media and online gaming
  • Finally, in case of any suspicion, double check and report it to the host site or concerned authorities
The author is the CIO of MOVIN

Disclaimer: The views expressed are solely of the author and ETCIO does not necessarily subscribe to it. ETCIO shall not be responsible for any damage caused to any person/organization directly or indirectly.

  • Published On Oct 3, 2023 at 03:02 PM IST

Most Read in Artificial Intelligence

Join the community of 2M+ industry professionals

Subscribe to our newsletter to get latest insights & analysis.

Download ETCIO App

  • Get Realtime updates
  • Save your favourite articles

Title:

Content: What we know about Vall-E 2
According to these claims, Microsoft has developed a new artificial intelligence speech generator that is so adept that it can do more harm than good.
VALL-E 2 voices the text with the voice of a particular person, for which he needs only a few seconds of audio recording of the speech of this person.
Midjourney artificial intelligence has its own version of who is the president of the United States, and it ’ s not Biden
Microsoft researchers said that VALL-E 2 "has reached human parity."
It is capable of generating "accurate, natural speech by the voice of the original announcer, which can be compared to a human voice."
In other words, the new AI voice generator is convincing enough to be mistaken for a living person.
This opens up potentially dangerous opportunities for unscrupulous people.
VALL-E 2 is the latest achievement in speech models of neural codecs and marks an important milestone in text-to-speech (TTS) synthesis.
[...] VALL-E 2 consistently synthesizes high-quality speech, even for sentences that traditionally cause difficulties due to their complexity or repetitive phrases,
The developers write.
We ’ ve already seen examples of neural networks that are able to clone voices based on a multi-second recording, but Microsoft says its technology is superior to anything that has been on the market so far.
"Our experiments conducted on the LibriSpeech and VCTK datasets have shown that the VALL-E 2 is superior to previous TTS-systems [...] in reliability, naturalness and similarity to the speakers.
This is the first of its kind system that has reached parity with a person on these indicators, ” the article says.
The quality of the VALL-E 2 results depends on the length and quality of the speech prompts, as well as environmental factors such as background noise.
See also Google allows you to make your own copy of a celebrity to chat with her in a chatbot
What happens next with the technology
Despite its capabilities, Microsoft will not release VALL-E 2 to the public due to potential abuse risks.
Recently, we have seen a wave of fraud – both at the level of ordinary users, who are deceived by fraudsters, forging the voice of their relatives or friends, and at the level of state leaders who “call ” their voters, and celebrities who allegedly advertise cryptocurrencies and various fraudulent schemes in advertising.
VALL-E 2 is a research project.
We do not plan to include VALL-E 2 in the product or expand access to it for the public.
This may carry potential risks of abuse of the model, such as faking voice identification or impersonating a particular speaker,
The creators of the technology write.
But they suggest that artificial intelligence technology may find practical applications in the future.
VALL-E 2 can synthesize a language that retains the identity of the speaker, and can be used for educational training, entertainment, journalism, author content, accessibility features, interactive voice response systems, translation, chatbots, and more.
But to do this, you need to add a special protective protocol that will ensure that the speaker approves the use of his voice.

What are some risks regarding AI voice clning?

What is necessary for voice cloning to work?

What are some risks regarding AI voice clning?

What is necessary for voice cloning to work?

What are some risks regarding AI voice clning?

What is necessary for voice cloning to work?

Advances in machine learning and computing power have driven the development of voice cloning technology, enabling faster creation of convincing fake audio recordings.

Title:

Content: Science and Technology
Technology: AI can create fake sounds that fool smart devices and humans
Thanks for reading the news about technology: AI can create fake sounds that fool smart devices and humans.
Researchers at the University of Chicago ’ s Security, Algorithms, Networks, and Data (SAND) Lab tested AI with deep voice counterfeiting software available on open-source developer community site Github to see if they could unlock voice recognition security on Amazon ’ s Alexa, WeChat, and Microsoft Azure.
Easily available software can imitate someone ’ s voice with such precision that it can fool both humans and smart devices, and one software, known as SV2TTS, takes just five seconds to make an acceptable imitation.
SV2TTS has also been described as a “real-time audio cloning toolbox ” and was able to fool Microsoft Azure around 30% of the time but even more so than WeChat and Amazon Alexa almost two-thirds of the time, or 63% of the time.
The technique was also able to trick human ears, so 200 volunteers were scammed and asked to identify real sounds from deep fakes about half the time.
Deep voice was more successful at faking women ’ s voices and those of non-native English speakers, the researchers wrote in a report published on open access server arxiv: “We found that both humans and machines can be reliably fooled by artificial speech and that existing defenses against compound speech are weak. ”
"Such tools in the wrong hands would enable a range of powerful attacks against both humans and software systems."
WeChat allows users to log in with their voices, and among other features, Alexa allows users to use voice commands to make payments for third-party apps.
Wenger and her colleagues also tested another audio synthesis software, AutoVC, which requires five minutes of speech to recreate the target ’ s voice.
AutoVC was only able to fool Microsoft Azure around 15% of the time, so the researchers refused to test it against WeChat and Alexa.
Lyrebird, a San Francisco-based startup, recently announced its ability to generate the world ’ s most realistic synthetic sounds, and in its ethical manifesto, Lyrebird admits that the audio synthesizer “holds the potential for abuse. ”
You may also read.

Title:

Content: That’s how easily your vote can be stolen – and used for AI fraud

The person on the phone sounded exactly like Ruth Card’s grandson Brandon.

He needed money fast and Ruth, recognizing his voice, went to the bank.

Benjamin Perkins’ parents received a call from a man who said he was a lawyer. Benjamin was alleged to have killed another man and needed bail money. The lawyer handed the phone to someone – who sounded exactly like Benjamin.

In both cases, as Washington Post reported on, it involved a new form of fraud – voices cloned using artificial intelligence.

“Impossible to imagine a year ago”

In the past, large amounts of audio material were required to be able to reliably clone someone’s voice, but AI development is going at a breakneck pace – now it’s faster, easier and more accessible than before.

– What was impossible to imagine a year ago is free today. The companies that make and sell AI want a lot of data – that’s why they give away their services, says Tobias Falk, lecturer at the department of computer and systems science at Stockholm University, to SVT Nyheter.

“Having reached a point where the machines can imitate us”

– Algorithms are trained to imitate how the human brain works. It’s going really fast now, but it’s taken decades to get to the point where the machines can mimic us as well as they do today.

The police’s national fraud center writes in an email to SVT Nyheter that they are “aware of the phenomenon” but that they have not seen any cases in Sweden at the moment. “We monitor this and have communication with international contacts,” writes the police spokesperson.

How many seconds long clip is enough to be able to clone someone’s voice? And how well does it actually work in Swedish?

Watch the video above for our test.

Voice cloning technology uses AI to imitate a person's voice by training on their recordings with Natural Language Processing.

Title:

Content: Opinions and Articles
What is deepfake technology and how does it work?
What is deepfake technology and what is its mechanism of action and the limits of its potential that can be used to fake videos, images and sounds?
# Alert your personal opinion as a specialist in the field in the last post:
Deepfake is a very dangerous artificial intelligence technique that is used in the manufacture and counterfeiting of videos, images and sounds, which can show people saying or doing things they never said or did in fact and can reach high accuracy in it with the large size of data used in the training of the quasms that the technology works on.
Let ’ s start with Voice Deepfake, also known as Voice Cloning, is an artificial intelligence technique designed to create quasmids capable of imitating the voice of a real person.
In order to do this, it must be trained on the recordings of the target person and after the completion of the training phase, the algorithm is able to produce a synthetic voice similar to the voice of the target person.
To do this, specialists use natural language processing techniques such as NLP, a machine learning technique that enables computers to interpret, process, and understand human language.
These techniques are used to identify the distinctive voice features of the voice of the target person and there are a large number of voice features that are analyzed, including the feature of pitch and low voice so that there are people characterized by high voice and others by low voice, and is also analyzed speed feature in the nature of the speech of the target person, and also of these features Cadence, which is the way the voice of the target.
Of course, to reach high accuracy, there must be huge data to train Khasmia many recordings of the target person and the easiest way to reach quick results to falsify the voice of a person is to use one of the existing Khasmia online open source and the transfer learning technology on it and train the algorithm on a simple recording can Khasmia trained high precision easily identify the voice features and imitate.
But the problem is that most of the existing algorithms yes are high precision but they have been trained on either recordings in English or classical Arabic and algorithms trained on ZD data for those who enter a section in Sudanese bicycles get what is known as data drifting and this leads me a sharp decline in the accuracy of the results of the algorithm so you will find the product section very clear that it is fake.
Good and solution?
In the case of trying to fake the voice of a person in a Sudanese dialect using the technology of transfer learning will not benefit and will not come satisfactory results so you must train Khasmia from scratch on data using too many clips for the target person and is a very cumbersome process so you find there is a Russian company that offers this service to produce clips in English to fake videos and voice me anyone but at a cost of $20,000 per minute English can cost you $100,000.
The conclusion of the personal opinion that the audio in the video is real, but the video may be an old video was installed audio and adjust the synchronization and movement of the lips using the Deepfake technology in the video I noticed in the movement of the lips of the speaker some errors in the synchronization between what is said and the movement of the lips.
with my regards,
M.M. Mohammed A.M.
Valid
Researcher and Engineer Automated Robotics and Expert Artificial Intelligence Systems
London, United Kingdom
# Cher _ in _ the _ good
A dose of awareness
# شير _ على _ معر _ مع

What is necessary for voice cloning to work?