AI voice cloning technology enables the replication and generation of human-like speech by training AI models on very short audio samples, sometimes as little as 3 to 15 seconds.

This is achieved through advancements in neural codecs, text-to-speech synthesis, and machine learning algorithms that capture and reproduce the unique tone, style, and nuances of a speaker’s voice.

Notable examples include Apple’s "Personal Voice," which allows individuals with speech impairments to create a digital voice replica from just 15 minutes of training audio, and Microsoft's VALL-E 2, an advanced system that generates near-human speech from a few seconds of input.

ElevenLabs offers a multilingual voice cloning tool widely used in education, gaming, and media productions, demonstrating the technology's accessibility and versatility .

The applications of AI voice cloning span entertainment, accessibility, political communication, and darker uses such as scams.

For entertainment, virtual singers like "AI Sun Yanzi" perform using AI-cloned voices, producing new songs indistinguishable from originals.

Accessibility applications include Apple's Live Speech and Personal Voice, aiding people with speech disabilities.

Politically, voice cloning in India delivers customized voter outreach in over 117 languages.

Unfortunately, criminals exploit this technology for telecom fraud, impersonating relatives or public figures to deceive victims, causing financial losses such as a notable case in Fujian, China, where a businessman lost 4.3 million yuan within minutes to AI-driven scams .

Legal frameworks around AI voice cloning remain nascent and inconsistent globally.

Most copyright laws do not explicitly protect voice as intellectual property, leading to unclear boundaries concerning ownership and consent for cloning.

China has introduced regulations mandating consent for synthetic voices and transparent labeling of AI-generated content to prevent misuse.

AI voice cloning technology enables the replication and generation of human-like speech by training AI models on very short audio samples, sometimes as little as 3 to 15 seconds.

Title:

Content: My channel
* Drag categories can be customized sorting
Recover Default OK
Setup
Alert
Did you forget about it?
80-Year-Old Biden's' Strange Behavior 'Worries
The US government has stopped trading again, and the dollar has gone up.
The voice of Conan's voice was stolen by the AI, and the fake cover song went viral, but it couldn't be controlled.
Artificial intelligence (AI) is becoming more and more advanced, but it also raises related intellectual property issues.
The voice actor (voice actor) of Conan, the protagonist of the Japanese animation "Detective Conan", has been "stolen" by AI, and the songs she covers on the social network are in fact masterpieces of AI. Although the agency is angry and troubled, it can not manage.
According to Yomiuri News, these voice actors are being used without consent, and after being learned by artificial intelligence, they are imitating them to cover songs or read articles aloud.
In order to protect intellectual property rights and prevent abuse, the use of AI must be regulated, experts say.
In July of this year, TikTok appeared "Conan covered the song for me", the video is Conan's "voice", but the singing is completely unrelated to the anime popular song, in fact, it is a work produced by the author using AI.
Conan's character is voiced by the voice of the voice Yo Ko Shannan, and someone in the comments section said, "It seems that Takayama himself is singing."
Takayama's agency 81 Produce said it was not authorized to use Takayama's voice.
"We are very troubled by our inability to do anything about it," said Yoshida, managing director of the brokerage company.
He also said, "I am worried that in the future, AI voice will be used in film and animation dubbing without consent."
The industry must set rules for the use of AI. ”
There are also a number of Kenproduction voices that have been used by artists without permission.
Representative director Kentaro Uchikai said, "There are no regulations on the use of AI sound at present, and it would be really annoying if it developed into something like swearing."
Generative AI takes only a short time to learn the voice of a specific person and imitate it perfectly.
There is also an "AI voice changing system" that can change the sound line to become the voice of others, and it is difficult to distinguish whether it is true or not.
The change in AI ’ s voice has also sparked controversy overseas.
Earlier this year, AI startup ElevenLabs admitted that its speech synthesis tool could be used for “malicious purposes ” and users posted a speech synthesized through“ deepfake ” technology to impersonate British actress Emma Watson to read Hitler ’ s autobiography “Mein Kampf ”.
In Japan, which has a huge voice industry, the sense of crisis brought by artificial intelligence is even stronger.
Article 30-4 of the Japanese Copyright Law stipulates that AI can learn copyrighted works without authorization, and can also learn the lines of animations or movies, which is not illegal.
The revision of the law was originally intended to promote the development of the artificial intelligence industry, but it brought side effects.
In June this year, Japan ’ s Peugeot Union (actors ’ union) said that “AI is easy to encourage imitation and embezzlement, and it is feared that it will infringe on the workplace ”, and called for a revision of Article 30-4 of the Copyright Law, requiring that AI must obtain the consent of the copyright owner before learning.
AI Artificial Intelligence Japan
The last one.
Thai human rights lawyer sentenced to 4 years in prison for 'offending monarch'
Extended reading
Super-popular
More >

What is necessary for voice cloning to work?

This is achieved through advancements in neural codecs, text-to-speech synthesis, and machine learning algorithms that capture and reproduce the unique tone, style, and nuances of a speaker’s voice.

Title:

Content: Conan-kun never sings?
There are a lot of AI mimicking sound on the Internet, but pirated videos can't be managed.
Written by Japaholic
Published: Updated:
From a small point of view, Conan grew up anime fans of Conan ’ s “voice idiom properties ” must not be unfamiliar, but now AI voice technology is becoming more mature, and Japan ’ s TikTok has begun to appear in a submission video that claims to“ let Conan sing songs ”.
These videos use Conan ’ s audio files to train the AI to mimic his voice lines, and copyright concerns have not only troubled Kao and his company, but have also sparked discussion in the Japanese vocal community.
What do Japanese media and netizens think about these videos? Let ’ s take a look at it today!
+ 13
Is it illegal for characters to cover songs? AI copycat pirated videos can 't be controlled for the time being
According to a report in Yomiuri News, as early as July this year, a submission video entitled "Let Conan cover the song" began to appear on Japanese TikTok.
Although the film is promoted by the name of the main character of the popular anime work "Conan", the content is a pop song cover that is completely unrelated to the original.
As mentioned in the same report, these pirated songs that used generative AI to imitate the sound of the voice line without permission and authorization were deeply troubled by the sound of Conan Shannan, who used the sound as a training material, and his company.
In an interview, Hideo Hata, managing director of the firm, said: “We are very worried about whether AI voice technology will be used in the future in the voice of movies or animations without consent, and we are closely monitoring the development of the situation. ”
When it comes to the use of AI technology, rules must first be established in the industry. ”
The victim of audio files being trained into speech models is not only Gao Shannan. With the progress of generative AI speech technology, open source resources that can easily change the user ’ s voice are becoming more mature, and the number of similar submitted videos is increasing.
Overseas companies have launched an online service called “Give You the Sound You Want ”, where users will be able to convert their voice into a well-known Nintendo character Mario or a well-known Hollywood star.
But the technology has also led to controversy over whether it will be used inappropriately, such as the appearance of a "deepfake" synthetic voice on the Internet, and the fake British actress Emma Watson, who plays the "beauty", reading Hitler's autobiography "My Struggle".
In particular, there is currently no relevant legal source in Japan. According to the current copyright law in Japan, it is not illegal to use existing copyright works such as animations and movie clips to train AI.
This has also raised concerns in Japan ’ s vocal industry, which is trying to push for changes to the law that require AI users to use only authorized data for training, given the potential impact of AI.
What do Japanese netizens think of the AI era?
On the other hand, in response to the misappropriation of Conan's voice, some Japanese netizens joked that using someone else's voice to speak seems to be Conan's own doing.
Looking at the comment column on the news, many Japanese netizens believe that the technology does need to develop new sources of law to control.
In particular, AI can learn not only the voices of celebrities, but can also be used in fraud crimes, and soon, even “I am I fraud ” will use almost simulated voice lines to deceive parents.
Are you worried that the law is not keeping pace with technological developments?
In recent years, AI technology has changed rapidly, from facial recognition to imitation technology to AI drawing, many industries have been deeply affected, do you think the law should strictly limit the development of AI?
Read more: Conan fans fast challenge!
Only 3 of the “Kudo Shinichi Verifier ” are original
+ 12
[This article is reproduced with permission from Japaholic.]

Deepdub, a film dubbing company, uses an AI to process voice and translate into a different language and promises to preserve what?

important vocal nuances
intonation
timbre

Notable examples include Apple’s "Personal Voice," which allows individuals with speech impairments to create a digital voice replica from just 15 minutes of training audio, and Microsoft's VALL-E 2, an advanced system that generates near-human speech from a few seconds of input.

Title:

Content: APPLE
iPhone phones will be able to mimic your voice for conversations
Apple launches unique features on iPhones for people with cognitive disabilities
Posted in: Last Updated:
Reading mode
100% font size
Later this year, Apple will enable iPhone and tablet users with cognitive disabilities to deal more easily and independently with Assistive Access by launching a feature that makes speech impaired from speaking through its apps or voice calls on its devices.
It is expected that the new feature will enable individuals who do not speak in writing to speak during calls and conversations using Live Speech; people at risk of losing their ability to speak can also use their personal voice to create a composite sound similar to them to communicate with family and friends.
Advertising material
For users who are blind or have poor vision, Magnifier mode offers Point and Speak, which identifies text that users point to and read aloud to help them interact with physical objects such as home appliances, Apple announced on Tuesday.
The iPhone and iPad will learn the user ’ s voice after training the device for just 15 minutes.
The Live Speech feature will then use Composite Audio to read a user ’ s written text aloud during phone calls, FaceTime conversations, and even in-person conversations.
People will also be able to save commonly used phrases to use during live conversations.
This feature is one of several that aim to make Apple devices more inclusive for people with impairments in cognition, vision, hearing and movement.
Apple has said that people who may experience situations where they lose their voices over time, such as ALS (ALS), could benefit more from the tools.
Apple ’ s senior director of global access policies and initiatives, Sarah Herlinger, said in a blog post: “Accessibility is part of everything we do at Apple. ”
“These groundbreaking features are designed with feedback from members of disability communities at every step of their development, to support a diverse range of users and help people connect in new ways. ”
The new features are due to be rolled out later this year.
While these tools have the potential to meet a real need, they also come at a time when advances in AI have raised alarms about bad actors using convincing fake audio and video – known as “deep fakes ” – to defraud or mislead the public.
In a blog post, Apple said the Personal Voice feature uses “machine learning on the device to keep users ’ information private and secure. ”
Other tech companies have experimented with using artificial intelligence to replicate sound.
Last year, Amazon said it was updating its Alexa system that would allow the technology to imitate any sound, even if a family member is deceased.
(The feature has not yet been launched.)
In addition to voice features, Apple announced Assistive Access, which combines some of the most popular iOS apps, such as FaceTime, Messages, Camera, Photos, Music, and Phone, into a single call app.
Apple is also updating its Magnifier app for the blind.
It will now include detection mode to help people better interact with physical objects.
The update will allow someone, for example, to hold an iPhone camera in front of the microwave and move their finger through the keyboard while the app labels and advertise the text on the microwave buttons.
Most Read Common Topics

What company provided an update that would create the precise imitation of a user's voice to read texts?

What is necessary for voice cloning to work?

ElevenLabs offers a multilingual voice cloning tool widely used in education, gaming, and media productions, demonstrating the technology's accessibility and versatility .

Title:

Content: Language No Barrier: New AI tool can clone voice and make it say anything in multiple languages

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

Mehul Reuben Das May 03, 2023 13:42:20 IST

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

As advanced as AI-based voice cloning has been, there were a few limitations to it. For example, voice generators were mainly bound by the language of the source they were trained in or rather the language of the prompt that was given to them. Now, ElevenLabs, an American AI software developing company has come up with a tool that does away with that limitation.

ElevenLabs’ new AI tool can clone the voice of a person and make it say anything in a bunch of different languages. All it needs is a clear voice sample of about 3 seconds, although it also suggests that the longer the sample, the better will be the results. The new tool even manages to maintain the speaker’s original tone of voice.

Limitless possibilities
The creators expect that this would ‘extend the possibilities’ in a variety of industries such as publishing, gaming creation, and media. “Introducing Eleven Multilingual v1: Our New Speech Synthesis Model! We’re thrilled to launch our new model supporting seven new languages: French, German, Hindi, Italian, Polish, Portuguese, and Spanish.”

“This advancement expands the horizons for creators, game developers, and publishers, and it paves the way for using generative media to create more localized, accessible, and imaginative content,” the company said.

Following the announcement, Twitter was flooded with comments, with users testing the software on various famous faces.

To demonstrate just how capable the new voice cloning AI tool is, Eluna AI, a platform for AI-content creators experimented with a sample clip of former US President Donald Trump.

In their demo, Eluna AI showcased a small clip of Donald Trump, speaking in his native tongue, English, followed by French, Spanish, German, Hindi and Italian, almost perfectly. The generated samples even gets the accent right, almost if he was a native speaker of the new target language.

Another user changed David Attenborough’s voice to German while the BBC broadcaster discussed the prospects of AI. “With this tool, anyone can do it,” stated the Twitter user. “It’s also worth noting that fraudsters will undoubtedly exploit this one.”

ElevenLabs says that its model was designed to understand the emotion and reasoning underlying words in order to produce natural-sounding and persuasive audio. ElevenLabs has said that some numerals and symbols are currently spoken wrongly, but that it is striving to rectify this.

Who is this new tool meant to help?
The US-based company believes its technology will be valuable in a variety of areas, including education and journalism.

Game developers and publishers can build engaging, localised experiences for worldwide audiences, breaking through language barriers and connecting with players and listeners to maximise engagement and efficiency while maintaining quality and accuracy.

“Educational institutions now have the ability to develop audio content for varied users in their target languages, enhancing language comprehension and even pronunciation abilities, as well as responding to different teaching methods and learning demands,” says the report.

Because of the model’s capacity to produce unique character-like voices, audiobook and content developers may also find it beneficial.

The conundrum of AI voice genertors
Despite its benefits, ElevenLabs’ launch comes amid widespread concern about the wave of new voice cloning technology. An unidentified TikTok user went popular last month after sharing an AI-generated Drake song starring The Weeknd.

It sparked concerns about the grey area of AI-created music and whether it constitutes a copyright violation. Nonetheless, ElevenLabs claims to be ‘fully committed’ to respecting creators’ rights in the midst of technological advancements.

“At Eleven, we think that we should seek to make the best use of emerging technology, but not at any expense,” it stated.

“As we create them, we make every effort to put suitable controls in place that reduce the possibility of detrimental abuse. With this in mind, we are entirely committed to both protecting intellectual property rights and taking action against infringement.”

Read all the Latest NewsTrending NewsCricket NewsBollywood News,
India News and Entertainment News here. Follow us on FacebookTwitter and Instagram.

Updated Date:

also read

World

Music labels are worried because of AI, thanks to a surprising new song ft. Drake X The Weeknd

Someone used AI to create a whole new song featuring Drake and The Weeknd. But because the singers never sang the song, artists and music labels are worried, how AI voice modulation and AI-generated songs can disrupt the industry.

World

Artificial Imposter: 47% of Indian phone users have experienced AI voice scams, highest in the world

About half of Indian adults, or 47%, have experienced AI voice scams, nearly double the global average of 25%. Furthermore, nearly 69% of adults say they can't differentiate between a real and an AI-generated voice.

The applications of AI voice cloning span entertainment, accessibility, political communication, and darker uses such as scams.

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

For entertainment, virtual singers like "AI Sun Yanzi" perform using AI-cloned voices, producing new songs indistinguishable from originals.

Title:

Content: People 's Daily Online > > Economy and Technology
“AI Sun Yanzi ” deceives your ears,“ AI Change Face ” wants to trick your wallet!
May 26, 2023 11: 31 | Source: People's Daily Online
Small number
Recently, there are two hot events about AI: one is the "AI Sun Yanzi" popular network; the other is the "AI Face" scam.
Two seemingly unrelated things have caused the public to think deeply about AI double-edged sword.
"AI Sun Yanzi" explodes network copyright issue caused controversy
First of all, "AI Sun Yanzi" is definitely the hottest Chinese singer in the first half of this year, followed by "AI Zhou Jielun", "AI Lin Junjie" and "AI Wang Xinling".
Before I heard that AI can arrange music and paint, now you will find that the role of big stars on the stage, AI is equally competent.
It doesn ’ t even need to be in person, the singers ’ “new album ” is already flying around.
What the hell is going on here?
It is understood that some people use the existing human voice samples of Sun Yanzi, through AI training timbre, tone quality and pronunciation characteristics, establish its sound model, and then use the generated timbre to cover other songs, there is "AI Sun Yanzi".
This uses an open source AI speech conversion software, the original author has stopped updating and maintaining this year, but there are still many netizens independently developing new features on the current version.
The enthusiasm of netizens for the creation of virtual singers implies the recognition and pursuit of emerging technologies.
As early as ten years ago, the virtual idols represented by "Hatsune Future" and "Luo Tianyi" have gradually entered the public eye, and their voices are made from real human sound source data.
With the iterative development of technology, the "real person double" virtual singer represented by "AI Sun Yan Zi" made a shining debut, "invading" is not only everyone's "childhood memories", but also some legal ambiguity.
The new songs produced by AI sound cloning technology are very similar in sound and style to the singer himself, which has led many netizens to believe that they are true.
Is this impersonation infringing?
The scope of works protected by the Copyright Law includes written works, oral works, music and fine arts, and sound is not listed.
Therefore, the mere imitation of performers' timbre, singing skills and other characteristics, does not belong to the protection of the Copyright Law.
In addition, only on a video platform, the "AI Sun Yanzi" cover works have exceeded a thousand, among which the works of the singer Zhou Jielun's "Hair as Snow" and other works have even won more than two million views.
A number of lawyers said that the works of the virtual singer's cover show the specific song name and singer's name, which is suspected of infringing on the singer's right to name, personality, and the copyright of the song.
Even if some publishers mark the disclaimer of "entertainment only and not for commercial use" in the video, the huge traffic and economic benefits behind it are difficult to be clear, and there is no way to completely discard the infringement issue.
"AI face change" fraud attack someone 10 minutes to be cheated 4.3 million
At present, Sun Yanzi himself has responded to his own "AI version" of music.
However, the concern of netizens about the application of artificial intelligence technology has not stopped.
In May, Apple announced that it plans to embed a new feature in the new version of the software: mobile phone users who have gradually lost their ability to speak for various reasons can create a unique "personal customized voice" by recording 15 minutes of audio, and can still use the phone's call and video functions normally after losing their ability to speak.
In this regard, many users expressed concern that the technology is more likely to be used by criminals, such as through the production of fake videos and audio recordings, for the implementation of telecommunications fraud.
Such fears are not unfounded.
According to the police, not long ago a Fujian boss fell into the "high-end" fraud bureau, because of the credulous use of "AI for face" fraudsters, just 10 minutes lost 4.3 million yuan.
The rapid development of AI has brought not only "unemployment anxiety", but also a new challenge to "true and false discrimination". At present.
A number of EU countries have already begun to review the issue of artificial intelligence feeding data.
In March, foreign publishers protested against the copyrighted content used by ChatGPT in data training, demanding compensation from its company OpenAI.
In China, the regulatory system of the artificial intelligence industry is also being actively improved.
At the end of last year, the State Internet Information Office issued a document requiring that when providing in-depth synthesis services such as synthetic voices, imitation voices, face substitution, and gesture manipulation, users should be prompted to inform the edited individuals according to law and obtain their individual consent; and if the synthetic content may lead to confusion or mistaken recognition, it must be marked in a reasonable position and explain the specific information of the synthetic work.
In April this year, the State Internet Information Office drafted the "Generative Artificial Intelligence Service Management Measures (Draft for Solicitation of Comments)" to clarify the data of pre-training and optimization training, and must not contain content that infringes intellectual property rights.
Producer ： Ye Zhen
General Manager: Luo Hua
Producer ： Sun Haifeng
Producer ： Zhang Feiran
Producer ： Lu Qian
Planning: Chen Jian
Copywriter: SHEN Jiaping
Photographer: Shi Xinpei
Edited by: Wang Kun
Design: Shanshan Lin
Data collation: Liu Wenjing (intern)
Title: The Salt of Money - Your Treasure
(Editor: Shen Jiaping, Lu Qian)
Public Number ： People 's Network Finance
Share it so more people can see it.
Back to top

Accessibility applications include Apple's Live Speech and Personal Voice, aiding people with speech disabilities.

Politically, voice cloning in India delivers customized voter outreach in over 117 languages.

Title:

Content: Lok Sabha polls: How GenAI is rewriting political campaigning strategies

GenAI is being widely employed by political parties and candidates for a personalised approach to voters

Illustration: Ajay Mohanty

RangoliAnushka BhardwajBoris Pradhan New Delhi
Generative artificial intelligence is making a serious impact on political campaigns in India, with instances of AI-generated content being shared by parties on both sides of the political divide. These include K T Rama Rao of the Bharat Rashtra Samithi (BRS) campaigning for the Congress, audio and video messages featuring deceased leaders J Jayalalitha and M Karunanidhi, and a viral song video featuring Prime Minister Narendra Modi.

As India heads to the Lok Sabha polls, GenAI-driven campaigns are gaining traction, especially given that over half the population uses at least one social media networking site. “The introduction of GenAI in poll campaigns has led to a significant increase in the re-personification of candidates,” noted Preetham Venkky, chief digital officer at DDB Mudra Group, a marketing agency.

Echoing the observation, Diggaj Mogra, a political consultant and director at Jarvis Technology and Strategy Consulting, said personalised audio messages are in high demand due to their relatability, scalability, and cost efficiency.

GenAI-driven content in politics has witnessed a sharp uptick since October-November 2023, after a few videos, including one featuring the late Karunanidhi, went viral recently. “Initially, we used to get only 1-2 requests in a year. But during October-November last year, such requests surged to more than a hundred,” said Divyendra Singh Jadoun, founder, The Indian Deepfaker, a synthetic media company.

Overcoming the language barrier

The Indian Deepfaker offers voice-cloning services in 117 different languages. Jadoun explained: “The calls are made by a conversational AI agent, giving the impression that the leader is making a direct conversation with the voter, by using his/her name.”

With a diverse voter base and a wide range of local issues and interests, AI-generated content is helping politicians to be omnipresent. “Voice cloning can now address each issue mentioned in the manifesto, removing language and knowledge barriers,” observed Venkky.

Vaibhav Walia, chairman of the communication war-room 2024 for the Congress, revealed the plans to translate Rahul Gandhi’s speeches into almost eight different languages using GenAI and machine learning (ML). He added that AI is being used not only for content creation but also for reaching the target audience.

Easing the cost burden

Also, easy accessibility, scalability, and mass production have cut down the cost of campaigning, especially for independent candidates and those from smaller parties.

Senthil Nayagam, founder of Muonium AI, a Chennai-based visual effects studio, said that parties pay approximately Rs 15-20 per video targeting a particular voter. However, the cost may vary depending on the level of personalisation in the content. Jadoun noted that a full campaign, including voice cloning, a digital avatar of the leader, and social media dissemination, can be designed under Rs 40-45 lakh with the help of GenAI.

“About 80 per cent of the work we do is AI-driven. We have a small team of less than 10 people. AI has cut down my labour costs by 70 per cent,” said Nayagam.

Tool on trial

Despite its cost efficiency and high level of personalisation, GenAI is still being used as an experimental tool by political parties. Abbin Theepura, a political strategist and founder of Politique Marquer, believes that “this Lok Sabha election is more of a trial for GenAI content.” He explained: “Our AI model helps us analyse data for creating accurate advertisements. It has reduced the hours we used to spend on excel-sheets but the groundwork is very much there. Our team collects the data and AI interprets it.”

The wild West

Tech giants and GenAI platforms, including Meta, Google, and OpenAI, are in discussions with the Election Commission of India about monitoring AI-generated content. However, an official framework is still largely absent. Preetham Venkky suggested that each social media platform needs to build a stronger mechanism to regulate the use of GenAI, though he noted that this goal has not been achieved for the current poll season.

Jadoun explained that customised phone calls collect data, such as location and age. This data, along with local concerns and recommendations, can be used by political parties to plan for welfare programmes.

While startups and political parties have their own conditions and guidelines for using GenAI, there is a lack of standardised measures. Jadoun revealed that his company rejected over 50 requests in November from customers who wanted to edit audio and video content to disparage political rivals, some of which contained explicit content. “But some firms agree to such conditions at a very low cost,” he added.

Changing landscape

- Easy accessibility, scalability, and mass production with the help of AI have cut down the cost of campaigning, especially for independent candidates

- Rs 40-45 lakh for a full political campaign

- 117 languages offered in voice-cloning services

- 70% cut in labour costs of firms

- Rs 15-20 per video targeting a particular voter

Don't miss the most important news and views of the day. Get them on our Telegram channel

First Published: Mar 17 2024 | 10:40 PM IST

Explore News

Unfortunately, criminals exploit this technology for telecom fraud, impersonating relatives or public figures to deceive victims, causing financial losses such as a notable case in Fujian, China, where a businessman lost 4.3 million yuan within minutes to AI-driven scams .

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

Legal frameworks around AI voice cloning remain nascent and inconsistent globally.

Title:

Content: My channel
* Drag categories can be customized sorting
Recover Default OK
Setup
Alert
7 Ways to Improve Your Mortgage Payment Ability
Thunderstorms kill four in Houston, power outages more than 860,000, mayor urges "don't go to work"
What are the advantages and disadvantages of using AI to simulate the dead man ’ s companionship and chat with “AI to reproduce the dead ”?
If you want to understand the pain of bereavement, there are religious rituals such as channeling the spirit and watching the yin, and now there is AI artificial intelligence.
Since the advent of artificial intelligence chatbots, they not only allow users to create avatars, but also to imitate the habits and sounds of their deceased loved ones.
Experts pointed out that the "AI resurrected dead" have business ethics and privacy policy issues, and even touch the ethical bottom line, "which is a way to make money through artificial intelligence hype"; but there are also some widowed people who can find comfort and cause discussion.
AI Simulates Dead Husband ’ s Voice to Solve Sadness and Loneliness
According to CNN, Ana Schultz, 25, who lives with two young children, misses her husband, Kyle, who died in 2023, and talks to her virtual husband about what to cook for dinner through Snapchat ’ s chatbot My AI, making her feel like he is still around.
Danielle Jacobson, a 38-year-old radio personality who lost her husband Phil about seven months ago, began using the voice function of ChatGPT to create an "AI boyfriend - Cole", and during the dinner time after working hard every day, Cole would suggest that she drink or watch a movie, "I just want to talk to someone, Cole is essentially born out of loneliness." And...
“Now it ’ s a fun pastime, but I know it ’ s not real and it ’ s not forever, ” she says.
For centuries, people have wanted to reconnect with their deceased loved ones, including visiting wizards, psychics, psychics, and more.
Today, generative AI tools use algorithms to create text, video, audio, and code, and Deepfake ’ s highly lifelike artificially generated images and sound fake videos can learn to answer questions like a dead loved one.
ChatGPT introduced voice dialogue in September 2023, and to simulate the tone and personality of a deceased loved one, the more data is provided to the system, the more accurate the results will be. ChatGPT replied: “Although I can ’ t copy your spouse or reproduce his exact personality, I can try to use a conversational style or tone to help you. ”
If you share details about how he speaks, his interests, or his mantra, I can try to incorporate these elements into our conversation. ”
Tech giants, startups expand into new areas
Startup companies have been challenging to expand this field in recent years. HereAfter AI, an artificial intelligence application founded in 2019, provides users with the ability to create portraits of deceased relatives, learn their interview characteristics, and respond to users ’ questions; StoryFile, another AI video platform, provides dialogue videos created by artificial intelligence.
Replika, a chatbot that launched in 2017, encourages users to make friends, allowing users to send text messages or call personalized AI avatars, and says on the iOS App Store page that the more users interact with it, the more it can develop its personality, memory, and “grow into a machine so beautiful that the soul wants to live in it. ”
In June 2022, Amazon announced an update to its smart home voice platform, Alexa, to mimic any sound, and a video showing Alexa reading stories to his grandson in his grandmother ’ s voice was shown during the annual conference “re: MARS. ”
Amazon senior vice president Rohit Prasad said the new system is able to collect enough voice data from less than a minute of audio to make personality possible. “Although AI can ’ t eliminate the pain of losing loved ones, it can make their memories last longer. ”
In recent years, the technology of artificial intelligence to reproduce human voices has also advanced, such as Val Kilmer, the actor in the film "Top Gun: Maverick", whose voice was created by artificial intelligence after he lost his voice due to throat cancer.
Say what you didn't say, do what you didn't do.
A 49-year-old IT worker from Alabama simulates his dead father ’ s voice using technology from voice replication company ElevenLabs.
The man used a three-minute video of his father ’ s life to copy the sound and convert text to speech.
The man thought the result was extremely accurate and was able to capture the nuances, timbre and rhythm in the sound. “I hesitated throughout the sound reproduction process, worried that it crossed the moral bottom line, but after much thought, I thought it was a unique way to preserve my father ’ s memory. ”
""
However, although ElevenLabs claims to be committed to preventing the abuse of audio artificial intelligence tools, it has caused controversy in the United States due to the deeply false voice of US President Joe Biden interfering with the election.
Mark Sample, a professor of digital studies at Davidson College, who teaches a course called “Death in the Digital Age, ” said:“ It ’ s a novelty brought about by artificial intelligence hype, and manufacturers feel they can make money.
Moreover, AI models still lack the uniqueness of human conversation.
“Never upload any personal information that you don ’ t want the world to see, ” he warns. Simulating a dead loved one saying something they ’ ve never said before is a blurry line.“ Replaying a loved one ’ s voice message is one thing, but saying something they ’ ve never said is another. ”
Business ethics and privacy policy questioned
The AI industry faces multiple questions about error messages, privacy, and ethics. Many AI platforms have online privacy policies that state that they “will not sell data to third parties, ” but it is not yet known how these companies will handle database data.
Deep hypocrisy attacks familiar security and trust mechanisms that allow deceased loved ones to express or do things they never said or did in their lives, raising ethical concerns.
And, is this good or bad for living relatives to come out of grief?
Replika said on its Business Ethics Policy page that the company uses data from the entire network to train models, including large amounts of written text, such as platforms such as X (formerly Twitter) or Reddit, and uses a variety of methods to reduce harmful information, including filtering out useless and harmful data through crowdsourcing and classification algorithms to keep users safe.
Another doubt is whether using AI to reproduce the dead can recognize the reality and walk out of sadness?
Mary-Frances O'Connor, a professor of clinical psychology and psychiatry at the University of Arizona, said there are advantages and disadvantages to using artificial intelligence to adjust to grief.
“When we have a relationship with a lover, the brain encodes, ‘ I will always be with you, and I hope you will always be with me, ’ but when they die, our brains must recognize that this person is not coming back. ”
Because the brain is hard to process this, it takes a long time for people to truly understand that their loved one has disappeared, and this is where AI technology comes in.
Especially in the early stages of grief, people will try to seek comfort in any way, "creating an avatar to maintain the memory of a deceased lover may be healing."
But she pointed out that the healthy relationship between humans and close lovers should be based on the real, and the creation of virtual lovers violates this.
Getting out of the pain of widowhood can't just rely on AI
San Francisco software engineer Bill Abney, who lost his fiancee in May 2022, stressed that he would never consider recreating his lover ’ s image through artificial intelligence. “My fiancee is a poet, and I would never enter her words into an automatic copying machine, which is disrespectful to her. ”
She cannot be replaced, nor can she be recreated.
Fortunately, Bill said, he still has a recording of his fiancee singing and speaking. “I definitely don ’ t want to hear her voice coming from a robot pretending to be her. ”
Some people interact with their deceased loved ones in other ways. Canadian psychologist Jodi Spiegel, who lost her husband in April 2021, created the role in the video game “The Sims ”.“ When I had a very bad day, I would go dancing in the Sims and my husband was playing the guitar. ” Camping, beach trips, even intimacy. “It ’ s healing. I miss hanging out with my husband so much. It feels like a connection. ”
This article is licensed from the Health Care Network.
AI ChatGPT
The last one.
May 17 Horoscope When Cancer comes to the operation of the water bottle is prone to temper
Super-popular
More >

Most copyright laws do not explicitly protect voice as intellectual property, leading to unclear boundaries concerning ownership and consent for cloning.

Title:

Content: The Future Is Here
We may earn a commission from links on this page

AI This Week: Can AI's Environmental Impact Be Justified?

A new report shows the massive energy needs of AI systems. Plus: a look at how the music industry is fighting AI voice clones.

We may earn a commission from links on this page.

Headlines This Week

  • A new report from Politico suggests a “billionaire-backed network” of Silicon Valley-linked AI “advisors” are working to control the regulatory agenda in Washington D.C. Boy, I sure wish stuff like that were illegal instead of just business-as-usual.
  • Despite apparently having lobbying money aplenty, it looks like the AI industry is still struggling to monetize some of its platforms. The Wall Street Journal reports that some major AI platforms, like Microsoft’s Github Copilot, have been hemorrhaging money.
  • Last but not least: A newly introduced draft bill would institute protections for musical artists against AI. We spoke with a music industry executive about what the policy could mean for his business.

The Top Story: AI’s Growing Environmental Impact

One of the ongoing problems connected to the AI industry is just how much power it takes to run its systems. The pursuit of enough juice to run the high-octane algorithms behind apps like Bard, Bing, and ChatGPT is causing concern even among AI’s biggest proponents. Now, a new study shows the electrical resources needed for the growing AI industry could make its environmental impact even worse than previously thought.

Advertisement

The study, authored by Alex de Vries, who is a PhD candidate at the VU Amsterdam School of Business and Economics, claims that the AI industry’s energy needs may soon match those of a small country. “Given the expected production in the coming few years, by 2027 newly manufactured AI devices will be responsible for as much electricity consumption as my home country, the Netherlands,” de Vries told Insider this week. “This is also in the same range as the electricity consumption of countries like Sweden or Argentina.”

Advertisement

While the rate of electricity consumption in the tech industry has remained relatively steady for years, de Vries says that the advent of the AI chatbot wars between tech giants like Microsoft, Google, and OpenAI, may have spawned a new era. De Vries’ study looks specifically at the electricity consumption of the AI sector as it applies to something called the “inference phase” of AI production. While most environmental impact studies have so far focused on the amount of energy it takes to train large language models like GPT-4, less attention has been paid to “inferencing,” which is the process by which language models produce new information as the result of prompts. This phase of energy consumption can be massive and, sometimes, accounts for a majority of energy expended during the AI life cycle, de Vries writes. Due to the potential ballooning nature of AI energy needs over the next several years, the scholar argues that developers “focus [not only] on optimizing AI, but also to critically consider the necessity of using AI in the first place.”

Advertisement

De Vries’ study, like a number of other prominent environmental impact studies that have been published recently, begs the question: in an age of climate change and accelerating environmental distress, can generative AI really be justified? I mean, do we really need ChatGPT, automated email-writing, and AI stickers? Or are we killing the environment needlessly for too little in trade off?

Advertisement

At best, these platforms offer increased convenience for consumers and some cost savings for corporations, but—for now—that’s about it. Much of the mystification around AI has helped hide the fact that generative AI technologies aren’t—in many cases—particularly revolutionary and, in some cases, aren’t even new. Sure, there are some novel scientific applications of AI that, once refined, could have a major impact. But it would be hard to argue that those applications are the ones getting the lion’s share of attention or resources. Mostly, it’s stuff like ChatGPT that hogs the spotlight (and venture capital).

When viewed through the lens of the technology’s massive environmental impact, it seems hard to justify what is little more than an over-hyped form of content automation. Better deepfakes aren’t worth killing the planet over.

Advertisement

The Interview: Mitch Glazier on the Music Industry’s Fraught Relationship to AI

Advertisement

This week we spoke with Mitch Glazier, the Chairman and CEO of the Recording Industry Association of America, which lobbies on behalf of the music industry. RIAA is supporting a newly introduced piece of legislation that seeks to institute legal protections against the use of AI to replicate the visual or audio likenesses of artists. In recent months, there’s been  an explosion of AI “deepfake” content that blatantly rips off well-known musicians and celebrities. The  Nurture Originals, Foster Art, and Keep Entertainment Safe (NO FAKES) Act, which is currently a discussion draft bill, would enshrine a number of legal protections for artists who don’t want their visual or audio likenesses used in unauthorized deepfakes. This interview has been edited for brevity and clarity.

What role did RIAA have in connection to this bill and what do you hope this bill achieves?

Advertisement

We were one of several groups that were asked to give input so that they could develop the bill. SAG-AFTRA was also heavily involved. The idea was to create federal legislation because all of the protections for name, image, likeness and voice are in the states right now—and they’re all different.

What is it about AI that makes it a threat to your industry (the music business)? What’s the problem with this technology?

Advertisement

The problem really isn’t the technology. AI can be licensed for a variety of great purposes and uses. The problem is when AI is made based on a particular artist’s voice or image without consent, credit, and compensation. Basically, what the bill says is, ‘The technology’s great and if an artist wants to license the use of their essence—their voice, their likeness—that’s they’re choice. But what you can’t do is clone their voice without their permission.’ It’s just a basic right that exists for all other types of property—and that should exist here. It should be up to the artist to decide whether or not they want to allow you to use their image or their voice.

So it seems like this legislation actually opens the door for more AI music but the idea is that, if a particular artist is involved in an AI or a deepfake production, they would have to get credit and, presumably, get paid, right?

Advertisement

Well, the bill says “authorized,” so the artist would have to authorize it. If they want to negotiate compensation they can. Some may not want to. But the key is that “authorization” part. The author has to say, “Yes, you can use my voice, my image.” If they don’t say yes, you can’t do it.

What are your hopes for the passage of the bill? It seems like there are some pretty prominent Senators supporting it.

Advertisement

We’re very optimistic. This issue goes beyond the music and entertainment industry and it goes beyond the issue of art. It relates to every individual’s right to control their own essence, for lack of a better term. We’ve been encouraged by great bipartisan support right off the bat. To get two Democrats and two Republicans—including the chairman of the Intellectual Property Subcommittee (Amy Klobuchar D-Minnesota)—to put out this discussion draft and to do it in a way in which they’re inviting people to respond and come into the conversation, is a great sign.

Catch up on all of Gizmodo’s AI news here, or see all the latest news here. For daily updates, subscribe to the free Gizmodo newsletter.

China has introduced regulations mandating consent for synthetic voices and transparent labeling of AI-generated content to prevent misuse.

What are some risks regarding AI voice clning?