Voice cloning technology uses machine learning to simulate anyone's voice by analyzing their voice data and learning its patterns.

AI voice cloning tools are now available online, allowing anyone to clone a voice without technical knowledge or cost.

Voice cloning technology has advanced rapidly, enabling highly realistic audio falsifications.

A key breakthrough in voice cloning technology was the release of Tortoise, a program that could learn what and how to say things.

Voice cloning technology raises concerns about potential misuse, including extortion and scams, via AI clones.

The technology is used in entertainment and accessibility, including virtual assistants and audio content for people with disabilities.

ElevenLabs, founded by Piotr Dabkowski and Staniszewski, is a leading voice cloning technology developer, offering a browser-based sound synthesis app.

OpenAI has developed a text-to-speech tool that generates a natural-sounding human voice from text input and a 15-second voice clip.

Law enforcement warns that AI voice clones could be used to extort money from loved ones over the phone.

The use of voice cloning technology in education raises ethical concerns and requires instructors to mitigate potential risks.

Instructors can ensure necessary permissions by obtaining informed consent from individuals whose voices are being recorded and cloned.

Voice cloning laws and regulations are evolving and vary by country, amid concerns over potential misuse.

A large, diverse dataset of voice recordings is essential for high-quality voice data.

High-quality voice data is crucial for developing realistic and accurate voice cloning models.

The technology has the potential to revolutionize industries and enhance language learning, but also raises technical, challenging, and ethical concerns.

Voice cloning technology uses machine learning to simulate anyone's voice by analyzing their voice data and learning its patterns.

Title:

Content: The scary side of artificial intelligence

The pros of AI outweigh the Cons or threats in our day-to-day lives, and there’s no magic pill to protect us from the scary threats of AI.

  • Exclusive

It's a free Content, simply login/signup to unlock

Get in-depth Industry Insights and Analysis through our “Exclusive” content, presented to you by our esteemed panel of writers, for free

By continuing, you agree to the Terms & Conditions and acknowledge our Privacy Policy. This same account can be used across all Economic Times B2B portals.

  • Updated On Oct 3, 2023 at 03:02 PM IST

Artificial intelligence (AI), as we all know, is the simulation of human intelligence leveraging computer systems and machines. AI programs can continuously learn and evolve with experience. In technical terms, AI systems render the output by churning and analyzing the data for correlations and patterns and help make future predictions using these patterns.

Advt
Today AI is being used extensively in all facets of our lives starting from lifestyle, e-commerce, home appliances, automobiles, navigation, transport, healthcare, agriculture, education, financial planning, chatbots, marketing, cyber security, virtual assistant, industrial automation and many more.

Clearly, we have and are leveraging the strengths of AI to the fullest to automate the routine tasks and make it auto-learn over a period. There’s no doubt that AI has revolutionized the lives of all – organizations, consumers etc. But as they say, “Everything comes at a price”. This analogy is quite true for AI as well, there have been a lot of threats that have emerged using AI and are being utilized by the Cyber criminals to dupe the ignorant users, cause mental stress and extort money.

continued below

Executive Workshop

I’m not going to delve into all of threats but would like to elucidate some of the real ones that have come to the surface recently:

Voice cloning or mimicry

As the name suggests, it uses machine learning algorithms to simulate anyone’s voice. It requires certain voice data to analyze and learn the specific patterns of any individual. There are certain advantages of cloning a voice that can be used in voice assistants, chatbots, navigation systems and other areas. Voice cloning has existed for a while but was restricted to experts who possess the technical knowledge to be able to use the same. But now AI Voice cloning tools are available on the open Internet that anyone can leverage with literally no technical knowledge or cost to clone anyone’s voice. All you need to do is just Google and it will pop up and get a bunch of both free and paid AI Voice cloning tools.

Advt
In fact, recently one of the global leaders in online protection published a report stating how AI is fueling a rise in online voice scams, with just three seconds of audio required to clone a person’s voice. This is extremely creepy. Just imagine, if a Cyber-criminal clones your voice and tricks your near ones by making them believe that they are talking to you, and request for money due to any distress reasons. In fact, these are not assumptions but real-life incidents that are happening across the world every minute.

Deepfakes AI

Deepfakes AI are being used to impersonate an individual by manipulating videos, images, audios, and other content available on the social media platforms using deep learning techniques. It mainly transforms existing content from one person to another. This is another area that has been exploited by the Cyber criminals in the recent past, and there are a few deepfake cases that have made waves on the Internet. One of the most famous ones being Deepfake created by a VFX artist of one of Hollywood’s most famous male actors. This piece was so well made by rendering thousands of pictures using artificial versions of the actor. There are similar Deepfakes incidents involving other global celebrities and leaders. The damage and misuse of the deepfakes videos could be extremely dangerous for the human society and can be used by terrorists to incite riots and create nuisance.

Creating virtual people

This is another area where AI is being used to create people that do not exist. There are a lot of websites that allow you to generate a random image by just specifying the age group, gender & ethnicity, and you can continue to refresh these images at the click of a button. Be mindful of the fact that these images pertain to people that do not exist in this world. On the similar lines, there’s an emerging trend of AI news anchors that possess a human-like appearance and are fed data that they can read using text-to-speech technology. Recently, there's been a surge of AI-Driven robotic new anchors in multiple language channels. While the main objective of this initiative is to provide royalty free or cost-effective human images for branding and other purposes. However, the overuse of these technologies causes Fear of missing out (FOMO), Feeling of inadequacy, dissatisfaction, and isolation may potentially lead to psychological and emotional vulnerabilities.

One of the Hollywood movies, ‘HER’ portrayed an introverted and lonely writer (Joaquin Phoenix) who purchases an AI virtual assistant personified through a female voice to assist him in his writing job. However, when he finds out about its ability to learn and adapt, he falls in love with it. The film delves into emotional vulnerability and the impact of AI on human relationships.

Needless to say, that the pros of AI outweigh the Cons or threats in our day-to-day lives, and there’s no magic pill to protect us from the scary threats of AI. However, there are certain preventive tips that one can follow to mitigate any such risks. Do spread awareness with your family and friends:

  • Set some code words with family, and friends to verify the identity during emergency circumstances
  • Optimize social media presence by limiting your connections with only known contacts and avoid connecting with any unknown ones
  • Avoid saying ‘Yes’ as a greeting while receiving unknown calls as it can be used to authorize credit card charges or other purposes
  • Continuously update privacy settings on social media to allow viewing by friends and family only
  • Avoid clicking on any suspicious links or calls received without proper due diligence
  • Do not share your passwords and other sensitive information with anyone
  • Verify the credentials of any online information before circulating it through various mediums
  • Avoid public Wi-Fi connections offered at coffee shops or airports, which requires to enter password
  • Closely monitor the time spent by younger generation on social media and online gaming
  • Finally, in case of any suspicion, double check and report it to the host site or concerned authorities
The author is the CIO of MOVIN

Disclaimer: The views expressed are solely of the author and ETCIO does not necessarily subscribe to it. ETCIO shall not be responsible for any damage caused to any person/organization directly or indirectly.

  • Published On Oct 3, 2023 at 03:02 PM IST

Most Read in Artificial Intelligence

Join the community of 2M+ industry professionals

Subscribe to our newsletter to get latest insights & analysis.

Download ETCIO App

  • Get Realtime updates
  • Save your favourite articles

What is necessary for voice cloning to work?

AI voice cloning tools are now available online, allowing anyone to clone a voice without technical knowledge or cost.

Voice cloning technology has advanced rapidly, enabling highly realistic audio falsifications.

Title:

Content: Expressionkaspersky.com
What are the mysteries of deep sonic falsification?
The spread of artificial intelligence and easy access to tools capable of altering the truth have led to the emergence of one of the most shocking and disturbing digital manipulation techniques, “deepfake. ”
Deep fakes make it possible to create fake videos, photos and sounds that show individuals saying or doing things they never said or did, and although the most popular version until recently was video, deep fakes are gaining importance day by day.
A historical overview
The first major program to bring the potential of deep voice counterfeiting to the general public was Adobe Voco in 2016, which used artificial intelligence to mimic a person ’ s voice from a short recording.
emoticalipwatchdog.com
The software was scrapped after it was found that it could be used to create false, misleading and dangerous sounds, and since then, advances in neural network technology have enabled increasingly realistic and convincing audio falsifications.
At present, we can find many applications and tools online that use this technology to create fake sounds, where Microsoft has launched an artificial intelligence model called VALL-E that can imitate the human voice with a recording of only three seconds.
Deep sonic falsification
Deep voice falsification aims to create an audio model capable of replicating the actual speaker ’ s voice, but the model must be trained through the speaker ’ s audio recordings, in order to be ready to generate an artificial sound similar to that of the original person.
expressiontelegraph.co.uk
Deep learning and natural language processing techniques are used to analyze the unique patterns and characteristics of sound, some of which include pitch, speed, rhythm and tone, and artificial intelligence uses recordings to deliver an original sound, creating a new audio recording that mimics the speaker ’ s voice to a full degree.
How to Create Deep Audio Counterfeiting
Fake deep voice is created using AI-powered text to speech technology, and this can be done with just a few minutes of recorded speech to train an AI speech model, which can read any text with the target voice.
expressionveritonevoice.com
The original recorded sound must be of sufficient quality to sample the unique characteristics of the speaker ’ s voice, after which AI algorithms analyze the patterns and characteristics of the original sound and learn to mimic them.
This can be done with male and female voices and adaptation to the identity of the speaker, the result is a fake voice recording that mimics the voice of the original person, and in addition to generating speech, these instruments can simulate sounds such as breathing and mouth movements.
Initiatives to combat voice counterfeiting
There are initiatives aimed at combating this increasingly prevalent voice counterfeiting, and some technologies can detect these counterfeit products, such as voice biometrics, an authentication method that uses a person ’ s unique voice pattern to verify their identity.
expressionclt.nliu.ac.in
This pattern includes characteristics such as tone and pitch of the voice, speech speed, and pronunciation, and to use voice biometrics, a person's voice must be captured, after which, its unique characteristics are analyzed as well as the length of the words.
Spectroscopy can also be used, consisting of analyzing acoustic signals to detect unique sound patterns that are difficult to replicate in deep fakes.
There are also tools that can detect the digital traces present in deep voice fakes, because the latter fails to accurately simulate all the variables of the actual voice recording, and therefore, deep fakes may contain breaks in sound or background noise that differ from those expected in the original sound.
Most Read
No stories found.
Erm News
www.eremnews.com

What are some risks regarding AI voice clning?

What has the US Federal Trade Commission warned about the use of voice cloning tools?

Difficult to distinguish from human voice

A key breakthrough in voice cloning technology was the release of Tortoise, a program that could learn what and how to say things.

Title:

Content: OpenAI's Johansson gaffe pushes voice cloning into spotlight

Law enforcement warned that AI clones could be used to extort money from loved ones over the phone

By AFP

  • Follow us on

Scarlett Johansson voiced an AI character in the film "Her". — Reuters file

Published: Mon 27 May 2024, 7:51 PM

Last updated: Mon 27 May 2024, 7:52 PM

OpenAI was forced to apologise to actor Scarlett Johansson last week for using her voice -- or something very similar -- on its latest chatbot, throwing the spotlight on to voice-cloning tech.

Although OpenAI denied the voice they used was Johansson's, their case was not helped by CEO Sam Altman flagging the new model with a one-word message on social media -- "Her".

Johansson voiced an AI character in the film "Her", which Altman has previously said is his favourite film about the technology.

Right from the start, AI voice cloning has proved problematic.

Last year, British firm Elevenlabs went viral for all the wrong reasons when it released its voice-cloning software.

Internet pranksters immediately began pushing out deepfaked celebrities -- Harry Potter star Emma Watson was shown reading Hitler's Mein Kampf.

Law enforcement warned that AI clones could be used to extort money from loved ones over the phone.

The technology has developed rapidly in the past year becoming far more realistic and nuanced.

Danish entrepreneur Victor Riparbelli, CEO of British AI firm Synthesia, told AFP it was largely down to a program called Tortoise that was released two years ago.

The program's developers threw thousands of hours of voice data into their model in an unstructured way and discovered it not only learnt what to say but how to say it.

"That was a pretty big paradigm shift," Riparbelli said on the sidelines of last week's VivaTech conference in Paris.

Tortoise was an open source program and Elevenlabs was the first to go to market using it.

OpenAI uses similar systems though they do not release any details.

Much of the controversy around voice cloning has focused on concerns over people misusing the software.

But the claim against OpenAI is unusual because it is the company itself accused of playing fast and loose.

"It was very unfortunate that OpenAI did that -- really not very good," Katya Laine, CEO of TALKR.ai, told AFP at VivaTech.

"If they actually cloned her voice without her knowing then I think that's very very bad," said Riparbelli.

The two entrepreneurs are among hundreds harnessing AI voice programs for uses that they argue will make companies more efficient.

Laine's firm provides virtual voice assistants -- essentially AI customer service agents.

She said her firm's system could now resolve 25 to 30 percent of calls without any human involvement.

Synthesia specialises in video avatars, which Riparbelli said allowed any office worker to turn text or slides into a video performed by a realistic AI.

Both Riparbelli and Laine allow their clients to use their own avatars, off-the-shelf products or those supplied by the likes of OpenAI and Elevenlabs.

Riparbelli said Synthesia used actors whose likenesses and voices were licensed for two years with an option to renew after the initial period.

The problems arise if actors' voices are used without their consent.

The fiasco overshadowed a developer conference in Paris last week when OpenAI was showing off a suite of new tools.

In front of a big screen in an auditorium, Romain Huet, OpenAI's Head of Developer Experience, breezily chatted into his phone.

Seconds later, his short voice sample had been processed and could be heard commentating over a generated video -- in five languages.

The demonstration showed how quickly the field is moving, but the headlines had already been written.

The Washington Post asked in a newsletter "How dumb is OpenAI?", other commentators were suggesting wunderkind Altman was nothing more than a huckster.

Nonetheless, Riparbelli was open to OpenAI's argument that they had used another actor who just sounded liked Johansson.

"If it's not her but someone who sounds a lot like her... where do you draw that line," Riparbelli asked.

"If they're not allowed to use someone who sounds a lot like her, then it sets a very odd precedent."

More news from World

Voice cloning technology raises concerns about potential misuse, including extortion and scams, via AI clones.

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

The technology is used in entertainment and accessibility, including virtual assistants and audio content for people with disabilities.

ElevenLabs, founded by Piotr Dabkowski and Staniszewski, is a leading voice cloning technology developer, offering a browser-based sound synthesis app.

Title:

Content: Grow with AppMaster.
Become our partner
AI voice pioneer ElevenLabs raises $80 million
ElevenLabs broke new ground in the voice AI industry, successfully raising an impressive $80 million in a Series B round led by industry giants such as Andreessen Horowitz, former GitHub CEO Nat Friedman, and renowned entrepreneur Daniel Gross.
The company has received investments from well-known companies such as Sequoia CapitalSmash CapitalSV AngelBroadLight CapitalCredo Ventures, which has raised a total of $101 million, giving it a valuation of more than $1 billion, exponentially growing and entering the Unicorn Alliance.
The previous year it was about $100 million.
CEO Mati Staniszewski laid out an ambitious fund-raising agenda, outlining aggressive product development, infrastructure expansion, team development, AI research, and plans to implement robust security measures to ensure ethical AI development.
In a letter to TechCrunch, Staniszewski said: “Our vision with this new investment is to consolidate ElevenLabs ’ leading position in global voice AI, both in pioneering research and in practical applications. ”
ElevenLabs, the brainchild of Piotr Dabkowski, a former Google machine learning engineer, and Staniszewski, a former Palantir strategist, was born out of a shared vision to improve speech cloning capabilities, fuelled by the two men ’ s experience shooting shoddy films in their respective home countries. Poland.
Since launching the beta a year ago, the company has quickly become known for its browser-based app, which cleverly synthesizes sounds and can be fine-tuned for tone, emotion and rhythm, and other sound nuances.
ElevenLabs offers a free and premium service that allows users to enter text for sound interpretation or submit speech samples for personalized speech cloning.
The company ’ s commitment to innovation extends to creating specialized voice generation for industries such as audiobooks, movie dubbing, game characters and promotions.
One of their breakthrough developments, launched last year, is the “speech-to-speech ” tool, which aims to retain the unique characteristics of the speaker ’ s voice while eliminating unwanted background noise and subtly tweaking the voiceover of film and TV content.
Going forward, ElevenLabs is about to launch an advanced voiceover studio workflow and mobile app designed to narrate web pages and text through its proprietary voice technology.
The company ’ s innovations have attracted a diverse customer base, including game developer Paradox Interactive and prominent media outlet The Washington Post.
Staniszewski proudly tells us that ElevenLab users have been generating audio content for more than a century, and now it ’ s a favorite tool for 41% of Fortune 500 employees.
The boom in AI-driven voice technology is paralleled by the iterative growth of AppMasterno-code platforms, which democratize application development for a variety of users.
As ElevenLabs continues to rise in the ranks of innovative technology companies, its trajectory gives us a glimpse of the transformative potential of AI in voice and speech.
Related posts
OpenSSF partners with CISA to develop new package repository security framework
A collaborative initiative between OpenSSF and CISA has led to the development of package repository security principles.
Kobiton open source AI-driven Appium script generation tool
Kobiton is shaking up the mobile testing landscape by open-sourcing its Appium scripting tools, increasing automation, and encouraging community-driven development.
Google ’ s Gemini Advanced: Using Ultra 1.0 to Boost AI Assistant Capabilities
Google has ushered in a new era of digital assistance with Gemini Advanced in the Google One AI Premium Plan.
Unlock advanced features like complex coding and creativity for just $19.99 per month.
Start for free
Are you inspired to try it yourself?
The best way to learn about the power of AppMaster is to experience it firsthand.
Free subscription, make your own app in minutes
Turn your ideas into reality

What company created an AI tool that could mimic the voices of deceased movie stars?

OpenAI has developed a text-to-speech tool that generates a natural-sounding human voice from text input and a 15-second voice clip.

Title:

Content: Setup
• Day and night
with the system.
Light color
Dark color
• Theme Colors
Speech cloning raises concerns, OpenAI again explains its text-to-speech tool
2024 / 6 / 10 9: 57: 21 Source: IT House Author: Yuanyang Editor: Yuanyang
OpenAI explained its text-to-speech tool for the second time in a few months, and again stressed that the tool is not currently widely available and may not be available in the future.
“Whether or not we end up deploying this technology at scale, it ’ s important for people around the world to understand where it ’ s going, ” OpenAI said in a statement on its website Friday.“ That ’ s why we want to explain how the model works, how we use it for research and education, and how we implement security measures around the technology. ”
At the end of last year, OpenAI shared its “voice engine ” with a small number of external users.
The engine uses text input and a 15-second clip of human voices to “generate a natural sounding human voice that is very similar to the original speaker. ”
The tool could create fake, multilingual human voices, and the company said at the time that it had chosen to preview the technology rather than launch it at scale to “enhance social resilience ” to the threat posed by“ increasingly realistic artificial intelligence-generated models. ”
As part of these efforts, OpenAI says it is actively phasing out ways to use voice recognition for bank account verification, exploring policies to protect individual voices for use in AI, educating the public about the risks of AI, and accelerating the development of technologies to track audiovisual content so users can identify whether they are interacting with real people or synthetic content.
However, despite these efforts, concerns about the technology remain.
Bruce Reed, the head of artificial intelligence for US President Joe Biden, has said that voice cloning is one of the reasons he can't sleep at night.
The Federal Trade Commission said in March that scammers were using AI technology to increase the credibility of their fraud, using voice cloning tools that make it harder for people to distinguish between AI-generated voices and human voices.
“We continue to engage with U.S. and international partners from government, media, entertainment, education, civil society, and more to ensure we incorporate their feedback in the build process, ” the company also noted, once the“ Voice Engine ” is equipped with its latest model, GPT-4o, it will also bring new threats.
The company says it is actively “conducting ‘ red team testing ’ on GPT-4o to identify and address known and unknown risks from areas such as social psychology, bias and fairness, and misinformation. ”
Advertisement Statement: The external redirect links contained in the text (including not limited to hyperlinks, QR codes, passwords, etc.) are used to convey more information and save selection time. The results are for reference only. All articles of IT House contain this statement.
Related articles
Soft media 's website: IT home hot products - Value shopping guide, coupons most buy - rebate coupons iPhone home Win7 home Win10 home Win11 home
Soft media software: Cube cool point desktop Win7 optimization master Win10 optimization master soft media mobile APP application

What is necessary for voice cloning to work?

Law enforcement warns that AI voice clones could be used to extort money from loved ones over the phone.

The use of voice cloning technology in education raises ethical concerns and requires instructors to mitigate potential risks.

Title:

Content: Freedom Square (Beishe Review) Policy response strategy for artificial intelligence deep counterfeiting and voice copying technology
◎ Cai Yue Ting
Deep hypocrisy and voice copying are technologies that use artificial intelligence to generate fake or manipulative media that can be used for a variety of purposes, including entertainment, education, and journalism.
If it is abused for fraud and the dissemination of false information, it will damage the reputation and rights of the individual, and it will affect social order and national security.
Because there are major potential hazards, it is necessary to formulate relevant regulations and effective management, and it can promote the healthy development of this innovative industry.
Consolidating practice cases to standardize policy measures to manage deep counterfeiting and voice copying can go hand in hand with the following aspects:
I. Regulations:
The content of the bill should include: (1) clearly stipulate the legal and illegal use of deep counterfeiting and voice copying to protect personal and national security and rights; (2) establish effective enforcement mechanisms and regular amendments to ensure the effective implementation of the law and adapt to the rapid development of technology; (3) use ethics education and advocacy; and (4) specify appropriate punitive measures.
2. Technical supervision:
(1) Establish an effective enforcement mechanism, consisting of experts with professional knowledge and technical ability, to (1) supervise the development and application of deep counterfeiting and voice reproduction technology to ensure that the use of the technology complies with laws, regulations and ethical standards; (2) adhere to the principle of minimum intervention, and strike a balance between protecting personal privacy and preventing abuse; and (3) promote the sound development of the industry.
Restrictions on use: Restrictions on the use of deep counterfeiting and voice copying technologies, especially in sensitive areas such as finance, politics, law, and medicine, and where they may have a serious impact on personal privacy.
Transparency and Authentication: (1) Require developers and users of deep counterfeiting and voice copying technologies to provide transparency to ensure that users are informed and consent to the use of their data.
(2) Establish a certification mechanism to ensure that only accredited institutions and individuals can use these technologies.
(4) Technical research: Encourage research on deep counterfeiting and voice copying technologies, especially research on detecting and preventing abuse, and research on how to protect personal privacy.
Participation, use of ethics education and public awareness: to strengthen the education of the public and related industries, and to raise awareness of the potential risks of deep counterfeiting and voice copying technology.
Authorities should provide corresponding preventive measures and education and training.
The development of deep counterfeiting and voice reproduction technology has brought many potential risks, but it is also an integral part of the country ’ s sustainable development.
This industry requires the participation of multiple stakeholders, how to ensure that these technologies are used responsibly and ethically through legal, technical and educational means, and to minimize their potential hazards, to the rapid and vigorous development of the industry is a matter of urgency.
(The author is Deputy Secretary General of Beishe, Director of Research and Development of the Institute for Information Technology)
No need to smoke, no need to grab, now use the APP to watch the news, guarantee the daily winning point I download the APP
I've added friends, thank you.
Welcome to [Free Commentary]
It's a compliment. Good.
It has been praised, thank you.
Editor 's Choice

What are some risks regarding AI voice clning?

Instructors can ensure necessary permissions by obtaining informed consent from individuals whose voices are being recorded and cloned.

Voice cloning laws and regulations are evolving and vary by country, amid concerns over potential misuse.

Title:

Content: Artificial intelligence is replacing human actors in voiceovers and videos
Chris Vallance (Chris Vallance)
• BBC Technical Reporter
The Screen Actors Guild (Equity) has said that if current laws are not changed, the livelihoods of entertainers will be threatened by artificial intelligence.
The campaign, launched by the British Performers Union, is called “Don ’ t Let Artificial Intelligence Catch the Camera. ”
Artificial intelligence can use parts of the actor ’ s voice and face to create content, including so-called “deep fakes ”, which uses artificial intelligence to generate anthropomorphic images and mix them with human images to make it difficult to distinguish between true and false.
The Screen Actors Guild says, “From auto-generated listening content to digitally personalised images, AI systems are now replacing professional actors. ”
The Screen Actors Guild has warned that unless copyright laws are amended now, there will be an end to what it calls a “dystopia, ” a future in which social forms are comprehensively deteriorating.
The Screen Actors Guild points to a number of ways in which AI makes use of actors ’ voices and looks.
For example, actors can work with AI companies to build a system that can generate AI voiceovers or help generate digitally simulated human images.
Artificial intelligence can produce “synthetic ” performances, and in some cases even bring actors who are no longer alive back to the screen.
While AI generates performance as a creative tool, the actors ’ union is concerned that actors ’ control cannot be protected, i.e. they are not always able to control how their image is used or, without consent or adequate remuneration, their own image is used.
Manually generated "deep fake" celebrity videos are becoming more and more popular online.
The Screen Actors Guild ’ s “Don ’ t Let Artificial Intelligence Catch the Camera ” campaign was supported by actress Talulah Riley.
“As a performer, no matter how easy it is to reproduce sound and image with digital technology, how cheap the price is, my voice and my pictogram belong to me, which is the most important thing, ” she said.
I think performance artists should be rewarded for what they create. "
Trouble with voice actors
The Screen Actors Guild says that when actors work with AI companies, most are unaware of their rights, and many are asked to sign confidentiality agreements.
The Screen Actors Guild conducted a survey of 430 members and found that 93% of dubbing artists felt AI was a threat to their employment opportunities.
One voice actor who participated in the survey told the union, “Over the past six months, my voice has been used in large-scale marketing campaigns at companies around the world.
I think I signed a contract that forbids third-party advertising, and even then I didn ’ t get a penny. ”
“The growing ability of AI to clone human sounds is a big risk for sound owners, who get paid less, or not at all, ” the actor ’ s union said.
The Screen Actors Guild said they were particularly concerned about the development of digital sound technology designed to automatically generate audiobooks.
Examples of China
China ’ s CCTV aired the documentary “Innovate China ” in 2018, which is said to be the first in the world to use artificial intelligence to simulate human voice.
The voice of a deceased Chinese voice actor reappears in the film through language synthesis technology.
In addition, Chinese media have also reported that the voice in China's car navigation software uses the voice of Taiwanese actress Lin Zhiling, who was synthesized by artificial intelligence.
The issue of copyright in the use of personal voices through artificial intelligence synthesis technology and how to ensure legal protection in China is also a matter of widespread concern, but still to be defined by law.
Text to Speech
The union's lobbying campaign was supported by voice actor Bev Standing, who had filed a lawsuit over the use of her voice on the social media site TikTok.
The Canadian voiceover artist recorded 10,000 sentences for translation in 2018 for the research institute of the China Institute of Acoustics.
But Ms. Stein said her voice later appeared in TikTok's "text-to-speech" (TTS) feature, a software that converts text into sound, dubbing uploaded videos, and often producing comedic effects.
She said the synthetic sounds of those rationed videos often repeat swear words.
Although TikTok never admitted to using Ms. Stedin ’ s voice, TikTok adjusted its “text-to-speech ” function accordingly after she filed a lawsuit.
Later, TikTok made an out-of-court settlement with Ms. Stein.
"I only work with dubbing companies that give me control over how I authorize my use," Ms. Stein said, speaking to the Screen Actors Union.
Government action is needed.
The Screen Actors Guild said existing copyright laws do not provide enough protection for performing artists because artificial intelligence “can generate performances without recording or copying the original. ”
The Screen Actors Guild wants the government to take action to protect the rights of actors, and they want to amend copyright laws to “adapt to the pace of technological development. ”
But there are also concerns that changes to copyright laws could have a negative impact on freedom of expression or curb innovation.
The British government told the BBC that it wants AI to be properly regulated to encourage innovation while also “protecting people ’ s rights and our fundamental values. ”
“Our country ’ s AI strategy has a 10-year plan to take advantage of technology opportunities, and we will develop a management strategy to keep it on the right track, ” the government statement said.

A large, diverse dataset of voice recordings is essential for high-quality voice data.

High-quality voice data is crucial for developing realistic and accurate voice cloning models.

What is necessary for voice cloning to work?

The technology has the potential to revolutionize industries and enhance language learning, but also raises technical, challenging, and ethical concerns.

Title:

Content: Language No Barrier: New AI tool can clone voice and make it say anything in multiple languages

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

Mehul Reuben Das May 03, 2023 13:42:20 IST

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

As advanced as AI-based voice cloning has been, there were a few limitations to it. For example, voice generators were mainly bound by the language of the source they were trained in or rather the language of the prompt that was given to them. Now, ElevenLabs, an American AI software developing company has come up with a tool that does away with that limitation.

ElevenLabs’ new AI tool can clone the voice of a person and make it say anything in a bunch of different languages. All it needs is a clear voice sample of about 3 seconds, although it also suggests that the longer the sample, the better will be the results. The new tool even manages to maintain the speaker’s original tone of voice.

Limitless possibilities
The creators expect that this would ‘extend the possibilities’ in a variety of industries such as publishing, gaming creation, and media. “Introducing Eleven Multilingual v1: Our New Speech Synthesis Model! We’re thrilled to launch our new model supporting seven new languages: French, German, Hindi, Italian, Polish, Portuguese, and Spanish.”

“This advancement expands the horizons for creators, game developers, and publishers, and it paves the way for using generative media to create more localized, accessible, and imaginative content,” the company said.

Following the announcement, Twitter was flooded with comments, with users testing the software on various famous faces.

To demonstrate just how capable the new voice cloning AI tool is, Eluna AI, a platform for AI-content creators experimented with a sample clip of former US President Donald Trump.

In their demo, Eluna AI showcased a small clip of Donald Trump, speaking in his native tongue, English, followed by French, Spanish, German, Hindi and Italian, almost perfectly. The generated samples even gets the accent right, almost if he was a native speaker of the new target language.

Another user changed David Attenborough’s voice to German while the BBC broadcaster discussed the prospects of AI. “With this tool, anyone can do it,” stated the Twitter user. “It’s also worth noting that fraudsters will undoubtedly exploit this one.”

ElevenLabs says that its model was designed to understand the emotion and reasoning underlying words in order to produce natural-sounding and persuasive audio. ElevenLabs has said that some numerals and symbols are currently spoken wrongly, but that it is striving to rectify this.

Who is this new tool meant to help?
The US-based company believes its technology will be valuable in a variety of areas, including education and journalism.

Game developers and publishers can build engaging, localised experiences for worldwide audiences, breaking through language barriers and connecting with players and listeners to maximise engagement and efficiency while maintaining quality and accuracy.

“Educational institutions now have the ability to develop audio content for varied users in their target languages, enhancing language comprehension and even pronunciation abilities, as well as responding to different teaching methods and learning demands,” says the report.

Because of the model’s capacity to produce unique character-like voices, audiobook and content developers may also find it beneficial.

The conundrum of AI voice genertors
Despite its benefits, ElevenLabs’ launch comes amid widespread concern about the wave of new voice cloning technology. An unidentified TikTok user went popular last month after sharing an AI-generated Drake song starring The Weeknd.

It sparked concerns about the grey area of AI-created music and whether it constitutes a copyright violation. Nonetheless, ElevenLabs claims to be ‘fully committed’ to respecting creators’ rights in the midst of technological advancements.

“At Eleven, we think that we should seek to make the best use of emerging technology, but not at any expense,” it stated.

“As we create them, we make every effort to put suitable controls in place that reduce the possibility of detrimental abuse. With this in mind, we are entirely committed to both protecting intellectual property rights and taking action against infringement.”

Read all the Latest NewsTrending NewsCricket NewsBollywood News,
India News and Entertainment News here. Follow us on FacebookTwitter and Instagram.

Updated Date:

also read

World

Music labels are worried because of AI, thanks to a surprising new song ft. Drake X The Weeknd

Someone used AI to create a whole new song featuring Drake and The Weeknd. But because the singers never sang the song, artists and music labels are worried, how AI voice modulation and AI-generated songs can disrupt the industry.

World

Artificial Imposter: 47% of Indian phone users have experienced AI voice scams, highest in the world

About half of Indian adults, or 47%, have experienced AI voice scams, nearly double the global average of 25%. Furthermore, nearly 69% of adults say they can't differentiate between a real and an AI-generated voice.

How will educational institutions benefit from developing AI voice audio content for languages learners?