Voice cloning technology is a rapidly advancing field that enables the creation of highly realistic and convincing digital replicas of human voices, with some tools requiring as little as 3 seconds of audio to clone a person's voice.

This technology uses machine learning algorithms to simulate anyone's voice, making it incredibly realistic and accessible, with applications in entertainment, accessibility, and education.

The development of voice cloning technology has significant implications for various industries, including the potential to revolutionize the way we interact with languages and cultures.

However, the technology also raises significant concerns about the potential risks of generating speech that resembles someone's voice, including the risk of scams, extortion, and misinformation.

To mitigate these risks, developers and instructors must ensure the responsible use of voice cloning technology, including obtaining explicit consent from voice owners, disclosing the use of AI-generated sound, and implementing digital watermarks to track the source of audio.

The use of voice cloning technology in language instruction raises concerns about authenticity, security, and the potential for misuse, highlighting the need for instructors and developers to be aware of these risks and take steps to mitigate them.

Real-world examples of the technology's potential for misuse include its use in scams, phishing attacks, and the creation of deepfakes, which can have serious consequences, including financial loss, reputational damage, and social unrest.

Furthermore, the technology's accessibility and ease of use have made it possible for anyone to create and disseminate fake audio content, highlighting the need for education and awareness about the potential risks and limitations of voice cloning technology.

Instructors and developers can mitigate these risks by implementing protective protocols, such as speaker approval and digital watermarking, and by promoting transparency and accountability in the use of voice cloning technology.

Ultimately, the responsible development and use of voice cloning technology require a nuanced understanding of its potential benefits and risks, as well as a commitment to ensuring that its use is ethical, transparent, and respectful of individuals' rights and dignity.

The technical requirements for generating realistic Listening Comprehension materials at low proficiency levels (ILR 1 - 1+) using voice cloning technology include the use of AI tools like ElevenLabs, which can create convincing digital replicas of voices.

However, the use of such tools may require users to pay for access to voice-cloning tools, and social media companies may require labels on AI content.

Open-source AI tools, on the other hand, can be tweaked by users, and guardrails can be lowered or eliminated in AI tools, allowing for more flexibility in generating Listening Comprehension materials.

To generate realistic Listening Comprehension materials at low proficiency levels (ILR 1 - 1+), it is essential to have a low variety of voices to make a realistic simulation.

Additionally, AI models can be developed to echo specific talking points, and images can be generated using text descriptions with AI tools like Dall-E and Midjourney.

The use of voice cloning technology for foreign language learners at low proficiency levels is still limited, and there is a need for more research and development in this area.

Some companies, like Voice Engine, are working on adapting voice cloning technology for educational purposes, such as helping people who cannot read or children in learning.

The technology has the potential to break through language barriers and connect with users worldwide, but it also raises concerns about intellectual property rights and the potential for misuse.

In terms of ethical challenges, there is a need for guidelines on the responsible application of AI voice cloning technology, as well as consideration of the potential impact on cultural nuances and language learning.

The use of AI voice over generators in e-learning platforms and podcasts can also provide scalable and cost-effective solutions for multilingual content creation.

However, data privacy is essential when using AI voice over generators, and companies must ensure that they are protecting users' personal information.

Overall, voice cloning technology has the potential to revolutionize the way we interact with languages and cultures, but it requires careful consideration of the ethical and legal implications.

The development of voice cloning technology involves the use of neural networks to mimic human audio patterns, and some companies, such as ElevenLabs, are working to improve the quality and accuracy of their tools.

However, the use of voice cloning technology also raises ethical concerns, such as the potential for misuse, intellectual property infringement, and the need for clear policies and regulations to protect individual rights.

Some companies, such as OpenAI, are calling for discussions on policies to protect individual voices in AI, and there are already laws and regulations being implemented to address these concerns, such as the requirement for labels on AI-generated content.

The legal implications of voice cloning technology are still evolving, but it is clear that there will be a need for clear guidelines and regulations to ensure that this technology is used responsibly and ethically.

Real-world examples of the use of voice cloning technology include its application in education to develop audio content for language comprehension, as well as its potential use in the entertainment industry to create realistic voiceovers and audio effects.

However, the use of this technology also raises legal implications, such as the need for policies to protect individual voices and prevent copyright violation.

Companies like OpenAI and Microsoft are taking a cautious approach to the release of voice cloning technology, with Microsoft limiting access to its VALL-E 2 tool to prevent fraud and requiring speaker approval for voice use.

Ultimately, the responsible use of voice cloning technology requires a careful consideration of its potential risks and limitations, as well as the implementation of safeguards to prevent abuse and ensure transparency and accountability.

Voice cloning technology is a rapidly developing field that enables the creation of highly realistic and convincing digital replicas of human voices, raising both excitement and concern about its potential applications and implications.

This technology has advanced to the point where it can clone a person's voice in as little as 15 seconds, using tools such as OpenAI's Voice Engine.

The development of voice cloning technology has significant implications for various industries, including entertainment, accessibility, and education, where it can be used to create realistic voiceovers, translate languages, and enhance learning experiences.

However, the technology also poses significant risks, including the potential for fraud, election interference, and the spread of misinformation, as it can be used to create fake audio content that is nearly indistinguishable from real voices.

To mitigate these risks, developers and instructors must ensure the responsible use of voice cloning technology, including obtaining explicit consent from voice owners, disclosing the use of AI-generated sound, and implementing digital watermarks to track the source of audio.

OpenAI has acknowledged the significant risks associated with generating speech that resembles someone's voice and has implemented strict controls, including requiring partners to inform the audience that sound is AI-generated and proactively monitoring tool usage.

The use of voice cloning technology in language instruction raises concerns about authenticity, security, and the potential for misuse, highlighting the need for instructors and developers to be aware of these risks and take steps to mitigate them.

Moreover, the technology poses a threat to the livelihoods of entertainers and voice professionals, as it can be used to create performances without recording or copying originals, and existing copyright laws may not protect performing artists from AI-generated content.

To address these challenges, governments and regulatory bodies are considering changes to copyright laws and implementing regulations to protect rights and innovation, while also ensuring the responsible development and use of voice cloning technology.

Real-world examples of the technology's potential for misuse include its use in scams, phishing attacks, and the creation of deepfakes, which can have serious consequences, including financial loss, reputational damage, and social unrest.

Furthermore, the technology's accessibility and ease of use have made it possible for anyone to create and disseminate fake audio content, highlighting the need for education and awareness about the potential risks and limitations of voice cloning technology.

Instructors and developers can mitigate these risks by implementing protective protocols, such as speaker approval and digital watermarking, and by promoting transparency and accountability in the use of voice cloning technology.

Ultimately, the responsible development and use of voice cloning technology require a nuanced understanding of its potential benefits and risks, as well as a commitment to ensuring that its use is ethical, transparent, and respectful of individuals' rights and dignity.

Voice cloning technology is a rapidly advancing field that enables the creation of highly realistic and convincing digital replicas of human voices, with some tools requiring as little as 3 seconds of audio to clone a person's voice.

Title:

Content: The scary side of artificial intelligence

The pros of AI outweigh the Cons or threats in our day-to-day lives, and there’s no magic pill to protect us from the scary threats of AI.

  • Exclusive

It's a free Content, simply login/signup to unlock

Get in-depth Industry Insights and Analysis through our “Exclusive” content, presented to you by our esteemed panel of writers, for free

By continuing, you agree to the Terms & Conditions and acknowledge our Privacy Policy. This same account can be used across all Economic Times B2B portals.

  • Updated On Oct 3, 2023 at 03:02 PM IST

Artificial intelligence (AI), as we all know, is the simulation of human intelligence leveraging computer systems and machines. AI programs can continuously learn and evolve with experience. In technical terms, AI systems render the output by churning and analyzing the data for correlations and patterns and help make future predictions using these patterns.

Advt
Today AI is being used extensively in all facets of our lives starting from lifestyle, e-commerce, home appliances, automobiles, navigation, transport, healthcare, agriculture, education, financial planning, chatbots, marketing, cyber security, virtual assistant, industrial automation and many more.

Clearly, we have and are leveraging the strengths of AI to the fullest to automate the routine tasks and make it auto-learn over a period. There’s no doubt that AI has revolutionized the lives of all – organizations, consumers etc. But as they say, “Everything comes at a price”. This analogy is quite true for AI as well, there have been a lot of threats that have emerged using AI and are being utilized by the Cyber criminals to dupe the ignorant users, cause mental stress and extort money.

continued below

Executive Workshop

I’m not going to delve into all of threats but would like to elucidate some of the real ones that have come to the surface recently:

Voice cloning or mimicry

As the name suggests, it uses machine learning algorithms to simulate anyone’s voice. It requires certain voice data to analyze and learn the specific patterns of any individual. There are certain advantages of cloning a voice that can be used in voice assistants, chatbots, navigation systems and other areas. Voice cloning has existed for a while but was restricted to experts who possess the technical knowledge to be able to use the same. But now AI Voice cloning tools are available on the open Internet that anyone can leverage with literally no technical knowledge or cost to clone anyone’s voice. All you need to do is just Google and it will pop up and get a bunch of both free and paid AI Voice cloning tools.

Advt
In fact, recently one of the global leaders in online protection published a report stating how AI is fueling a rise in online voice scams, with just three seconds of audio required to clone a person’s voice. This is extremely creepy. Just imagine, if a Cyber-criminal clones your voice and tricks your near ones by making them believe that they are talking to you, and request for money due to any distress reasons. In fact, these are not assumptions but real-life incidents that are happening across the world every minute.

Deepfakes AI

Deepfakes AI are being used to impersonate an individual by manipulating videos, images, audios, and other content available on the social media platforms using deep learning techniques. It mainly transforms existing content from one person to another. This is another area that has been exploited by the Cyber criminals in the recent past, and there are a few deepfake cases that have made waves on the Internet. One of the most famous ones being Deepfake created by a VFX artist of one of Hollywood’s most famous male actors. This piece was so well made by rendering thousands of pictures using artificial versions of the actor. There are similar Deepfakes incidents involving other global celebrities and leaders. The damage and misuse of the deepfakes videos could be extremely dangerous for the human society and can be used by terrorists to incite riots and create nuisance.

Creating virtual people

This is another area where AI is being used to create people that do not exist. There are a lot of websites that allow you to generate a random image by just specifying the age group, gender & ethnicity, and you can continue to refresh these images at the click of a button. Be mindful of the fact that these images pertain to people that do not exist in this world. On the similar lines, there’s an emerging trend of AI news anchors that possess a human-like appearance and are fed data that they can read using text-to-speech technology. Recently, there's been a surge of AI-Driven robotic new anchors in multiple language channels. While the main objective of this initiative is to provide royalty free or cost-effective human images for branding and other purposes. However, the overuse of these technologies causes Fear of missing out (FOMO), Feeling of inadequacy, dissatisfaction, and isolation may potentially lead to psychological and emotional vulnerabilities.

One of the Hollywood movies, ‘HER’ portrayed an introverted and lonely writer (Joaquin Phoenix) who purchases an AI virtual assistant personified through a female voice to assist him in his writing job. However, when he finds out about its ability to learn and adapt, he falls in love with it. The film delves into emotional vulnerability and the impact of AI on human relationships.

Needless to say, that the pros of AI outweigh the Cons or threats in our day-to-day lives, and there’s no magic pill to protect us from the scary threats of AI. However, there are certain preventive tips that one can follow to mitigate any such risks. Do spread awareness with your family and friends:

  • Set some code words with family, and friends to verify the identity during emergency circumstances
  • Optimize social media presence by limiting your connections with only known contacts and avoid connecting with any unknown ones
  • Avoid saying ‘Yes’ as a greeting while receiving unknown calls as it can be used to authorize credit card charges or other purposes
  • Continuously update privacy settings on social media to allow viewing by friends and family only
  • Avoid clicking on any suspicious links or calls received without proper due diligence
  • Do not share your passwords and other sensitive information with anyone
  • Verify the credentials of any online information before circulating it through various mediums
  • Avoid public Wi-Fi connections offered at coffee shops or airports, which requires to enter password
  • Closely monitor the time spent by younger generation on social media and online gaming
  • Finally, in case of any suspicion, double check and report it to the host site or concerned authorities
The author is the CIO of MOVIN

Disclaimer: The views expressed are solely of the author and ETCIO does not necessarily subscribe to it. ETCIO shall not be responsible for any damage caused to any person/organization directly or indirectly.

  • Published On Oct 3, 2023 at 03:02 PM IST

Most Read in Artificial Intelligence

Join the community of 2M+ industry professionals

Subscribe to our newsletter to get latest insights & analysis.

Download ETCIO App

  • Get Realtime updates
  • Save your favourite articles

What has the US Federal Trade Commission warned about the use of voice cloning tools?

Difficult to distinguish from human voice

What is necessary for voice cloning to work?

This technology uses machine learning algorithms to simulate anyone's voice, making it incredibly realistic and accessible, with applications in entertainment, accessibility, and education.

What has the US Federal Trade Commission warned about the use of voice cloning tools?

Difficult to distinguish from human voice

The development of voice cloning technology has significant implications for various industries, including the potential to revolutionize the way we interact with languages and cultures.

Title:

Content: Artificial intelligence developed by the Israelis is able to duplicate films with the voices of the original
Israeli startup Deepdub has developed a service for translating video content into new languages using machine learning algorithms.
The company uses neural networks to generate the speech of original actors from movies, TV shows, games and advertising.
AI processes voices and then translates them into a new language, preserving the timbre, rhythm, intonation and other important voice nuances in the work of a professional artist.
Deepdub promises to solve the main problems of industries related to voiceover and duplication.
According to Aberdeen, an average of five minutes of storytelling takes an hour to work in a recording studio.
And if the dubbing actor wants to match the original track as much as possible, the time spent on dubbing can increase by another two times.
At the same time, the cost of such services is a significant part of the budget for filmmakers and video game developers - a minute of duplication of one person per language on average costs about $75 for a simple video.
The startup aims to create a one-stop solution for content makers who want to go international or reduce their own costs for translators.
Using synthetic voices based on the original voice patterns of the actors, the startup duplicates movies, games and advertising in the post-production phase.
According to the developers, in addition to reducing costs, dubbing with the help of neural networks gives another advantage - AI reproduces the voice of the original, so the viewer will always watch the film in the form in which it was conceived by the director and performed by the actor. "Our artificial intelligence models allow you to reproduce the characteristics of the voice, using no more than three minutes of original voice data.
The AI-generated voice in the target language can be reproduced at any level of expressiveness, including crying, screaming, talking with food in the mouth, and more — even if the original voice data did not contain this information, ” said Deepdub co-founder Nir Krakowski.
Additionally, Deepdub ’ s algorithms track facial expressions and lip movements of actors.
Thus, the output of the audio track of the startup fully corresponds to how the voice actors work.
The current version of the platform supports six languages, and the startup plans to add six more before the end of next year.
In the long term, the company also intends to take its algorithms to the next level – to teach AI to duplicate voices in real time.
Among the famous works of Deepdub Krasowski mentioned the English-language thriller “Every time I die ” 2019.
The startup dubbed the film into Spanish and Portuguese.
According to the developers, this is one of the first cases when a full-fledged film with synthesized voices was released in the world.
Recently, Deepdub raised $20 million in the series A round. The company will direct the funds received to improve its technologies.

How will AI Voice help educators with building courses?

However, the technology also raises significant concerns about the potential risks of generating speech that resembles someone's voice, including the risk of scams, extortion, and misinformation.

Title:

Content: OpenAI's Johansson gaffe pushes voice cloning into spotlight

Law enforcement warned that AI clones could be used to extort money from loved ones over the phone

By AFP

  • Follow us on

Scarlett Johansson voiced an AI character in the film "Her". — Reuters file

Published: Mon 27 May 2024, 7:51 PM

Last updated: Mon 27 May 2024, 7:52 PM

OpenAI was forced to apologise to actor Scarlett Johansson last week for using her voice -- or something very similar -- on its latest chatbot, throwing the spotlight on to voice-cloning tech.

Although OpenAI denied the voice they used was Johansson's, their case was not helped by CEO Sam Altman flagging the new model with a one-word message on social media -- "Her".

Johansson voiced an AI character in the film "Her", which Altman has previously said is his favourite film about the technology.

Right from the start, AI voice cloning has proved problematic.

Last year, British firm Elevenlabs went viral for all the wrong reasons when it released its voice-cloning software.

Internet pranksters immediately began pushing out deepfaked celebrities -- Harry Potter star Emma Watson was shown reading Hitler's Mein Kampf.

Law enforcement warned that AI clones could be used to extort money from loved ones over the phone.

The technology has developed rapidly in the past year becoming far more realistic and nuanced.

Danish entrepreneur Victor Riparbelli, CEO of British AI firm Synthesia, told AFP it was largely down to a program called Tortoise that was released two years ago.

The program's developers threw thousands of hours of voice data into their model in an unstructured way and discovered it not only learnt what to say but how to say it.

"That was a pretty big paradigm shift," Riparbelli said on the sidelines of last week's VivaTech conference in Paris.

Tortoise was an open source program and Elevenlabs was the first to go to market using it.

OpenAI uses similar systems though they do not release any details.

Much of the controversy around voice cloning has focused on concerns over people misusing the software.

But the claim against OpenAI is unusual because it is the company itself accused of playing fast and loose.

"It was very unfortunate that OpenAI did that -- really not very good," Katya Laine, CEO of TALKR.ai, told AFP at VivaTech.

"If they actually cloned her voice without her knowing then I think that's very very bad," said Riparbelli.

The two entrepreneurs are among hundreds harnessing AI voice programs for uses that they argue will make companies more efficient.

Laine's firm provides virtual voice assistants -- essentially AI customer service agents.

She said her firm's system could now resolve 25 to 30 percent of calls without any human involvement.

Synthesia specialises in video avatars, which Riparbelli said allowed any office worker to turn text or slides into a video performed by a realistic AI.

Both Riparbelli and Laine allow their clients to use their own avatars, off-the-shelf products or those supplied by the likes of OpenAI and Elevenlabs.

Riparbelli said Synthesia used actors whose likenesses and voices were licensed for two years with an option to renew after the initial period.

The problems arise if actors' voices are used without their consent.

The fiasco overshadowed a developer conference in Paris last week when OpenAI was showing off a suite of new tools.

In front of a big screen in an auditorium, Romain Huet, OpenAI's Head of Developer Experience, breezily chatted into his phone.

Seconds later, his short voice sample had been processed and could be heard commentating over a generated video -- in five languages.

The demonstration showed how quickly the field is moving, but the headlines had already been written.

The Washington Post asked in a newsletter "How dumb is OpenAI?", other commentators were suggesting wunderkind Altman was nothing more than a huckster.

Nonetheless, Riparbelli was open to OpenAI's argument that they had used another actor who just sounded liked Johansson.

"If it's not her but someone who sounds a lot like her... where do you draw that line," Riparbelli asked.

"If they're not allowed to use someone who sounds a lot like her, then it sets a very odd precedent."

More news from World

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

To mitigate these risks, developers and instructors must ensure the responsible use of voice cloning technology, including obtaining explicit consent from voice owners, disclosing the use of AI-generated sound, and implementing digital watermarks to track the source of audio.

Title:

Content: Acoustic reproduction techniques have developed rapidly and advanced in the past year.
REUTERS
Artificial intelligence is causing a crisis.
Rapid advances in artificial intelligence have made it easier to produce believable sounds that have allowed anyone from foreign actors to music lovers to clone someone ’ s voice, leading to a flood of fake content on the internet, confusion, anger and sowing discord.
Last week, actor Tom Hanks warned his followers on social media that bad actors used his voice to imitate him wrongly as he promoted dental plans.
Hani Farid, a professor of digital forensics at the University of California, says it ’ s not hypothetical, it ’ s about violence, it ’ s about election theft, it ’ s about fraud, and it ’ s about real consequences for individuals, societies, and democracies.
Phonetic cloning techniques have undergone rapid and advanced development in the past year.
The proliferation of cheap tools that are easily accessible online has allowed almost anyone to launch a complex audio campaign from their bedroom.
Tom Hanks Warns Against Advertising Exploited by ‘ Artificial Intelligence ’
It ’ s hard for the average person to spot fake audio campaigns, while photos and videos still have noticeable abnormalities — such as deformed hands and deviant words.
Social media companies are finding it difficult to modify the voice generated by artificial intelligence because human auditors often have a hard time detecting counterfeit products.
At the same time, few software companies have firewalls to prevent illegal use.
In the past, voice cloning software produced unrealistic automated sounds, but computing has become more powerful, and software has become more accurate.
The result was a technique that could clone millions of sounds, identify patterns in primary speech units, called phonetics, and simulate them within seconds.
Source: The Washington Post
Report: Artificial Intelligence Faces a Tough Test in 2024
Most Read
No stories found.
Erm News
www.eremnews.com

The use of voice cloning technology in language instruction raises concerns about authenticity, security, and the potential for misuse, highlighting the need for instructors and developers to be aware of these risks and take steps to mitigate them.

Title:

Content: Artificial intelligence is replacing human actors in voiceovers and videos
Chris Vallance (Chris Vallance)
• BBC Technical Reporter
The Screen Actors Guild (Equity) has said that if current laws are not changed, the livelihoods of entertainers will be threatened by artificial intelligence.
The campaign, launched by the British Performers Union, is called “Don ’ t Let Artificial Intelligence Catch the Camera. ”
Artificial intelligence can use parts of the actor ’ s voice and face to create content, including so-called “deep fakes ”, which uses artificial intelligence to generate anthropomorphic images and mix them with human images to make it difficult to distinguish between true and false.
The Screen Actors Guild says, “From auto-generated listening content to digitally personalised images, AI systems are now replacing professional actors. ”
The Screen Actors Guild has warned that unless copyright laws are amended now, there will be an end to what it calls a “dystopia, ” a future in which social forms are comprehensively deteriorating.
The Screen Actors Guild points to a number of ways in which AI makes use of actors ’ voices and looks.
For example, actors can work with AI companies to build a system that can generate AI voiceovers or help generate digitally simulated human images.
Artificial intelligence can produce “synthetic ” performances, and in some cases even bring actors who are no longer alive back to the screen.
While AI generates performance as a creative tool, the actors ’ union is concerned that actors ’ control cannot be protected, i.e. they are not always able to control how their image is used or, without consent or adequate remuneration, their own image is used.
Manually generated "deep fake" celebrity videos are becoming more and more popular online.
The Screen Actors Guild ’ s “Don ’ t Let Artificial Intelligence Catch the Camera ” campaign was supported by actress Talulah Riley.
“As a performer, no matter how easy it is to reproduce sound and image with digital technology, how cheap the price is, my voice and my pictogram belong to me, which is the most important thing, ” she said.
I think performance artists should be rewarded for what they create. "
Trouble with voice actors
The Screen Actors Guild says that when actors work with AI companies, most are unaware of their rights, and many are asked to sign confidentiality agreements.
The Screen Actors Guild conducted a survey of 430 members and found that 93% of dubbing artists felt AI was a threat to their employment opportunities.
One voice actor who participated in the survey told the union, “Over the past six months, my voice has been used in large-scale marketing campaigns at companies around the world.
I think I signed a contract that forbids third-party advertising, and even then I didn ’ t get a penny. ”
“The growing ability of AI to clone human sounds is a big risk for sound owners, who get paid less, or not at all, ” the actor ’ s union said.
The Screen Actors Guild said they were particularly concerned about the development of digital sound technology designed to automatically generate audiobooks.
Examples of China
China ’ s CCTV aired the documentary “Innovate China ” in 2018, which is said to be the first in the world to use artificial intelligence to simulate human voice.
The voice of a deceased Chinese voice actor reappears in the film through language synthesis technology.
In addition, Chinese media have also reported that the voice in China's car navigation software uses the voice of Taiwanese actress Lin Zhiling, who was synthesized by artificial intelligence.
The issue of copyright in the use of personal voices through artificial intelligence synthesis technology and how to ensure legal protection in China is also a matter of widespread concern, but still to be defined by law.
Text to Speech
The union's lobbying campaign was supported by voice actor Bev Standing, who had filed a lawsuit over the use of her voice on the social media site TikTok.
The Canadian voiceover artist recorded 10,000 sentences for translation in 2018 for the research institute of the China Institute of Acoustics.
But Ms. Stein said her voice later appeared in TikTok's "text-to-speech" (TTS) feature, a software that converts text into sound, dubbing uploaded videos, and often producing comedic effects.
She said the synthetic sounds of those rationed videos often repeat swear words.
Although TikTok never admitted to using Ms. Stedin ’ s voice, TikTok adjusted its “text-to-speech ” function accordingly after she filed a lawsuit.
Later, TikTok made an out-of-court settlement with Ms. Stein.
"I only work with dubbing companies that give me control over how I authorize my use," Ms. Stein said, speaking to the Screen Actors Union.
Government action is needed.
The Screen Actors Guild said existing copyright laws do not provide enough protection for performing artists because artificial intelligence “can generate performances without recording or copying the original. ”
The Screen Actors Guild wants the government to take action to protect the rights of actors, and they want to amend copyright laws to “adapt to the pace of technological development. ”
But there are also concerns that changes to copyright laws could have a negative impact on freedom of expression or curb innovation.
The British government told the BBC that it wants AI to be properly regulated to encourage innovation while also “protecting people ’ s rights and our fundamental values. ”
“Our country ’ s AI strategy has a 10-year plan to take advantage of technology opportunities, and we will develop a management strategy to keep it on the right track, ” the government statement said.

Real-world examples of the technology's potential for misuse include its use in scams, phishing attacks, and the creation of deepfakes, which can have serious consequences, including financial loss, reputational damage, and social unrest.

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

Furthermore, the technology's accessibility and ease of use have made it possible for anyone to create and disseminate fake audio content, highlighting the need for education and awareness about the potential risks and limitations of voice cloning technology.

Title:

Content: What we know about Vall-E 2
According to these claims, Microsoft has developed a new artificial intelligence speech generator that is so adept that it can do more harm than good.
VALL-E 2 voices the text with the voice of a particular person, for which he needs only a few seconds of audio recording of the speech of this person.
Midjourney artificial intelligence has its own version of who is the president of the United States, and it ’ s not Biden
Microsoft researchers said that VALL-E 2 "has reached human parity."
It is capable of generating "accurate, natural speech by the voice of the original announcer, which can be compared to a human voice."
In other words, the new AI voice generator is convincing enough to be mistaken for a living person.
This opens up potentially dangerous opportunities for unscrupulous people.
VALL-E 2 is the latest achievement in speech models of neural codecs and marks an important milestone in text-to-speech (TTS) synthesis.
[...] VALL-E 2 consistently synthesizes high-quality speech, even for sentences that traditionally cause difficulties due to their complexity or repetitive phrases,
The developers write.
We ’ ve already seen examples of neural networks that are able to clone voices based on a multi-second recording, but Microsoft says its technology is superior to anything that has been on the market so far.
"Our experiments conducted on the LibriSpeech and VCTK datasets have shown that the VALL-E 2 is superior to previous TTS-systems [...] in reliability, naturalness and similarity to the speakers.
This is the first of its kind system that has reached parity with a person on these indicators, ” the article says.
The quality of the VALL-E 2 results depends on the length and quality of the speech prompts, as well as environmental factors such as background noise.
See also Google allows you to make your own copy of a celebrity to chat with her in a chatbot
What happens next with the technology
Despite its capabilities, Microsoft will not release VALL-E 2 to the public due to potential abuse risks.
Recently, we have seen a wave of fraud – both at the level of ordinary users, who are deceived by fraudsters, forging the voice of their relatives or friends, and at the level of state leaders who “call ” their voters, and celebrities who allegedly advertise cryptocurrencies and various fraudulent schemes in advertising.
VALL-E 2 is a research project.
We do not plan to include VALL-E 2 in the product or expand access to it for the public.
This may carry potential risks of abuse of the model, such as faking voice identification or impersonating a particular speaker,
The creators of the technology write.
But they suggest that artificial intelligence technology may find practical applications in the future.
VALL-E 2 can synthesize a language that retains the identity of the speaker, and can be used for educational training, entertainment, journalism, author content, accessibility features, interactive voice response systems, translation, chatbots, and more.
But to do this, you need to add a special protective protocol that will ensure that the speaker approves the use of his voice.

What are some risks regarding AI voice clning?

Instructors and developers can mitigate these risks by implementing protective protocols, such as speaker approval and digital watermarking, and by promoting transparency and accountability in the use of voice cloning technology.

Title:

Content: Home > Web3

AI Voice Over Generator: Turning Text to Speech in 24 Languages

newsonjapan.com -- Aug 15
Communication has crossed boundaries and languages in today's technology driven society.

The AI voice over generator, a sophisticated technology capable of translating written text into realistic speech in a variety of languages, is a driving force in this worldwide change. The astonishing capacity of these technologies to produce voice overs in 24 different languages, and often more, is propelling them to the forefront of digital communication. We go deep into the field of AI-driven text to voice below, giving practical tips for anybody interested in realizing its enormous potential.

Why Do Multilingual Skills Matter?

Language inclusion is critical for companies, schools, and content providers that want to reach a global audience. An AI voice over generator that handles various languages allows for a broader reach while also ensuring that no audience section feels alienated. Multilingual technologies, such as those that transform English transcripts into Mandarin audio or Spanish text into French voice, help to break down communication obstacles.

Practical User Advice:

Emphasize Quality Over Quantity: While having a tool that can translate text in several languages seems great, it is critical to emphasize output quality. Choose platforms that are well-known for their precision and realistic voice reproduction.

Adjust the Tone, pace, and Accent: A decent AI voice over generator enables users to adjust the tone, pace, and accent of the created speech. This adaptability guarantees that the discourse is genuine and connects with the intended listener.

Keep Up to Date: Because these technologies are based on AI, they are always improving. Regular software upgrades might bring new languages to the table or enhance current ones. To benefit from the most recent advances, keep your software up to date at all times.

Using Nuanced Speech to Bridge Cultural Gaps

Understanding a language entails understanding the nuances, intonations, and cultural nuances as well as the words themselves. Advanced AI voice over generators not only translate text to speech but also guarantee that the speech is emotionally appropriate. For example, the way a joke is presented in Japanese may vary from how it is shown in German. As a result, always use a tool that considers these subtleties in order to make the speech seem as genuine and culturally appropriate as feasible.

Potential Multilingual Text to Speech Applications:

E-Learning Platforms: Educators may build courses in one language and then utilize an AI voice over generator to translate them into numerous languages, guaranteeing that learners all over the globe can benefit.

Podcasts in different Languages: Podcast makers may reach a worldwide audience by giving their material in different languages without having to re-record episodes.

Global Business Presentations: Companies with a global presence may simply tailor their presentations to a variety of language audiences.

Scalability and pricing

Costs, like with any technology, might be an issue. With the rise of cloud-based solutions, however, many AI voice over producers now provide scalable price structures. There is undoubtedly a price option to meet your needs, whether you are an individual wishing to convert a few pages or an organization with mass requirements.

Data Privacy Is Important

Given that these technologies may be used to convert sensitive or private information, it is critical to address data privacy. Choose platforms that emphasize user data security to ensure that the material you convert stays private.

Extending the Multilingual Communication Landscape

As companies and organizations strive for a worldwide presence, the demand for multilingual communication has never been greater. Then there are AI voice over generators. These technologies provide companies, schools, and content producers an advantage by enabling them to cater to a varied audience.

Courses in numerous Languages: Educators and e-learning platforms may now offer their courses in numerous languages. Python programming may be learned in Mandarin by one student in Beijing and Portuguese by another in So Paulo. Learning results are improved by catering to their linguistic comfort. The student may concentrate on grasping the material rather than dealing with linguistic intricacies.

Digital Marketing: By employing the AI voice over generator to translate and vocalize their promotional material, brands can easily roll out worldwide campaigns. This not only saves time, but it also guarantees that the brand message is consistent across several languages.

IVR (Interactive Voice Response) Systems: Companies may customize their customer service lines by using AI-generated voices in several languages. This provides a more personalized client experience, which may dramatically increase user happiness and loyalty.

Podcasters, YouTube makers, and digital storytellers may utilize these technologies to make their material accessible in several languages, extending their fan base and worldwide reach.

Language and Cultural Nuances

While these AI voice over generators' skills are astounding, users should be conscious of the subtleties and complexity of various languages and cultures. Even if a technology is capable of converting text to voice in 24 languages, the user must verify that the material is culturally appropriate and respectful. Certain idioms or phrases in English, for example, may not have a direct counterpart in another language or may be misconstrued.

AI engineers are tackling these issues by training their models on culturally varied datasets in order to capture the nuances of each language. However, it is also the users' responsibility to examine and, if required, change the created information to guarantee its relevancy and appropriateness.

Best Practices for Using AI Voice Over Generators

Here are some practical advice for individuals who want to fully use the possibilities of AI voice over generators:

Always Review the Output: Before completing, always listen to the created voice over. Check that your pronunciation, intonation, and emotion are appropriate for the context of your topic.

Customize Settings: Most programs enable users to change the pace, pitch, and other characteristics of their voice. Experiment with these options to get the desired result.

Keep up to date: The disciplines of AI and machine learning are rapidly growing. Use the most recent version of the program or application, since developers are always refining and improving their algorithms.

Request input: If your material is intended for a particular linguistic group, get input from native speakers. They may reveal insights that non-natives may miss.

In conclusion

In the digital age, the AI voice over generator is changing the way we interact. Its capacity to convert text into lifelike voice in different languages bridges barriers, fosters inclusion, and makes global communication easier than ever. Remember to consider quality, cultural subtlety, and data protection as you investigate the numerous products in the text to speech domain. By doing so, you get access to more than simply a tool; you also gain access to worldwide dialogues.

Web3 Page: 1 | 2 | 3

Ultimately, the responsible development and use of voice cloning technology require a nuanced understanding of its potential benefits and risks, as well as a commitment to ensuring that its use is ethical, transparent, and respectful of individuals' rights and dignity.

Title:

Content: Setup
• Day and night
with the system.
Light color
Dark color
• Theme Colors
Speech cloning raises concerns, OpenAI again explains its text-to-speech tool
2024 / 6 / 10 9: 57: 21 Source: IT House Author: Yuanyang Editor: Yuanyang
OpenAI explained its text-to-speech tool for the second time in a few months, and again stressed that the tool is not currently widely available and may not be available in the future.
“Whether or not we end up deploying this technology at scale, it ’ s important for people around the world to understand where it ’ s going, ” OpenAI said in a statement on its website Friday.“ That ’ s why we want to explain how the model works, how we use it for research and education, and how we implement security measures around the technology. ”
At the end of last year, OpenAI shared its “voice engine ” with a small number of external users.
The engine uses text input and a 15-second clip of human voices to “generate a natural sounding human voice that is very similar to the original speaker. ”
The tool could create fake, multilingual human voices, and the company said at the time that it had chosen to preview the technology rather than launch it at scale to “enhance social resilience ” to the threat posed by“ increasingly realistic artificial intelligence-generated models. ”
As part of these efforts, OpenAI says it is actively phasing out ways to use voice recognition for bank account verification, exploring policies to protect individual voices for use in AI, educating the public about the risks of AI, and accelerating the development of technologies to track audiovisual content so users can identify whether they are interacting with real people or synthetic content.
However, despite these efforts, concerns about the technology remain.
Bruce Reed, the head of artificial intelligence for US President Joe Biden, has said that voice cloning is one of the reasons he can't sleep at night.
The Federal Trade Commission said in March that scammers were using AI technology to increase the credibility of their fraud, using voice cloning tools that make it harder for people to distinguish between AI-generated voices and human voices.
“We continue to engage with U.S. and international partners from government, media, entertainment, education, civil society, and more to ensure we incorporate their feedback in the build process, ” the company also noted, once the“ Voice Engine ” is equipped with its latest model, GPT-4o, it will also bring new threats.
The company says it is actively “conducting ‘ red team testing ’ on GPT-4o to identify and address known and unknown risks from areas such as social psychology, bias and fairness, and misinformation. ”
Advertisement Statement: The external redirect links contained in the text (including not limited to hyperlinks, QR codes, passwords, etc.) are used to convey more information and save selection time. The results are for reference only. All articles of IT House contain this statement.
Related articles
Soft media 's website: IT home hot products - Value shopping guide, coupons most buy - rebate coupons iPhone home Win7 home Win10 home Win11 home
Soft media software: Cube cool point desktop Win7 optimization master Win10 optimization master soft media mobile APP application

What are some risks regarding AI voice clning?

The technical requirements for generating realistic Listening Comprehension materials at low proficiency levels (ILR 1 - 1+) using voice cloning technology include the use of AI tools like ElevenLabs, which can create convincing digital replicas of voices.

Title:

Content: ×
ADVERTISEMENT
ADVERTISEMENT
ADVERTISEMENT

Dark corners of the web offer a glimpse at Artificial Intelligence's nefarious future

AI tools such as Dall-E and Midjourney generate novel images from simple text descriptions. But a new wave of AI image generators are made for the purpose of creating fake pornography, including removing clothes from existing images.
Last Updated 08 January 2024, 10:39 IST

When the Louisiana parole board met in October to discuss the potential release of a convicted murderer, it called on a doctor with years of experience in mental health to talk about the inmate.

The parole board was not the only group paying attention.

A collection of online trolls took screenshots of the doctor from an online feed of her testimony and edited the images with artificial intelligence tools to make her appear naked. They then shared the manipulated files on 4chan, an anonymous message board known for fostering harassment and spreading hateful content and conspiracy theories.

It was one of numerous times that people on 4chan had used new AI-powered tools such as audio editors and image generators to spread racist and offensive content about people who had appeared before the parole board, according to Daniel Siegel, a graduate student at Columbia University who researches how AI is being exploited for malicious purposes. Siegel chronicled the activity on the site for several months.

The manipulated images and audio have not spread far beyond the confines of 4chan, Siegel said. But experts who monitor fringe message boards said the efforts offered a glimpse at how nefarious internet users could employ sophisticated AI tools to supercharge online harassment and hate campaigns in the months and years ahead.

Callum Hood, head of research at the Center for Countering Digital Hate, said fringe sites such as 4chan -- perhaps the most notorious of them all -- often gave early warning signs for how new technology would be used to project extreme ideas. Those platforms, he said, are filled with young people who are "very quick to adopt new technologies" such as AI to "project their ideology back into mainstream spaces."

Those tactics, he said, are often adopted by some users on more popular online platforms.

Here are several problems resulting from AI tools that experts discovered on 4chan -- and what regulators and technology companies are doing about them.

Artificial Images and AI Pornography

AI tools such as Dall-E and Midjourney generate novel images from simple text descriptions. But a new wave of AI image generators are made for the purpose of creating fake pornography, including removing clothes from existing images.

"They can use AI to just create an image of exactly what they want," Hood said of online hate and misinformation campaigns.

There is no federal law banning the creation of fake images of people, leaving groups such as the Louisiana parole board scrambling to determine what can be done. The board opened an investigation in response to Siegel's findings on 4chan.

"Any images that are produced portraying our board members or any participants in our hearings in a negative manner, we would definitely take issue with," said Francis Abbott, executive director of the Louisiana Board of Pardons and Committee on Parole. "But we do have to operate within the law, and whether it's against the law or not -- that has to be determined by somebody else."

Illinois expanded its law governing revenge pornography to allow targets of nonconsensual pornography made by AI systems to sue creators or distributors. California, Virginia and New York have also passed laws banning the distribution or creation of AI-generated pornography without consent.

Cloning Voices

Late last year, ElevenLabs, an AI company, released a tool that could create a convincing digital replica of someone's voice saying anything typed into the program.

Almost as soon as the tool went live, users on 4chan circulated clips of a fake Emma Watson, a British actor, reading Adolf Hitler's manifesto, "Mein Kampf."

Using content from the Louisiana parole board hearings, 4chan users have since shared fake clips of judges uttering offensive and racist comments about defendants. Many of the clips were generated by ElevenLabs' tool, according to Siegel, who used an AI voice identifier developed by ElevenLabs to investigate their origins.

ElevenLabs rushed to impose limits, including requiring users to pay before they could gain access to voice-cloning tools. But the changes did not seem to slow the spread of AI-created voices, experts said. Scores of videos using fake celebrity voices have circulated on TikTok and YouTube -- many of them sharing political disinformation.

Some major social media companies, including TikTok and YouTube, have since required labels on some AI content.

President Joe Biden issued an executive order in October asking that all companies label such content and directed the Commerce Department to develop standards for watermarking and authenticating AI content.

Custom AI Tools

As Meta moved to gain a foothold in the AI race, the company embraced a strategy to release its software code to researchers. The approach, broadly called "open source," can speed development by giving academics and technologists access to more raw material to find improvements and develop their own tools.

When the company released Llama, its large language model, to select researchers in February, the code quickly leaked onto 4chan. People there used it for different ends: They tweaked the code to lower or eliminate guardrails, creating new chatbots capable of producing antisemitic ideas.

The effort previewed how free-to-use and open-source AI tools can be tweaked by technologically savvy users.

"While the model is not accessible to all, and some have tried to circumvent the approval process, we believe the current release strategy allows us to balance responsibility and openness," a spokesperson for Meta said in an email.

In the months since, language models have been developed to echo far-right talking points or to create more sexually explicit content. Image generators have been tweaked by 4chan users to produce nude images or provide racist memes, bypassing the controls imposed by larger technology companies.

ADVERTISEMENT
(Published 08 January 2024, 10:39 IST)

Follow us on

ADVERTISEMENT
ADVERTISEMENT

However, the use of such tools may require users to pay for access to voice-cloning tools, and social media companies may require labels on AI content.

Open-source AI tools, on the other hand, can be tweaked by users, and guardrails can be lowered or eliminated in AI tools, allowing for more flexibility in generating Listening Comprehension materials.

To generate realistic Listening Comprehension materials at low proficiency levels (ILR 1 - 1+), it is essential to have a low variety of voices to make a realistic simulation.

Title:

Content: ChatGPT ’ s new feature makes it possible to synthesize realistic vocals in just 15 seconds OpenAI: not available yet
Author: Au Jingluo
Published: Updated:
OpenAI has decided to postpone the release of its new software, Voice Engine, which can copy and synthesize realistic human voices in just 15 seconds of recording. OpenAI says it is too risky to release the tool now.
Voice Engine was developed in 2022 and the original version was used for the Text-to-Speech feature of ChatGPT.
However, OpenAI wants to expand it into a tool for simulating speech, copying the sounds of real people.
“We want to start a conversation about the responsible application of synthetic sound and how society responds to these new capabilities, ” OpenAI said in a blog post.“ Based on the results of small-scale testing, we will be more informed about whether and how to deploy this technology at scale. ”
A giant AI logo at the Artificial Intelligence Conference in Shanghai, China, on July 6, 2023. (Reuters)
In the article, OpenAI shares practical examples of partners trying this technology.
For example, the edtech company Age of Learning uses it to generate script voiceovers, while the AI voice company HeyGen uses user recordings to translate directly, such as using audio samples from French users to simulate users reading English.
It doesn ’ t take much variety to make a realistic simulation, and one of the demonstrations uses only 15 seconds of recording to successfully replicate.
OpenAI says it won ’ t release the technology publicly at this time because it ’ s too risky.
The company called on the community to discuss “policies to protect the use of individual voices in AI ” and“ educate the public about the capabilities and limitations of AI technology, including the possibility of fraudulent content. ”

Additionally, AI models can be developed to echo specific talking points, and images can be generated using text descriptions with AI tools like Dall-E and Midjourney.

The use of voice cloning technology for foreign language learners at low proficiency levels is still limited, and there is a need for more research and development in this area.

Title:

Content: How media agencies are tightening brand safety and transparency measures as influencers tap AI

With greater use of artificial intelligence across influencer marketing and social media, media agencies are having to prioritize transparency and tighten brand safety measures when working with influencers.

Content creators and agencies are continuing to experiment with generative AI images and sounds to social media filters and AI influencers – which comes with more ethical and legal considerations when it comes to publishing content. For agencies and their clients, the risk of not disclosing use of AI content can lead to damage of the brand and its reputation. And for influencers, it could hurt their authenticity and engagement with followers.

“The biggest consideration for an agency, and the partners we engage with, is always around the attribution concerns of AI,” said Alexis DeBrunner, associate strategy director at IPG agency R/GA.

Ben Jeffries, CEO of influencer marketing company Influencer, added that audience trust could decline if followers perceive content as “manipulative.” Jeffries pointed to risks such as deepfake technology, misinformation or harmful biases and stereotypes that could be perpetuated by AI-generated content.

“Brands must strike a balance between using technology to enhance their influencer campaigns and maintaining the human element that makes them truly resonate with consumers,” Jeffries said. “After all, AI is only as unbiased as the data it’s trained on, and if that data is flawed or discriminatory, the content it produces will be, too.”

Disclosures when using AI

Many influencers are employing AI in a variety of ways – from video filters and shorts generators to translation tools and strategies for analyzing people’s behavior and preferences to produce personalized content. Some 94.5% of creators surveyed in the U.S. this year said they use AI for content editing and generation, according to The Influencer Marketing Factory.

Media.Monks teams are incorporating measures into the contract process with influencers when discussing AI usage. Amy Luca, evp and global head of social at the agency network, said the legal contracts conversation will cover transparency and disclosure when using AI in content.

Influencers have to be “very clear and tacit about the ground rules for how that content is created,” Luca told Digiday. “I think that’s something we’re going to see a lot more from an ethics perspective, but more importantly from a brand safety and brand transparency perspective. Because at the end of the day, it only takes one influencer to produce content that is not authentic or is done through AI and for that to be found out.”

For example, one of the stipulations with brands and influencers selling a cosmetic product, such as mascara, is they cannot use fake eyelashes. The same goes for skincare products, like foundations, because they have clauses that say influencers cannot use filters or augmented tools to change skin tone or looks to ensure the authenticity.

“They have to be their real lashes,” Luca said, “because we want to show that mascara could do the job, not something that’s false like false lashes … At the end of the day, it kind of comes down to the fundamentals of how that content is created and what messages they’re putting out there.”

Because using generative AI is still in its early days, Luca believes that some issues will inevitably come up – but the “core legal framework” they have established and being transparent about using AI will be critical. “I think AI is that new frontier for brands – where if they do employ AI, they have to do it in a responsible and ethical way so that they don’t erode long-term brand equity and trust. It’s a huge risk for future brands.”

Arielle Carter, group vp of consumer and content experience at Razorfish, also mentioned that the disclosure of employing AI will become more important in influencer marketing. Carter said the influencers they work with have already been using a variety of AI-generated sounds, filters and editing on social media, but the development of generative AI will require more industry standards and collaboration.

“With the filters and the sounds and everything, I think that’s already kind of a given and not necessarily something where we’re currently being asked to give disclosures around that – but that’s where that governance comes in for generative AI and thinking about the future of leveraging AI with creators,” Carter explained. “It’s definitely a new frontier that we’re all going to have to navigate together, but that governance is definitely going to be a key first step to work as an industry to get established.”

Besides legal, CMI Media Group is also focusing on the right targeting and comment moderations for campaigns to protect brands. Bianca Blando Kroupa, associate director of paid social, said CMI works with legal and privacy teams closely on new products and offerings with content creation.

“We take that even one step further to any content that they’re a part of actually goes through our full med legal review,” Kroupa said. “They’ll review every piece of it for accuracy to make sure … that we are only making claims that are totally accurate.”

The future of AI in influencer marketing

As more influencers turn to AI not just in content creation, but in scaling and business efficiency tools, Ryan Detert, CEO of influencer marketing company Influential, said the technology allows them to rapidly grow the business. Detert said his company ensures that data is consented and anonymized with AI brand safety tactics in order to protect clients – a safety mechanism that was implemented seven years ago.

“Many are also using AI to generate or inspire creative concepts, creative briefs, or customer and creator support tickets,” Detert said. “To us, AI is a tool just like a calculator, a force multiplier to get more efficient.”

Luca at Media.Monks also said there is opportunity for celebrities and influencers to have their likeness or voices become licensed with AI integration – sort of like cloning themselves. These can be turned into live events, content and experiences that people can interact with, beyond social media.

“There’s something really interesting about that from a living history perspective,” Luca said.

Another business potential for influencer marketing is using AI to produce content that reaches more people across different markets and languages. With advancing AI and translation tools, influencers can have their content and voice synthesized into many languages with the availability of large language models.

“With the dawn of AI and large language models, you’re able to retain such high fidelity with the actual context of the word itself,” said Michael Balarezo, global vp of enterprise automation at Media.Monks. “And you transcribe the actual text and then you can have the machine read in a synthesized voice, the translated copy itself – and that can all be automated today.”

Some AI is also capable of syncing the person’s lips to the spoken word that is analyzed in the video, Balarezo said. “I always say this AI technology today is the worst it’s ever going to be. It’s only going to get better.”

And ironically, AI can even be leveraged to mitigate some of the risks created by AI content. For instance, as Jeffries at Influencer explained, AI can help with brand safety by analyzing the uploaded content or captions and providing insight on how the information will be perceived by different audiences, be it region, age or other demographics.

“This extra dose of insight can help brands make necessary tweaks to ensure that their content is appropriate and have the sort of impact they’d imagined,” he added.

https://digiday.com/?p=503705
Digiday Top Stories

Some companies, like Voice Engine, are working on adapting voice cloning technology for educational purposes, such as helping people who cannot read or children in learning.

Title:

Content: OpenAI introduced a tool based on artificial intelligence, which can voice the text of any person
17: 57, 31 March 2024
Voice Engine can clone your voice in as little as 15 seconds.
Photo: gzeromedia.com
Follow the latest news in social networks SUD.UA
OpenAI has introduced a new tool based on artificial intelligence Voice Engine, capable of voicing texts with the voice of any person.
This is on the OpenAI website.
In particular, having a 15-second sample of the sound of speech, the instrument can reproduce the voice of any person.
Voice Engine has the same AI model underlying the “read aloud ” feature of ChatGPT chatbot.
The tool is offered to be used to translate videos and podcasts.
Voice Engine retains the natural accent of the speaker even in translation.
Also, the developers note that Voice Engine can help people who can not read or children in learning, since natural sound is better perceived than robotic voices.
Voice Engine can be used to restore voice to patients with impaired speech apparatus.
People will be able to communicate by voicing their text queries in natural language thanks to the tool, added to OpenAI.
OpenAI created the Voice Engine in late 2022, but there is no public access to it yet.
Developers fear that it can be used to create deepfakes.
Subscribe to our Telegram-channel t.me / sudua and to Google News SUD.UA, as well as to our VIBER, Facebook page and Instagram to be aware of the most important events.
The status of limited fit will be canceled: how it will affect the mobilization
The status of limited fit will be canceled: how it will affect the mobilization
The main thing about court
Today is Birthday Celebration
• Igor Zavalnyuk
Judge of the Odessa District Administrative Court
• Lyudmila Kosik
Judge of the Svyatoshinsky District Court of the City of Kyiv

How will educational institutions benefit from developing AI voice audio content for languages learners?

The technology has the potential to break through language barriers and connect with users worldwide, but it also raises concerns about intellectual property rights and the potential for misuse.

Title:

Content: Language No Barrier: New AI tool can clone voice and make it say anything in multiple languages

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

Mehul Reuben Das May 03, 2023 13:42:20 IST

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

As advanced as AI-based voice cloning has been, there were a few limitations to it. For example, voice generators were mainly bound by the language of the source they were trained in or rather the language of the prompt that was given to them. Now, ElevenLabs, an American AI software developing company has come up with a tool that does away with that limitation.

ElevenLabs’ new AI tool can clone the voice of a person and make it say anything in a bunch of different languages. All it needs is a clear voice sample of about 3 seconds, although it also suggests that the longer the sample, the better will be the results. The new tool even manages to maintain the speaker’s original tone of voice.

Limitless possibilities
The creators expect that this would ‘extend the possibilities’ in a variety of industries such as publishing, gaming creation, and media. “Introducing Eleven Multilingual v1: Our New Speech Synthesis Model! We’re thrilled to launch our new model supporting seven new languages: French, German, Hindi, Italian, Polish, Portuguese, and Spanish.”

“This advancement expands the horizons for creators, game developers, and publishers, and it paves the way for using generative media to create more localized, accessible, and imaginative content,” the company said.

Following the announcement, Twitter was flooded with comments, with users testing the software on various famous faces.

To demonstrate just how capable the new voice cloning AI tool is, Eluna AI, a platform for AI-content creators experimented with a sample clip of former US President Donald Trump.

In their demo, Eluna AI showcased a small clip of Donald Trump, speaking in his native tongue, English, followed by French, Spanish, German, Hindi and Italian, almost perfectly. The generated samples even gets the accent right, almost if he was a native speaker of the new target language.

Another user changed David Attenborough’s voice to German while the BBC broadcaster discussed the prospects of AI. “With this tool, anyone can do it,” stated the Twitter user. “It’s also worth noting that fraudsters will undoubtedly exploit this one.”

ElevenLabs says that its model was designed to understand the emotion and reasoning underlying words in order to produce natural-sounding and persuasive audio. ElevenLabs has said that some numerals and symbols are currently spoken wrongly, but that it is striving to rectify this.

Who is this new tool meant to help?
The US-based company believes its technology will be valuable in a variety of areas, including education and journalism.

Game developers and publishers can build engaging, localised experiences for worldwide audiences, breaking through language barriers and connecting with players and listeners to maximise engagement and efficiency while maintaining quality and accuracy.

“Educational institutions now have the ability to develop audio content for varied users in their target languages, enhancing language comprehension and even pronunciation abilities, as well as responding to different teaching methods and learning demands,” says the report.

Because of the model’s capacity to produce unique character-like voices, audiobook and content developers may also find it beneficial.

The conundrum of AI voice genertors
Despite its benefits, ElevenLabs’ launch comes amid widespread concern about the wave of new voice cloning technology. An unidentified TikTok user went popular last month after sharing an AI-generated Drake song starring The Weeknd.

It sparked concerns about the grey area of AI-created music and whether it constitutes a copyright violation. Nonetheless, ElevenLabs claims to be ‘fully committed’ to respecting creators’ rights in the midst of technological advancements.

“At Eleven, we think that we should seek to make the best use of emerging technology, but not at any expense,” it stated.

“As we create them, we make every effort to put suitable controls in place that reduce the possibility of detrimental abuse. With this in mind, we are entirely committed to both protecting intellectual property rights and taking action against infringement.”

Read all the Latest NewsTrending NewsCricket NewsBollywood News,
India News and Entertainment News here. Follow us on FacebookTwitter and Instagram.

Updated Date:

also read

World

Music labels are worried because of AI, thanks to a surprising new song ft. Drake X The Weeknd

Someone used AI to create a whole new song featuring Drake and The Weeknd. But because the singers never sang the song, artists and music labels are worried, how AI voice modulation and AI-generated songs can disrupt the industry.

World

Artificial Imposter: 47% of Indian phone users have experienced AI voice scams, highest in the world

About half of Indian adults, or 47%, have experienced AI voice scams, nearly double the global average of 25%. Furthermore, nearly 69% of adults say they can't differentiate between a real and an AI-generated voice.

In terms of ethical challenges, there is a need for guidelines on the responsible application of AI voice cloning technology, as well as consideration of the potential impact on cultural nuances and language learning.

Title:

Content: Advertisment

China Media Group Debuts AI-dubbed English Documentary, Pioneering Global Communication

China Media Group launches its first AI-dubbed English documentary, enhancing global reach and fostering international understanding through advanced AI technology.

Aqsa Younas Rana
Updated On
New Update

In a groundbreaking move, China Media Group has launched its first AI-dubbed English documentary, marking a significant milestone in the use of artificial intelligence for global media outreach. This innovative approach to dubbing not only showcases the advancements in AI technology but also underscores China's ambitions to foster better international communication and understanding. Through this initiative, the documentary, originally produced in Mandarin, has been made accessible to a broader English-speaking audience, enhancing its global reach and impact.

Advertisment

Revolutionizing Content Accessibility

The application of AI in dubbing the documentary into English reflects a growing trend in leveraging technology to bridge language barriers. Similar to the educational advancements discussed in 'Voice Cloning in Education: Bridging Language Gaps in Learning Environments,' this initiative by China Media Group capitalizes on the potential of AI voice cloning technology. By generating lifelike digital replicas of human voices, the documentary's AI-dubbed version maintains the authenticity of the original narration while making it understandable for English-speaking viewers. This technological leap not only improves accessibility but also ensures the delivery of content with emotional depth and cultural nuances intact.

The launch of this AI-dubbed documentary serves as a testament to China's commitment to enhancing global dialogue and cultural exchange. By removing language barriers, China Media Group is effectively broadening the documentary's audience, enabling people from different parts of the world to gain insights into Chinese culture, history, and perspectives. This initiative aligns with the broader objective of promoting mutual understanding and respect among diverse global communities, paving the way for more inclusive and informed international discourse.

Advertisment

Setting New Standards in Media Production

China Media Group's pioneering use of AI technology in documentary dubbing sets new standards for media production and distribution. It illustrates the potential of AI to transform traditional media practices, making content more accessible and engaging for global audiences. As AI technology continues to evolve, it is likely to open up further possibilities for creating multilingual content, thereby enhancing the reach and impact of media across borders. This development also raises important considerations regarding the ethical use of voice cloning technology, underscoring the need for guidelines that ensure its responsible application in media and beyond.

As we reflect on the implications of this technological advancement, it becomes clear that AI-dubbed media content holds significant promise for fostering international understanding and cooperation. By making diverse cultural and educational materials available in multiple languages, we can build a more connected and informed world. The initiative by China Media Group not only highlights the practical applications of AI in media but also invites us to contemplate the future of global communication in an increasingly digital age.

Advertisment
Advertisment

Deepdub, a film dubbing company, uses an AI to process voice and translate into a different language and promises to preserve what?

The use of AI voice over generators in e-learning platforms and podcasts can also provide scalable and cost-effective solutions for multilingual content creation.

How will AI Voice help educators with building courses?

However, data privacy is essential when using AI voice over generators, and companies must ensure that they are protecting users' personal information.

Overall, voice cloning technology has the potential to revolutionize the way we interact with languages and cultures, but it requires careful consideration of the ethical and legal implications.

The development of voice cloning technology involves the use of neural networks to mimic human audio patterns, and some companies, such as ElevenLabs, are working to improve the quality and accuracy of their tools.

However, the use of voice cloning technology also raises ethical concerns, such as the potential for misuse, intellectual property infringement, and the need for clear policies and regulations to protect individual rights.

Some companies, such as OpenAI, are calling for discussions on policies to protect individual voices in AI, and there are already laws and regulations being implemented to address these concerns, such as the requirement for labels on AI-generated content.

The legal implications of voice cloning technology are still evolving, but it is clear that there will be a need for clear guidelines and regulations to ensure that this technology is used responsibly and ethically.

Real-world examples of the use of voice cloning technology include its application in education to develop audio content for language comprehension, as well as its potential use in the entertainment industry to create realistic voiceovers and audio effects.

How will educational institutions benefit from developing AI voice audio content for languages learners?

However, the use of this technology also raises legal implications, such as the need for policies to protect individual voices and prevent copyright violation.

Companies like OpenAI and Microsoft are taking a cautious approach to the release of voice cloning technology, with Microsoft limiting access to its VALL-E 2 tool to prevent fraud and requiring speaker approval for voice use.

What are some risks regarding AI voice clning?

Ultimately, the responsible use of voice cloning technology requires a careful consideration of its potential risks and limitations, as well as the implementation of safeguards to prevent abuse and ensure transparency and accountability.

What are some risks regarding AI voice clning?

Voice cloning technology is a rapidly developing field that enables the creation of highly realistic and convincing digital replicas of human voices, raising both excitement and concern about its potential applications and implications.

Title:

Content: This website uses relevant technologies to provide a better reading experience, while respecting the privacy of users. Click here to understand the privacy statement of the Central News Agency. When you close this window, you agree to the above regulations.
Your browser does not appear to support Traditional Chinese.
Would you like to go to CNA ’ s English website, “Focus Taiwan ”?
Koko Koko Koko Koko Koko Koko
"日本語版「フィーカス」について" (in Japanese).
Central News First-hand News APP
Download
OpenAI Reveals New Voice Replication Tool Will Be Strictly Regulated to Prevent Abuse
2024 / 3 / 30 13: 38
Please agree to our privacy policy in order to enable news listening.
Please agree to our privacy policy in order to enable news listening.
U.S. artificial intelligence (AI) development company OpenAI today revealed a voice copying tool that intends to implement strict controls before implementing protection against speech fraud.
According to an OpenAI blog post sharing the results of the small scale test, the model, called Voice Engine, can mainly copy a person ’ s voice based on a 15-second sound sample.
San Francisco-based OpenAI said, “We acknowledge the significant risks involved in generating speech that resembles someone ’ s voice, especially given the election year … We work with U.S. and international partners in government, media, entertainment, education, civil society, and other areas to ensure that we incorporate their input into the build process. ”
Fake information researchers are concerned that AI-powered applications are being abused in a critical election year, as voice copying tools become more and more affordable, easy to use, and difficult to track.
OpenAI, which recognises these issues, said it would be cautious and kept abreast of wider releases "based on the potential for synthetic speech abuse."
A few months ago, a political adviser to a Democratic presidential primary candidate in the United States admitted to impersonating President Joe Biden ’ s voice by calling AI-generated automated voice calls that sounded like Biden ’ s call to voters not to vote in January ’ s New Hampshire primary.
The incident alarmed experts who feared a flood of AI-generated fake information ahead of the US presidential election in November and other important elections around the world.
OpenAI said that partners testing the Voice Engine have agreed to a number of specifications, including requiring that all voices copied by the tool be given explicit and informed consent.
OpenAI also said that it is also necessary to clearly inform the audience that the sound they hear is generated by AI.
“We have implemented a range of security measures, including digital watermarking to track the source of all audio generated by the Voice Engine and proactively monitor how the tool is used, ” OpenAI said.
(Translator: Zeng Yixuan / Review: Zhang Xiaowen) 1130330
Central News Agency "First-hand News" app
The text, pictures and audio and video of this website shall not be reproduced, broadcast or transmitted or used without authorization.
Please continue reading.
Electric Power Association: The development of AI computing power needs sufficient power, the government should support the deployment
172.30.142.201

What are some risks regarding AI voice clning?

This technology has advanced to the point where it can clone a person's voice in as little as 15 seconds, using tools such as OpenAI's Voice Engine.

The development of voice cloning technology has significant implications for various industries, including entertainment, accessibility, and education, where it can be used to create realistic voiceovers, translate languages, and enhance learning experiences.

How will AI Voice help educators with building courses?

How will educational institutions benefit from developing AI voice audio content for languages learners?

Enhance pronunciation abilities
Enhance language comprehension

However, the technology also poses significant risks, including the potential for fraud, election interference, and the spread of misinformation, as it can be used to create fake audio content that is nearly indistinguishable from real voices.

Title:

Content: You can copy your voice in 15 seconds!
OpenAI Announces New Voice Engine Tool
▲ This technology is at risk of abuse. OpenAI is only available to partners at this stage and is not yet open to the public. (Graph / CFP)
Journalist Chan Ya-ting / General Report
American artificial intelligence development company OpenAI on Friday (29) revealed that the voice AI tool "Voice Engine", just 15 seconds of speaking sound samples, can copy the voice of the person, and the result is not limited by the sound sample language. If you speak English, this technology can use your voice to generate results in Spanish, French and other languages.
However, due to the risk of abuse, OpenAI is only available to partners at this stage and is not yet available to the public.
The New York Times and the Associated Press reported that OpenAI entered the field of speech technology, sharing test results after applying for the trademark Voice Engine, but considering the possibility of synthetic speech abuse, especially worried that the technology could be used to destroy voice authenticators such as online bank accounts, OpenAI is now taking a cautious attitude towards wider release.
OpenAI pointed out that there are significant risks in producing voice-like speech, especially in an election year when Voice Engine testing partners have agreed to regulations such as disclosing to audiences that sound is generated by AI and that the original voice must have explicit and informed consent.
In addition, OpenAI said that the company has implemented a number of security measures, including the use of digital watermarks to track the source of all the audio generated by the Voice Engine and actively monitor its usage.
Share with friends:
※ This article is copyrighted and cannot be reproduced without permission. [ETtoday Copyright Notice]
Related News
Hot News
The best video
And more.
Hot News
Back to the top.

What are some risks regarding AI voice clning?

What has the US Federal Trade Commission warned about the use of voice cloning tools?

Difficult to distinguish from human voice

OpenAI has acknowledged the significant risks associated with generating speech that resembles someone's voice and has implemented strict controls, including requiring partners to inform the audience that sound is AI-generated and proactively monitoring tool usage.

What are some risks regarding AI voice clning?

Moreover, the technology poses a threat to the livelihoods of entertainers and voice professionals, as it can be used to create performances without recording or copying originals, and existing copyright laws may not protect performing artists from AI-generated content.

Title:

Content: Advertisement
Technology and Science
Technical expert talks about the danger of "falsifying" sounds: "5 minutes is enough"
22-10-2023 | 23: 00
A-
A +
photos 0
A +
A-
Noufal Tonsi, sales manager at digital voice human performance services company Acapella, said on Saturday that the digital voice creation market is developing rapidly, opening up “unlimited prospects ” for developers and content makers, but warned of“ unprecedented risks ” facing society.
Advertisement
On the sidelines of GITEX 2023 in Dubai, Tonsi said that “just five minutes of pure sound recorded in someone ’ s voice is enough to create a digital version of his voice, to make it easy to make him utter any words in the same language, ” noting that“ it has become easy to use the voice of any influential or famous person to fabricate facts and spread rumors. ”
The Belgian company official added that "care must be taken in dealing with the techniques of generative artificial intelligence," noting that "voice performance professionals are at risk due to the development of digital voice generation technologies."
Tunisi stated that his company does not intend to enter the market of providing digital voice creation services to individuals, which is led largely by ElevenLabs.
He urged companies operating in this market to "adhere to an advanced level of ethical standards, to protect themselves from legal accountability on the one hand, and to prevent the dissemination of misinformation on the other."
He pointed out that "Acapella" is currently working to provide the service of simultaneous audio translation of audio clips between different languages, while maintaining the same voice and performance of the speaker.
Several major companies have entered the market for voice translation services, mainly Spotify and YouTube.
Acapella ’ s digital sounds can speak more than 30 languages, including Arabic, English, French, Turkish, Spanish and Italian, and offers a feature called Voice Smileys that provides digital sounds with the ability to express different emotions, giving a human character to manufactured sounds.
Tounsi said that Acapella has worked for 22 years to build and train its own smart models capable of delivering human performance of digital voices, to serve the goals of its customers in the marketing and promotional sectors, as well as to support people of determination who are unable to speak, to voice themselves.
He pointed out that the company's work with people of determination is the only aspect of its cooperation with individuals, explaining that the company provides the visually impaired and the blind with intelligent voice assistants through its service Infovox3, which allows the user to interact with any text appearing on his computer screen, saying that "the service reads the text aloud, and then the user can interact with his voice commands with his device."
He pointed out that "Acapella" offers its services to people with speech problems by enabling them to create a digital copy of their voice through recording audio clips with a variety of performance, so that the patient uses that copy to interact with the world naturally later.
Advertisement
Our news via your email
SIGN UP

To address these challenges, governments and regulatory bodies are considering changes to copyright laws and implementing regulations to protect rights and innovation, while also ensuring the responsible development and use of voice cloning technology.

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

What are some risks regarding AI voice clning?

Instructors and developers can mitigate these risks by implementing protective protocols, such as speaker approval and digital watermarking, and by promoting transparency and accountability in the use of voice cloning technology.

What are some risks regarding AI voice clning?