Voice cloning technology is a rapidly developing field that uses artificial intelligence to mimic human voices, making it faster and more accessible, with large audio material no longer required for cloning.

This technology has developed rapidly in the past year, enabling the production of believable sounds, and allowing anyone to clone someone's voice using online tools.

The development of voice cloning technology is attributed to advances in artificial intelligence, which enables machines to mimic human voices with high accuracy.

AI voice cloning software can mimic the voices of artists, and has been used to mimic the voices of famous individuals such as Drake and The Weeknd.

The technology uses machine learning to simulate anyone's voice, requiring voice data to analyze patterns, and can be used in various applications, including voice assistants and chatbots.

ElevenLabs developed an AI voice cloning tool that can clone voices in multiple languages, requiring only a three-second voice sample and text prompt to work.

OpenAI developed a voice cloning tool using text input and a 15-second voice clip, which can generate natural-sounding human voices and create fake multilingual human voices.

The technology has raised concerns about misuse, with scammers using AI voice cloning for online scams, including fake kidnapping scams and demanding ransom.

Voice cloning technology also raises concerns about consent and intellectual property, with companies like Universal Music Group expressing concerns over AI training on artist music.

The technology has the potential to bridge language gaps and enhance global reach, with China Media Group debuting an AI-dubbed English documentary.

However, the lack of regulation and oversight has led to concerns about the potential harm of voice cloning technology, with some startups warning about its potential misuse.

The use of voice cloning technology in entertainment, such as in music and film production, has also raised questions about the rights and compensation of artists.

The development of voice cloning technology has been rapid, with significant advancements in the past year, and its applications and implications continue to evolve.

The technology has the potential to be used in various industries, including publishing, gaming, and media, with companies like ElevenLabs committed to respecting creators' rights and protecting intellectual property.

Despite the potential benefits, voice cloning technology also poses significant risks, including the potential for scams, fraud, and misuse, highlighting the need for regulation and oversight.

The technology can be used to create personalized learning experiences, such as audiobooks and podcasts, with realistic and engaging voice narration.

However, the use of voice cloning technology also raises ethical concerns, such as the potential for misuse and unintended harm, and the need for protective protocols to prevent abuse.

To address these concerns, companies like OpenAI are taking steps to educate the public about the risks of AI and to develop policies to protect individual voices.

Ultimately, the development and use of voice cloning technology require a balanced approach that considers both its potential benefits and risks, and prioritizes the protection of individuals' rights and privacy.

The technology has the potential to revolutionize the way we interact with audio content, but it also requires careful consideration of the ethical and legal implications.

As the technology continues to evolve, it is essential to address the potential challenges and limitations, such as data privacy, security, and misuse, and to establish policies and protocols to protect individual voices and prevent abuse.

The use of voice cloning technology in language learning can improve learning outcomes, but it also requires consideration of cultural nuances and complexity of languages.

To ensure the effective and responsible use of voice cloning technology, it is essential to prioritize data privacy, obtain speaker voice approval, and develop policies for the responsible use of the technology.

The evaluation of voice cloning technology should also consider the cultural nuances and subtleties of different languages and dialects, as well as the potential impact on technological inequality.

Overall, voice cloning technology has the potential to be incredibly realistic and accessible, but it also raises important ethical and legal implications that need to be addressed.

Voice cloning technology is a rapidly developing field that uses artificial intelligence to mimic human voices, making it faster and more accessible, with large audio material no longer required for cloning.

Title:

Content: That’s how easily your vote can be stolen – and used for AI fraud

The person on the phone sounded exactly like Ruth Card’s grandson Brandon.

He needed money fast and Ruth, recognizing his voice, went to the bank.

Benjamin Perkins’ parents received a call from a man who said he was a lawyer. Benjamin was alleged to have killed another man and needed bail money. The lawyer handed the phone to someone – who sounded exactly like Benjamin.

In both cases, as Washington Post reported on, it involved a new form of fraud – voices cloned using artificial intelligence.

“Impossible to imagine a year ago”

In the past, large amounts of audio material were required to be able to reliably clone someone’s voice, but AI development is going at a breakneck pace – now it’s faster, easier and more accessible than before.

– What was impossible to imagine a year ago is free today. The companies that make and sell AI want a lot of data – that’s why they give away their services, says Tobias Falk, lecturer at the department of computer and systems science at Stockholm University, to SVT Nyheter.

“Having reached a point where the machines can imitate us”

– Algorithms are trained to imitate how the human brain works. It’s going really fast now, but it’s taken decades to get to the point where the machines can mimic us as well as they do today.

The police’s national fraud center writes in an email to SVT Nyheter that they are “aware of the phenomenon” but that they have not seen any cases in Sweden at the moment. “We monitor this and have communication with international contacts,” writes the police spokesperson.

How many seconds long clip is enough to be able to clone someone’s voice? And how well does it actually work in Swedish?

Watch the video above for our test.

This technology has developed rapidly in the past year, enabling the production of believable sounds, and allowing anyone to clone someone's voice using online tools.

Title:

Content: Acoustic reproduction techniques have developed rapidly and advanced in the past year.
REUTERS
Artificial intelligence is causing a crisis.
Rapid advances in artificial intelligence have made it easier to produce believable sounds that have allowed anyone from foreign actors to music lovers to clone someone ’ s voice, leading to a flood of fake content on the internet, confusion, anger and sowing discord.
Last week, actor Tom Hanks warned his followers on social media that bad actors used his voice to imitate him wrongly as he promoted dental plans.
Hani Farid, a professor of digital forensics at the University of California, says it ’ s not hypothetical, it ’ s about violence, it ’ s about election theft, it ’ s about fraud, and it ’ s about real consequences for individuals, societies, and democracies.
Phonetic cloning techniques have undergone rapid and advanced development in the past year.
The proliferation of cheap tools that are easily accessible online has allowed almost anyone to launch a complex audio campaign from their bedroom.
Tom Hanks Warns Against Advertising Exploited by ‘ Artificial Intelligence ’
It ’ s hard for the average person to spot fake audio campaigns, while photos and videos still have noticeable abnormalities — such as deformed hands and deviant words.
Social media companies are finding it difficult to modify the voice generated by artificial intelligence because human auditors often have a hard time detecting counterfeit products.
At the same time, few software companies have firewalls to prevent illegal use.
In the past, voice cloning software produced unrealistic automated sounds, but computing has become more powerful, and software has become more accurate.
The result was a technique that could clone millions of sounds, identify patterns in primary speech units, called phonetics, and simulate them within seconds.
Source: The Washington Post
Report: Artificial Intelligence Faces a Tough Test in 2024
Most Read
No stories found.
Erm News
www.eremnews.com

The development of voice cloning technology is attributed to advances in artificial intelligence, which enables machines to mimic human voices with high accuracy.

AI voice cloning software can mimic the voices of artists, and has been used to mimic the voices of famous individuals such as Drake and The Weeknd.

Title:

Content: "This assault on human creativity must be stopped": Pearl Jam, Stevie Wonder, Billie Eilish and 200 more artists call for protections against threat of AI

A group of over 200 artists has come together to sign an open letter urging tech companies to "stop devaluing music" and cease the use of artificial intelligence to infringe on artists' rights.

The Artist Rights Alliance, a group of artists that includes Pearl Jam, Billie Eilish, Stevie Wonder, Nicki Minaj and Zayn Malik, has shared a statement demanding that AI developers, technology companies and digital music services pledge that they will not "develop or deploy AI music-generation technology, content or tools that undermine or replace the human artistry of songwriters and artists" or deny them "fair compensation" for their work.

"Some platforms and developers are employing AI to sabotage creativity and undermine artists, songwriters, musicians and rightsholders," the statement reads. "When used irresponsibly, AI poses enormous threats to our ability to protect our privacy, our identities, our music and our livelihoods."

The statement goes on to describe how tech companies are training AI models on the work of artists' without their permission, efforts that the Artists Rights Alliance believes are "directly aimed at replacing the work of human artists" with AI-generated sounds and images that will dilute the royalty pools paid out to working musicians and recording artists.

"For many working musicians, artists and songwriters who are just trying to make ends meet, this would be catastrophic," the statement continues.

The letter does not demand a wholesale ban on the use of AI in music, conceding that the potential to advance human creativity when used responsibly.

Concerns over the threat that generative artificial intelligence poses artists and musicians have grown rapidly in recent years as AI-powered tools and platforms have advanced in sophistication. AI music generators such as Stable Audio and Google's MusicFX are now capable of generating entire tracks on demand, leading many to question whether music produced by this technology could gain popularity, directing royalty payments away from human artists and into the pockets of tech companies.

Last year, AI voice cloning software was used to mimic the voices of Drake and The Weeknd for a viral track that racked up thousands of streams before being taken down from streaming platforms.

Following the incident, Universal Music Group issued a statement voicing its concerns over the training of generative AI using the music of artists belonging to the label. Earlier this year, Tennessee became the first US state to introduce legislation protecting musicians from unauthorized voice cloning.

Read the full letter from the Artist Rights Alliance.

Revisit our 2023 feature on AI voice cloning.

Tech Editor

I'm the Tech Editor for MusicRadar, working across everything from artist interviews to product news to tech tutorials. I love electronic music and I'm endlessly fascinated by the tools we use to make it. When I'm not behind my laptop keyboard, you'll find me behind a MIDI keyboard, carefully crafting the beginnings of another project that I'll ultimately abandon to the creative graveyard that is my overstuffed hard drive.

All-access artist interviews, in-depth gear reviews, essential production tutorials and much more.
Get the latest issue now!

The technology uses machine learning to simulate anyone's voice, requiring voice data to analyze patterns, and can be used in various applications, including voice assistants and chatbots.

Title:

Content: The scary side of artificial intelligence

The pros of AI outweigh the Cons or threats in our day-to-day lives, and there’s no magic pill to protect us from the scary threats of AI.

  • Exclusive

It's a free Content, simply login/signup to unlock

Get in-depth Industry Insights and Analysis through our “Exclusive” content, presented to you by our esteemed panel of writers, for free

By continuing, you agree to the Terms & Conditions and acknowledge our Privacy Policy. This same account can be used across all Economic Times B2B portals.

  • Updated On Oct 3, 2023 at 03:02 PM IST

Artificial intelligence (AI), as we all know, is the simulation of human intelligence leveraging computer systems and machines. AI programs can continuously learn and evolve with experience. In technical terms, AI systems render the output by churning and analyzing the data for correlations and patterns and help make future predictions using these patterns.

Advt
Today AI is being used extensively in all facets of our lives starting from lifestyle, e-commerce, home appliances, automobiles, navigation, transport, healthcare, agriculture, education, financial planning, chatbots, marketing, cyber security, virtual assistant, industrial automation and many more.

Clearly, we have and are leveraging the strengths of AI to the fullest to automate the routine tasks and make it auto-learn over a period. There’s no doubt that AI has revolutionized the lives of all – organizations, consumers etc. But as they say, “Everything comes at a price”. This analogy is quite true for AI as well, there have been a lot of threats that have emerged using AI and are being utilized by the Cyber criminals to dupe the ignorant users, cause mental stress and extort money.

continued below

Executive Workshop

I’m not going to delve into all of threats but would like to elucidate some of the real ones that have come to the surface recently:

Voice cloning or mimicry

As the name suggests, it uses machine learning algorithms to simulate anyone’s voice. It requires certain voice data to analyze and learn the specific patterns of any individual. There are certain advantages of cloning a voice that can be used in voice assistants, chatbots, navigation systems and other areas. Voice cloning has existed for a while but was restricted to experts who possess the technical knowledge to be able to use the same. But now AI Voice cloning tools are available on the open Internet that anyone can leverage with literally no technical knowledge or cost to clone anyone’s voice. All you need to do is just Google and it will pop up and get a bunch of both free and paid AI Voice cloning tools.

Advt
In fact, recently one of the global leaders in online protection published a report stating how AI is fueling a rise in online voice scams, with just three seconds of audio required to clone a person’s voice. This is extremely creepy. Just imagine, if a Cyber-criminal clones your voice and tricks your near ones by making them believe that they are talking to you, and request for money due to any distress reasons. In fact, these are not assumptions but real-life incidents that are happening across the world every minute.

Deepfakes AI

Deepfakes AI are being used to impersonate an individual by manipulating videos, images, audios, and other content available on the social media platforms using deep learning techniques. It mainly transforms existing content from one person to another. This is another area that has been exploited by the Cyber criminals in the recent past, and there are a few deepfake cases that have made waves on the Internet. One of the most famous ones being Deepfake created by a VFX artist of one of Hollywood’s most famous male actors. This piece was so well made by rendering thousands of pictures using artificial versions of the actor. There are similar Deepfakes incidents involving other global celebrities and leaders. The damage and misuse of the deepfakes videos could be extremely dangerous for the human society and can be used by terrorists to incite riots and create nuisance.

Creating virtual people

This is another area where AI is being used to create people that do not exist. There are a lot of websites that allow you to generate a random image by just specifying the age group, gender & ethnicity, and you can continue to refresh these images at the click of a button. Be mindful of the fact that these images pertain to people that do not exist in this world. On the similar lines, there’s an emerging trend of AI news anchors that possess a human-like appearance and are fed data that they can read using text-to-speech technology. Recently, there's been a surge of AI-Driven robotic new anchors in multiple language channels. While the main objective of this initiative is to provide royalty free or cost-effective human images for branding and other purposes. However, the overuse of these technologies causes Fear of missing out (FOMO), Feeling of inadequacy, dissatisfaction, and isolation may potentially lead to psychological and emotional vulnerabilities.

One of the Hollywood movies, ‘HER’ portrayed an introverted and lonely writer (Joaquin Phoenix) who purchases an AI virtual assistant personified through a female voice to assist him in his writing job. However, when he finds out about its ability to learn and adapt, he falls in love with it. The film delves into emotional vulnerability and the impact of AI on human relationships.

Needless to say, that the pros of AI outweigh the Cons or threats in our day-to-day lives, and there’s no magic pill to protect us from the scary threats of AI. However, there are certain preventive tips that one can follow to mitigate any such risks. Do spread awareness with your family and friends:

  • Set some code words with family, and friends to verify the identity during emergency circumstances
  • Optimize social media presence by limiting your connections with only known contacts and avoid connecting with any unknown ones
  • Avoid saying ‘Yes’ as a greeting while receiving unknown calls as it can be used to authorize credit card charges or other purposes
  • Continuously update privacy settings on social media to allow viewing by friends and family only
  • Avoid clicking on any suspicious links or calls received without proper due diligence
  • Do not share your passwords and other sensitive information with anyone
  • Verify the credentials of any online information before circulating it through various mediums
  • Avoid public Wi-Fi connections offered at coffee shops or airports, which requires to enter password
  • Closely monitor the time spent by younger generation on social media and online gaming
  • Finally, in case of any suspicion, double check and report it to the host site or concerned authorities
The author is the CIO of MOVIN

Disclaimer: The views expressed are solely of the author and ETCIO does not necessarily subscribe to it. ETCIO shall not be responsible for any damage caused to any person/organization directly or indirectly.

  • Published On Oct 3, 2023 at 03:02 PM IST

Most Read in Artificial Intelligence

Join the community of 2M+ industry professionals

Subscribe to our newsletter to get latest insights & analysis.

Download ETCIO App

  • Get Realtime updates
  • Save your favourite articles

What is necessary for voice cloning to work?

ElevenLabs developed an AI voice cloning tool that can clone voices in multiple languages, requiring only a three-second voice sample and text prompt to work.

Title:

Content: Language No Barrier: New AI tool can clone voice and make it say anything in multiple languages

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

Mehul Reuben Das May 03, 2023 13:42:20 IST

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

As advanced as AI-based voice cloning has been, there were a few limitations to it. For example, voice generators were mainly bound by the language of the source they were trained in or rather the language of the prompt that was given to them. Now, ElevenLabs, an American AI software developing company has come up with a tool that does away with that limitation.

ElevenLabs’ new AI tool can clone the voice of a person and make it say anything in a bunch of different languages. All it needs is a clear voice sample of about 3 seconds, although it also suggests that the longer the sample, the better will be the results. The new tool even manages to maintain the speaker’s original tone of voice.

Limitless possibilities
The creators expect that this would ‘extend the possibilities’ in a variety of industries such as publishing, gaming creation, and media. “Introducing Eleven Multilingual v1: Our New Speech Synthesis Model! We’re thrilled to launch our new model supporting seven new languages: French, German, Hindi, Italian, Polish, Portuguese, and Spanish.”

“This advancement expands the horizons for creators, game developers, and publishers, and it paves the way for using generative media to create more localized, accessible, and imaginative content,” the company said.

Following the announcement, Twitter was flooded with comments, with users testing the software on various famous faces.

To demonstrate just how capable the new voice cloning AI tool is, Eluna AI, a platform for AI-content creators experimented with a sample clip of former US President Donald Trump.

In their demo, Eluna AI showcased a small clip of Donald Trump, speaking in his native tongue, English, followed by French, Spanish, German, Hindi and Italian, almost perfectly. The generated samples even gets the accent right, almost if he was a native speaker of the new target language.

Another user changed David Attenborough’s voice to German while the BBC broadcaster discussed the prospects of AI. “With this tool, anyone can do it,” stated the Twitter user. “It’s also worth noting that fraudsters will undoubtedly exploit this one.”

ElevenLabs says that its model was designed to understand the emotion and reasoning underlying words in order to produce natural-sounding and persuasive audio. ElevenLabs has said that some numerals and symbols are currently spoken wrongly, but that it is striving to rectify this.

Who is this new tool meant to help?
The US-based company believes its technology will be valuable in a variety of areas, including education and journalism.

Game developers and publishers can build engaging, localised experiences for worldwide audiences, breaking through language barriers and connecting with players and listeners to maximise engagement and efficiency while maintaining quality and accuracy.

“Educational institutions now have the ability to develop audio content for varied users in their target languages, enhancing language comprehension and even pronunciation abilities, as well as responding to different teaching methods and learning demands,” says the report.

Because of the model’s capacity to produce unique character-like voices, audiobook and content developers may also find it beneficial.

The conundrum of AI voice genertors
Despite its benefits, ElevenLabs’ launch comes amid widespread concern about the wave of new voice cloning technology. An unidentified TikTok user went popular last month after sharing an AI-generated Drake song starring The Weeknd.

It sparked concerns about the grey area of AI-created music and whether it constitutes a copyright violation. Nonetheless, ElevenLabs claims to be ‘fully committed’ to respecting creators’ rights in the midst of technological advancements.

“At Eleven, we think that we should seek to make the best use of emerging technology, but not at any expense,” it stated.

“As we create them, we make every effort to put suitable controls in place that reduce the possibility of detrimental abuse. With this in mind, we are entirely committed to both protecting intellectual property rights and taking action against infringement.”

Read all the Latest NewsTrending NewsCricket NewsBollywood News,
India News and Entertainment News here. Follow us on FacebookTwitter and Instagram.

Updated Date:

also read

World

Music labels are worried because of AI, thanks to a surprising new song ft. Drake X The Weeknd

Someone used AI to create a whole new song featuring Drake and The Weeknd. But because the singers never sang the song, artists and music labels are worried, how AI voice modulation and AI-generated songs can disrupt the industry.

World

Artificial Imposter: 47% of Indian phone users have experienced AI voice scams, highest in the world

About half of Indian adults, or 47%, have experienced AI voice scams, nearly double the global average of 25%. Furthermore, nearly 69% of adults say they can't differentiate between a real and an AI-generated voice.

What company created an AI tool that could mimic the voices of deceased movie stars?

OpenAI developed a voice cloning tool using text input and a 15-second voice clip, which can generate natural-sounding human voices and create fake multilingual human voices.

Title:

Content: Setup
• Day and night
with the system.
Light color
Dark color
• Theme Colors
Speech cloning raises concerns, OpenAI again explains its text-to-speech tool
2024 / 6 / 10 9: 57: 21 Source: IT House Author: Yuanyang Editor: Yuanyang
OpenAI explained its text-to-speech tool for the second time in a few months, and again stressed that the tool is not currently widely available and may not be available in the future.
“Whether or not we end up deploying this technology at scale, it ’ s important for people around the world to understand where it ’ s going, ” OpenAI said in a statement on its website Friday.“ That ’ s why we want to explain how the model works, how we use it for research and education, and how we implement security measures around the technology. ”
At the end of last year, OpenAI shared its “voice engine ” with a small number of external users.
The engine uses text input and a 15-second clip of human voices to “generate a natural sounding human voice that is very similar to the original speaker. ”
The tool could create fake, multilingual human voices, and the company said at the time that it had chosen to preview the technology rather than launch it at scale to “enhance social resilience ” to the threat posed by“ increasingly realistic artificial intelligence-generated models. ”
As part of these efforts, OpenAI says it is actively phasing out ways to use voice recognition for bank account verification, exploring policies to protect individual voices for use in AI, educating the public about the risks of AI, and accelerating the development of technologies to track audiovisual content so users can identify whether they are interacting with real people or synthetic content.
However, despite these efforts, concerns about the technology remain.
Bruce Reed, the head of artificial intelligence for US President Joe Biden, has said that voice cloning is one of the reasons he can't sleep at night.
The Federal Trade Commission said in March that scammers were using AI technology to increase the credibility of their fraud, using voice cloning tools that make it harder for people to distinguish between AI-generated voices and human voices.
“We continue to engage with U.S. and international partners from government, media, entertainment, education, civil society, and more to ensure we incorporate their feedback in the build process, ” the company also noted, once the“ Voice Engine ” is equipped with its latest model, GPT-4o, it will also bring new threats.
The company says it is actively “conducting ‘ red team testing ’ on GPT-4o to identify and address known and unknown risks from areas such as social psychology, bias and fairness, and misinformation. ”
Advertisement Statement: The external redirect links contained in the text (including not limited to hyperlinks, QR codes, passwords, etc.) are used to convey more information and save selection time. The results are for reference only. All articles of IT House contain this statement.
Related articles
Soft media 's website: IT home hot products - Value shopping guide, coupons most buy - rebate coupons iPhone home Win7 home Win10 home Win11 home
Soft media software: Cube cool point desktop Win7 optimization master Win10 optimization master soft media mobile APP application

What is necessary for voice cloning to work?

The technology has raised concerns about misuse, with scammers using AI voice cloning for online scams, including fake kidnapping scams and demanding ransom.

Title:

Content: AI clones child’s voice in fake kidnapping scam

‘I never doubted for one second it was her,’ mother says

Anthony Cuthbertson
Thursday 13 April 2023 12:34
Comments

A mother has said she was “100 per cent” convinced by an AI voice clone of her daughter that scammers used in a faked kidnapping attempt.

Jennifer DeStefano from Arizona picked up a call from an unknown number and heard what she believed to be her 15-year-old daughter Brie “sobbing”.

The voice on the other end of the line said, “mom, I messed up”, before a male voice took over and made threatening demands.

“This man gets on the phone, and he’s like, ‘listen here, I’ve got your daughter’,” Ms DeStafano told local news show WKYT.

The apparent kidnapper told the mother: “You call the police, you call anybody, I’m going to pop her so full of drugs, I’m going to have my way with her, and I’m going to drop her off in Mexico.”

In the background, Ms DeStefano said she could hear her daughter saying “help me, mom, please help me” and crying.

“It was 100 per cent her voice,” Ms DeStefano said.

“It was never a question of who is this? It was completely her voice, it was her inflection, it was the way she would have cried – I never doubted for one second it was her. That was the freaky part that really got me to my core.”

The apparent kidnapper demanded $1 million for the daughter to be released, before lowering the figure to $50,000. Ms DeStefano only realised that her daughter was safe after a friend called her husband and confirmed that she was safe.

The scammer, who police are still investigating, appears to have used artificial intelligence voice clone technology, which has become increasingly competent in recent years at mimicking people’s voices.

It is also relatively easy to access and use, with AI tools freely available on the internet.

AI-generated voices have already been used in films to replicate actors like James Earl Jones who voiced the original Darth Vader character in the Star Wars franchise.

It has also been touted as a way for authors to produce audiobooks without spending hours in a studio reading their work.

The technology has also raised fears that it could be misused by scammers or people attempting to create deepfake videos, with one voice clone startup warning that it could be “harmful in the wrong hands”.

In a press release last year, the firm Respeecher said: “The widespread attention and adoption of deepfake technologies will accelerate the need to regulate the use of the technology.”

Thank you for registering

Please refresh the page or navigate to another page on the site to be automatically logged inPlease refresh your browser to be logged in

Voice cloning technology also raises concerns about consent and intellectual property, with companies like Universal Music Group expressing concerns over AI training on artist music.

The technology has the potential to bridge language gaps and enhance global reach, with China Media Group debuting an AI-dubbed English documentary.

Title:

Content: Advertisment

China Media Group Debuts AI-dubbed English Documentary, Pioneering Global Communication

China Media Group launches its first AI-dubbed English documentary, enhancing global reach and fostering international understanding through advanced AI technology.

Aqsa Younas Rana
Updated On
New Update

In a groundbreaking move, China Media Group has launched its first AI-dubbed English documentary, marking a significant milestone in the use of artificial intelligence for global media outreach. This innovative approach to dubbing not only showcases the advancements in AI technology but also underscores China's ambitions to foster better international communication and understanding. Through this initiative, the documentary, originally produced in Mandarin, has been made accessible to a broader English-speaking audience, enhancing its global reach and impact.

Advertisment

Revolutionizing Content Accessibility

The application of AI in dubbing the documentary into English reflects a growing trend in leveraging technology to bridge language barriers. Similar to the educational advancements discussed in 'Voice Cloning in Education: Bridging Language Gaps in Learning Environments,' this initiative by China Media Group capitalizes on the potential of AI voice cloning technology. By generating lifelike digital replicas of human voices, the documentary's AI-dubbed version maintains the authenticity of the original narration while making it understandable for English-speaking viewers. This technological leap not only improves accessibility but also ensures the delivery of content with emotional depth and cultural nuances intact.

The launch of this AI-dubbed documentary serves as a testament to China's commitment to enhancing global dialogue and cultural exchange. By removing language barriers, China Media Group is effectively broadening the documentary's audience, enabling people from different parts of the world to gain insights into Chinese culture, history, and perspectives. This initiative aligns with the broader objective of promoting mutual understanding and respect among diverse global communities, paving the way for more inclusive and informed international discourse.

Advertisment

Setting New Standards in Media Production

China Media Group's pioneering use of AI technology in documentary dubbing sets new standards for media production and distribution. It illustrates the potential of AI to transform traditional media practices, making content more accessible and engaging for global audiences. As AI technology continues to evolve, it is likely to open up further possibilities for creating multilingual content, thereby enhancing the reach and impact of media across borders. This development also raises important considerations regarding the ethical use of voice cloning technology, underscoring the need for guidelines that ensure its responsible application in media and beyond.

As we reflect on the implications of this technological advancement, it becomes clear that AI-dubbed media content holds significant promise for fostering international understanding and cooperation. By making diverse cultural and educational materials available in multiple languages, we can build a more connected and informed world. The initiative by China Media Group not only highlights the practical applications of AI in media but also invites us to contemplate the future of global communication in an increasingly digital age.

Advertisment
Advertisment

However, the lack of regulation and oversight has led to concerns about the potential harm of voice cloning technology, with some startups warning about its potential misuse.

The use of voice cloning technology in entertainment, such as in music and film production, has also raised questions about the rights and compensation of artists.

The development of voice cloning technology has been rapid, with significant advancements in the past year, and its applications and implications continue to evolve.

The technology has the potential to be used in various industries, including publishing, gaming, and media, with companies like ElevenLabs committed to respecting creators' rights and protecting intellectual property.

Despite the potential benefits, voice cloning technology also poses significant risks, including the potential for scams, fraud, and misuse, highlighting the need for regulation and oversight.

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

The technology can be used to create personalized learning experiences, such as audiobooks and podcasts, with realistic and engaging voice narration.

Title:

Content: clonemyvoice.io
WebCatalog Desktop not installed for you?
Download WebCatalog Desktop.
Use of the web application
Website: clonemyvoice.io
Get a better experience using the desktop app from clonemyvoice.io on WebCatalog Desktop for Mac, Windows and Linux.
Run apps on Windows distraction-free with several improvements.
You can easily manage and switch between multiple accounts and apps without switching browsers.
clonemyvoice.io is an artificial intelligence-based platform that specializes in creating accurate voice feedback from available source materials.
The tool is designed to handle long-form content for various applications, including podcasts, presentations, and social media.
Users provide an audio sample of the sound to be imitated, along with the text to be pronounced, and the system processes this data to create a voiceover.
This tool supports any language and offers sounds in different dialects.
clonemyvoice.io claims to accurately capture the tone, pitch and essence of the original sound in its connections.
The final audio files can be downloaded after processing.
In accordance with the privacy policies disclosed, user data is processed on the site, is not shared with third parties, and is completely deleted after 14 days.
In addition to audio commentary for audio shows and social media content, its capabilities extend to the production of podcasts and complete audio books.
User testimonials highlight the user-friendly interface of the system and the impressive level of detail and accuracy in audio reproduction.
Website: clonemyvoice.io
Disclaimer: WebCatalog is not affiliated with, associated with, licensed, or endorsed in any way or officially connected to clonemyvoice.io.
All product names, logos and trademarks are owned by their respective owners.
© 2024 WebCatalog, Inc.
We use cookies to provide and improve our websites.
Your use of our sites indicates your consent to cookies.

Eleven Labs is extending its voice cloning services for which industries?

How will educational institutions benefit from developing AI voice audio content for languages learners?

However, the use of voice cloning technology also raises ethical concerns, such as the potential for misuse and unintended harm, and the need for protective protocols to prevent abuse.

Title:

Content: What we know about Vall-E 2
According to these claims, Microsoft has developed a new artificial intelligence speech generator that is so adept that it can do more harm than good.
VALL-E 2 voices the text with the voice of a particular person, for which he needs only a few seconds of audio recording of the speech of this person.
Midjourney artificial intelligence has its own version of who is the president of the United States, and it ’ s not Biden
Microsoft researchers said that VALL-E 2 "has reached human parity."
It is capable of generating "accurate, natural speech by the voice of the original announcer, which can be compared to a human voice."
In other words, the new AI voice generator is convincing enough to be mistaken for a living person.
This opens up potentially dangerous opportunities for unscrupulous people.
VALL-E 2 is the latest achievement in speech models of neural codecs and marks an important milestone in text-to-speech (TTS) synthesis.
[...] VALL-E 2 consistently synthesizes high-quality speech, even for sentences that traditionally cause difficulties due to their complexity or repetitive phrases,
The developers write.
We ’ ve already seen examples of neural networks that are able to clone voices based on a multi-second recording, but Microsoft says its technology is superior to anything that has been on the market so far.
"Our experiments conducted on the LibriSpeech and VCTK datasets have shown that the VALL-E 2 is superior to previous TTS-systems [...] in reliability, naturalness and similarity to the speakers.
This is the first of its kind system that has reached parity with a person on these indicators, ” the article says.
The quality of the VALL-E 2 results depends on the length and quality of the speech prompts, as well as environmental factors such as background noise.
See also Google allows you to make your own copy of a celebrity to chat with her in a chatbot
What happens next with the technology
Despite its capabilities, Microsoft will not release VALL-E 2 to the public due to potential abuse risks.
Recently, we have seen a wave of fraud – both at the level of ordinary users, who are deceived by fraudsters, forging the voice of their relatives or friends, and at the level of state leaders who “call ” their voters, and celebrities who allegedly advertise cryptocurrencies and various fraudulent schemes in advertising.
VALL-E 2 is a research project.
We do not plan to include VALL-E 2 in the product or expand access to it for the public.
This may carry potential risks of abuse of the model, such as faking voice identification or impersonating a particular speaker,
The creators of the technology write.
But they suggest that artificial intelligence technology may find practical applications in the future.
VALL-E 2 can synthesize a language that retains the identity of the speaker, and can be used for educational training, entertainment, journalism, author content, accessibility features, interactive voice response systems, translation, chatbots, and more.
But to do this, you need to add a special protective protocol that will ensure that the speaker approves the use of his voice.

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

To address these concerns, companies like OpenAI are taking steps to educate the public about the risks of AI and to develop policies to protect individual voices.

Ultimately, the development and use of voice cloning technology require a balanced approach that considers both its potential benefits and risks, and prioritizes the protection of individuals' rights and privacy.

What are some risks regarding AI voice clning?

The technology has the potential to revolutionize the way we interact with audio content, but it also requires careful consideration of the ethical and legal implications.

As the technology continues to evolve, it is essential to address the potential challenges and limitations, such as data privacy, security, and misuse, and to establish policies and protocols to protect individual voices and prevent abuse.

The use of voice cloning technology in language learning can improve learning outcomes, but it also requires consideration of cultural nuances and complexity of languages.

Title:

Content: Home > Web3

AI Voice Over Generator: Turning Text to Speech in 24 Languages

newsonjapan.com -- Aug 15
Communication has crossed boundaries and languages in today's technology driven society.

The AI voice over generator, a sophisticated technology capable of translating written text into realistic speech in a variety of languages, is a driving force in this worldwide change. The astonishing capacity of these technologies to produce voice overs in 24 different languages, and often more, is propelling them to the forefront of digital communication. We go deep into the field of AI-driven text to voice below, giving practical tips for anybody interested in realizing its enormous potential.

Why Do Multilingual Skills Matter?

Language inclusion is critical for companies, schools, and content providers that want to reach a global audience. An AI voice over generator that handles various languages allows for a broader reach while also ensuring that no audience section feels alienated. Multilingual technologies, such as those that transform English transcripts into Mandarin audio or Spanish text into French voice, help to break down communication obstacles.

Practical User Advice:

Emphasize Quality Over Quantity: While having a tool that can translate text in several languages seems great, it is critical to emphasize output quality. Choose platforms that are well-known for their precision and realistic voice reproduction.

Adjust the Tone, pace, and Accent: A decent AI voice over generator enables users to adjust the tone, pace, and accent of the created speech. This adaptability guarantees that the discourse is genuine and connects with the intended listener.

Keep Up to Date: Because these technologies are based on AI, they are always improving. Regular software upgrades might bring new languages to the table or enhance current ones. To benefit from the most recent advances, keep your software up to date at all times.

Using Nuanced Speech to Bridge Cultural Gaps

Understanding a language entails understanding the nuances, intonations, and cultural nuances as well as the words themselves. Advanced AI voice over generators not only translate text to speech but also guarantee that the speech is emotionally appropriate. For example, the way a joke is presented in Japanese may vary from how it is shown in German. As a result, always use a tool that considers these subtleties in order to make the speech seem as genuine and culturally appropriate as feasible.

Potential Multilingual Text to Speech Applications:

E-Learning Platforms: Educators may build courses in one language and then utilize an AI voice over generator to translate them into numerous languages, guaranteeing that learners all over the globe can benefit.

Podcasts in different Languages: Podcast makers may reach a worldwide audience by giving their material in different languages without having to re-record episodes.

Global Business Presentations: Companies with a global presence may simply tailor their presentations to a variety of language audiences.

Scalability and pricing

Costs, like with any technology, might be an issue. With the rise of cloud-based solutions, however, many AI voice over producers now provide scalable price structures. There is undoubtedly a price option to meet your needs, whether you are an individual wishing to convert a few pages or an organization with mass requirements.

Data Privacy Is Important

Given that these technologies may be used to convert sensitive or private information, it is critical to address data privacy. Choose platforms that emphasize user data security to ensure that the material you convert stays private.

Extending the Multilingual Communication Landscape

As companies and organizations strive for a worldwide presence, the demand for multilingual communication has never been greater. Then there are AI voice over generators. These technologies provide companies, schools, and content producers an advantage by enabling them to cater to a varied audience.

Courses in numerous Languages: Educators and e-learning platforms may now offer their courses in numerous languages. Python programming may be learned in Mandarin by one student in Beijing and Portuguese by another in So Paulo. Learning results are improved by catering to their linguistic comfort. The student may concentrate on grasping the material rather than dealing with linguistic intricacies.

Digital Marketing: By employing the AI voice over generator to translate and vocalize their promotional material, brands can easily roll out worldwide campaigns. This not only saves time, but it also guarantees that the brand message is consistent across several languages.

IVR (Interactive Voice Response) Systems: Companies may customize their customer service lines by using AI-generated voices in several languages. This provides a more personalized client experience, which may dramatically increase user happiness and loyalty.

Podcasters, YouTube makers, and digital storytellers may utilize these technologies to make their material accessible in several languages, extending their fan base and worldwide reach.

Language and Cultural Nuances

While these AI voice over generators' skills are astounding, users should be conscious of the subtleties and complexity of various languages and cultures. Even if a technology is capable of converting text to voice in 24 languages, the user must verify that the material is culturally appropriate and respectful. Certain idioms or phrases in English, for example, may not have a direct counterpart in another language or may be misconstrued.

AI engineers are tackling these issues by training their models on culturally varied datasets in order to capture the nuances of each language. However, it is also the users' responsibility to examine and, if required, change the created information to guarantee its relevancy and appropriateness.

Best Practices for Using AI Voice Over Generators

Here are some practical advice for individuals who want to fully use the possibilities of AI voice over generators:

Always Review the Output: Before completing, always listen to the created voice over. Check that your pronunciation, intonation, and emotion are appropriate for the context of your topic.

Customize Settings: Most programs enable users to change the pace, pitch, and other characteristics of their voice. Experiment with these options to get the desired result.

Keep up to date: The disciplines of AI and machine learning are rapidly growing. Use the most recent version of the program or application, since developers are always refining and improving their algorithms.

Request input: If your material is intended for a particular linguistic group, get input from native speakers. They may reveal insights that non-natives may miss.

In conclusion

In the digital age, the AI voice over generator is changing the way we interact. Its capacity to convert text into lifelike voice in different languages bridges barriers, fosters inclusion, and makes global communication easier than ever. Remember to consider quality, cultural subtlety, and data protection as you investigate the numerous products in the text to speech domain. By doing so, you get access to more than simply a tool; you also gain access to worldwide dialogues.

Web3 Page: 1 | 2 | 3

Deepdub, a film dubbing company, uses an AI to process voice and translate into a different language and promises to preserve what?

How will educational institutions benefit from developing AI voice audio content for languages learners?

Enhance language comprehension
Enhance pronunciation abilities

To ensure the effective and responsible use of voice cloning technology, it is essential to prioritize data privacy, obtain speaker voice approval, and develop policies for the responsible use of the technology.

The evaluation of voice cloning technology should also consider the cultural nuances and subtleties of different languages and dialects, as well as the potential impact on technological inequality.

Title:

Content: Artificial intelligence is flourishing all over the world, and has begun to make amazing leaps and achievements in the field of language computing, that is, the creation of software that understands and uses language, from the writing programs « Word » and its electronic proofreader, which points out errors and alerts the writer to correct them, to chatbots and artificial intelligence programs generative.
In this image from within Lelapa AI ’ s Johannesburg headquarters, some of the company ’ s employees are developing socially-based research to advance AI technology for African languages, and trying to overcome some of the problems arising from the fact that language models in smart technology are primarily trained in English, leaving many speakers of other languages outside the circle of contributing to the AI revolution.
The AI revolution has taken off from the West, leading experts in the field to fear that the language gap will exacerbate technological inequality, leaving many regions and communities far behind.
These experts believe that delaying access to good technology, even if only for a few years, could lead to a few decades of economic lag.
AI tools often err on facts, sounds, and pronunciation when working with some languages, because they are “low-resource ” languages by AI standards, meaning there are not enough data sets and content available online for an AI model to learn from.
Tens and hundreds of millions of people around the world speak “low-resource ” languages, but they produce less digital data, because the development of AI technology and online sharing is concentrated in the United States, China and Europe.
To overcome this problem, academic institutions, civic organizations and volunteer efforts are catching up to build resources for speakers of languages that are not well represented in the digital landscape.
Johannesburg based Lelapa AI is one such company that is leading efforts on the African continent in particular.
Although it is a startup, it is developing multilingual AI products for people and businesses in Africa.
(Photo courtesy of the New York Times)

Deepdub, a film dubbing company, uses an AI to process voice and translate into a different language and promises to preserve what?

What are some risks regarding AI voice clning?

Overall, voice cloning technology has the potential to be incredibly realistic and accessible, but it also raises important ethical and legal implications that need to be addressed.

Title:

Content: Medicine and Health
With your cough...
Google may be able to diagnose your illness
Artificial intelligence is entering medicine from the open door, and medical diagnosis will be in the hands of machines and robots in the not-too-distant future.
Google announced the news after a team led by its scientists developed a machine learning tool that can help detect and monitor health conditions by assessing noise such as coughing and breathing.
So doctors may one day use an artificial intelligence (AI) system, which has been trained on millions of syllables of human voices, to diagnose diseases including COVID-19 and tuberculosis, as well as assess how well a person ’ s lungs are working.
Some may be surprised to read these lines, but this isn ’ t the first time a research group has explored the use of voice as a biomarker of disease — a concept that gained much attention during the COVID-19 pandemic, when scientists discovered it was possible to detect respiratory diseases through a person ’ s cough.
But what ’ s new in Google ’ s system, dubbed Health Acoustic Representations (HeAR), is the massive data set it ’ s trained on, and the fact that it can be finely tuned to perform multiple tasks.
The researchers, who announced the tool earlier this month in a preliminary version that has yet to be reviewed, say it is too early to tell if HeAR will become a commercial product.
For now, the plan aims to give interested researchers access to the model so they can use it in their own investigations.
Sujai Kakarmatt, Google ’ s product manager in New York City who worked on the project, said: “Our goal as part of Google ’ s research is to spur innovation in this emerging field.
Most AI tools developed in this area are trained on, for example, cough audio recordings, combined with health information about the person who made the sounds.
The clips are classified to indicate that the person had bronchitis at the time of recording.
The tool comes to associate voice features with the data label, in a training process called supervised learning.
“In medicine, traditionally, we have been using a lot of supervised learning, which is great because you have clinical potency, ” says Yael Bensosan, a laryngologist at the University of South Florida in Tampa.
“The downside is that it really limits the datasets you can use, because there ’ s a shortage of annotated datasets. ”
Instead, Google researchers used self-supervised learning, which is based on unclassified data.
Through an automated process, they extracted more than 300 million short audio clips of coughing, breathing, clearing throat and other human voices from publicly available YouTube videos.
Each segment was converted into a visual representation of sound called a spectrogram.
The researchers then blocked parts of the spectral charts to help the model learn to predict missing parts.
This is similar to how we teach the large language model that ChatGPT is based on to predict the next word in a sentence after training it on countless examples from human text.
Using this method, the researchers created what they call the basic model, which they say can be adapted for many tasks.
In the case of HeAR, the Google team modified it to detect coronavirus (COVID-19), tuberculosis and characteristics such as whether a person is a smoker.
Because the model was trained on a wide range of human voices, to fine-tune it, the researchers only had to provide it with very limited sets of data disaggregated by these diseases and characteristics.
In terms of accuracy and effectiveness of this model, it turns out that on a scale of 0.5 models performing best at random prediction and 1 model making accurate predictions each time, Google ’ s HeAR model scored 0.645 and 0.710 for COVID-19 detection, depending on the data set tested.
These results are better than existing models trained in speech or general voice data.
For tuberculosis, the result was 0.739.
The fact that the original training data was so diverse — with voice quality and human sources varying — also means that the results are generalizable, Kakarmatt says.
Ali Omran, an engineer at the University of Oklahoma in Tulsa, said the sheer volume of data Google uses makes search important.
“It gives us confidence that this is a reliable tool, ” he said.
Omran is leading the development of an application called AI4COVID-19, which has shown promising results in distinguishing between COVID-19 cough and other types of cough.
His team plans to apply for U.S. Food and Drug Administration (FDA) approval so that the app can eventually go to market; it is currently seeking funding to conduct the necessary clinical trials.
To date, there is no FDA-approved tool that provides diagnosis through sounds.
Thus, the field of health acoustics, or “acoustics, ” appears to be a promising one.
“Audio science has been around for decades.
What is different is that now, with artificial intelligence and machine learning, we have the means to collect and analyze a lot of data at the same time.
“There is tremendous potential not only for diagnosis, but also for screening, ” he added.
“We can ’ t repeat scans or biopsies every week.
That ’ s why sound becomes an important biomarker for disease monitoring. ”
NEWS NOW