AI voice cloning technology uses artificial intelligence and machine learning algorithms to create highly realistic digital replicas of human voices, often requiring only a few seconds of clear audio to generate convincing results.

For example, OpenAI's Voice Engine can synthesize natural-sounding speech from a 15-second sample, while tools like Tortoise leverage vast unstructured voice data to capture not just what is said, but how it is said, marking a significant leap in voice synthesis since late 2022 .

These advances have made voice cloning increasingly accessible, with some platforms offering multilingual capabilities and the ability to generate speech in multiple languages from a single voice sample .

In **entertainment and media**, AI voice cloning is used to create realistic voiceovers for films, video games, and documentaries, and to localize content for global audiences.

ElevenLabs, for instance, enables voice cloning in multiple languages, enhancing accessibility and emotional authenticity in media productions.

The China Media Group's AI-dubbed English documentary exemplifies how this technology can maintain the original narration's emotional depth while reaching new audiences .

In **education and accessibility**, AI voice cloning generates personalized listening comprehension materials, supports language learning, and provides a voice for individuals with speech disabilities.

Tools like Loora offer conversational English practice with AI tutors, while Voiceitt enables spontaneous speech recognition for users with non-standard speech, improving communication in virtual settings .

However, the technology is also exploited in **scams and fraud**.

Scammers have used AI-generated voices to impersonate family members in fake kidnapping scenarios or executives in fraudulent calls, making these schemes more convincing and emotionally manipulative.

**Legal implications** are evolving rapidly.

Copyright and right of publicity concerns are prominent, with lawsuits

AI voice cloning technology uses artificial intelligence and machine learning algorithms to create highly realistic digital replicas of human voices, often requiring only a few seconds of clear audio to generate convincing results.

For example, OpenAI's Voice Engine can synthesize natural-sounding speech from a 15-second sample, while tools like Tortoise leverage vast unstructured voice data to capture not just what is said, but how it is said, marking a significant leap in voice synthesis since late 2022 .

Title:

Content: Advertisment

China Media Group Debuts AI-dubbed English Documentary, Pioneering Global Communication

China Media Group launches its first AI-dubbed English documentary, enhancing global reach and fostering international understanding through advanced AI technology.

Aqsa Younas Rana
Updated On
New Update

In a groundbreaking move, China Media Group has launched its first AI-dubbed English documentary, marking a significant milestone in the use of artificial intelligence for global media outreach. This innovative approach to dubbing not only showcases the advancements in AI technology but also underscores China's ambitions to foster better international communication and understanding. Through this initiative, the documentary, originally produced in Mandarin, has been made accessible to a broader English-speaking audience, enhancing its global reach and impact.

Advertisment

Revolutionizing Content Accessibility

The application of AI in dubbing the documentary into English reflects a growing trend in leveraging technology to bridge language barriers. Similar to the educational advancements discussed in 'Voice Cloning in Education: Bridging Language Gaps in Learning Environments,' this initiative by China Media Group capitalizes on the potential of AI voice cloning technology. By generating lifelike digital replicas of human voices, the documentary's AI-dubbed version maintains the authenticity of the original narration while making it understandable for English-speaking viewers. This technological leap not only improves accessibility but also ensures the delivery of content with emotional depth and cultural nuances intact.

The launch of this AI-dubbed documentary serves as a testament to China's commitment to enhancing global dialogue and cultural exchange. By removing language barriers, China Media Group is effectively broadening the documentary's audience, enabling people from different parts of the world to gain insights into Chinese culture, history, and perspectives. This initiative aligns with the broader objective of promoting mutual understanding and respect among diverse global communities, paving the way for more inclusive and informed international discourse.

Advertisment

Setting New Standards in Media Production

China Media Group's pioneering use of AI technology in documentary dubbing sets new standards for media production and distribution. It illustrates the potential of AI to transform traditional media practices, making content more accessible and engaging for global audiences. As AI technology continues to evolve, it is likely to open up further possibilities for creating multilingual content, thereby enhancing the reach and impact of media across borders. This development also raises important considerations regarding the ethical use of voice cloning technology, underscoring the need for guidelines that ensure its responsible application in media and beyond.

As we reflect on the implications of this technological advancement, it becomes clear that AI-dubbed media content holds significant promise for fostering international understanding and cooperation. By making diverse cultural and educational materials available in multiple languages, we can build a more connected and informed world. The initiative by China Media Group not only highlights the practical applications of AI in media but also invites us to contemplate the future of global communication in an increasingly digital age.

Advertisment
Advertisment

Title:

Content: Language No Barrier: New AI tool can clone voice and make it say anything in multiple languages

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

Mehul Reuben Das May 03, 2023 13:42:20 IST

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

As advanced as AI-based voice cloning has been, there were a few limitations to it. For example, voice generators were mainly bound by the language of the source they were trained in or rather the language of the prompt that was given to them. Now, ElevenLabs, an American AI software developing company has come up with a tool that does away with that limitation.

ElevenLabs’ new AI tool can clone the voice of a person and make it say anything in a bunch of different languages. All it needs is a clear voice sample of about 3 seconds, although it also suggests that the longer the sample, the better will be the results. The new tool even manages to maintain the speaker’s original tone of voice.

Limitless possibilities
The creators expect that this would ‘extend the possibilities’ in a variety of industries such as publishing, gaming creation, and media. “Introducing Eleven Multilingual v1: Our New Speech Synthesis Model! We’re thrilled to launch our new model supporting seven new languages: French, German, Hindi, Italian, Polish, Portuguese, and Spanish.”

“This advancement expands the horizons for creators, game developers, and publishers, and it paves the way for using generative media to create more localized, accessible, and imaginative content,” the company said.

Following the announcement, Twitter was flooded with comments, with users testing the software on various famous faces.

To demonstrate just how capable the new voice cloning AI tool is, Eluna AI, a platform for AI-content creators experimented with a sample clip of former US President Donald Trump.

In their demo, Eluna AI showcased a small clip of Donald Trump, speaking in his native tongue, English, followed by French, Spanish, German, Hindi and Italian, almost perfectly. The generated samples even gets the accent right, almost if he was a native speaker of the new target language.

Another user changed David Attenborough’s voice to German while the BBC broadcaster discussed the prospects of AI. “With this tool, anyone can do it,” stated the Twitter user. “It’s also worth noting that fraudsters will undoubtedly exploit this one.”

ElevenLabs says that its model was designed to understand the emotion and reasoning underlying words in order to produce natural-sounding and persuasive audio. ElevenLabs has said that some numerals and symbols are currently spoken wrongly, but that it is striving to rectify this.

Who is this new tool meant to help?
The US-based company believes its technology will be valuable in a variety of areas, including education and journalism.

Game developers and publishers can build engaging, localised experiences for worldwide audiences, breaking through language barriers and connecting with players and listeners to maximise engagement and efficiency while maintaining quality and accuracy.

“Educational institutions now have the ability to develop audio content for varied users in their target languages, enhancing language comprehension and even pronunciation abilities, as well as responding to different teaching methods and learning demands,” says the report.

Because of the model’s capacity to produce unique character-like voices, audiobook and content developers may also find it beneficial.

The conundrum of AI voice genertors
Despite its benefits, ElevenLabs’ launch comes amid widespread concern about the wave of new voice cloning technology. An unidentified TikTok user went popular last month after sharing an AI-generated Drake song starring The Weeknd.

It sparked concerns about the grey area of AI-created music and whether it constitutes a copyright violation. Nonetheless, ElevenLabs claims to be ‘fully committed’ to respecting creators’ rights in the midst of technological advancements.

“At Eleven, we think that we should seek to make the best use of emerging technology, but not at any expense,” it stated.

“As we create them, we make every effort to put suitable controls in place that reduce the possibility of detrimental abuse. With this in mind, we are entirely committed to both protecting intellectual property rights and taking action against infringement.”

Read all the Latest NewsTrending NewsCricket NewsBollywood News,
India News and Entertainment News here. Follow us on FacebookTwitter and Instagram.

Updated Date:

also read

World

Music labels are worried because of AI, thanks to a surprising new song ft. Drake X The Weeknd

Someone used AI to create a whole new song featuring Drake and The Weeknd. But because the singers never sang the song, artists and music labels are worried, how AI voice modulation and AI-generated songs can disrupt the industry.

World

Artificial Imposter: 47% of Indian phone users have experienced AI voice scams, highest in the world

About half of Indian adults, or 47%, have experienced AI voice scams, nearly double the global average of 25%. Furthermore, nearly 69% of adults say they can't differentiate between a real and an AI-generated voice.

These advances have made voice cloning increasingly accessible, with some platforms offering multilingual capabilities and the ability to generate speech in multiple languages from a single voice sample .

Title:

Content: Moving at rapid speed, the Federal Communications Commission (FCC) has just announced its unanimous adoption of a new Declaratory Ruling finding that voice calls using artificial intelligence (AI)-generated voices fall under the Telephone Consumer Protection Act (TCPA).

The ruling takes effect immediately and gives state attorneys general powerful new tools to go after voice cloning scams. Under FCC rules, telemarketers that use robocalls subject to the TCPA are required to obtain prior express written consent from the consumer unless an exemption applies. The TCPA has always prohibited the use of both prerecorded and artificial voices but advances in AI-generated voices have prompted the FCC to specifically address their use.

In recent years, scammers and other parties have begun using AI to create fake and even "cloned" artificial voices, including those of celebrities, politicians, and even a call recipient's family member. In this election season, there has been increasing concern about the use of voice clones to engage in voter suppression schemes.

Concerned about the potential malevolent uses of these AI-generated voice calls, the FCC issued a Notice of Inquiry (NOI) in November on the topic of "Implications of Artificial Intelligence Technologies on Protecting Consumers from Unwanted Robocalls and Robotexts." In the NOI, the FCC asked questions regarding the use of "AI-influenced" technologies in robocalling. A coalition of 26 state attorneys general, as well as a telecommunication carrier trade group, strongly urged the FCC to take action to give the attorneys general clear authority to act against AI-generated robocall violators.

The FCC now has made clear that the use of voice cloning in telephone calls and texts falls within the FCC's statutory authority under the TCPA. A major intent of the ruling is to communicate that the TCPA "does not allow for any carve-out of technologies that purport to provide the equivalent of a live agent, thus preventing unscrupulous businesses from attempting to exploit any perceived ambiguity in our TCPA rules."

As FCC Chairwoman Jessica Rosenworcel explained, "with this Declaratory Ruling, we will have another tool to go after voice cloning scams and get this junk off the line."

The content of this article is intended to provide a general guide to the subject matter. Specialist advice should be sought about your specific circumstances.

Title:

Content: Voiceitt Announces CEO Transition

Published: Sep. 14, 2023 at 9:30 AM CDT|Updated: 45 minutes ago

Alyson Pace Appointed Chief Executive Officer, Effective Immediately

Focus on Sales, Market Expansion and Next Generation Technology to Unlock Voiceitt's Commercial Growth

TEL AVIV, Israel and STAMFORD, Conn., Sept. 14, 2023 /PRNewswire/ -- Voiceitt, a leading provider of speech recognition for non-standard speech, announced that its Board of Directors has appointed Alyson Pace, formerly Director at Cisco, as Chief Executive Officer, effective immediately. Alyson Pace succeeds Danny Weissberg, Co-Founder, who has stepped down as CEO. Mr. Weissberg will remain involved to ensure a smooth transition, and serve as a strategic advisor and Director of the company.

Alyson joins Voiceitt from Cisco, where she served as Director of Strategy, Business Development and Partnerships in the Collaboration business.

"Co-Founder and CEO Danny Weissberg has done a remarkable job building the technological foundation of Voiceitt. In Alyson Pace, Danny has found a partner who can take the business to the next stage, bringing this incredible productivity tool to populations that have historically been left behind. On behalf of the Investors and the Board of Directors of Voiceitt, we are thrilled that Alyson will bring her leadership skills, business acumen and industry relationships to bear as our new CEO. Her addition is a grand slam for the Company," said Karl Anderson, Chairman of the Board and CEO of Viking Maccabee Ventures. "We are equally excited to welcome Danny to the Board as a Director where he will continue to provide important strategic guidance to the company."

The announcement follows the launch of Voiceitt's next-generation technology, which supports spontaneous speech recognition for people with speech disabilities. In addition to a browser-based application employing the next-generation technology, which is available to end users via bulk license sales, Voiceitt also offers an API that enables seamless integration of its tech with any voice interface, making these products accessible to users with disabilities, degenerative disease or brain injuries, developmental disorders, aging-related speech changes, and even challenging dialects. Early integrations of the next-generation technology include Webex, announced with Cisco in May 2023, a unique partnership enabling people with speech impairments to speak and be understood during virtual meetings through innovative captioning and transcription leveraging Voiceitt's AI on the leading collaboration platform.

"I am deeply inspired by the vision, dedication, and tireless work that has brought the company to this turning point," says Ms. Pace. "It is among the greatest honors of my professional life to join Danny on this journey, and to pick up the reins as CEO, joining co-founder, Sara Smolley, and the team as we bring Voiceitt into its next stage of impact, commercialization, and growth."

Ms. Pace added, "Voiceitt, which was founded with the mission to help people with speech disabilities live more connected lives, is emerging as a leading provider of voice AI for non-standard speech.  The underlying technology, speech recognition based on cutting edge proprietary automatic speech recognition algorithms, has moved from science fiction to a real, working product. The business opportunities sit at the heart of a revolution in conversational AI, as well as a paradigm shift in inclusion and accessibility. There is no better timing."

"As Voiceitt enters a new phase, Alyson's exceptional track record, encompassing her time at Cisco and her experience developing and commercializing impactful voice AI, positions her well to bring Voiceitt successfully into its next stage of growth," said Mr. Weissberg. "With Alyson's leadership, Voiceitt is set to thrive. Thanks to my co-founders Stas Tiomkin and Sara Smolley, our amazing team, and our strategic partners and investors, we've developed continuous speech recognition for non-standard speakers, positioned uniquely in one of the most dynamic areas of AI, and poised to help our partners provide inclusive voice experiences and products that meet the needs of all customers. As ever, I remain dedicated to Voiceitt's mission and to making a difference in the world while achieving remarkable success."

About Alyson Pace
Alyson Pace is a dedicated entrepreneur turned corporate executive leader. Before her second tour at Cisco in 2018, Alyson was an early executive at Voicea, a voice AI tech startup, and a leader at Webex, both with successful acquisitions. Her leadership has emphasized exceptional user experience and technical and GTM partnerships, including sales or channel enablement and OEM commercial deals, which led to the company's acquisition by Cisco.

At Cisco, Ms. Pace led the M&A and integration practice for the company's Collaboration business unit to accelerate time to value and provide world-class employee experience. As part of Corporate Development at Cisco Investments, she managed multiple practices for the acceleration and scaling of Cisco portfolio startups' businesses, accelerating time-to-market and revenue. Ms. Pace's career is marked by her passion for disruptive technologies, and her capabilities to bring complex technological products to market, from ideation to scale, and to build early-stage companies from startups to successful enterprises.

About Voiceitt
Voiceitt was founded with the mission to apply its machine learning and speech recognition technologies to help people with speech disabilities resulting from stroke, degenerative disease, or developmental disorders live more connected, independent lives. Its proprietary automatic speech recognition (ASR) makes voice AI accessible — enabling people with speech impairments to interact with mainstream voice technologies, communicate by voice, and be understood.

Voiceitt has been highlighted in international media, including Forbes, The New York Times, and the BBC. Investors include Cisco Investments, the Amazon Alexa Fund, AARP, XTX Markets, and Microsoft's M12. Voiceitt was founded in 2012 and is headquartered in Israel with a subsidiary in Stamford, CT.

Media Contact:
Sara A Smolley
Co-Founder & Vice President, Partnerships
sara@voiceitt.com

View original content to download multimedia:

SOURCE Voiceitt, Inc.

The above press release was provided courtesy of PRNewswire. The views, opinions and statements in the press release are not endorsed by Gray Media Group nor do they necessarily state or reflect those of Gray Media Group, Inc.

How will AI Voice help educators with building courses?

How will AI Voice help educators with building courses?

In **entertainment and media**, AI voice cloning is used to create realistic voiceovers for films, video games, and documentaries, and to localize content for global audiences.

ElevenLabs, for instance, enables voice cloning in multiple languages, enhancing accessibility and emotional authenticity in media productions.

The China Media Group's AI-dubbed English documentary exemplifies how this technology can maintain the original narration's emotional depth while reaching new audiences .

Deepdub, a film dubbing company, uses an AI to process voice and translate into a different language and promises to preserve what?

Deepdub, a film dubbing company, uses an AI to process voice and translate into a different language and promises to preserve what?

In **education and accessibility**, AI voice cloning generates personalized listening comprehension materials, supports language learning, and provides a voice for individuals with speech disabilities.

Tools like Loora offer conversational English practice with AI tutors, while Voiceitt enables spontaneous speech recognition for users with non-standard speech, improving communication in virtual settings .

Title:

Content: Aug 31, 2022

Now, software can replicate your boss’s voice and tell you what to do

HTML EMBED:
COPY
"Deepfake" audio technology is here, and scammers are taking advantage.

If you’re listening to or have already listened to the beginning of this episode, you probably noticed that the voice introducing Kimberly Adams sounded a bit off, right?

That’s because it’s an audio “deepfake,” and it was created by Yisroel Mirsky at the Offensive AI Research Lab through a process called voice cloning.

It uses software to study a short sample of someone’s voice and create a deepfake, which in this case took only 15 seconds to generate, according to Mirsky.

It’s far from a perfect replica, but it turns out that scammers recently started to use deepfake audio for telephone scams and in some cases have succeeded.

Marketplace’s Kimberly Adams recently spoke with Kyle Alspach, a cybersecurity reporter with Protocol, about how the tech behind audio deepfakes works and how they’re being used in phone scams. The following is an edited transcript of their conversation.

Kyle Alspach: The technology involves having [artificial intelligence], deep learning, and it takes an audio sample of someone’s voice. It can be as little as three seconds, and it trains itself on the way that this person sounds. And it creates a model that can then be used to replicate that person’s voice. The current way that it works is you have to use text to speech, which is just you type in a phrase, and then it speaks using the cloned voice.

Kimberly Adams: How are these audio deepfakes being used in scams?

Alspach: So they’re, at least we know, being used to target businesses at this point, especially larger businesses. Someone will call up pretending to be someone else with someone else’s voice, typically some kind of executive or someone’s boss, and ask them to transfer funds or ask them for password credentials, that kind of thing. And in some cases, they have been successful.

Adams: Do you have a sense of how common audio deepfakes are now? And where do experts in the industry see it going?

Alspach: You know, among the larger businesses, I think more and more of them are starting to see these because they’re really ripe targets for this kind of thing. But right now, I don’t think that it’s something that a lot of people are seeing, but it is the beginning of this kind of technology being used in this way.

Adams: What do cybersecurity experts suggest that regular people or businesses do to avoid falling for these deepfake audio scams?

Alspach: For business purposes, for instance, if you’re going to transfer money, you might want to add some additional steps to that process and involve someone saying some kind of challenge phrase or something like that, that everyone’s agreed on beforehand, [to] prevent that from happening. But the biggest thing is just to be aware that it might happen to you and to pay attention when someone calls you up and make sure that it actually sounds the way you would expect, and they are asking you for things that they normally would be asking you for. It’s really at this point kind of a low-tech approach to defending against this kind of thing. But really, it’s just creating the possibility in your mind of this happening. And I guess, unfortunately, you kind of have to become more skeptical now when people call you up.

You can read more of Alspach’s reporting on audio deepfakes here.

Yisroel Mirsky told us that the tech he used to generate the deepfake audio for Alspach’s article, and for our show, is “relatively old.”

Alspach also mentioned in his piece that there is an open-source voice cloning tool online that anyone — even scammers can download and potentially use.

But as we found out, getting that software to work isn’t a simple process of downloading and hitting the Install button.

Tech barriers can stop you at a number of steps in the process. Like, if you don’t know the coding language Python or if your computer isn’t powerful enough, you’ll likely be unable to use it, as our producer Daniel Shin discovered.

The future of this podcast starts with you.

Every day, the “Marketplace Tech” team demystifies the digital economy with stories that explore more than just Big Tech. We’re committed to covering topics that matter to you and the world around us, diving deep into how technology intersects with climate change, inequity, and disinformation.

As part of a nonprofit newsroom, we’re counting on listeners like you to keep this public service paywall-free and available to all.

Support “Marketplace Tech” in any amount today and become a partner in our mission.

The team

Michael Lipkin Senior Producer
Stephanie Hughes Producer
Jesus Alvarado Assistant Producer

Title:

Content: AI-generated voices will be restricted by the FCC for robocalls

|
,

Robocalls are some of the worst things you can see come up on your mobile phone. Most of them are annoying sales pitches, or outright scams. But these days, with AI-generated everything, robocalls have the potential to become more of a problem than they already are.

Estimated reading time: 2 minutes

AI-generated voices are a real thing, and AI-generated voices can be made effortlessly. Spend any time on YouTube Shorts and you can find ads showing celebrities like Dwayne Johnson and Oprah, hocking federal tax relief and other scams. These YouTube Shorts use AI-generated voices to try to convince you that these celebrities actually endorse the product shown.

Using this method over the phone is far more effective because you don’t have the visual to help your brain discern that it is fake. According to PC Mag, the FCC has confirmed that AI-generated voice calls can “break an existing US law from 1991 that was designed to protect consumers from pre-recorded automated calls.”

FCC Chair Jessica Rosenworcel said, “The Telephone Consumer Protection Act (TCPA) is the primary law we have to help limit unwanted robocalls. It means that AI tech like voice cloning falls within this law’s existing prohibitions and that calls that use this technology to simulate a human voice are illegal, unless callers have obtained prior express consent.”

According to PC Mag, the FCC’s rule may stop unwanted and spammy robocalls, but it will also affect legit companies that use “AI agents” for certain phone calls. The companies using this technology will then need to receive permission from users before using the technology for their phone calls.

Our AI world is getting wild and soon we may not know what is real and what is not real.

What do you think of AI? The use of AI in phone calls? AI in general? You may comment by using the social media buttons below. Please share on your favorite social media site and tag us on Facebook, X, MeWe, and LinkedIn. Or join our Telegram channel here.

Image Credit: dm.derk from Midjourney
Previous

Ring security basic plan will see a price hike next month

Latest Articles

Share via
Copy link
Powered by Social Snap

How will educational institutions benefit from developing AI voice audio content for languages learners?

How will educational institutions benefit from developing AI voice audio content for languages learners?

How will educational institutions benefit from developing AI voice audio content for languages learners?

However, the technology is also exploited in **scams and fraud**.

Scammers have used AI-generated voices to impersonate family members in fake kidnapping scenarios or executives in fraudulent calls, making these schemes more convincing and emotionally manipulative.

**Legal implications** are evolving rapidly.

Copyright and right of publicity concerns are prominent, with lawsuits