Voice cloning technology can replicate a person's voice using a short sample, as little as 3-15 seconds, to create a deepfake audio clip.

This technology uses AI and deep learning to replicate a person's voice.

AI systems analyze data to make predictions, and voice cloning uses machine learning to simulate anyone's voice.

OpenAI's text-to-speech tool can generate natural-sounding human voices with just 15 seconds of audio input.

ElevenLabs' AI voice cloning tool can create realistic, multi-language voice personas almost indistinguishable from the original speaker.

The tool requires a three-second sample clip and some text, with longer clips yielding better results.

AI dubbing improves content accessibility, preserves emotional depth and cultural nuances, and has advanced with voice cloning technology to create realistic digital voice replicas.

AI voice clones have been used for scams and a new bill aims to protect musical artists from the technology.

The NO FAKES Act would require artists to authorize AI use of their voice or image, establishing a federal framework to protect their rights amidst the ethical and legal challenges of voice cloning technology.

Voice cloning technology raises ethical concerns and falls under the Telephone Consumer Protection Act (TCPA), according to the Federal Communications Commission (FCC).

The creation of virtual singers using voice cloning technology raises copyright issues and disrupts the voice acting industry.

AI voice over generators and voice cloning technology can support foreign language instruction and bridge language gaps.

Integrating voice cloning technology into foreign language instruction can support listening skills at low proficiency levels.

To protect oneself from voice cloning scams, experts recommend verifying caller identity through alternative means, not sharing personal or financial information in unsolicited calls, and being cautious with links and downloads that can hack into one's phone.

Voice cloning technology can replicate a person's voice using a short sample, as little as 3-15 seconds, to create a deepfake audio clip.

Title:

Content: Aug 31, 2022

Now, software can replicate your boss’s voice and tell you what to do

HTML EMBED:
COPY
"Deepfake" audio technology is here, and scammers are taking advantage.

If you’re listening to or have already listened to the beginning of this episode, you probably noticed that the voice introducing Kimberly Adams sounded a bit off, right?

That’s because it’s an audio “deepfake,” and it was created by Yisroel Mirsky at the Offensive AI Research Lab through a process called voice cloning.

It uses software to study a short sample of someone’s voice and create a deepfake, which in this case took only 15 seconds to generate, according to Mirsky.

It’s far from a perfect replica, but it turns out that scammers recently started to use deepfake audio for telephone scams and in some cases have succeeded.

Marketplace’s Kimberly Adams recently spoke with Kyle Alspach, a cybersecurity reporter with Protocol, about how the tech behind audio deepfakes works and how they’re being used in phone scams. The following is an edited transcript of their conversation.

Kyle Alspach: The technology involves having [artificial intelligence], deep learning, and it takes an audio sample of someone’s voice. It can be as little as three seconds, and it trains itself on the way that this person sounds. And it creates a model that can then be used to replicate that person’s voice. The current way that it works is you have to use text to speech, which is just you type in a phrase, and then it speaks using the cloned voice.

Kimberly Adams: How are these audio deepfakes being used in scams?

Alspach: So they’re, at least we know, being used to target businesses at this point, especially larger businesses. Someone will call up pretending to be someone else with someone else’s voice, typically some kind of executive or someone’s boss, and ask them to transfer funds or ask them for password credentials, that kind of thing. And in some cases, they have been successful.

Adams: Do you have a sense of how common audio deepfakes are now? And where do experts in the industry see it going?

Alspach: You know, among the larger businesses, I think more and more of them are starting to see these because they’re really ripe targets for this kind of thing. But right now, I don’t think that it’s something that a lot of people are seeing, but it is the beginning of this kind of technology being used in this way.

Adams: What do cybersecurity experts suggest that regular people or businesses do to avoid falling for these deepfake audio scams?

Alspach: For business purposes, for instance, if you’re going to transfer money, you might want to add some additional steps to that process and involve someone saying some kind of challenge phrase or something like that, that everyone’s agreed on beforehand, [to] prevent that from happening. But the biggest thing is just to be aware that it might happen to you and to pay attention when someone calls you up and make sure that it actually sounds the way you would expect, and they are asking you for things that they normally would be asking you for. It’s really at this point kind of a low-tech approach to defending against this kind of thing. But really, it’s just creating the possibility in your mind of this happening. And I guess, unfortunately, you kind of have to become more skeptical now when people call you up.

You can read more of Alspach’s reporting on audio deepfakes here.

Yisroel Mirsky told us that the tech he used to generate the deepfake audio for Alspach’s article, and for our show, is “relatively old.”

Alspach also mentioned in his piece that there is an open-source voice cloning tool online that anyone — even scammers can download and potentially use.

But as we found out, getting that software to work isn’t a simple process of downloading and hitting the Install button.

Tech barriers can stop you at a number of steps in the process. Like, if you don’t know the coding language Python or if your computer isn’t powerful enough, you’ll likely be unable to use it, as our producer Daniel Shin discovered.

The future of this podcast starts with you.

Every day, the “Marketplace Tech” team demystifies the digital economy with stories that explore more than just Big Tech. We’re committed to covering topics that matter to you and the world around us, diving deep into how technology intersects with climate change, inequity, and disinformation.

As part of a nonprofit newsroom, we’re counting on listeners like you to keep this public service paywall-free and available to all.

Support “Marketplace Tech” in any amount today and become a partner in our mission.

The team

Michael Lipkin Senior Producer
Stephanie Hughes Producer
Jesus Alvarado Assistant Producer

What is necessary for voice cloning to work?

This technology uses AI and deep learning to replicate a person's voice.

AI systems analyze data to make predictions, and voice cloning uses machine learning to simulate anyone's voice.

Title:

Content: The scary side of artificial intelligence

The pros of AI outweigh the Cons or threats in our day-to-day lives, and there’s no magic pill to protect us from the scary threats of AI.

  • Exclusive

It's a free Content, simply login/signup to unlock

Get in-depth Industry Insights and Analysis through our “Exclusive” content, presented to you by our esteemed panel of writers, for free

By continuing, you agree to the Terms & Conditions and acknowledge our Privacy Policy. This same account can be used across all Economic Times B2B portals.

  • Updated On Oct 3, 2023 at 03:02 PM IST

Artificial intelligence (AI), as we all know, is the simulation of human intelligence leveraging computer systems and machines. AI programs can continuously learn and evolve with experience. In technical terms, AI systems render the output by churning and analyzing the data for correlations and patterns and help make future predictions using these patterns.

Advt
Today AI is being used extensively in all facets of our lives starting from lifestyle, e-commerce, home appliances, automobiles, navigation, transport, healthcare, agriculture, education, financial planning, chatbots, marketing, cyber security, virtual assistant, industrial automation and many more.

Clearly, we have and are leveraging the strengths of AI to the fullest to automate the routine tasks and make it auto-learn over a period. There’s no doubt that AI has revolutionized the lives of all – organizations, consumers etc. But as they say, “Everything comes at a price”. This analogy is quite true for AI as well, there have been a lot of threats that have emerged using AI and are being utilized by the Cyber criminals to dupe the ignorant users, cause mental stress and extort money.

continued below

Executive Workshop

I’m not going to delve into all of threats but would like to elucidate some of the real ones that have come to the surface recently:

Voice cloning or mimicry

As the name suggests, it uses machine learning algorithms to simulate anyone’s voice. It requires certain voice data to analyze and learn the specific patterns of any individual. There are certain advantages of cloning a voice that can be used in voice assistants, chatbots, navigation systems and other areas. Voice cloning has existed for a while but was restricted to experts who possess the technical knowledge to be able to use the same. But now AI Voice cloning tools are available on the open Internet that anyone can leverage with literally no technical knowledge or cost to clone anyone’s voice. All you need to do is just Google and it will pop up and get a bunch of both free and paid AI Voice cloning tools.

Advt
In fact, recently one of the global leaders in online protection published a report stating how AI is fueling a rise in online voice scams, with just three seconds of audio required to clone a person’s voice. This is extremely creepy. Just imagine, if a Cyber-criminal clones your voice and tricks your near ones by making them believe that they are talking to you, and request for money due to any distress reasons. In fact, these are not assumptions but real-life incidents that are happening across the world every minute.

Deepfakes AI

Deepfakes AI are being used to impersonate an individual by manipulating videos, images, audios, and other content available on the social media platforms using deep learning techniques. It mainly transforms existing content from one person to another. This is another area that has been exploited by the Cyber criminals in the recent past, and there are a few deepfake cases that have made waves on the Internet. One of the most famous ones being Deepfake created by a VFX artist of one of Hollywood’s most famous male actors. This piece was so well made by rendering thousands of pictures using artificial versions of the actor. There are similar Deepfakes incidents involving other global celebrities and leaders. The damage and misuse of the deepfakes videos could be extremely dangerous for the human society and can be used by terrorists to incite riots and create nuisance.

Creating virtual people

This is another area where AI is being used to create people that do not exist. There are a lot of websites that allow you to generate a random image by just specifying the age group, gender & ethnicity, and you can continue to refresh these images at the click of a button. Be mindful of the fact that these images pertain to people that do not exist in this world. On the similar lines, there’s an emerging trend of AI news anchors that possess a human-like appearance and are fed data that they can read using text-to-speech technology. Recently, there's been a surge of AI-Driven robotic new anchors in multiple language channels. While the main objective of this initiative is to provide royalty free or cost-effective human images for branding and other purposes. However, the overuse of these technologies causes Fear of missing out (FOMO), Feeling of inadequacy, dissatisfaction, and isolation may potentially lead to psychological and emotional vulnerabilities.

One of the Hollywood movies, ‘HER’ portrayed an introverted and lonely writer (Joaquin Phoenix) who purchases an AI virtual assistant personified through a female voice to assist him in his writing job. However, when he finds out about its ability to learn and adapt, he falls in love with it. The film delves into emotional vulnerability and the impact of AI on human relationships.

Needless to say, that the pros of AI outweigh the Cons or threats in our day-to-day lives, and there’s no magic pill to protect us from the scary threats of AI. However, there are certain preventive tips that one can follow to mitigate any such risks. Do spread awareness with your family and friends:

  • Set some code words with family, and friends to verify the identity during emergency circumstances
  • Optimize social media presence by limiting your connections with only known contacts and avoid connecting with any unknown ones
  • Avoid saying ‘Yes’ as a greeting while receiving unknown calls as it can be used to authorize credit card charges or other purposes
  • Continuously update privacy settings on social media to allow viewing by friends and family only
  • Avoid clicking on any suspicious links or calls received without proper due diligence
  • Do not share your passwords and other sensitive information with anyone
  • Verify the credentials of any online information before circulating it through various mediums
  • Avoid public Wi-Fi connections offered at coffee shops or airports, which requires to enter password
  • Closely monitor the time spent by younger generation on social media and online gaming
  • Finally, in case of any suspicion, double check and report it to the host site or concerned authorities
The author is the CIO of MOVIN

Disclaimer: The views expressed are solely of the author and ETCIO does not necessarily subscribe to it. ETCIO shall not be responsible for any damage caused to any person/organization directly or indirectly.

  • Published On Oct 3, 2023 at 03:02 PM IST

Most Read in Artificial Intelligence

Join the community of 2M+ industry professionals

Subscribe to our newsletter to get latest insights & analysis.

Download ETCIO App

  • Get Realtime updates
  • Save your favourite articles

OpenAI's text-to-speech tool can generate natural-sounding human voices with just 15 seconds of audio input.

Title:

Content: Setup
• Day and night
with the system.
Light color
Dark color
• Theme Colors
Speech cloning raises concerns, OpenAI again explains its text-to-speech tool
2024 / 6 / 10 9: 57: 21 Source: IT House Author: Yuanyang Editor: Yuanyang
OpenAI explained its text-to-speech tool for the second time in a few months, and again stressed that the tool is not currently widely available and may not be available in the future.
“Whether or not we end up deploying this technology at scale, it ’ s important for people around the world to understand where it ’ s going, ” OpenAI said in a statement on its website Friday.“ That ’ s why we want to explain how the model works, how we use it for research and education, and how we implement security measures around the technology. ”
At the end of last year, OpenAI shared its “voice engine ” with a small number of external users.
The engine uses text input and a 15-second clip of human voices to “generate a natural sounding human voice that is very similar to the original speaker. ”
The tool could create fake, multilingual human voices, and the company said at the time that it had chosen to preview the technology rather than launch it at scale to “enhance social resilience ” to the threat posed by“ increasingly realistic artificial intelligence-generated models. ”
As part of these efforts, OpenAI says it is actively phasing out ways to use voice recognition for bank account verification, exploring policies to protect individual voices for use in AI, educating the public about the risks of AI, and accelerating the development of technologies to track audiovisual content so users can identify whether they are interacting with real people or synthetic content.
However, despite these efforts, concerns about the technology remain.
Bruce Reed, the head of artificial intelligence for US President Joe Biden, has said that voice cloning is one of the reasons he can't sleep at night.
The Federal Trade Commission said in March that scammers were using AI technology to increase the credibility of their fraud, using voice cloning tools that make it harder for people to distinguish between AI-generated voices and human voices.
“We continue to engage with U.S. and international partners from government, media, entertainment, education, civil society, and more to ensure we incorporate their feedback in the build process, ” the company also noted, once the“ Voice Engine ” is equipped with its latest model, GPT-4o, it will also bring new threats.
The company says it is actively “conducting ‘ red team testing ’ on GPT-4o to identify and address known and unknown risks from areas such as social psychology, bias and fairness, and misinformation. ”
Advertisement Statement: The external redirect links contained in the text (including not limited to hyperlinks, QR codes, passwords, etc.) are used to convey more information and save selection time. The results are for reference only. All articles of IT House contain this statement.
Related articles
Soft media 's website: IT home hot products - Value shopping guide, coupons most buy - rebate coupons iPhone home Win7 home Win10 home Win11 home
Soft media software: Cube cool point desktop Win7 optimization master Win10 optimization master soft media mobile APP application

What is necessary for voice cloning to work?

ElevenLabs' AI voice cloning tool can create realistic, multi-language voice personas almost indistinguishable from the original speaker.

Title:

Content: Language No Barrier: New AI tool can clone voice and make it say anything in multiple languages

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

Mehul Reuben Das May 03, 2023 13:42:20 IST

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

As advanced as AI-based voice cloning has been, there were a few limitations to it. For example, voice generators were mainly bound by the language of the source they were trained in or rather the language of the prompt that was given to them. Now, ElevenLabs, an American AI software developing company has come up with a tool that does away with that limitation.

ElevenLabs’ new AI tool can clone the voice of a person and make it say anything in a bunch of different languages. All it needs is a clear voice sample of about 3 seconds, although it also suggests that the longer the sample, the better will be the results. The new tool even manages to maintain the speaker’s original tone of voice.

Limitless possibilities
The creators expect that this would ‘extend the possibilities’ in a variety of industries such as publishing, gaming creation, and media. “Introducing Eleven Multilingual v1: Our New Speech Synthesis Model! We’re thrilled to launch our new model supporting seven new languages: French, German, Hindi, Italian, Polish, Portuguese, and Spanish.”

“This advancement expands the horizons for creators, game developers, and publishers, and it paves the way for using generative media to create more localized, accessible, and imaginative content,” the company said.

Following the announcement, Twitter was flooded with comments, with users testing the software on various famous faces.

To demonstrate just how capable the new voice cloning AI tool is, Eluna AI, a platform for AI-content creators experimented with a sample clip of former US President Donald Trump.

In their demo, Eluna AI showcased a small clip of Donald Trump, speaking in his native tongue, English, followed by French, Spanish, German, Hindi and Italian, almost perfectly. The generated samples even gets the accent right, almost if he was a native speaker of the new target language.

Another user changed David Attenborough’s voice to German while the BBC broadcaster discussed the prospects of AI. “With this tool, anyone can do it,” stated the Twitter user. “It’s also worth noting that fraudsters will undoubtedly exploit this one.”

ElevenLabs says that its model was designed to understand the emotion and reasoning underlying words in order to produce natural-sounding and persuasive audio. ElevenLabs has said that some numerals and symbols are currently spoken wrongly, but that it is striving to rectify this.

Who is this new tool meant to help?
The US-based company believes its technology will be valuable in a variety of areas, including education and journalism.

Game developers and publishers can build engaging, localised experiences for worldwide audiences, breaking through language barriers and connecting with players and listeners to maximise engagement and efficiency while maintaining quality and accuracy.

“Educational institutions now have the ability to develop audio content for varied users in their target languages, enhancing language comprehension and even pronunciation abilities, as well as responding to different teaching methods and learning demands,” says the report.

Because of the model’s capacity to produce unique character-like voices, audiobook and content developers may also find it beneficial.

The conundrum of AI voice genertors
Despite its benefits, ElevenLabs’ launch comes amid widespread concern about the wave of new voice cloning technology. An unidentified TikTok user went popular last month after sharing an AI-generated Drake song starring The Weeknd.

It sparked concerns about the grey area of AI-created music and whether it constitutes a copyright violation. Nonetheless, ElevenLabs claims to be ‘fully committed’ to respecting creators’ rights in the midst of technological advancements.

“At Eleven, we think that we should seek to make the best use of emerging technology, but not at any expense,” it stated.

“As we create them, we make every effort to put suitable controls in place that reduce the possibility of detrimental abuse. With this in mind, we are entirely committed to both protecting intellectual property rights and taking action against infringement.”

Read all the Latest NewsTrending NewsCricket NewsBollywood News,
India News and Entertainment News here. Follow us on FacebookTwitter and Instagram.

Updated Date:

also read

World

Music labels are worried because of AI, thanks to a surprising new song ft. Drake X The Weeknd

Someone used AI to create a whole new song featuring Drake and The Weeknd. But because the singers never sang the song, artists and music labels are worried, how AI voice modulation and AI-generated songs can disrupt the industry.

World

Artificial Imposter: 47% of Indian phone users have experienced AI voice scams, highest in the world

About half of Indian adults, or 47%, have experienced AI voice scams, nearly double the global average of 25%. Furthermore, nearly 69% of adults say they can't differentiate between a real and an AI-generated voice.

What company created an AI tool that could mimic the voices of deceased movie stars?

What has the US Federal Trade Commission warned about the use of voice cloning tools?

Difficult to distinguish from human voice

The tool requires a three-second sample clip and some text, with longer clips yielding better results.

AI dubbing improves content accessibility, preserves emotional depth and cultural nuances, and has advanced with voice cloning technology to create realistic digital voice replicas.

Title:

Content: Advertisment

China Media Group Debuts AI-dubbed English Documentary, Pioneering Global Communication

China Media Group launches its first AI-dubbed English documentary, enhancing global reach and fostering international understanding through advanced AI technology.

Aqsa Younas Rana
Updated On
New Update

In a groundbreaking move, China Media Group has launched its first AI-dubbed English documentary, marking a significant milestone in the use of artificial intelligence for global media outreach. This innovative approach to dubbing not only showcases the advancements in AI technology but also underscores China's ambitions to foster better international communication and understanding. Through this initiative, the documentary, originally produced in Mandarin, has been made accessible to a broader English-speaking audience, enhancing its global reach and impact.

Advertisment

Revolutionizing Content Accessibility

The application of AI in dubbing the documentary into English reflects a growing trend in leveraging technology to bridge language barriers. Similar to the educational advancements discussed in 'Voice Cloning in Education: Bridging Language Gaps in Learning Environments,' this initiative by China Media Group capitalizes on the potential of AI voice cloning technology. By generating lifelike digital replicas of human voices, the documentary's AI-dubbed version maintains the authenticity of the original narration while making it understandable for English-speaking viewers. This technological leap not only improves accessibility but also ensures the delivery of content with emotional depth and cultural nuances intact.

The launch of this AI-dubbed documentary serves as a testament to China's commitment to enhancing global dialogue and cultural exchange. By removing language barriers, China Media Group is effectively broadening the documentary's audience, enabling people from different parts of the world to gain insights into Chinese culture, history, and perspectives. This initiative aligns with the broader objective of promoting mutual understanding and respect among diverse global communities, paving the way for more inclusive and informed international discourse.

Advertisment

Setting New Standards in Media Production

China Media Group's pioneering use of AI technology in documentary dubbing sets new standards for media production and distribution. It illustrates the potential of AI to transform traditional media practices, making content more accessible and engaging for global audiences. As AI technology continues to evolve, it is likely to open up further possibilities for creating multilingual content, thereby enhancing the reach and impact of media across borders. This development also raises important considerations regarding the ethical use of voice cloning technology, underscoring the need for guidelines that ensure its responsible application in media and beyond.

As we reflect on the implications of this technological advancement, it becomes clear that AI-dubbed media content holds significant promise for fostering international understanding and cooperation. By making diverse cultural and educational materials available in multiple languages, we can build a more connected and informed world. The initiative by China Media Group not only highlights the practical applications of AI in media but also invites us to contemplate the future of global communication in an increasingly digital age.

Advertisment
Advertisment

Deepdub, a film dubbing company, uses an AI to process voice and translate into a different language and promises to preserve what?

AI voice clones have been used for scams and a new bill aims to protect musical artists from the technology.

Title:

Content: Moving at rapid speed, the Federal Communications Commission (FCC) has just announced its unanimous adoption of a new Declaratory Ruling finding that voice calls using artificial intelligence (AI)-generated voices fall under the Telephone Consumer Protection Act (TCPA).

The ruling takes effect immediately and gives state attorneys general powerful new tools to go after voice cloning scams. Under FCC rules, telemarketers that use robocalls subject to the TCPA are required to obtain prior express written consent from the consumer unless an exemption applies. The TCPA has always prohibited the use of both prerecorded and artificial voices but advances in AI-generated voices have prompted the FCC to specifically address their use.

In recent years, scammers and other parties have begun using AI to create fake and even "cloned" artificial voices, including those of celebrities, politicians, and even a call recipient's family member. In this election season, there has been increasing concern about the use of voice clones to engage in voter suppression schemes.

Concerned about the potential malevolent uses of these AI-generated voice calls, the FCC issued a Notice of Inquiry (NOI) in November on the topic of "Implications of Artificial Intelligence Technologies on Protecting Consumers from Unwanted Robocalls and Robotexts." In the NOI, the FCC asked questions regarding the use of "AI-influenced" technologies in robocalling. A coalition of 26 state attorneys general, as well as a telecommunication carrier trade group, strongly urged the FCC to take action to give the attorneys general clear authority to act against AI-generated robocall violators.

The FCC now has made clear that the use of voice cloning in telephone calls and texts falls within the FCC's statutory authority under the TCPA. A major intent of the ruling is to communicate that the TCPA "does not allow for any carve-out of technologies that purport to provide the equivalent of a live agent, thus preventing unscrupulous businesses from attempting to exploit any perceived ambiguity in our TCPA rules."

As FCC Chairwoman Jessica Rosenworcel explained, "with this Declaratory Ruling, we will have another tool to go after voice cloning scams and get this junk off the line."

The content of this article is intended to provide a general guide to the subject matter. Specialist advice should be sought about your specific circumstances.

The NO FAKES Act would require artists to authorize AI use of their voice or image, establishing a federal framework to protect their rights amidst the ethical and legal challenges of voice cloning technology.

Title:

Content: The Future Is Here
We may earn a commission from links on this page

AI This Week: Can AI's Environmental Impact Be Justified?

A new report shows the massive energy needs of AI systems. Plus: a look at how the music industry is fighting AI voice clones.

We may earn a commission from links on this page.

Headlines This Week

  • A new report from Politico suggests a “billionaire-backed network” of Silicon Valley-linked AI “advisors” are working to control the regulatory agenda in Washington D.C. Boy, I sure wish stuff like that were illegal instead of just business-as-usual.
  • Despite apparently having lobbying money aplenty, it looks like the AI industry is still struggling to monetize some of its platforms. The Wall Street Journal reports that some major AI platforms, like Microsoft’s Github Copilot, have been hemorrhaging money.
  • Last but not least: A newly introduced draft bill would institute protections for musical artists against AI. We spoke with a music industry executive about what the policy could mean for his business.

The Top Story: AI’s Growing Environmental Impact

One of the ongoing problems connected to the AI industry is just how much power it takes to run its systems. The pursuit of enough juice to run the high-octane algorithms behind apps like Bard, Bing, and ChatGPT is causing concern even among AI’s biggest proponents. Now, a new study shows the electrical resources needed for the growing AI industry could make its environmental impact even worse than previously thought.

Advertisement

The study, authored by Alex de Vries, who is a PhD candidate at the VU Amsterdam School of Business and Economics, claims that the AI industry’s energy needs may soon match those of a small country. “Given the expected production in the coming few years, by 2027 newly manufactured AI devices will be responsible for as much electricity consumption as my home country, the Netherlands,” de Vries told Insider this week. “This is also in the same range as the electricity consumption of countries like Sweden or Argentina.”

Advertisement

While the rate of electricity consumption in the tech industry has remained relatively steady for years, de Vries says that the advent of the AI chatbot wars between tech giants like Microsoft, Google, and OpenAI, may have spawned a new era. De Vries’ study looks specifically at the electricity consumption of the AI sector as it applies to something called the “inference phase” of AI production. While most environmental impact studies have so far focused on the amount of energy it takes to train large language models like GPT-4, less attention has been paid to “inferencing,” which is the process by which language models produce new information as the result of prompts. This phase of energy consumption can be massive and, sometimes, accounts for a majority of energy expended during the AI life cycle, de Vries writes. Due to the potential ballooning nature of AI energy needs over the next several years, the scholar argues that developers “focus [not only] on optimizing AI, but also to critically consider the necessity of using AI in the first place.”

Advertisement

De Vries’ study, like a number of other prominent environmental impact studies that have been published recently, begs the question: in an age of climate change and accelerating environmental distress, can generative AI really be justified? I mean, do we really need ChatGPT, automated email-writing, and AI stickers? Or are we killing the environment needlessly for too little in trade off?

Advertisement

At best, these platforms offer increased convenience for consumers and some cost savings for corporations, but—for now—that’s about it. Much of the mystification around AI has helped hide the fact that generative AI technologies aren’t—in many cases—particularly revolutionary and, in some cases, aren’t even new. Sure, there are some novel scientific applications of AI that, once refined, could have a major impact. But it would be hard to argue that those applications are the ones getting the lion’s share of attention or resources. Mostly, it’s stuff like ChatGPT that hogs the spotlight (and venture capital).

When viewed through the lens of the technology’s massive environmental impact, it seems hard to justify what is little more than an over-hyped form of content automation. Better deepfakes aren’t worth killing the planet over.

Advertisement

The Interview: Mitch Glazier on the Music Industry’s Fraught Relationship to AI

Advertisement

This week we spoke with Mitch Glazier, the Chairman and CEO of the Recording Industry Association of America, which lobbies on behalf of the music industry. RIAA is supporting a newly introduced piece of legislation that seeks to institute legal protections against the use of AI to replicate the visual or audio likenesses of artists. In recent months, there’s been  an explosion of AI “deepfake” content that blatantly rips off well-known musicians and celebrities. The  Nurture Originals, Foster Art, and Keep Entertainment Safe (NO FAKES) Act, which is currently a discussion draft bill, would enshrine a number of legal protections for artists who don’t want their visual or audio likenesses used in unauthorized deepfakes. This interview has been edited for brevity and clarity.

What role did RIAA have in connection to this bill and what do you hope this bill achieves?

Advertisement

We were one of several groups that were asked to give input so that they could develop the bill. SAG-AFTRA was also heavily involved. The idea was to create federal legislation because all of the protections for name, image, likeness and voice are in the states right now—and they’re all different.

What is it about AI that makes it a threat to your industry (the music business)? What’s the problem with this technology?

Advertisement

The problem really isn’t the technology. AI can be licensed for a variety of great purposes and uses. The problem is when AI is made based on a particular artist’s voice or image without consent, credit, and compensation. Basically, what the bill says is, ‘The technology’s great and if an artist wants to license the use of their essence—their voice, their likeness—that’s they’re choice. But what you can’t do is clone their voice without their permission.’ It’s just a basic right that exists for all other types of property—and that should exist here. It should be up to the artist to decide whether or not they want to allow you to use their image or their voice.

So it seems like this legislation actually opens the door for more AI music but the idea is that, if a particular artist is involved in an AI or a deepfake production, they would have to get credit and, presumably, get paid, right?

Advertisement

Well, the bill says “authorized,” so the artist would have to authorize it. If they want to negotiate compensation they can. Some may not want to. But the key is that “authorization” part. The author has to say, “Yes, you can use my voice, my image.” If they don’t say yes, you can’t do it.

What are your hopes for the passage of the bill? It seems like there are some pretty prominent Senators supporting it.

Advertisement

We’re very optimistic. This issue goes beyond the music and entertainment industry and it goes beyond the issue of art. It relates to every individual’s right to control their own essence, for lack of a better term. We’ve been encouraged by great bipartisan support right off the bat. To get two Democrats and two Republicans—including the chairman of the Intellectual Property Subcommittee (Amy Klobuchar D-Minnesota)—to put out this discussion draft and to do it in a way in which they’re inviting people to respond and come into the conversation, is a great sign.

Catch up on all of Gizmodo’s AI news here, or see all the latest news here. For daily updates, subscribe to the free Gizmodo newsletter.

Voice cloning technology raises ethical concerns and falls under the Telephone Consumer Protection Act (TCPA), according to the Federal Communications Commission (FCC).

The creation of virtual singers using voice cloning technology raises copyright issues and disrupts the voice acting industry.

Title:

Content: People 's Daily Online > > Economy and Technology
“AI Sun Yanzi ” deceives your ears,“ AI Change Face ” wants to trick your wallet!
May 26, 2023 11: 31 | Source: People's Daily Online
Small number
Recently, there are two hot events about AI: one is the "AI Sun Yanzi" popular network; the other is the "AI Face" scam.
Two seemingly unrelated things have caused the public to think deeply about AI double-edged sword.
"AI Sun Yanzi" explodes network copyright issue caused controversy
First of all, "AI Sun Yanzi" is definitely the hottest Chinese singer in the first half of this year, followed by "AI Zhou Jielun", "AI Lin Junjie" and "AI Wang Xinling".
Before I heard that AI can arrange music and paint, now you will find that the role of big stars on the stage, AI is equally competent.
It doesn ’ t even need to be in person, the singers ’ “new album ” is already flying around.
What the hell is going on here?
It is understood that some people use the existing human voice samples of Sun Yanzi, through AI training timbre, tone quality and pronunciation characteristics, establish its sound model, and then use the generated timbre to cover other songs, there is "AI Sun Yanzi".
This uses an open source AI speech conversion software, the original author has stopped updating and maintaining this year, but there are still many netizens independently developing new features on the current version.
The enthusiasm of netizens for the creation of virtual singers implies the recognition and pursuit of emerging technologies.
As early as ten years ago, the virtual idols represented by "Hatsune Future" and "Luo Tianyi" have gradually entered the public eye, and their voices are made from real human sound source data.
With the iterative development of technology, the "real person double" virtual singer represented by "AI Sun Yan Zi" made a shining debut, "invading" is not only everyone's "childhood memories", but also some legal ambiguity.
The new songs produced by AI sound cloning technology are very similar in sound and style to the singer himself, which has led many netizens to believe that they are true.
Is this impersonation infringing?
The scope of works protected by the Copyright Law includes written works, oral works, music and fine arts, and sound is not listed.
Therefore, the mere imitation of performers' timbre, singing skills and other characteristics, does not belong to the protection of the Copyright Law.
In addition, only on a video platform, the "AI Sun Yanzi" cover works have exceeded a thousand, among which the works of the singer Zhou Jielun's "Hair as Snow" and other works have even won more than two million views.
A number of lawyers said that the works of the virtual singer's cover show the specific song name and singer's name, which is suspected of infringing on the singer's right to name, personality, and the copyright of the song.
Even if some publishers mark the disclaimer of "entertainment only and not for commercial use" in the video, the huge traffic and economic benefits behind it are difficult to be clear, and there is no way to completely discard the infringement issue.
"AI face change" fraud attack someone 10 minutes to be cheated 4.3 million
At present, Sun Yanzi himself has responded to his own "AI version" of music.
However, the concern of netizens about the application of artificial intelligence technology has not stopped.
In May, Apple announced that it plans to embed a new feature in the new version of the software: mobile phone users who have gradually lost their ability to speak for various reasons can create a unique "personal customized voice" by recording 15 minutes of audio, and can still use the phone's call and video functions normally after losing their ability to speak.
In this regard, many users expressed concern that the technology is more likely to be used by criminals, such as through the production of fake videos and audio recordings, for the implementation of telecommunications fraud.
Such fears are not unfounded.
According to the police, not long ago a Fujian boss fell into the "high-end" fraud bureau, because of the credulous use of "AI for face" fraudsters, just 10 minutes lost 4.3 million yuan.
The rapid development of AI has brought not only "unemployment anxiety", but also a new challenge to "true and false discrimination". At present.
A number of EU countries have already begun to review the issue of artificial intelligence feeding data.
In March, foreign publishers protested against the copyrighted content used by ChatGPT in data training, demanding compensation from its company OpenAI.
In China, the regulatory system of the artificial intelligence industry is also being actively improved.
At the end of last year, the State Internet Information Office issued a document requiring that when providing in-depth synthesis services such as synthetic voices, imitation voices, face substitution, and gesture manipulation, users should be prompted to inform the edited individuals according to law and obtain their individual consent; and if the synthetic content may lead to confusion or mistaken recognition, it must be marked in a reasonable position and explain the specific information of the synthetic work.
In April this year, the State Internet Information Office drafted the "Generative Artificial Intelligence Service Management Measures (Draft for Solicitation of Comments)" to clarify the data of pre-training and optimization training, and must not contain content that infringes intellectual property rights.
Producer ： Ye Zhen
General Manager: Luo Hua
Producer ： Sun Haifeng
Producer ： Zhang Feiran
Producer ： Lu Qian
Planning: Chen Jian
Copywriter: SHEN Jiaping
Photographer: Shi Xinpei
Edited by: Wang Kun
Design: Shanshan Lin
Data collation: Liu Wenjing (intern)
Title: The Salt of Money - Your Treasure
(Editor: Shen Jiaping, Lu Qian)
Public Number ： People 's Network Finance
Share it so more people can see it.
Back to top

AI voice over generators and voice cloning technology can support foreign language instruction and bridge language gaps.

Title:

Content: Home > Web3

AI Voice Over Generator: Turning Text to Speech in 24 Languages

newsonjapan.com -- Aug 15
Communication has crossed boundaries and languages in today's technology driven society.

The AI voice over generator, a sophisticated technology capable of translating written text into realistic speech in a variety of languages, is a driving force in this worldwide change. The astonishing capacity of these technologies to produce voice overs in 24 different languages, and often more, is propelling them to the forefront of digital communication. We go deep into the field of AI-driven text to voice below, giving practical tips for anybody interested in realizing its enormous potential.

Why Do Multilingual Skills Matter?

Language inclusion is critical for companies, schools, and content providers that want to reach a global audience. An AI voice over generator that handles various languages allows for a broader reach while also ensuring that no audience section feels alienated. Multilingual technologies, such as those that transform English transcripts into Mandarin audio or Spanish text into French voice, help to break down communication obstacles.

Practical User Advice:

Emphasize Quality Over Quantity: While having a tool that can translate text in several languages seems great, it is critical to emphasize output quality. Choose platforms that are well-known for their precision and realistic voice reproduction.

Adjust the Tone, pace, and Accent: A decent AI voice over generator enables users to adjust the tone, pace, and accent of the created speech. This adaptability guarantees that the discourse is genuine and connects with the intended listener.

Keep Up to Date: Because these technologies are based on AI, they are always improving. Regular software upgrades might bring new languages to the table or enhance current ones. To benefit from the most recent advances, keep your software up to date at all times.

Using Nuanced Speech to Bridge Cultural Gaps

Understanding a language entails understanding the nuances, intonations, and cultural nuances as well as the words themselves. Advanced AI voice over generators not only translate text to speech but also guarantee that the speech is emotionally appropriate. For example, the way a joke is presented in Japanese may vary from how it is shown in German. As a result, always use a tool that considers these subtleties in order to make the speech seem as genuine and culturally appropriate as feasible.

Potential Multilingual Text to Speech Applications:

E-Learning Platforms: Educators may build courses in one language and then utilize an AI voice over generator to translate them into numerous languages, guaranteeing that learners all over the globe can benefit.

Podcasts in different Languages: Podcast makers may reach a worldwide audience by giving their material in different languages without having to re-record episodes.

Global Business Presentations: Companies with a global presence may simply tailor their presentations to a variety of language audiences.

Scalability and pricing

Costs, like with any technology, might be an issue. With the rise of cloud-based solutions, however, many AI voice over producers now provide scalable price structures. There is undoubtedly a price option to meet your needs, whether you are an individual wishing to convert a few pages or an organization with mass requirements.

Data Privacy Is Important

Given that these technologies may be used to convert sensitive or private information, it is critical to address data privacy. Choose platforms that emphasize user data security to ensure that the material you convert stays private.

Extending the Multilingual Communication Landscape

As companies and organizations strive for a worldwide presence, the demand for multilingual communication has never been greater. Then there are AI voice over generators. These technologies provide companies, schools, and content producers an advantage by enabling them to cater to a varied audience.

Courses in numerous Languages: Educators and e-learning platforms may now offer their courses in numerous languages. Python programming may be learned in Mandarin by one student in Beijing and Portuguese by another in So Paulo. Learning results are improved by catering to their linguistic comfort. The student may concentrate on grasping the material rather than dealing with linguistic intricacies.

Digital Marketing: By employing the AI voice over generator to translate and vocalize their promotional material, brands can easily roll out worldwide campaigns. This not only saves time, but it also guarantees that the brand message is consistent across several languages.

IVR (Interactive Voice Response) Systems: Companies may customize their customer service lines by using AI-generated voices in several languages. This provides a more personalized client experience, which may dramatically increase user happiness and loyalty.

Podcasters, YouTube makers, and digital storytellers may utilize these technologies to make their material accessible in several languages, extending their fan base and worldwide reach.

Language and Cultural Nuances

While these AI voice over generators' skills are astounding, users should be conscious of the subtleties and complexity of various languages and cultures. Even if a technology is capable of converting text to voice in 24 languages, the user must verify that the material is culturally appropriate and respectful. Certain idioms or phrases in English, for example, may not have a direct counterpart in another language or may be misconstrued.

AI engineers are tackling these issues by training their models on culturally varied datasets in order to capture the nuances of each language. However, it is also the users' responsibility to examine and, if required, change the created information to guarantee its relevancy and appropriateness.

Best Practices for Using AI Voice Over Generators

Here are some practical advice for individuals who want to fully use the possibilities of AI voice over generators:

Always Review the Output: Before completing, always listen to the created voice over. Check that your pronunciation, intonation, and emotion are appropriate for the context of your topic.

Customize Settings: Most programs enable users to change the pace, pitch, and other characteristics of their voice. Experiment with these options to get the desired result.

Keep up to date: The disciplines of AI and machine learning are rapidly growing. Use the most recent version of the program or application, since developers are always refining and improving their algorithms.

Request input: If your material is intended for a particular linguistic group, get input from native speakers. They may reveal insights that non-natives may miss.

In conclusion

In the digital age, the AI voice over generator is changing the way we interact. Its capacity to convert text into lifelike voice in different languages bridges barriers, fosters inclusion, and makes global communication easier than ever. Remember to consider quality, cultural subtlety, and data protection as you investigate the numerous products in the text to speech domain. By doing so, you get access to more than simply a tool; you also gain access to worldwide dialogues.

Web3 Page: 1 | 2 | 3

How will AI Voice help educators with building courses?

How will educational institutions benefit from developing AI voice audio content for languages learners?

How will AI Voice help educators with building courses?

How will educational institutions benefit from developing AI voice audio content for languages learners?

Integrating voice cloning technology into foreign language instruction can support listening skills at low proficiency levels.

Title:

Content: British Text to Speech & Accent Generator

Speak with Authority: British Text-to-Speech Voices for AI Driven Narrations

With a repertoire of over 40 diverse British English accents, effortlessly bring your text to speech with PlayHT`s AI voices and speech synthesis. Whether you`re creating a documentary, creating a health and safety video, or localizing your multimedia ads, convert text to voice in British English using our AI voice generator.

Download your audio files as MP3 or WAV, or access our British English AI voices through our state-of-the-art TTS API.

Excellent150+ reviews on Trustpilot
0/1,000

Trusted by individuals and teams of all sizes

34 Text-to-Speech British English Accents

Take your audience on a journey across the British Isles with cutting-edge AI voices powered by PlayHT, Amazon Polly, Google WaveNet, IBM Watson, and Microsoft Azure.

English (UK)

34 voices
These are the most realistic and natural sounding voices, built using AI and Machine Learning.
Abbi
Alfie
Anna
Bella
Charlie
Charlotte
Elliot
Emilia
Ethan
Hannah
Harry
Hollie
Isla
James
Kathy
Libby
Lily
Logan
Maisie
Noah
Oliver
Olivia
Ryan
Sonia
Thomas

High quality voices that don’t sound robotic, built using computer generated algorithms without AI.

Amelia
Amy
Brian
Emma
Isabella
Jack
Mia
Sandy
Thomas

Explore Additional English TTS Voices

How it works

How to Generate Speech with British English Text-to-Speech Voices

  • Go to the PlayHT Studio
  • Choose your voice
  • Type your text or paste your script into the TTS Editor
  • Customize the voice by adjusting the speech or pitch. Include any pauses or emphasis, if necessary
  • Click generate audio
  • Preview your generation or regenerate audio and choose your preferred generation
  • Download your audio

British English Text-to-Speech Use Cases

Curate an immersive auditory experience for your audience with PlayHT’s British English accent generator. Narrate your audiobooks, voice your e-learning modules, and get creative with your documentary voiceovers.

  • Accent Training

    Have you ever wanted to speak with a British accent? You can use our AI voices as part of your accent training. Convert your text to speech with one of our British English AI voices and use the audio as a training guide to perfect your accent.

    Create stable, reliable accent drills and exercises using any British English AI voice of your choice. Record your voice and compare your audio with audio generated by PlayHT.

    Voice
  • Documentary Voiceovers

    Inspired by David Attenborough’s clear, authoritative, yet precise documentary voiceovers? Choose one of our Ultra-realistic narrative-style British English AI voices for your documentary voiceovers. Import your video to the PlayHT studio and add the voiceover directly to your video.

    Voice
  • E-learning

    The clarity and richness of British accents make British accents the perfect choice for e-learning audio content. Whether it’s educational tutorials or corporate training modules, the crisp British English accent is a great choice for your learning materials.

    Voice
  • Language Learning

    Perfect your language skills with authentic British text-to-speech voices. Master English pronunciation, intonation, and rhythm with our ultra-realistic British text-to-speech voices. Build a dialogue simulation with multiple British accents to enhance conversational fluency.

    Voice
  • IVR Systems

    Impress callers with clear, natural sounding voice prompts with our ultra-realistic British text-to-speech voices. Whether your call center is based in the United Kingdom or you’re addressing an English speaking market, a clear, articulate voice is a must.

    Voice

Start Creating Today

Frequently Asked Questions

How many British English accents can I generate?

What is the most realistic British English accent generator?

How do I download my British English accent files?

What other accents can I generate?

How will educational institutions benefit from developing AI voice audio content for languages learners?

How will educational institutions benefit from developing AI voice audio content for languages learners?

How will educational institutions benefit from developing AI voice audio content for languages learners?

To protect oneself from voice cloning scams, experts recommend verifying caller identity through alternative means, not sharing personal or financial information in unsolicited calls, and being cautious with links and downloads that can hack into one's phone.

Title:

Content: Dangerous techniques of artificial intelligence: "falsification of sound"..
How to protect yourself from them – Al Manar Channel – Lebanon
Lebanese Media Group
Al Manar Channel
Dangerous techniques of artificial intelligence: "falsification of sound"..
How to protect yourself from it.
You should be careful when receiving emergency phone calls, especially when you are asked to transfer money, or provide sensitive information, even if the voice is like the voice of your relatives or friends, in the age of artificial intelligence, counterfeiting surrounds people in all their matters.
Recently, a type of fraud has spread by artificial intelligence applications called "fraud counterfeiting" or "voice manipulation", but you can survive it if you pay attention to these developments, and follow the advice given by two experts in cybersecurity and information technology for the site "Sky News Arabia".
OpenAI, a specialist in generative artificial intelligence, and the creator of the popular chat program “Chat GBT, ” last March, offered a tool for voice cloning that will be limited in use to avoid fraud.
The tool, called Voice Engine, is able to reproduce a person ’ s voice through a 15-second audio sample, according to an OpenAI statement that touched on the results of a small-scale test.
“We recognize that the ability to generate human-like voices is a high-risk step, especially in this election year, ” the statement said, adding that“ we are working with U.S. and international partners from governments, media, entertainment, education, civil society and other sectors, and taking their observations into account. ”
Manipulation and loss of confidence
According to cybersecurity and information technology expert Mohammed Khleif, it has become “very easy ” to use artificial intelligence to make phone calls with sounds that sound familiar to people, and this is called“ voice counterfeiting ” or “voice manipulation. ”
On how this fake sound is made, Khalif says it is done with artificial intelligence programs to imitate known or taken sounds from social media.
One of the perils of using this counterfeiting is to defraud victims in urgent financial requests by deluding them that the caller is known to them, explains Khalif, who warns that such uses may lose confidence in the digital world, negatively affecting the pace of digital transformation.
Cybersecurity and information technology expert Tamer Mohammed calls for caution in the communications we receive, saying that “phone communications by artificial intelligence have spread very widely, and there are applications that implement them without the need for the fraudster to have experience. ”
It is worth mentioning that the frauds reached the most famous figures in the world, including that an adviser working in the presidential campaign of a rival in the Democratic Party of the US President, Joe Biden, invented during the presidential primaries, an automated program that impersonated Biden, and called the fake voice voters not to vote in the New Hampshire elections.
The voices of celebrities such as English artist Stephen Fry and London Mayor Sadiq Khan have also been cloned and attributed to them statements that caused them inconvenience or embarrassment, and one of the executives, who was not named, was exposed to fraud that caused him to transfer $243,000 to the fraudster after receiving a fake phone call, according to the British newspaper “Daily Mail ”.
How do we protect ourselves from fraud?
To counter this new threat, Mohammed Khalif and Tamer Mohammed offer these tips when receiving phone calls, or listening to voices without seeing them:
Always question the authenticity of the communication, even if the sound is familiar, especially when it seems urgent.
Try to communicate with the person who is supposed to be calling through a different means of communication that you check.
Be careful to provide personal information or financial statements during a call that you did not initiate yourself.
- Do not access the link of an account or an unknown website; because through it the phone is hacked, uses voice recordings and knows the voice of the person.
- Not to agree to the terms of any program without checking them and knowing the application well.
Source: Sky News
Your opinion matters to us
Participate with us in the survey of the course of programs of the holy month of Ramadan