AI voice cloning technology employs machine learning algorithms to replicate a person's voice by analyzing unique speech patterns, including tone, inflection, and emotional nuances, often requiring only a short audio sample to produce realistic results.

This technology is powered by advanced neural networks and deep learning models, which meticulously analyze and replicate voice characteristics such as pitch, rhythm, and tone from the provided audio data.

Generative adversarial networks (GANs) are also utilized in voice cloning, where two neural networks compete to refine the accuracy of the synthesized voice, ensuring it closely matches the original speaker's vocal nuances.

Open-source programs like Tortoise have significantly advanced voice cloning capabilities by leveraging vast amounts of unstructured voice data to replicate not just the content of speech but also its delivery style.

For example, Microsoft's VALL-E can synthesize highly realistic speech from as little as three seconds of audio, using neural codec language models trained on extensive datasets to achieve human-like naturalness and emotional expressiveness.

ElevenLabs' voice cloning tool exemplifies the accessibility of this technology, requiring only a three-second sample to clone voices while maintaining emotional depth and tone across multiple languages.

AI voice cloning has found applications in entertainment, such as dubbing films and games into multiple languages while preserving the original speaker's tone and emotional depth, as demonstrated by ElevenLabs' multilingual speech synthesis model.

In the realm of accessibility, AI voice cloning enables the creation of lifelike voiceovers for educational materials and documentaries, bridging language barriers and enhancing global communication, as seen in China Media Group's AI-dubbed English documentary.

In language education, tools like ElevenLabs' technology allow for the development of audio content that improves pronunciation and comprehension, catering to diverse learning needs and methods.

For foreign language instructors, AI voice cloning offers the potential to generate authentic Listening Comprehension materials tailored to low proficiency levels (ILR 1 - 1+), maintaining the speaker's original tone and emotional nuances.

NaturalSpeech3, a speech synthesis system, excels in producing nuanced and natural speech by modeling timbre and emotion, making it ideal for crafting realistic audio materials for specific language learning needs.

The Beanbag Sound Reproduction Model by ByteDance supports cross-language migration, enabling the creation of culturally authentic Listening Comprehension materials for beginner-level learners with just a five-second audio sample.

AI voice cloning has also been applied in education to create audio content in multiple languages, enhancing language comprehension and pronunciation skills for learners worldwide.

OpenAI's Voice Engine has been utilized by edtech companies to generate script voiceovers and translate user recordings, showcasing its potential in creating tailored language learning materials.

Despite its benefits, the use of AI voice cloning in education raises ethical concerns about authenticity, as the technology can blur the line between real and synthetic voices, potentially misleading students and educators.

Transparency is another critical issue, as AI-generated voices may be used without clear disclosure, leading to a lack of informed consent and trust among users in educational settings.

The potential misuse of AI voice cloning for creating fraudulent or manipulative content, such as falsified recordings, underscores the need for robust ethical guidelines and legal frameworks to prevent harm.

AI voice cloning has been exploited for scams, such as fake ransom calls using cloned voices of loved ones, causing financial losses and emotional distress for victims.

The technology has also been used to spread misinformation, including voter suppression schemes during elections, where cloned voices of politicians misled voters, undermining democratic processes.

Legal frameworks addressing AI voice cloning vary globally, with the United States relying on copyright and intellectual property laws that leave significant ambiguity around non-commercial uses of cloned voices.

Japan has acknowledged the limitations of its intellectual property laws in regulating AI voice cloning, suggesting voluntary efforts by AI operators and international rule formation as potential solutions.

The European Union has taken a more proactive approach with the AI Act, which includes penalties for violations of AI development rules, though it does not directly address voice cloning.

AI voice cloning raises intellectual property concerns, particularly when replicating voices of public figures, as current laws often fail to address unauthorized use or provide proper compensation.

The U.S. Copyright Office is exploring whether AI-generated works that imitate human voices should be subject to copyright protections or other legal frameworks like publicity rights.

Data privacy laws, such as China's Personal Information Protection Law, require developers to ensure transparency and obtain consent for the use of personal data in AI voice cloning.

The FCC mandates prior express consent for AI-generated voice calls under the Telephone Consumer Protection Act, restricting the use of voice cloning technology in telemarketing.

Ethical concerns about using AI voice cloning without consent include privacy violations, misuse of personal data, and the potential for fraud, which could undermine trust in society.

To mitigate these concerns, companies like OpenAI have implemented strict policies requiring explicit consent, watermarking generated audio, and advocating for voice authentication systems.

Foreign language instructors can ensure ethical use of AI voice cloning by adhering to advanced ethical standards to prevent misinformation and maintain the integrity of educational materials.

Instructors should prioritize transparency and obtain informed consent when using AI voice cloning, ensuring that students and stakeholders are aware of its application and potential risks.

AI voice cloning technology faces limitations in accurately replicating pronunciation and emotional nuances, particularly for low proficiency learners, due to the complexity of human speech patterns.

The lack of sufficient training data for low-resource languages further hinders the effectiveness of AI voice cloning in language education, resulting in errors in pronunciation and grammar.

Despite these challenges, AI voice cloning offers a promising solution for creating tailored Listening Comprehension materials for ILR 1 - 1+ levels, enhancing accessibility and engagement in language learning.

To maintain ethical and legal compliance, it is essential to implement robust data privacy protocols, including encryption and restricted access controls, to safeguard sensitive information during AI training and deployment.

Organizations should adopt ethical guidelines emphasizing accountability, transparency, and human oversight in AI applications to prevent biases and protect privacy rights.

Future trends in AI voice cloning include advancements in multilingual capabilities, enabling the creation of localized and accessible language education materials tailored to diverse learners' needs.

Innovative platforms like Loora are leveraging voice-based AI to provide personalized conversational language learning, focusing on improving pronunciation and fluency for low-proficiency learners.

AI voice cloning technology employs machine learning algorithms to replicate a person's voice by analyzing unique speech patterns, including tone, inflection, and emotional nuances, often requiring only a short audio sample to produce realistic results.

Title:

Content: The scary side of artificial intelligence

The pros of AI outweigh the Cons or threats in our day-to-day lives, and there’s no magic pill to protect us from the scary threats of AI.

  • Exclusive

It's a free Content, simply login/signup to unlock

Get in-depth Industry Insights and Analysis through our “Exclusive” content, presented to you by our esteemed panel of writers, for free

By continuing, you agree to the Terms & Conditions and acknowledge our Privacy Policy. This same account can be used across all Economic Times B2B portals.

  • Updated On Oct 3, 2023 at 03:02 PM IST

Artificial intelligence (AI), as we all know, is the simulation of human intelligence leveraging computer systems and machines. AI programs can continuously learn and evolve with experience. In technical terms, AI systems render the output by churning and analyzing the data for correlations and patterns and help make future predictions using these patterns.

Advt
Today AI is being used extensively in all facets of our lives starting from lifestyle, e-commerce, home appliances, automobiles, navigation, transport, healthcare, agriculture, education, financial planning, chatbots, marketing, cyber security, virtual assistant, industrial automation and many more.

Clearly, we have and are leveraging the strengths of AI to the fullest to automate the routine tasks and make it auto-learn over a period. There’s no doubt that AI has revolutionized the lives of all – organizations, consumers etc. But as they say, “Everything comes at a price”. This analogy is quite true for AI as well, there have been a lot of threats that have emerged using AI and are being utilized by the Cyber criminals to dupe the ignorant users, cause mental stress and extort money.

continued below

Executive Workshop

I’m not going to delve into all of threats but would like to elucidate some of the real ones that have come to the surface recently:

Voice cloning or mimicry

As the name suggests, it uses machine learning algorithms to simulate anyone’s voice. It requires certain voice data to analyze and learn the specific patterns of any individual. There are certain advantages of cloning a voice that can be used in voice assistants, chatbots, navigation systems and other areas. Voice cloning has existed for a while but was restricted to experts who possess the technical knowledge to be able to use the same. But now AI Voice cloning tools are available on the open Internet that anyone can leverage with literally no technical knowledge or cost to clone anyone’s voice. All you need to do is just Google and it will pop up and get a bunch of both free and paid AI Voice cloning tools.

Advt
In fact, recently one of the global leaders in online protection published a report stating how AI is fueling a rise in online voice scams, with just three seconds of audio required to clone a person’s voice. This is extremely creepy. Just imagine, if a Cyber-criminal clones your voice and tricks your near ones by making them believe that they are talking to you, and request for money due to any distress reasons. In fact, these are not assumptions but real-life incidents that are happening across the world every minute.

Deepfakes AI

Deepfakes AI are being used to impersonate an individual by manipulating videos, images, audios, and other content available on the social media platforms using deep learning techniques. It mainly transforms existing content from one person to another. This is another area that has been exploited by the Cyber criminals in the recent past, and there are a few deepfake cases that have made waves on the Internet. One of the most famous ones being Deepfake created by a VFX artist of one of Hollywood’s most famous male actors. This piece was so well made by rendering thousands of pictures using artificial versions of the actor. There are similar Deepfakes incidents involving other global celebrities and leaders. The damage and misuse of the deepfakes videos could be extremely dangerous for the human society and can be used by terrorists to incite riots and create nuisance.

Creating virtual people

This is another area where AI is being used to create people that do not exist. There are a lot of websites that allow you to generate a random image by just specifying the age group, gender & ethnicity, and you can continue to refresh these images at the click of a button. Be mindful of the fact that these images pertain to people that do not exist in this world. On the similar lines, there’s an emerging trend of AI news anchors that possess a human-like appearance and are fed data that they can read using text-to-speech technology. Recently, there's been a surge of AI-Driven robotic new anchors in multiple language channels. While the main objective of this initiative is to provide royalty free or cost-effective human images for branding and other purposes. However, the overuse of these technologies causes Fear of missing out (FOMO), Feeling of inadequacy, dissatisfaction, and isolation may potentially lead to psychological and emotional vulnerabilities.

One of the Hollywood movies, ‘HER’ portrayed an introverted and lonely writer (Joaquin Phoenix) who purchases an AI virtual assistant personified through a female voice to assist him in his writing job. However, when he finds out about its ability to learn and adapt, he falls in love with it. The film delves into emotional vulnerability and the impact of AI on human relationships.

Needless to say, that the pros of AI outweigh the Cons or threats in our day-to-day lives, and there’s no magic pill to protect us from the scary threats of AI. However, there are certain preventive tips that one can follow to mitigate any such risks. Do spread awareness with your family and friends:

  • Set some code words with family, and friends to verify the identity during emergency circumstances
  • Optimize social media presence by limiting your connections with only known contacts and avoid connecting with any unknown ones
  • Avoid saying ‘Yes’ as a greeting while receiving unknown calls as it can be used to authorize credit card charges or other purposes
  • Continuously update privacy settings on social media to allow viewing by friends and family only
  • Avoid clicking on any suspicious links or calls received without proper due diligence
  • Do not share your passwords and other sensitive information with anyone
  • Verify the credentials of any online information before circulating it through various mediums
  • Avoid public Wi-Fi connections offered at coffee shops or airports, which requires to enter password
  • Closely monitor the time spent by younger generation on social media and online gaming
  • Finally, in case of any suspicion, double check and report it to the host site or concerned authorities
The author is the CIO of MOVIN

Disclaimer: The views expressed are solely of the author and ETCIO does not necessarily subscribe to it. ETCIO shall not be responsible for any damage caused to any person/organization directly or indirectly.

  • Published On Oct 3, 2023 at 03:02 PM IST

Most Read in Artificial Intelligence

Join the community of 2M+ industry professionals

Subscribe to our newsletter to get latest insights & analysis.

Download ETCIO App

  • Get Realtime updates
  • Save your favourite articles

Deepdub, a film dubbing company, uses an AI to process voice and translate into a different language and promises to preserve what?

What is necessary for voice cloning to work?

This technology is powered by advanced neural networks and deep learning models, which meticulously analyze and replicate voice characteristics such as pitch, rhythm, and tone from the provided audio data.

Title:

Content: Expressionkaspersky.com
What are the mysteries of deep sonic falsification?
The spread of artificial intelligence and easy access to tools capable of altering the truth have led to the emergence of one of the most shocking and disturbing digital manipulation techniques, “deepfake. ”
Deep fakes make it possible to create fake videos, photos and sounds that show individuals saying or doing things they never said or did, and although the most popular version until recently was video, deep fakes are gaining importance day by day.
A historical overview
The first major program to bring the potential of deep voice counterfeiting to the general public was Adobe Voco in 2016, which used artificial intelligence to mimic a person ’ s voice from a short recording.
emoticalipwatchdog.com
The software was scrapped after it was found that it could be used to create false, misleading and dangerous sounds, and since then, advances in neural network technology have enabled increasingly realistic and convincing audio falsifications.
At present, we can find many applications and tools online that use this technology to create fake sounds, where Microsoft has launched an artificial intelligence model called VALL-E that can imitate the human voice with a recording of only three seconds.
Deep sonic falsification
Deep voice falsification aims to create an audio model capable of replicating the actual speaker ’ s voice, but the model must be trained through the speaker ’ s audio recordings, in order to be ready to generate an artificial sound similar to that of the original person.
expressiontelegraph.co.uk
Deep learning and natural language processing techniques are used to analyze the unique patterns and characteristics of sound, some of which include pitch, speed, rhythm and tone, and artificial intelligence uses recordings to deliver an original sound, creating a new audio recording that mimics the speaker ’ s voice to a full degree.
How to Create Deep Audio Counterfeiting
Fake deep voice is created using AI-powered text to speech technology, and this can be done with just a few minutes of recorded speech to train an AI speech model, which can read any text with the target voice.
expressionveritonevoice.com
The original recorded sound must be of sufficient quality to sample the unique characteristics of the speaker ’ s voice, after which AI algorithms analyze the patterns and characteristics of the original sound and learn to mimic them.
This can be done with male and female voices and adaptation to the identity of the speaker, the result is a fake voice recording that mimics the voice of the original person, and in addition to generating speech, these instruments can simulate sounds such as breathing and mouth movements.
Initiatives to combat voice counterfeiting
There are initiatives aimed at combating this increasingly prevalent voice counterfeiting, and some technologies can detect these counterfeit products, such as voice biometrics, an authentication method that uses a person ’ s unique voice pattern to verify their identity.
expressionclt.nliu.ac.in
This pattern includes characteristics such as tone and pitch of the voice, speech speed, and pronunciation, and to use voice biometrics, a person's voice must be captured, after which, its unique characteristics are analyzed as well as the length of the words.
Spectroscopy can also be used, consisting of analyzing acoustic signals to detect unique sound patterns that are difficult to replicate in deep fakes.
There are also tools that can detect the digital traces present in deep voice fakes, because the latter fails to accurately simulate all the variables of the actual voice recording, and therefore, deep fakes may contain breaks in sound or background noise that differ from those expected in the original sound.
Most Read
No stories found.
Erm News
www.eremnews.com

Deepdub, a film dubbing company, uses an AI to process voice and translate into a different language and promises to preserve what?

Generative adversarial networks (GANs) are also utilized in voice cloning, where two neural networks compete to refine the accuracy of the synthesized voice, ensuring it closely matches the original speaker's vocal nuances.

Title:

Content: “The Deep Falsification. ”
This is how you can discover sound and image fabrication | Politics and economics | In-depth analysis with a broader perspective than DW | DW | 08.01.2022
1.
Inhalt
2.
Navigation
3.
Weitere Inhalte
4.
Metanavigation
5.
Suche
6.
Choose from 30 Languages
Announcement
Politics and Economics
"The Deep Fake."
This is how you can detect the fabrication of sound and image.
In the era of what is known as deep fakes, it has become difficult to tell whether a video is real or not with the naked eye.
But we shouldn't worry, there are ways to find out.
DW has some advice to find out.
Combining the dance, voice and image of American singer Bruno Mars I would advise an example of employing the technique of "deep fakes"
Imagine dancing and singing with the same dexterity, agility and sound power as Bruno Mars!
Many people may think that the technology used to enable anyone to do or say things they have never done is complex, and it can be easily owned, as it only takes footage and video to start creating an “alternative reality. ”
This technique of manipulating both visual and audio content using artificial intelligence is called deepfakes.
This example dates back to 2018 and is still impressive, but now thanks to the “deep fakes ” technique it can be very realistic and convincing.
What is "deep fakes"?
The term "deep fakes" accurately describes the process of collecting audio and video files by artificial intelligence or machine learning.
All areas of "deep fakes" are possible, starting from changing faces, meaning replacing one person's face with another, or synchronizing the movement of the lips, where the speaker's mouth can be set to an audio file different from the original sound or the reproduction of the sound, where a copy of the sound is reproduced for use to say other things.
It is not only at this level, but also completely artificial faces and bodies can be created, for example, a digital avatar.
What ’ s more, “deep fakes ” can be used to evoke the dead, as the Dali Museum in Florida did with Salvador Dali, where the American Museum used this technique to allow visitors to take a live photo with Dali — who died in 1989 — and take selfies himself.
The process of using artificial intelligence to manipulate a video is based on a technique known as the "generative adversarial network", which is a model of machine learning, where two neural networks compete against each other for more accurate results, as this technology aims to improve results.
We may find it difficult to understand what is meant by the competition of two networks, but we will explain how the process works: one computer will inform the other computer if the digital reproduction, whether visual or auditory, that it has made for anyone is convincing and substantially identical to that person ’ s original; that is, whether the lip movement in the cloned copy is identical to the original, and whether facial expressions are identical.
Using the "generative adversarial network", the system as a whole is optimized until a convincing result is reached.
Although this technology is constantly being developed and improved, anyone can detect manipulation whether visual or audio in other words catch “deep fakes ” if the thing we ’ re looking for is identified.
Methods of Detecting "Deep Counterfeiting"
Capturing clips that have been subjected to "deep fakes" does not require one to be an expert in this complex technique in order to distinguish what is real from what is fake.
In that, DW offers some tips to help investigate “deep fakes. ”
First watch the clip carefully and do not rush to publish it, and ask yourself the question: is this clip real?
Couldn't it have been fabricated?
If you are in doubt, do not post it or send it to anyone.
In case of doubt, you should do a search for the same story or clip from different but trustworthy sources on the Internet, as finding a similar story will help you grab the edge of the thread to get to the real story.
If you suspect an audio, image, or video clip, enter that part into Google or DuckDuckGo and look for a similar version.
The two versions can then be compared.
Detecting and detecting some of the effects of manipulation is the biggest challenge, but there are some aspects that may help, such as the presence of inconsistent footage or change in tone or quality of sound and others, no matter how small, may be useful and you have to trust your visual and auditory senses and always ask yourself: Does it make sense?
You should remember that it only takes a lot of focus and you may need to seek help from someone else to help you identify where the manipulations might be simple things like nose, ear, teeth, whiteness or even hairstyle and whether it looks the same.
It may be necessary to view the clip at a scene rate to detect inconsistencies, for example the VL Media Player.
See also watchframebyframe.com.
Also, zoom in on the movements of the mouth and lips and compare them to the original version to discover the synchronization of the movement of the lips, and whether it makes sense.
Enhance your audio-visual skills
It is clear from all the above that it is all about the human senses, especially the auditory and visual skills, and fortunately you can enhance these abilities, through this training you can improve your hearing and vision skills to detect any manipulation of the image or sound.
High risk of "deep fakes" technique
The technique of "deep fakes" can be used in the field of pornography that comes within the framework of what is known as "revenge porn", in which fake pornographic images or clips are posted in order to blackmail or even damage the reputation of the victim.
“Revenge porn ” is defined as posting mostly pornographic images or videos online with the aim of taking revenge and harming people.
As for societies in general, the dangers of deepfakes depend on how we consume the Internet: people see too much when browsing the web and social media and are not always sure what they are posting or sharing, whether it is real or fabricated.
How to Detect Misinformation and Detect Deep Counterfeiting?
In polarized societies, deep fakes are a great opportunity to trick people into believing certain things.
It is not about the quality of the fake video, it may be what you saw, even if it is not true, for example a video of former England star David Beckham speaking nine languages.
In April 2019, Beckham launched a campaign to eradicate malaria by sending a message through a video clip in nine languages.
He began the letter in English and then spoke in eight other languages, but the other eight languages were not in his own voice but in the voices of malaria survivors and doctors.
At the time, the British organisation that produced the video said it had used video technology to make Beckham appear to speak these eight languages.
Politically, a fake “deepfakes ” video was produced by De Correspondent showing Dutch Prime Minister Mark Rutte talking about a major policy change, saying he would fully support long-term climate action.
Some politicians may benefit from a media climate filled with misinformation, but the presence of technology such as "deep fakes" allows them to claim that what they have said is untrue and false and it will be difficult to prove otherwise.
Perhaps the most striking example of this is former US President Donald Trump ’ s claim in 2016 that a 2005 video in which he spoke profanely about women was fabricated, although he later apologized for those words.
Salvador Dali Museum in Florida used artificial intelligence to bring back international painter Salvador Dali "from the dead"
Lesson learned
The bottom line is that spreading misinformation can be for the most prominent reasons of arousing suspicion and controversy or supporting certain beliefs in a deceptive way, but it does make the desired noise.
It may be difficult to verify manipulated videos or audio, but one can be trained to learn how to spot “deep fakes. ”
Above all, it is necessary to stop posting or sharing anything that has not been verified as authentic.
Julia Baer, Robin Baumeister / GC

Deepdub, a film dubbing company, uses an AI to process voice and translate into a different language and promises to preserve what?

timbre
important vocal nuances
intonation

Open-source programs like Tortoise have significantly advanced voice cloning capabilities by leveraging vast amounts of unstructured voice data to replicate not just the content of speech but also its delivery style.

Title:

Content: OpenAI's Johansson gaffe pushes voice cloning into spotlight

Law enforcement warned that AI clones could be used to extort money from loved ones over the phone

By AFP

  • Follow us on

Scarlett Johansson voiced an AI character in the film "Her". — Reuters file

Published: Mon 27 May 2024, 7:51 PM

Last updated: Mon 27 May 2024, 7:52 PM

OpenAI was forced to apologise to actor Scarlett Johansson last week for using her voice -- or something very similar -- on its latest chatbot, throwing the spotlight on to voice-cloning tech.

Although OpenAI denied the voice they used was Johansson's, their case was not helped by CEO Sam Altman flagging the new model with a one-word message on social media -- "Her".

Johansson voiced an AI character in the film "Her", which Altman has previously said is his favourite film about the technology.

Right from the start, AI voice cloning has proved problematic.

Last year, British firm Elevenlabs went viral for all the wrong reasons when it released its voice-cloning software.

Internet pranksters immediately began pushing out deepfaked celebrities -- Harry Potter star Emma Watson was shown reading Hitler's Mein Kampf.

Law enforcement warned that AI clones could be used to extort money from loved ones over the phone.

The technology has developed rapidly in the past year becoming far more realistic and nuanced.

Danish entrepreneur Victor Riparbelli, CEO of British AI firm Synthesia, told AFP it was largely down to a program called Tortoise that was released two years ago.

The program's developers threw thousands of hours of voice data into their model in an unstructured way and discovered it not only learnt what to say but how to say it.

"That was a pretty big paradigm shift," Riparbelli said on the sidelines of last week's VivaTech conference in Paris.

Tortoise was an open source program and Elevenlabs was the first to go to market using it.

OpenAI uses similar systems though they do not release any details.

Much of the controversy around voice cloning has focused on concerns over people misusing the software.

But the claim against OpenAI is unusual because it is the company itself accused of playing fast and loose.

"It was very unfortunate that OpenAI did that -- really not very good," Katya Laine, CEO of TALKR.ai, told AFP at VivaTech.

"If they actually cloned her voice without her knowing then I think that's very very bad," said Riparbelli.

The two entrepreneurs are among hundreds harnessing AI voice programs for uses that they argue will make companies more efficient.

Laine's firm provides virtual voice assistants -- essentially AI customer service agents.

She said her firm's system could now resolve 25 to 30 percent of calls without any human involvement.

Synthesia specialises in video avatars, which Riparbelli said allowed any office worker to turn text or slides into a video performed by a realistic AI.

Both Riparbelli and Laine allow their clients to use their own avatars, off-the-shelf products or those supplied by the likes of OpenAI and Elevenlabs.

Riparbelli said Synthesia used actors whose likenesses and voices were licensed for two years with an option to renew after the initial period.

The problems arise if actors' voices are used without their consent.

The fiasco overshadowed a developer conference in Paris last week when OpenAI was showing off a suite of new tools.

In front of a big screen in an auditorium, Romain Huet, OpenAI's Head of Developer Experience, breezily chatted into his phone.

Seconds later, his short voice sample had been processed and could be heard commentating over a generated video -- in five languages.

The demonstration showed how quickly the field is moving, but the headlines had already been written.

The Washington Post asked in a newsletter "How dumb is OpenAI?", other commentators were suggesting wunderkind Altman was nothing more than a huckster.

Nonetheless, Riparbelli was open to OpenAI's argument that they had used another actor who just sounded liked Johansson.

"If it's not her but someone who sounds a lot like her... where do you draw that line," Riparbelli asked.

"If they're not allowed to use someone who sounds a lot like her, then it sets a very odd precedent."

More news from World

Deepdub, a film dubbing company, uses an AI to process voice and translate into a different language and promises to preserve what?

For example, Microsoft's VALL-E can synthesize highly realistic speech from as little as three seconds of audio, using neural codec language models trained on extensive datasets to achieve human-like naturalness and emotional expressiveness.

Title:

Content: • Text size
News feed
Today, 14: 37
418
Today, 14: 37
418
Photo: en.oxu.az
“Fraudsters will be able to call the voice of your mother ”: Microsoft has created a new neural network
Microsoft has introduced a new project in the field of artificial intelligence.
The development called VALL-E can very accurately simulate any human voice, after listening to it for only three seconds, BaigeNews.kz reports with reference to IChip.
Moreover, artificial intelligence is able to imitate a person while preserving both the timbre and the emotional coloring of his voice.
Positioned as a language model of the neural codec development relies on EnCodec technology.
VALL-E was taught at the LibriLight library, which contains about 60,000 hours of speech received from more than 7,000 people.
However, for now this is all exclusively speech in English, so domestic telephone fraudsters will still have to wait before launching a mass call to residents of the post-Soviet space.
Subscribe to our Telegram channel and get the news first!
Share:
Partners news:
Back to top

What has the US Federal Trade Commission warned about the use of voice cloning tools?

Difficult to distinguish from human voice

What is necessary for voice cloning to work?

ElevenLabs' voice cloning tool exemplifies the accessibility of this technology, requiring only a three-second sample to clone voices while maintaining emotional depth and tone across multiple languages.

Title:

Content: Language No Barrier: New AI tool can clone voice and make it say anything in multiple languages

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

Mehul Reuben Das May 03, 2023 13:42:20 IST

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

As advanced as AI-based voice cloning has been, there were a few limitations to it. For example, voice generators were mainly bound by the language of the source they were trained in or rather the language of the prompt that was given to them. Now, ElevenLabs, an American AI software developing company has come up with a tool that does away with that limitation.

ElevenLabs’ new AI tool can clone the voice of a person and make it say anything in a bunch of different languages. All it needs is a clear voice sample of about 3 seconds, although it also suggests that the longer the sample, the better will be the results. The new tool even manages to maintain the speaker’s original tone of voice.

Limitless possibilities
The creators expect that this would ‘extend the possibilities’ in a variety of industries such as publishing, gaming creation, and media. “Introducing Eleven Multilingual v1: Our New Speech Synthesis Model! We’re thrilled to launch our new model supporting seven new languages: French, German, Hindi, Italian, Polish, Portuguese, and Spanish.”

“This advancement expands the horizons for creators, game developers, and publishers, and it paves the way for using generative media to create more localized, accessible, and imaginative content,” the company said.

Following the announcement, Twitter was flooded with comments, with users testing the software on various famous faces.

To demonstrate just how capable the new voice cloning AI tool is, Eluna AI, a platform for AI-content creators experimented with a sample clip of former US President Donald Trump.

In their demo, Eluna AI showcased a small clip of Donald Trump, speaking in his native tongue, English, followed by French, Spanish, German, Hindi and Italian, almost perfectly. The generated samples even gets the accent right, almost if he was a native speaker of the new target language.

Another user changed David Attenborough’s voice to German while the BBC broadcaster discussed the prospects of AI. “With this tool, anyone can do it,” stated the Twitter user. “It’s also worth noting that fraudsters will undoubtedly exploit this one.”

ElevenLabs says that its model was designed to understand the emotion and reasoning underlying words in order to produce natural-sounding and persuasive audio. ElevenLabs has said that some numerals and symbols are currently spoken wrongly, but that it is striving to rectify this.

Who is this new tool meant to help?
The US-based company believes its technology will be valuable in a variety of areas, including education and journalism.

Game developers and publishers can build engaging, localised experiences for worldwide audiences, breaking through language barriers and connecting with players and listeners to maximise engagement and efficiency while maintaining quality and accuracy.

“Educational institutions now have the ability to develop audio content for varied users in their target languages, enhancing language comprehension and even pronunciation abilities, as well as responding to different teaching methods and learning demands,” says the report.

Because of the model’s capacity to produce unique character-like voices, audiobook and content developers may also find it beneficial.

The conundrum of AI voice genertors
Despite its benefits, ElevenLabs’ launch comes amid widespread concern about the wave of new voice cloning technology. An unidentified TikTok user went popular last month after sharing an AI-generated Drake song starring The Weeknd.

It sparked concerns about the grey area of AI-created music and whether it constitutes a copyright violation. Nonetheless, ElevenLabs claims to be ‘fully committed’ to respecting creators’ rights in the midst of technological advancements.

“At Eleven, we think that we should seek to make the best use of emerging technology, but not at any expense,” it stated.

“As we create them, we make every effort to put suitable controls in place that reduce the possibility of detrimental abuse. With this in mind, we are entirely committed to both protecting intellectual property rights and taking action against infringement.”

Read all the Latest NewsTrending NewsCricket NewsBollywood News,
India News and Entertainment News here. Follow us on FacebookTwitter and Instagram.

Updated Date:

also read

World

Music labels are worried because of AI, thanks to a surprising new song ft. Drake X The Weeknd

Someone used AI to create a whole new song featuring Drake and The Weeknd. But because the singers never sang the song, artists and music labels are worried, how AI voice modulation and AI-generated songs can disrupt the industry.

World

Artificial Imposter: 47% of Indian phone users have experienced AI voice scams, highest in the world

About half of Indian adults, or 47%, have experienced AI voice scams, nearly double the global average of 25%. Furthermore, nearly 69% of adults say they can't differentiate between a real and an AI-generated voice.

Deepdub, a film dubbing company, uses an AI to process voice and translate into a different language and promises to preserve what?

What company created an AI tool that could mimic the voices of deceased movie stars?

What is necessary for voice cloning to work?

AI voice cloning has found applications in entertainment, such as dubbing films and games into multiple languages while preserving the original speaker's tone and emotional depth, as demonstrated by ElevenLabs' multilingual speech synthesis model.

Deepdub, a film dubbing company, uses an AI to process voice and translate into a different language and promises to preserve what?

Eleven Labs is extending its voice cloning services for which industries?

In the realm of accessibility, AI voice cloning enables the creation of lifelike voiceovers for educational materials and documentaries, bridging language barriers and enhancing global communication, as seen in China Media Group's AI-dubbed English documentary.

Title:

Content: Advertisment

China Media Group Debuts AI-dubbed English Documentary, Pioneering Global Communication

China Media Group launches its first AI-dubbed English documentary, enhancing global reach and fostering international understanding through advanced AI technology.

Aqsa Younas Rana
Updated On
New Update

In a groundbreaking move, China Media Group has launched its first AI-dubbed English documentary, marking a significant milestone in the use of artificial intelligence for global media outreach. This innovative approach to dubbing not only showcases the advancements in AI technology but also underscores China's ambitions to foster better international communication and understanding. Through this initiative, the documentary, originally produced in Mandarin, has been made accessible to a broader English-speaking audience, enhancing its global reach and impact.

Advertisment

Revolutionizing Content Accessibility

The application of AI in dubbing the documentary into English reflects a growing trend in leveraging technology to bridge language barriers. Similar to the educational advancements discussed in 'Voice Cloning in Education: Bridging Language Gaps in Learning Environments,' this initiative by China Media Group capitalizes on the potential of AI voice cloning technology. By generating lifelike digital replicas of human voices, the documentary's AI-dubbed version maintains the authenticity of the original narration while making it understandable for English-speaking viewers. This technological leap not only improves accessibility but also ensures the delivery of content with emotional depth and cultural nuances intact.

The launch of this AI-dubbed documentary serves as a testament to China's commitment to enhancing global dialogue and cultural exchange. By removing language barriers, China Media Group is effectively broadening the documentary's audience, enabling people from different parts of the world to gain insights into Chinese culture, history, and perspectives. This initiative aligns with the broader objective of promoting mutual understanding and respect among diverse global communities, paving the way for more inclusive and informed international discourse.

Advertisment

Setting New Standards in Media Production

China Media Group's pioneering use of AI technology in documentary dubbing sets new standards for media production and distribution. It illustrates the potential of AI to transform traditional media practices, making content more accessible and engaging for global audiences. As AI technology continues to evolve, it is likely to open up further possibilities for creating multilingual content, thereby enhancing the reach and impact of media across borders. This development also raises important considerations regarding the ethical use of voice cloning technology, underscoring the need for guidelines that ensure its responsible application in media and beyond.

As we reflect on the implications of this technological advancement, it becomes clear that AI-dubbed media content holds significant promise for fostering international understanding and cooperation. By making diverse cultural and educational materials available in multiple languages, we can build a more connected and informed world. The initiative by China Media Group not only highlights the practical applications of AI in media but also invites us to contemplate the future of global communication in an increasingly digital age.

Advertisment
Advertisment

How will AI Voice help educators with building courses?

How will educational institutions benefit from developing AI voice audio content for languages learners?

In language education, tools like ElevenLabs' technology allow for the development of audio content that improves pronunciation and comprehension, catering to diverse learning needs and methods.

How will educational institutions benefit from developing AI voice audio content for languages learners?

Enhance language comprehension
Respond to different learning demands
Enhance pronunciation abilities

For foreign language instructors, AI voice cloning offers the potential to generate authentic Listening Comprehension materials tailored to low proficiency levels (ILR 1 - 1+), maintaining the speaker's original tone and emotional nuances.

Deepdub, a film dubbing company, uses an AI to process voice and translate into a different language and promises to preserve what?

How will educational institutions benefit from developing AI voice audio content for languages learners?

Enhance language comprehension
Respond to different learning demands

NaturalSpeech3, a speech synthesis system, excels in producing nuanced and natural speech by modeling timbre and emotion, making it ideal for crafting realistic audio materials for specific language learning needs.

Title:

Content: Home > Industry > Keywords > Inflection News > Text
Today AI: GPT4 Enemy Inflection-2.5 model released; Midjourney to push the Chinese version of APP; MovieLLM a sentence to generate movies
2024-03-08 10: 44 · Source: Webmaster 's House
Welcome to AI Today! Here is your guide to exploring the world of artificial intelligence every day. Every day we present hot content in the AI field for you, focusing on developers, helping you understand technology trends and innovative AI product applications.
Fresh AI products click https: / / top.aibase.com /
# 1: # 2: # 2: # 1
Similar to GPT4! InflectionAI Releases Inflection-2.5 Version Model High IQ and High EQ
【 AiBase Summary: 】
➢ Inflection -2.5 is comparable to GPT4 in performance, using only 40% of the training computation
Combine high IQ and high EQ to improve programming math skills while maintaining compassion
Support multi-platform use, with real-time network search capabilities, greatly improve user experience
Details: https: / / top.aibase.com / tool / inflection-2-5
Midjourney plans to launch China version of MidjourneyDesktopApp
【 AiBase Summary: 】
➤ Slack similar Chinese version of MidjourneyDesktopApp coming soon
The new version of the app is consistent with the official version in overall design, but differs in content organization and social functions.
✔ Add more management functions to meet local regulatory needs
Midjourneyv6 version describe feature online generated prompt words longer and more detailed
【 AiBase Summary: 】
✅  Generate longer and more detailed tips after uploading images
✅  More in line with the trend of V6 models
✅  Generate similar images from reference diagrams without using prompt words
Adobe brings generative AI technology Firefly to mobile Express apps
【 AiBase Summary ： 】
✅  Adobe Launches Firefly GAI Features on Mobile Devices
✅  Users just enter a text prompt to generate the desired image
The Express mobile app also supports video editing and social content scheduling
Firefly product portal: https: / / top.aibase.com / tool / adobe-firefly
Researchers push new AI framework CyberDemo: let robots imitate learning through visual observation
【 AiBase Summary: 】
CyberDemo has a higher success rate in various operational tasks, especially when dealing with unseen objects.
The approach of CyberDemo challenges the traditional notion of relying on real-world demonstration data, demonstrating the potential of simulated data.
CyberDemo uses simulated human demonstration data to complete real-world robot manipulation tasks, improving task performance and generalization capabilities.
Paper address https: / / arxiv.org / abs / 2402.14795
Project address: https: / / top.aibase.com / tool / cyberdemo
Meta plans to launch generative AI models by 2026 to support Reels and others
【 AiBase Summary: 】
Meta plans to launch a new AI model that will support the video content space.
The goal is to increase user referral engagement and transform into an overall ecosystem.
Phantom Meta expands the scale of the model and hopes to become a one-stop entertainment service platform.
PreviousPrevious post: AI Applications
MyShell Multilingual, Multi-Accent Text to Speech Library MeloTTS Open Source
【 AiBase Summary: 】
≫ MeloTTS supports English, Spanish, French, Chinese, Japanese and Korean.
✅ Fast generation, seconds transcription
✅ Developers are free to use and modify MeloTTS, and widget generator is extensible.
Play: https: / / top.aibase.com / tool / melotts
MovieLLM: Synthesize a movie-grade video in a word or a sentence
【 AiBase Summary: 】
The MovieLLM framework generates high-quality, movie-level video data from simple text prompts.
MovieLLM combines GPT-4 and text-to-image models to generate detailed scripts and visual content.
MovieLLM provides training materials for AI models to drive long video content generation and understanding.
Project address: https: / / top.aibase.com / tool / moviellm
NaturalSpeech3: Speech synthesis system that clones timbre and emotion
【 AiBase Summary: 】
Using neural codecs for speech waveform decomposition for nuanced speech modeling.
NaturalSpeech3 is superior to existing TTS systems in terms of quality, similarity, prosody and intelligibility.
Produce natural speech by decomposing diffusion models and excel on LibriSpeech and Ravdess benchmarks.
Website: https: / / top.aibase.com / tool / naturalspeech-3
Design2Code: Provide design drawings, let multi-modal LLM automatically generate front-end code
【 AiBase Summary: 】
Production AI has made significant progress in multi-modal understanding and code generation, bringing a new paradigm to front-end development.
The researchers conduct a systematic study of design conversion to code tasks and come up with automatic evaluation metrics.
The GPT-4V performed well and generated pages are expected to replace the original reference pages in terms of both visual and content.
Project entry: https: / / top.aibase.com / tool / design2code
— — — — — — — — — — — — — — — — — — —
Today Midjourney Tips Share: 3.8 Goddess Special
3D cartoon style rendering, A beautiful woman stands behind a tulip flower, perfect facial details and exact character details.
Panorama, large aperture, trendy fashion clothes, new trend portraits, vibrant colors, popMart production, delicate glass, clean background, 8K gradient translucent glass melt, frozen glass -- niji6
Horizontal:
Source Note: Images are generated by AI, image licensing service Midjourney
Vertical version:
Report it.
• Related recommendations
• Everyone is watching
Words everyone is searching for today:

The Beanbag Sound Reproduction Model by ByteDance supports cross-language migration, enabling the creation of culturally authentic Listening Comprehension materials for beginner-level learners with just a five-second audio sample.

Title:

Content: Home > Industry > Key words > Beanbag latest information > Text
2024 spring volcano engine FORCE power conference summary byte bean package 9 models detailed introduction
2024-05-15 17: 56 · Source: Webmaster 's House
Webmaster 's House (ChinaZ.com) May 15 news: in the 2024 spring volcano engine FORCE power conference, bytedance grandly launched the self-developed "bean bag big model" series, marking the company' s deep accumulation and innovation ability in the field of artificial intelligence.
This series of large models covers the general model Pro, lite, as well as nine models such as role-playing model, speech synthesis model, voice reproduction model, speech recognition model, Vincennes diagram model, and Function Call model, aiming to fully meet the needs of different business scenarios.
Model introduction:
• Beanbag general model pro: bytedance self-developed LLM model professional version, support 128k long text, the whole series can be refined, with stronger understanding, generation, logic and other comprehensive capabilities, suitable for Q & A, summary, creation, classification and other rich scenes;
• Universal model lite: bytedance self-developed LLM model lightweight version, which provides lower token cost and lower latency compared to the professional version, providing enterprises with flexible and economical model choice;
• Beanbag · Role Playing Model: Personalized character creation ability, stronger contextual awareness and storytelling ability to meet flexible role-playing needs;
• Beanbag · Speech synthesis model: Provide natural and vivid speech synthesis ability, good at expressing a variety of emotions, deducing a variety of scenes;
• Beanbag · Sound reproduction model: 5 seconds can achieve sound 1: 1 cloning, highly restore the timbre similarity and naturalness, support the cross-language migration of sound;
• Beanbag · Speech recognition model: higher accuracy and sensitivity, lower speech recognition delay, support for correct recognition of multiple languages;
• Beanbag · Wensheng graphic model: more accurate text understanding ability, more accurate graphic matching, more beautiful picture effect, good at the creation of Chinese cultural elements;
• Function call model: provides more accurate function recognition and parameter extraction capabilities, suitable for complex tool call scenarios;
• Beanbag · Vectorization model: Focused vector retrieval scenarios, providing core understanding for LLM knowledge base, supporting multiple languages.
Target of the Volcano Engine
Volcano Engine is committed to becoming the most open and leading cloud service platform in the AI era, helping enterprises to transform AI through full-stack AI services and stimulate business growth potential.
ByteDance polished excellent models through large usage, making large models more popular with technology-driven cost performance, and supporting customer growth through rich industry experience and algorithmic services.
This conference showed the comprehensive layout of ByteDance in the field of AI, from technological innovation to commercial landing, large model technology is providing strong momentum for the intelligent transformation of various industries.
Report it.
• Related recommendations
• Everyone is watching
Words everyone is searching for today:

How will educational institutions benefit from developing AI voice audio content for languages learners?

AI voice cloning has also been applied in education to create audio content in multiple languages, enhancing language comprehension and pronunciation skills for learners worldwide.

How will AI Voice help educators with building courses?

How will educational institutions benefit from developing AI voice audio content for languages learners?

Enhance language comprehension
Enhance pronunciation abilities

OpenAI's Voice Engine has been utilized by edtech companies to generate script voiceovers and translate user recordings, showcasing its potential in creating tailored language learning materials.

Title:

Content: ChatGPT ’ s new feature makes it possible to synthesize realistic vocals in just 15 seconds OpenAI: not available yet
Author: Au Jingluo
Published: Updated:
OpenAI has decided to postpone the release of its new software, Voice Engine, which can copy and synthesize realistic human voices in just 15 seconds of recording. OpenAI says it is too risky to release the tool now.
Voice Engine was developed in 2022 and the original version was used for the Text-to-Speech feature of ChatGPT.
However, OpenAI wants to expand it into a tool for simulating speech, copying the sounds of real people.
“We want to start a conversation about the responsible application of synthetic sound and how society responds to these new capabilities, ” OpenAI said in a blog post.“ Based on the results of small-scale testing, we will be more informed about whether and how to deploy this technology at scale. ”
A giant AI logo at the Artificial Intelligence Conference in Shanghai, China, on July 6, 2023. (Reuters)
In the article, OpenAI shares practical examples of partners trying this technology.
For example, the edtech company Age of Learning uses it to generate script voiceovers, while the AI voice company HeyGen uses user recordings to translate directly, such as using audio samples from French users to simulate users reading English.
It doesn ’ t take much variety to make a realistic simulation, and one of the demonstrations uses only 15 seconds of recording to successfully replicate.
OpenAI says it won ’ t release the technology publicly at this time because it ’ s too risky.
The company called on the community to discuss “policies to protect the use of individual voices in AI ” and“ educate the public about the capabilities and limitations of AI technology, including the possibility of fraudulent content. ”

How will AI Voice help educators with building courses?

How will educational institutions benefit from developing AI voice audio content for languages learners?

Despite its benefits, the use of AI voice cloning in education raises ethical concerns about authenticity, as the technology can blur the line between real and synthetic voices, potentially misleading students and educators.

What are some risks regarding AI voice clning?

What has the US Federal Trade Commission warned about the use of voice cloning tools?

Difficult to distinguish from human voice

Transparency is another critical issue, as AI-generated voices may be used without clear disclosure, leading to a lack of informed consent and trust among users in educational settings.

Title:

Content: Freedom Square (Beishe Review) Policy response strategy for artificial intelligence deep counterfeiting and voice copying technology
◎ Cai Yue Ting
Deep hypocrisy and voice copying are technologies that use artificial intelligence to generate fake or manipulative media that can be used for a variety of purposes, including entertainment, education, and journalism.
If it is abused for fraud and the dissemination of false information, it will damage the reputation and rights of the individual, and it will affect social order and national security.
Because there are major potential hazards, it is necessary to formulate relevant regulations and effective management, and it can promote the healthy development of this innovative industry.
Consolidating practice cases to standardize policy measures to manage deep counterfeiting and voice copying can go hand in hand with the following aspects:
I. Regulations:
The content of the bill should include: (1) clearly stipulate the legal and illegal use of deep counterfeiting and voice copying to protect personal and national security and rights; (2) establish effective enforcement mechanisms and regular amendments to ensure the effective implementation of the law and adapt to the rapid development of technology; (3) use ethics education and advocacy; and (4) specify appropriate punitive measures.
2. Technical supervision:
(1) Establish an effective enforcement mechanism, consisting of experts with professional knowledge and technical ability, to (1) supervise the development and application of deep counterfeiting and voice reproduction technology to ensure that the use of the technology complies with laws, regulations and ethical standards; (2) adhere to the principle of minimum intervention, and strike a balance between protecting personal privacy and preventing abuse; and (3) promote the sound development of the industry.
Restrictions on use: Restrictions on the use of deep counterfeiting and voice copying technologies, especially in sensitive areas such as finance, politics, law, and medicine, and where they may have a serious impact on personal privacy.
Transparency and Authentication: (1) Require developers and users of deep counterfeiting and voice copying technologies to provide transparency to ensure that users are informed and consent to the use of their data.
(2) Establish a certification mechanism to ensure that only accredited institutions and individuals can use these technologies.
(4) Technical research: Encourage research on deep counterfeiting and voice copying technologies, especially research on detecting and preventing abuse, and research on how to protect personal privacy.
Participation, use of ethics education and public awareness: to strengthen the education of the public and related industries, and to raise awareness of the potential risks of deep counterfeiting and voice copying technology.
Authorities should provide corresponding preventive measures and education and training.
The development of deep counterfeiting and voice reproduction technology has brought many potential risks, but it is also an integral part of the country ’ s sustainable development.
This industry requires the participation of multiple stakeholders, how to ensure that these technologies are used responsibly and ethically through legal, technical and educational means, and to minimize their potential hazards, to the rapid and vigorous development of the industry is a matter of urgency.
(The author is Deputy Secretary General of Beishe, Director of Research and Development of the Institute for Information Technology)
No need to smoke, no need to grab, now use the APP to watch the news, guarantee the daily winning point I download the APP
I've added friends, thank you.
Welcome to [Free Commentary]
It's a compliment. Good.
It has been praised, thank you.
Editor 's Choice

The potential misuse of AI voice cloning for creating fraudulent or manipulative content, such as falsified recordings, underscores the need for robust ethical guidelines and legal frameworks to prevent harm.

Title:

Content: US teachers dissatisfied with being fired using AI to fake racist recordings of principals in retaliation for arrest
Author: United Morning Post
Published: Updated:
A Maryland college teacher used artificial intelligence (AI) to falsify a recording of a principal criticizing Jews and blacks, causing the principal to face accusations of racism and anti-Semitism, raising concerns about AI again.
The fake recording began circulating in January of this year.
Dazhon Darien, a 31-year-old physical education teacher at Pikesville High School, was accused of falsifying the voice of principal Eric Eiswert in retaliation for a December investigation into possible misuse of school funds by Darien.
After the incident, Eswart was verbally abused and threatened, and Darien was arrested at the end of last month.
After the recording went viral, activist DeRay McKesson, who has nearly a million fans, sent a letter asking the school to fire the principal involved, but the recording was later proved to be a forgery, and McKesson admitted that he had been fooled.
Billy Burke, executive director of the union representing the principals, said: “I am concerned about the harm these actions cause. ” Attorney Schellenberg also said the Parksville incident highlighted the need to“ keep the law up to speed with technology. ”
A professor at the University of Colorado analyzed the sound and found that it contained traces of AI-generated content and human editing.
Farid, a digital forensics expert at the University of California, Berkeley, also discovered that the voice had been tampered with and stitched together by multiple recordings.
"It takes just one photo to put a specific person into a segment, and it takes just 30 seconds for a voice to replicate someone's voice," Farid said.
He also said that the current threat is not only to celebrities, but also to high school principals and children, and anyone can be vulnerable to attack.
“This AI technology affects the economy and the country as a whole. ”
This article is authorized by the United Morning Post.

What are some risks regarding AI voice clning?

AI voice cloning has been exploited for scams, such as fake ransom calls using cloned voices of loved ones, causing financial losses and emotional distress for victims.

Title:

Content: AI voice fraud is rampant, so people can ’ t prevent it.
WASHINGTON (AFP) - The voice on the phone sounded exactly the same, as a mother in the United States heard her "daughter" sobbing for help, after a man answered the phone and demanded a ransom.
Advertisement
But in fact, the girl's voice comes from artificial intelligence (AI) synthesis, and the kidnapping is certainly false.
Experts say the biggest danger of AI is blurring the lines between real and false, giving cybercriminals cheap and effective technology to spread disinformation.
A new type of fraud has rocked the US authorities, with criminals using a readily available, virtual AI voice replication tool to impersonate family members to scam loved ones.
Jennifer DeStefano, who lives in Arizona, heard the phone call go, “Help me, Mom, help me. ”
Distefano was "100%" sure it was her 15-year-old daughter who was in trouble skiing.
Di Stefano told local television in April: "The problem is not who it is, it's her voice... that's how she cries."
In a poll of 7,000 people in nine countries, including the United States, one in four said they had experienced AI voice fraud or had heard of someone else having similar experiences.
The poll, published last month by US security firm McAfee Labs, showed that 70% of respondents said they had no confidence in being able to “distinguish between real and fake voices. ”
Hany Farid, a professor at the University of California at Berkeley ’ s School of Information, told AFP: “Because it ’ s now very easy to make a high-simulation voice …
Almost no one on the internet survived.
These frauds are rife, "he said.

The technology has also been used to spread misinformation, including voter suppression schemes during elections, where cloned voices of politicians misled voters, undermining democratic processes.

Title:

Content: Moving at rapid speed, the Federal Communications Commission (FCC) has just announced its unanimous adoption of a new Declaratory Ruling finding that voice calls using artificial intelligence (AI)-generated voices fall under the Telephone Consumer Protection Act (TCPA).

The ruling takes effect immediately and gives state attorneys general powerful new tools to go after voice cloning scams. Under FCC rules, telemarketers that use robocalls subject to the TCPA are required to obtain prior express written consent from the consumer unless an exemption applies. The TCPA has always prohibited the use of both prerecorded and artificial voices but advances in AI-generated voices have prompted the FCC to specifically address their use.

In recent years, scammers and other parties have begun using AI to create fake and even "cloned" artificial voices, including those of celebrities, politicians, and even a call recipient's family member. In this election season, there has been increasing concern about the use of voice clones to engage in voter suppression schemes.

Concerned about the potential malevolent uses of these AI-generated voice calls, the FCC issued a Notice of Inquiry (NOI) in November on the topic of "Implications of Artificial Intelligence Technologies on Protecting Consumers from Unwanted Robocalls and Robotexts." In the NOI, the FCC asked questions regarding the use of "AI-influenced" technologies in robocalling. A coalition of 26 state attorneys general, as well as a telecommunication carrier trade group, strongly urged the FCC to take action to give the attorneys general clear authority to act against AI-generated robocall violators.

The FCC now has made clear that the use of voice cloning in telephone calls and texts falls within the FCC's statutory authority under the TCPA. A major intent of the ruling is to communicate that the TCPA "does not allow for any carve-out of technologies that purport to provide the equivalent of a live agent, thus preventing unscrupulous businesses from attempting to exploit any perceived ambiguity in our TCPA rules."

As FCC Chairwoman Jessica Rosenworcel explained, "with this Declaratory Ruling, we will have another tool to go after voice cloning scams and get this junk off the line."

The content of this article is intended to provide a general guide to the subject matter. Specialist advice should be sought about your specific circumstances.

What are some risks regarding AI voice clning?

Legal frameworks addressing AI voice cloning vary globally, with the United States relying on copyright and intellectual property laws that leave significant ambiguity around non-commercial uses of cloned voices.

Title:

Content: People 's Daily Online > > Economy and Technology
“AI Sun Yanzi ” deceives your ears,“ AI Change Face ” wants to trick your wallet!
May 26, 2023 11: 31 | Source: People's Daily Online
Small number
Recently, there are two hot events about AI: one is the "AI Sun Yanzi" popular network; the other is the "AI Face" scam.
Two seemingly unrelated things have caused the public to think deeply about AI double-edged sword.
"AI Sun Yanzi" explodes network copyright issue caused controversy
First of all, "AI Sun Yanzi" is definitely the hottest Chinese singer in the first half of this year, followed by "AI Zhou Jielun", "AI Lin Junjie" and "AI Wang Xinling".
Before I heard that AI can arrange music and paint, now you will find that the role of big stars on the stage, AI is equally competent.
It doesn ’ t even need to be in person, the singers ’ “new album ” is already flying around.
What the hell is going on here?
It is understood that some people use the existing human voice samples of Sun Yanzi, through AI training timbre, tone quality and pronunciation characteristics, establish its sound model, and then use the generated timbre to cover other songs, there is "AI Sun Yanzi".
This uses an open source AI speech conversion software, the original author has stopped updating and maintaining this year, but there are still many netizens independently developing new features on the current version.
The enthusiasm of netizens for the creation of virtual singers implies the recognition and pursuit of emerging technologies.
As early as ten years ago, the virtual idols represented by "Hatsune Future" and "Luo Tianyi" have gradually entered the public eye, and their voices are made from real human sound source data.
With the iterative development of technology, the "real person double" virtual singer represented by "AI Sun Yan Zi" made a shining debut, "invading" is not only everyone's "childhood memories", but also some legal ambiguity.
The new songs produced by AI sound cloning technology are very similar in sound and style to the singer himself, which has led many netizens to believe that they are true.
Is this impersonation infringing?
The scope of works protected by the Copyright Law includes written works, oral works, music and fine arts, and sound is not listed.
Therefore, the mere imitation of performers' timbre, singing skills and other characteristics, does not belong to the protection of the Copyright Law.
In addition, only on a video platform, the "AI Sun Yanzi" cover works have exceeded a thousand, among which the works of the singer Zhou Jielun's "Hair as Snow" and other works have even won more than two million views.
A number of lawyers said that the works of the virtual singer's cover show the specific song name and singer's name, which is suspected of infringing on the singer's right to name, personality, and the copyright of the song.
Even if some publishers mark the disclaimer of "entertainment only and not for commercial use" in the video, the huge traffic and economic benefits behind it are difficult to be clear, and there is no way to completely discard the infringement issue.
"AI face change" fraud attack someone 10 minutes to be cheated 4.3 million
At present, Sun Yanzi himself has responded to his own "AI version" of music.
However, the concern of netizens about the application of artificial intelligence technology has not stopped.
In May, Apple announced that it plans to embed a new feature in the new version of the software: mobile phone users who have gradually lost their ability to speak for various reasons can create a unique "personal customized voice" by recording 15 minutes of audio, and can still use the phone's call and video functions normally after losing their ability to speak.
In this regard, many users expressed concern that the technology is more likely to be used by criminals, such as through the production of fake videos and audio recordings, for the implementation of telecommunications fraud.
Such fears are not unfounded.
According to the police, not long ago a Fujian boss fell into the "high-end" fraud bureau, because of the credulous use of "AI for face" fraudsters, just 10 minutes lost 4.3 million yuan.
The rapid development of AI has brought not only "unemployment anxiety", but also a new challenge to "true and false discrimination". At present.
A number of EU countries have already begun to review the issue of artificial intelligence feeding data.
In March, foreign publishers protested against the copyrighted content used by ChatGPT in data training, demanding compensation from its company OpenAI.
In China, the regulatory system of the artificial intelligence industry is also being actively improved.
At the end of last year, the State Internet Information Office issued a document requiring that when providing in-depth synthesis services such as synthetic voices, imitation voices, face substitution, and gesture manipulation, users should be prompted to inform the edited individuals according to law and obtain their individual consent; and if the synthetic content may lead to confusion or mistaken recognition, it must be marked in a reasonable position and explain the specific information of the synthetic work.
In April this year, the State Internet Information Office drafted the "Generative Artificial Intelligence Service Management Measures (Draft for Solicitation of Comments)" to clarify the data of pre-training and optimization training, and must not contain content that infringes intellectual property rights.
Producer ： Ye Zhen
General Manager: Luo Hua
Producer ： Sun Haifeng
Producer ： Zhang Feiran
Producer ： Lu Qian
Planning: Chen Jian
Copywriter: SHEN Jiaping
Photographer: Shi Xinpei
Edited by: Wang Kun
Design: Shanshan Lin
Data collation: Liu Wenjing (intern)
Title: The Salt of Money - Your Treasure
(Editor: Shen Jiaping, Lu Qian)
Public Number ： People 's Network Finance
Share it so more people can see it.
Back to top

Japan has acknowledged the limitations of its intellectual property laws in regulating AI voice cloning, suggesting voluntary efforts by AI operators and international rule formation as potential solutions.

Title:

Content: Legal Safeguards for Intellectual Property Weak on AI; Japanese Govt Panel Notes Issues, Offers Little Remedy

The draft outline of a government panel’s interim report has acknowledged that Japan’s existing laws are limited in their ability to prevent infringements of intellectual property rights by artificial intelligence technologies. It calls on AI operators to voluntarily make efforts to protect those rights.

The outline approved Thursday by the panel tasked with discussing the protection of intellectual property rights in the era of AI also underlined the importance of providing some compensation to creators and other rights holders, but did not go as far as to call for new legislation governing AI.

Chief Cabinet Secretary Yoshimasa Hayashi touched on the issue of protecting intellectual property rights during his press conference the same day. “Additional efforts must be promoted through an appropriate combination of laws, technologies and contracts at each stage,” Hayashi said.

When instructed to imitate the painting style of a given artist, generative AI can easily produce a picture that looks like an artwork the artist might have created. Similarly, this technology can easily generate a voice by learning the voices of real-life singers and voice actors.

Creators around the world have become increasingly concerned that their rights could be infringed by AI, which can very easily learn artworks and mimic skills that human creators used their ability and effort to develop.

The draft outline explicitly states that there are instances in which current laws cannot respond to such situations. Abilities nurtured during the creation of artworks, and literary or artistic “styles” that do not lend themselves to precise definitions, fall outside what is protected under the Copyright Law, and the outline explains that the possibility of things such as the “voice” of a voice actor being protected as a form of publicity rights by the law “cannot be said to be high.”

In addition, based on moves to introduce AI regulations in Europe and the United States, the outline states that the “formation of international rules and international standardization might be necessary.”

The European Union has passed AI legislation that includes penalties for violations of AI development and operation rules, and this will start being applied in 2026. By contrast, momentum for crafting a similar legal framework in Japan has not been growing.

A Cabinet Office official said the draft outline was not intended to be a channel “for offering an opinion on creating something new, but rather something arranged based on current laws.”

Uniform measures ‘difficult’

The draft outline also suggested that creators could be protected by way of having “profits returned” in the event that their work is used for learning by AI.

Individual creators and AI operators are not on an equal footing when it comes to bargaining power. Accordingly, the outline called on these operators to establish opportunities to properly adjust and reconcile usage conditions and other details with the creators.

The Copyright Law allows the training of AI models with copyrighted material without permission from copyright holders. However, the outline said that even in these cases it would be “possible” to reach an agreement with copyright holders on providing compensation to them, and that “it could be expected” that AI operators would offer such compensation.

However, the draft outline also stated that establishing “uniform, systematic measures” would be difficult. As things stand, it will be up to operators to take it upon themselves to make efforts on this issue.

The European Union has taken a more proactive approach with the AI Act, which includes penalties for violations of AI development rules, though it does not directly address voice cloning.

Title:

Content: 【 AI Competition 】 Hong Kong Chatbot Tech Companies Are Not Afraid of ChatGPT in Cantonese + Small Language Model Win
10: 00 2023 / 11 / 04
Share:
Share:
Wu Dechuan, founder and director of science and technology in Latin America, believes that the regulations on AI technology and data privacy protection around the world are still ambiguous, and it is the biggest stumbling block to development.
Generative AI (Generative AI) ChatGPT was launched at the end of last year, and it has captured the attention of the world, and major technology companies around the world have also actively deployed it.
For Hong Kong SMEs who are already working on AI chatbot technology, is the impact of the birth of ChatGPT positive or negative?
How should we deal with the impact of the monopolization of the market by large science and technology enterprises?
【 AI Business Opportunities 】 Help YouTuber Subtitle Hong Kong Cantonese Subtitle App to Expand B2B Market
The head of Lenovo Japan ’ s Daiwa Lab insists on top-down management and calls on the team to speak up and brainstorm.
In an interview with this newspaper, Derek Wu, founder and chief technology officer of Parami, a local SME that was founded in 2018 and mainly assists companies in developing chatbot solutions, admitted that the epidemic and the emergence of ChatGPT have really brought the AI technology boom back to life and given a different life.
But the outside world is giving these technologies another chance, and all industries are becoming more valued.
He bluntly said that this is indeed a huge development opportunity for him, who has been focusing on the development of AI chatbots.
Can be used as sales teaching to accompany users to chat
However, when AI and chatbots become hot words, it will naturally become a battle for large and medium-sized enterprises. Derek believes that for traditional enterprises that are already drilling related, the pressure is certainly there.
But as long as you find the right way to fight, it ’ s no big deal.
He revealed that the company, for example, started building its own language model based on Cantonese as early as 2019.
After all, there are fewer speakers in this area.
At the same time, based on the model design of a number of different types of chatbots, in addition to being used as customer service, but also can be used in sales, teaching, accompanying users to chat, etc., "and the outside world is currently mainly developed large language models the biggest difference is that we mainly do small language models, convenient for users to customize, for specific purposes."
Derek went on to say that since large language models are like “sharing the same brain ”, they may not be suitable for businesses.
Companies have internal data and should not upload it to this head at will, otherwise it is like sharing information with others, which is equivalent to data leakage.
Therefore, the company will mainly focus on modular design to help companies customize their own models.
PHOTO Latin America partnered with the Mental Health Advisory Committee last year to launch a chatbot for people in need of emotional support. (Photo of PHOTO Latin America)
Everywhere, regulatory chaos is the biggest stumbling block.
Derek stressed that only technology companies that lack their own technology assets and only know how to use technology for trading are most vulnerable. "We have our own research and development model, and we are confident that it will not be easy to defeat."
On the contrary, the regulations of various countries and regions for AI technology and data privacy protection are still ambiguous, lack of standards, and there are many gray areas, which is the biggest stumbling block.
He refers to:
It is true that AI technology wants to be global, but the legal provisions in various markets around the world are not clear, making people feel helpless.
It has become more difficult to expand overseas markets, and I don ’ t know what to do with it. The legal risk is too high.
Therefore, at present, the company can only focus on the Hong Kong market, follow the rules of Hong Kong, and then plan to expand to the market with clearer AI regulations. "After all, they are afraid of stepping on landmines, and the retrospective period is long and the fines are high.
He also believes that it is not a good thing for the EU to put forward a draft AI Act. “After all, there are rules that will allow technology companies to have clearer and clearer guidelines during research and development. ” Therefore, Derek hopes that both Hong Kong and foreign governments should set up clearer regulations as soon as possible.
Otherwise, it will only be "two ends of the land."
Reporter: Tseng Hsiao-wen
For each episode of ET, please come to Hong Kong corporate brands to share business tips:
Open hket app and read more
Subscribe to the Hong Kong Economic Times email newsletter
Receive first-hand financial news Learn more about investment and financial knowledge Submit my consent to receive promotional messages from Hong Kong Economic Times Group. You may also check the privacy policy of this website Terms of Use
Subscribe to the Hong Kong Economic Times email newsletter
Receive first-hand financial news Learn more about investment and financial knowledge Submit my consent to receive promotional messages from Hong Kong Economic Times Group. You may also check the privacy policy of this website Terms of Use

AI voice cloning raises intellectual property concerns, particularly when replicating voices of public figures, as current laws often fail to address unauthorized use or provide proper compensation.

The U.S. Copyright Office is exploring whether AI-generated works that imitate human voices should be subject to copyright protections or other legal frameworks like publicity rights.

Title:

Content: On August 30, 2023, the U.S. Copyright Office released a Notice of Inquiry (NOI) seeking comment on the copyright law and policy issues implicated by artificial intelligence (AI) systems. Businesses whose content or publications may be used by AI systems as well as businesses that develop or deploy AI systems, particularly those involving generative AI, should consider responding to the NOI. The comments could influence the direction of future AI and copyright policy and regulation, and comments are due Wednesday, October 18, 2023.

The NOI comes alongside other federal efforts to address AI, such as the White House's Blueprint for an AI Bill of Rights, the Department of Defense's (DoD) consideration of Bills of Materials for AI products, the National Institute of Science and Technology's (NIST) AI Risk Management Framework (AI RMF), the Federal Trade Commission's (FTC) consideration of potential privacy rules, and the National Telecommunications and Information Administration's (NTIA) AI Accountability study.

In light of the rapid advancement of AI systems and technologies within the last year, the Copyright Office is seeking a better understanding of the issues at the intersection of generative AI—that is, "technology capable of producing outputs such as text, images, video, or audio (including emulating a human voice)"—and copyright protections. This NOI is the latest initiative related to the Copyright Office's involvement with generative AI.

As previously discussed, this area of law and policy remains unsettled, and copyright and AI issues are only just beginning to wind their way through federal courts. In the NOI, the Copyright Office requests comments on four main areas: the use of copyrighted works to train AI systems; the potential liability for AI-generated works that infringe on existing copyrights; the extent to which material generated using AI systems can be copyrighted; and how to treat generative AI outputs that imitate the identity or style of human artists.

Key Takeaways

  • Copyright Office Considering Whether to License Copyrighted Works to Train AI Models. The Copyright Office seeks comment on how datasets are used to train AI models, the sourcing of materials incorporated into the corpora of AI systems, and whether/how copyright owners should be compensated when their works are included in an AI system's corpus. The NOI discusses several possible licensing solutions to address compensation when an AI-generated work is found to infringe on an existing copyright.
  • Possible Generative AI Labeling Requirements on the Horizon. The Copyright Office seeks input on whether to adopt rules that require AI-generated works to be labeled/publicly identified as being generated by AI. Although there currently are no rulemakings underway to adopt labeling requirements, companies should consider the prospect of labeling requirements when assessing whether to integrate generative AI into their business models.
  • The Amount of Human Input Required to Trigger Copyright Protections Remains Unclear. The Copyright Office acknowledges that there is still considerable uncertainty about the amount of human control required to entitle a work to copyright protection and asks whether, for example, selecting the data used in a corpus is sufficient to claim authorship of the resulting output. It also goes one step further, seeking comment from the public as to whether AI-generated works should be copyrightable, and, if so, whether such works would be covered under U.S. copyright law or a separate sui generis
  • Legality of Using Generative AI to Imitate/Use the Likenesses of Artists is Murky. Using AI to mimic voices and faces of famous performers has been one of the biggest points of contention during the Screen Actors Guild-American Federation of Television and Radio Artists (SAG/AFTRA) strike due to fears that studios and record labels will use AI-generated copies in lieu of hiring and paying performers. In a timely response to this newsworthy issue, the Copyright Office notes that although personal attributes are not generally protected by copyright laws, using an artist's likeness may implicate other areas of law such as state rights of publicity, unfair competition laws, and international treaty obligations. The Copyright Office thus seeks comment on the types of legal protection that may be implicated by using AI in this manner.

The content of this article is intended to provide a general guide to the subject matter. Specialist advice should be sought about your specific circumstances.

Data privacy laws, such as China's Personal Information Protection Law, require developers to ensure transparency and obtain consent for the use of personal data in AI voice cloning.

Title:

Content: China ’ s official media warned: AI swaps to impersonate officials to increase fraud
Central News Agency
(Central News Agency reporter Zhang Shuling Shanghai 3) Chinese state media disclosed that there have been a number of AI (artificial intelligence) fraud incidents, using "face change" and sound technology to impersonate government personnel to deceive, should be highly vigilant.
This is an advertisement, please continue reading.
Xinhua News Agency's Watchful News Weekly WeChat public number issued today, saying that the police in the northern province recently released a case of "political fraud" using "AI to change faces".
The impersonation of the culprit was made by a leading cadre known to the victim.
The swindler after the "face change" suggested in the WeChat video call that his friend had a project deposit that needed to be borrowed from the public account of the victim's company.
In just over 10 minutes of communication, the victim transferred millions of yuan.
This video screen through the "face change" of the AI deceiver facial expression is natural, the voice is realistic, so the victim relaxed their vigilance, and then called to confirm after the transfer, only to know that they were cheated.
The report pointed out that some leading cadres have a relatively high probability of going to television for work reasons, which provides a wealth of facial recognition material for illegal people; in TV and radio news, many sound data of some leading cadres can also be found, which makes the "fake cost" lower.
"You only need to extract at least 10 words and at most 32 words to synthesize the sound," said Zhao Mingming, an expert in security research at the National Internet Information and Communication Industry Group.
The Tianjin Daily reported today that Zhang Xiankun, deputy dean of the School of Artificial Intelligence at Tianjin University of Science and Technology, said that "AI face changing mimicry" is not a new technology, but with the continuous development and improvement of artificial intelligence technology, especially the improvement of computer computing power, the "face changing" effect is more realistic and has been widely used in the fields of film, television, advertising and games.
The report pointed out that China's "Civil Code" and "Personal Information Protection Law" promulgated in 2020 and 2021 respectively provide for biometric information.
The “Provisions on Several Issues Concerning the Applicable Law for the Trial of Civil Cases Related to the Use of Facial Recognition Technology for Handling Personal Information ” issued by the Supreme People ’ s Court in 2021, and the“ Provisions on Deep Synthesis Management of Internet Information Services ” jointly issued by various departments in December 2022 have also been further regulated.
However, Professor Jiao Yanling of the School of Law of Tianjin Normal University believes that there are so many legal provisions that the use of AI to change faces to illegal situations is still repeated, "reflecting that the core problem is not at the legislative level, but in the implementation of the law and the awareness of citizens", and it is necessary to increase the prevention and supervision of illegal acts.
Zhang Xiankun believes that although AI face modification can now be done with fake real, but "fake is fake", through the computer can still be identified, the future should soon appear a variety of "AI face" pictures or video applications.
(Editor: Cao Yufan) 1120703
This is an advertisement, please continue reading.

The FCC mandates prior express consent for AI-generated voice calls under the Telephone Consumer Protection Act, restricting the use of voice cloning technology in telemarketing.

Ethical concerns about using AI voice cloning without consent include privacy violations, misuse of personal data, and the potential for fraud, which could undermine trust in society.

Title:

Content: Amazon Alexa reproduces the voice of friends and relatives to remember the dead or help to cheat?
Author: 01 Weekly Report
Published: Updated:
Tech giant Amazon last week hosted its annual developer conference re: MARS to introduce AI applications in machine learning, automation, robotics and space.
A short demonstration video was shown.
A child asked the Panda ’ s child-themed voice assistant, “Alexa, can grandmother continue to tell me the story of The Wizard of Oz? ” Alexa answered“ OK ” with its preset voice line, then switched to another voice that sounded closer to humans and read the plot of the Cowardly Lion seeking self-confidence.
Rohit Prasad, Alexa ’ s chief scientist, introduced at the conference that Alexa can mimic a voice line with less than a minute of recorded content: “The way we do this is by defining the problem as a speech-to-speech task, not a speech-generating path. ”
Amazon has in the past developed voice synthesis technology that allows Alexa to mimic the voice of basketball star Shaquille O ’ Neal or comedian Melissa Mccarthy.
At that time, the practice was relatively backward, requiring someone to record a large amount of audio for a long time.
In contrast, Alexa, the new voice imitation function, is said to be based on recent advances in text-to-speech technology, which can generate high-quality, like-for-like sound lines with less data.
Alexa Chief Scientist Rohit Prasad told re: MARS 2022 that the company is developing AI to reproduce the voice of the deceased family and friends, hoping to deepen the “humanity ” of the AI voice assistant. (Amazon re: MARS 2022 YouTube clip screenshot)
For example, he claims that this advancement in AI can enable consumers to maintain “lasting personal relationships ” with their deceased relatives:“ While AI cannot eliminate the pain of losing a loved one, it can definitely make memories last … There is no doubt that we are living in the golden age of AI, and our dreams and science fiction are becoming a reality. ”
After Amazon announced the latest feature of Alexa, it also caused a lot of negative reviews on the Internet, from the social media Twitter, users criticized the feature as "disturbing", "sick", or they do not want it.
As Tama Leaver, a professor of Internet studies at Curtin University in Australia, points out, the line between humans and machines is beginning to blur in such applications: “You won ’ t remember whether you ’ re talking to Amazon ’ s data collection service or to the voice of your grandparents or a deceased loved one. ”
In a way, it ’ s kind of like the story of Black Mirror. ”
Some scholars have pointed out that the use of AI to reproduce voice lines involves security and ethical issues such as fraud risk, informed consent, and ownership, and should be considered early before such technology is popularized. (Replica)
Leaver also pointed out that the new feature of Alexa has an informed consent problem in the production.
Using the data of the deceased in this way, he said, “is both creepy and unethical, because the deceased himself may not have thought that his data would be so used after death. ”
Subbarao Kambhampati, a professor of computer science at the University of Arizona, agrees: “For people who are grieving, this technology may actually help, as we look back and watch videos of the deceased.
But it also raises serious ethical questions, such as, is it okay to do this without the consent of the deceased? ”
Some scholars and experts have pointed out that AI simulation sound lines may have security and ethical issues.
In terms of security, there are concerns that this technology could be used as a fake scam.
Rachel Tobac, CEO of security firm SocialProof Security, warns that society is not prepared for the risk that this voice technology will be exploited by criminals: “If cybercriminals can easily and reliably copy another person ’ s voice with a small number of voice samples, they can use that voice sample to impersonate others, which could lead to fraud, data and account theft. ”
For more information, please read the 323 issue of Hong Kong 01 e-Weekly (27 June 2022), "Amazon Alexa Recurring the Voice of Friends and Family to Remember the Dead or Help to Cheat?".
Click here to try our weekly newsletter for more in-depth coverage.
You may be interested

To mitigate these concerns, companies like OpenAI have implemented strict policies requiring explicit consent, watermarking generated audio, and advocating for voice authentication systems.

Title:

Content: OpenAI, the creators of ChatGPT, provided a glimpse into their latest artificial intelligence (AI) innovation on Friday—a tool known as Voice Engine, capable of generating “natural-sounding speech” and mimicking human voices with remarkable accuracy. According to OpenAI’s blog post, Voice Engine can produce lifelike speech from just a single 15-second audio sample, closely resembling the original speaker.

This cutting-edge AI tool has far-reaching applications, including reading assistance, content translation, and providing a voice for individuals who are nonverbal or afflicted by speech conditions. Despite its potential benefits, OpenAI acknowledges the serious risks associated with Voice Engine, particularly in an election year.

Development of Voice Engine began in late 2022, with private testing conducted among a select group of trusted partners starting late last year. OpenAI stresses that these partners adhere to stringent usage policies, ensuring explicit consent from the original speaker and prohibiting unauthorized impersonation.

To maintain transparency, any audio generated by Voice Engine is watermarked to aid in tracing its origin. OpenAI advocates for widespread deployment of voice authentication to verify the original speaker’s consent and suggests implementing a “no-go voice list” to prevent the creation of voices resembling prominent figures.

Moreover, OpenAI recommends phasing out voice-based authentication for sensitive information access, such as bank accounts. Despite these precautions, the company remains cautious about releasing Voice Engine more broadly.

OpenAI aims to foster a dialogue on the responsible deployment of synthetic voices, considering societal adaptation to these advancements. Based on ongoing discussions and test results, the company will make informed decisions regarding the technology’s widespread deployment.

The unveiling of Voice Engine comes amid escalating concerns surrounding AI-generated deepfakes and their potential to propagate misinformation, particularly in the context of elections. As OpenAI navigates the ethical and societal implications of Voice Engine, the tech community awaits further insights into the future of this transformative AI tool.

By Impact Lab

Foreign language instructors can ensure ethical use of AI voice cloning by adhering to advanced ethical standards to prevent misinformation and maintain the integrity of educational materials.

Title:

Content: Advertisement
Technology and Science
Technical expert talks about the danger of "falsifying" sounds: "5 minutes is enough"
22-10-2023 | 23: 00
A-
A +
photos 0
A +
A-
Noufal Tonsi, sales manager at digital voice human performance services company Acapella, said on Saturday that the digital voice creation market is developing rapidly, opening up “unlimited prospects ” for developers and content makers, but warned of“ unprecedented risks ” facing society.
Advertisement
On the sidelines of GITEX 2023 in Dubai, Tonsi said that “just five minutes of pure sound recorded in someone ’ s voice is enough to create a digital version of his voice, to make it easy to make him utter any words in the same language, ” noting that“ it has become easy to use the voice of any influential or famous person to fabricate facts and spread rumors. ”
The Belgian company official added that "care must be taken in dealing with the techniques of generative artificial intelligence," noting that "voice performance professionals are at risk due to the development of digital voice generation technologies."
Tunisi stated that his company does not intend to enter the market of providing digital voice creation services to individuals, which is led largely by ElevenLabs.
He urged companies operating in this market to "adhere to an advanced level of ethical standards, to protect themselves from legal accountability on the one hand, and to prevent the dissemination of misinformation on the other."
He pointed out that "Acapella" is currently working to provide the service of simultaneous audio translation of audio clips between different languages, while maintaining the same voice and performance of the speaker.
Several major companies have entered the market for voice translation services, mainly Spotify and YouTube.
Acapella ’ s digital sounds can speak more than 30 languages, including Arabic, English, French, Turkish, Spanish and Italian, and offers a feature called Voice Smileys that provides digital sounds with the ability to express different emotions, giving a human character to manufactured sounds.
Tounsi said that Acapella has worked for 22 years to build and train its own smart models capable of delivering human performance of digital voices, to serve the goals of its customers in the marketing and promotional sectors, as well as to support people of determination who are unable to speak, to voice themselves.
He pointed out that the company's work with people of determination is the only aspect of its cooperation with individuals, explaining that the company provides the visually impaired and the blind with intelligent voice assistants through its service Infovox3, which allows the user to interact with any text appearing on his computer screen, saying that "the service reads the text aloud, and then the user can interact with his voice commands with his device."
He pointed out that "Acapella" offers its services to people with speech problems by enabling them to create a digital copy of their voice through recording audio clips with a variety of performance, so that the patient uses that copy to interact with the world naturally later.
Advertisement
Our news via your email
SIGN UP

What are some risks regarding AI voice clning?

Instructors should prioritize transparency and obtain informed consent when using AI voice cloning, ensuring that students and stakeholders are aware of its application and potential risks.

What are some risks regarding AI voice clning?

AI voice cloning technology faces limitations in accurately replicating pronunciation and emotional nuances, particularly for low proficiency learners, due to the complexity of human speech patterns.

Title:

Content: Opinions and Articles
What is deepfake technology and how does it work?
What is deepfake technology and what is its mechanism of action and the limits of its potential that can be used to fake videos, images and sounds?
# Alert your personal opinion as a specialist in the field in the last post:
Deepfake is a very dangerous artificial intelligence technique that is used in the manufacture and counterfeiting of videos, images and sounds, which can show people saying or doing things they never said or did in fact and can reach high accuracy in it with the large size of data used in the training of the quasms that the technology works on.
Let ’ s start with Voice Deepfake, also known as Voice Cloning, is an artificial intelligence technique designed to create quasmids capable of imitating the voice of a real person.
In order to do this, it must be trained on the recordings of the target person and after the completion of the training phase, the algorithm is able to produce a synthetic voice similar to the voice of the target person.
To do this, specialists use natural language processing techniques such as NLP, a machine learning technique that enables computers to interpret, process, and understand human language.
These techniques are used to identify the distinctive voice features of the voice of the target person and there are a large number of voice features that are analyzed, including the feature of pitch and low voice so that there are people characterized by high voice and others by low voice, and is also analyzed speed feature in the nature of the speech of the target person, and also of these features Cadence, which is the way the voice of the target.
Of course, to reach high accuracy, there must be huge data to train Khasmia many recordings of the target person and the easiest way to reach quick results to falsify the voice of a person is to use one of the existing Khasmia online open source and the transfer learning technology on it and train the algorithm on a simple recording can Khasmia trained high precision easily identify the voice features and imitate.
But the problem is that most of the existing algorithms yes are high precision but they have been trained on either recordings in English or classical Arabic and algorithms trained on ZD data for those who enter a section in Sudanese bicycles get what is known as data drifting and this leads me a sharp decline in the accuracy of the results of the algorithm so you will find the product section very clear that it is fake.
Good and solution?
In the case of trying to fake the voice of a person in a Sudanese dialect using the technology of transfer learning will not benefit and will not come satisfactory results so you must train Khasmia from scratch on data using too many clips for the target person and is a very cumbersome process so you find there is a Russian company that offers this service to produce clips in English to fake videos and voice me anyone but at a cost of $20,000 per minute English can cost you $100,000.
The conclusion of the personal opinion that the audio in the video is real, but the video may be an old video was installed audio and adjust the synchronization and movement of the lips using the Deepfake technology in the video I noticed in the movement of the lips of the speaker some errors in the synchronization between what is said and the movement of the lips.
with my regards,
M.M. Mohammed A.M.
Valid
Researcher and Engineer Automated Robotics and Expert Artificial Intelligence Systems
London, United Kingdom
# Cher _ in _ the _ good
A dose of awareness
# شير _ على _ معر _ مع

Deepdub, a film dubbing company, uses an AI to process voice and translate into a different language and promises to preserve what?

The lack of sufficient training data for low-resource languages further hinders the effectiveness of AI voice cloning in language education, resulting in errors in pronunciation and grammar.

Title:

Content: Artificial intelligence is flourishing all over the world, and has begun to make amazing leaps and achievements in the field of language computing, that is, the creation of software that understands and uses language, from the writing programs « Word » and its electronic proofreader, which points out errors and alerts the writer to correct them, to chatbots and artificial intelligence programs generative.
In this image from within Lelapa AI ’ s Johannesburg headquarters, some of the company ’ s employees are developing socially-based research to advance AI technology for African languages, and trying to overcome some of the problems arising from the fact that language models in smart technology are primarily trained in English, leaving many speakers of other languages outside the circle of contributing to the AI revolution.
The AI revolution has taken off from the West, leading experts in the field to fear that the language gap will exacerbate technological inequality, leaving many regions and communities far behind.
These experts believe that delaying access to good technology, even if only for a few years, could lead to a few decades of economic lag.
AI tools often err on facts, sounds, and pronunciation when working with some languages, because they are “low-resource ” languages by AI standards, meaning there are not enough data sets and content available online for an AI model to learn from.
Tens and hundreds of millions of people around the world speak “low-resource ” languages, but they produce less digital data, because the development of AI technology and online sharing is concentrated in the United States, China and Europe.
To overcome this problem, academic institutions, civic organizations and volunteer efforts are catching up to build resources for speakers of languages that are not well represented in the digital landscape.
Johannesburg based Lelapa AI is one such company that is leading efforts on the African continent in particular.
Although it is a startup, it is developing multilingual AI products for people and businesses in Africa.
(Photo courtesy of the New York Times)

Despite these challenges, AI voice cloning offers a promising solution for creating tailored Listening Comprehension materials for ILR 1 - 1+ levels, enhancing accessibility and engagement in language learning.

How will educational institutions benefit from developing AI voice audio content for languages learners?

Enhance language comprehension
Respond to different learning demands

To maintain ethical and legal compliance, it is essential to implement robust data privacy protocols, including encryption and restricted access controls, to safeguard sensitive information during AI training and deployment.

Title:

Content: The integration of AI & ML tools in education

x

Artificial Intelligence courses: Developing tomorrow’s leaders

Highlights

Artificial Intelligence (AI) and Machine Learning (ML) aren’t just making waves in Silicon Valley; they’re knocking on the doors of our classrooms too.

Artificial Intelligence (AI) and Machine Learning (ML) aren’t just making waves in Silicon Valley; they’re knocking on the doors of our classrooms too. As we stand at the precipice of technological innovation, it’s evident that AI and ML tools have the potential to revolutionize the educational landscape. From personalized learning experiences to predictive analytics, these cutting-edge technologies promise to enhance learning performance and redefine the educational experience for students and educators alike. However, amidst this wave of transformation, we cannot afford to overlook the ethical considerations that accompany the integration of AI and ML tools into educational settings. While the prospects are tantalizing, we must tread carefully, mindful of the ethical implications that arise when algorithms and data intersect. Let’s look at these implications closely:

Bias and Discrimination: Challenging the Status Quo

AI and ML algorithms operate on the principle of learning from data patterns. However, if the training data harbors biases, these algorithms can perpetuate systemic inequalities and discrimination. Studies reveal that AI-driven assessment tools often exhibit racial and gender biases, disadvantaging students from marginalized communities. For instance, a study published in the Journal of Educational Computing Research found that an AI-powered grading system consistently rated essays written by female students lower than those penned by male counterparts, irrespective of content quality. Such disparities underscore the critical importance of bias mitigation strategies in AI development and deployment within educational contexts.

Data Privacy: Safeguarding Educational Assets

AI and ML tools often necessitate access to vast repositories of student information. Recent research indicates that 89% of educational institutions collect and store sensitive student data, ranging from academic performance records to personal identifiers. Ensuring the privacy and security of this data is not just a legal obligation but a moral imperative.

Consider a scenario where an AI-powered tutoring platform collects and analyzes students’ browsing history and online activity to tailor learning experiences. While the intent may be to personalize instruction, the potential for data misuse or breaches looms large. According to a survey, only 25% of educators feel adequately trained in data privacy practices, highlighting the urgent need for comprehensive privacy protocols in educational AI implementations.

Navigating Ethical Considerations for Responsible Implementation

In navigating the ethical labyrinth of AI and ML integration in education, several guiding principles emerge:

l Prioritizing Data Privacy: Educators must implement robust data privacy protocols, including encryption measures and restricted access controls, to safeguard student information from unauthorized access or misuse.

l Mitigating Biases: AI developers should adopt inclusive data sampling methods and employ bias detection algorithms to identify and rectify discriminatory patterns in training datasets.

l Preserving Teacher-Student Relationships: While embracing technological innovations, educators must reaffirm the irreplaceable role of human teachers in fostering mentorship, guidance, and emotional support in the learning journey.

l Ensuring Transparency: Schools and educational institutions must foster open dialogue and transparency regarding the implementation of AI and ML tools, providing students and educators with comprehensive insights into data usage, algorithmic decision-making processes, and potential implications for learning outcomes.

Show Full Article
Print Article
Next Story
More Stories
ADVERTISEMENT
ADVERTISEMENTS

Organizations should adopt ethical guidelines emphasizing accountability, transparency, and human oversight in AI applications to prevent biases and protect privacy rights.

Title:

Content: PCPD releases AI guidelines for reference by major organisations to enhance privacy protection
Author: Huang Yongyu
Published: Updated:
With the growing popularity of artificial intelligence applications, the PCPD today (18 September) released the "Guidelines on Ethical Standards for the Development and Use of Artificial Intelligence", which put forward a number of recommendations on ethical principles and practical practices for reference by organizations.
Privacy Commissioner Chung Li-ling believes that the development potential of artificial intelligence is large, but the risks can not be ignored. As for whether to legislate and regulate this, she believes that there is still controversy, and there is no urgency to legislate at present.
The use of artificial intelligence (AI) in Hong Kong is becoming more widespread, and moral risks cannot be ignored, said the Privacy Commissioner, Ms Raymond Chung. (photo by Mr Leung Peng-wai)
CHUNG Lai-ling: Moral risks of face and voice recognition cannot be ignored
The Office of the Privacy Commissioner, Ms. Chung Lai-ling, said that the growing popularity of AI applications in Hong Kong, including facial recognition, voice recognition, chatbots, and other privacy and ethical risks involved, should not be overlooked.
She also said that she hoped that the guidelines would tie in with the Guangdong-Hong Kong-Macao Greater Bay Area Development Plan to promote Hong Kong as a regional innovation and technology center and a world-class smart city.
Director of Global Affairs and Research, Mr Cheung Hin-chung, said the practical guidelines covered four main areas. (photo by Mr Leung Peng-wai)
The Guidelines cover seven principles and four areas
The Guidelines list seven ethical principles for AI, including accountability, fairness, transparency and interpretability, and data privacy.
As for practical operations, Director of Global Affairs and Research, Mr Cheung Hin-chung, noted that the Practice Guidelines cover four main areas, namely, formulation of AI strategy and governance, risk assessment and human oversight, implementation of AI model development and management of AI systems, and facilitation of communication and communication with stakeholders.
As for whether to legislate on this issue, Chung Lai-ling believes that it is still controversial, and there is no relevant urgency at present. (photo by Liang Peng-wei)
Corporate misconduct may violate the Privacy Ordinance even though it is not regulated by legislation
For whether this legislation will be enacted, Chung Li-ling believes that there is still controversy, bluntly speaking, even in Europe, different governments have different practices, at present, there is no legislative regulation of the impactness, describing the development potential of artificial intelligence, "What is regulation?
Where does regulation go?
There is no consensus in society, and we will continue to pay attention to the development of other countries in the future.
Ms Chung added that although there were no penalties attached to the guidelines, if enterprises did not comply with the guidelines, the PCPD would also decide whether an investigation should be conducted depending on the actual situation.
The PCPD today (18th) released the "Guidelines on Ethical Standards for the Development and Use of Artificial Intelligence" (photo by Leung Peng-wai)
CLP and HK Electric customer information systems comply with international standards
The amendment to the Personal Data (Privacy) Ordinance is now being scrutinized by the Legislative Council. Ms Chung said that once it is passed, the PCPD will implement it immediately, and I believe it can respond to the public's demands and strengthen the protection of privacy.
In addition, the PCPD today issued an inspection report on the customer personal data systems of CLP and HK Electric, concluding that the security measures of the two companies' customer personal data systems comply with international standards. However, the PCPD recommended that the two companies update their internal systems to track the complete digital footprint of their employees so as to effectively detect any misuse of personal data.
Leave a comment...

What are some risks regarding AI voice clning?

Future trends in AI voice cloning include advancements in multilingual capabilities, enabling the creation of localized and accessible language education materials tailored to diverse learners' needs.

How will AI Voice help educators with building courses?

How will educational institutions benefit from developing AI voice audio content for languages learners?

Enhance language comprehension
Respond to different learning demands

Innovative platforms like Loora are leveraging voice-based AI to provide personalized conversational language learning, focusing on improving pronunciation and fluency for low-proficiency learners.

Title:

Content: Loora, an AI-driven language learning startup focused on English, has emerged from stealth to announce $9.25 million in seed funding. The company aims to improve users' conversational English skills regardless of subject matter, using voice-based interactions with its eponymous iOS assistant.

Unlike typical generative AI apps, which are mostly text-based, Loora emphasizes audio. Users interact with the app as they would with a personal human tutor. Its AI tutor can understand and help refine any user's English and accent across a wide range of topics.

Emerge led the funding round, joined by Two Lanterns Venture Partners, Kaedan Capital, and several angel investors. Tel Aviv-based Loora was founded in 2020 by CEO Roy Mor and CTO Yonti Levin. They decided to focus on English language tuition due to its global prevalence, with over 1 billion learners worldwide.

Despite the numerous existing online language learning platforms, Mor and Levin found a gap in teaching conversational English in a one-to-one environment. Traditional language learning apps – such as Duolingo, Memrise, and Babel – are great for casual learners, but inadequate for those seeking to work in English. Human tutors offer a more personalized approach, but can be expensive and inaccessible to many.

Taking advantage of recent advancements in generative AI (like those used in OpenAI's ChatGPT and the Midjourney illustrator), Loora has developed an English tutor that engages in interactive conversations, offers discussion prompts, and understands users' speech to guide their improvements. Initially, Loora created its own large language models (LLMs) in 2020, but has since transitioned to utilizing multiple third-party LLMs, each suited for different tasks. The company trains these LLMs on its own data.

Loora's main focus is on spoken English and requires users to have some prior knowledge of the language. Although the platform does not cover reading or writing, an upcoming module will introduce reading texts as conversational anchors. Therefore, if users aim to master English, they may need to supplement their learning with other sources. Regardless, Loora's approach marks an interesting advancement in the field, with potential future implications for audio interfaces in generative AI services.

Incorporating voice-based learning experiences in the language learning domain is crucial to improve pronunciation and fluency. As the no-code and low-code movement accelerates the development of tech solutions, innovative platforms like AppMaster.io can facilitate the creation of ground-breaking applications and tools for various sectors, including language learning.

The investment by Emerge, Two Lanterns Venture Partners, and Kaedan Capital is a testament to Loora's potential to revolutionize virtual English education through its domain-specific AI tutor. It will be interesting to see how this voice-driven approach shapes the future of language learning and other generative AI applications.

How will educational institutions benefit from developing AI voice audio content for languages learners?