"Voice cloning technology, such as VALL-E 2, can generate realistic speech with just a few seconds of audio recording, posing both exciting opportunities and concerns about its potential misuse."

"Voice cloning technology, such as VALL-E 2, has raised concerns due to its ability to generate highly realistic speech that can be used for malicious purposes, including scams and misinformation."

"Voice cloning technology, like VALL-E 2, has the potential for fraud and abuse, such as impersonating individuals or creating fake voice identifications, leading its creators to restrict public access."

VALL-E 2, a new AI speech generator, can clone voices realistically with just a few seconds of audio, reaching human parity and raising concerns about potential misuse.

"Amnix International is based in the United Arab Emirates, Dubai."

"Voice cloning technology, such as VALL-E 2, has the potential to be used for malicious purposes, including scams and impersonation, due to its ability to generate highly realistic and convincing speech in the voice of a particular person."

The technology used to create synthetic voices is based on neural networks, as demonstrated by Microsoft's VALL-E 2, which can clone voices with high quality and has surpassed previous text-to-speech systems.

Individuals can protect themselves from voice cloning scams by being cautious of unusual audio content, verifying authenticity, and understanding the capabilities and limitations of voice cloning technology.

Microsoft's VALL-E neural network can accurately simulate human voices after listening for just three seconds, raising potential applications and concerns in areas like entertainment, accessibility, and scams.

The AI voice cloning tool by ElevenLabs can clone voices with just a three-second sample clip.

A potential misuse of AI voice clones, as warned by law enforcement, is using them to extort money from loved ones over the phone.

"Voice cloning technology, such as VALL-E 2, can generate realistic speech with just a few seconds of audio recording, posing both exciting opportunities and concerns about its potential misuse."

Title:

Content: What we know about Vall-E 2
According to these claims, Microsoft has developed a new artificial intelligence speech generator that is so adept that it can do more harm than good.
VALL-E 2 voices the text with the voice of a particular person, for which he needs only a few seconds of audio recording of the speech of this person.
Midjourney artificial intelligence has its own version of who is the president of the United States, and it ’ s not Biden
Microsoft researchers said that VALL-E 2 "has reached human parity."
It is capable of generating "accurate, natural speech by the voice of the original announcer, which can be compared to a human voice."
In other words, the new AI voice generator is convincing enough to be mistaken for a living person.
This opens up potentially dangerous opportunities for unscrupulous people.
VALL-E 2 is the latest achievement in speech models of neural codecs and marks an important milestone in text-to-speech (TTS) synthesis.
[...] VALL-E 2 consistently synthesizes high-quality speech, even for sentences that traditionally cause difficulties due to their complexity or repetitive phrases,
The developers write.
We ’ ve already seen examples of neural networks that are able to clone voices based on a multi-second recording, but Microsoft says its technology is superior to anything that has been on the market so far.
"Our experiments conducted on the LibriSpeech and VCTK datasets have shown that the VALL-E 2 is superior to previous TTS-systems [...] in reliability, naturalness and similarity to the speakers.
This is the first of its kind system that has reached parity with a person on these indicators, ” the article says.
The quality of the VALL-E 2 results depends on the length and quality of the speech prompts, as well as environmental factors such as background noise.
See also Google allows you to make your own copy of a celebrity to chat with her in a chatbot
What happens next with the technology
Despite its capabilities, Microsoft will not release VALL-E 2 to the public due to potential abuse risks.
Recently, we have seen a wave of fraud – both at the level of ordinary users, who are deceived by fraudsters, forging the voice of their relatives or friends, and at the level of state leaders who “call ” their voters, and celebrities who allegedly advertise cryptocurrencies and various fraudulent schemes in advertising.
VALL-E 2 is a research project.
We do not plan to include VALL-E 2 in the product or expand access to it for the public.
This may carry potential risks of abuse of the model, such as faking voice identification or impersonating a particular speaker,
The creators of the technology write.
But they suggest that artificial intelligence technology may find practical applications in the future.
VALL-E 2 can synthesize a language that retains the identity of the speaker, and can be used for educational training, entertainment, journalism, author content, accessibility features, interactive voice response systems, translation, chatbots, and more.
But to do this, you need to add a special protective protocol that will ensure that the speaker approves the use of his voice.

What are some risks regarding AI voice clning?

What is necessary for voice cloning to work?

"Voice cloning technology, such as VALL-E 2, has raised concerns due to its ability to generate highly realistic speech that can be used for malicious purposes, including scams and misinformation."

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

"Voice cloning technology, like VALL-E 2, has the potential for fraud and abuse, such as impersonating individuals or creating fake voice identifications, leading its creators to restrict public access."

What are some risks regarding AI voice clning?

VALL-E 2, a new AI speech generator, can clone voices realistically with just a few seconds of audio, reaching human parity and raising concerns about potential misuse.

What are some risks regarding AI voice clning?

What is necessary for voice cloning to work?

"Amnix International is based in the United Arab Emirates, Dubai."

Title:

Content: United Arab Emirates, Dubai: AMNX International, a leader in integrated digital solutions and services, is launching innovative content-generating AI solutions – an advanced technology that integrates the potential of content-generating AI and conversational AI together.
The innovative solutions combine artificial intelligence, machine learning and natural language processing, enabling them to enhance operational efficiency and pave the way for the future where intelligent systems can evolve and innovate on their own.
It is noteworthy that the artificial intelligence for conversation is developed through a writing platform that does not need programming codes, and allows mutual communication between humans and applications in a way that achieves continuous improvement in the performance and knowledge of the virtual assistant.
The solutions are also equipped with advanced capabilities that allow them to discern purpose, derive context, and identify emotions – which means achieving a unique conversational experience.
Conversational AI technologies excel in knowledge, vision, search and voice processing, and these features allow for intelligent recommendations, accurate search and image recognition with high levels of accuracy, as well as voice-based verification.
These technologies can seamlessly integrate with robotic process automation platforms and APIs, allowing for precise communication with core business applications.
The combination of conversational AI and content-generated AI enhances the ability of conversational AI to give more diverse answers closer to natural response.
Content-generated AI technologies include systems that can create new content based on the patterns it learns from structured and non-structured data, so that these models provide answers that mimic human language, understand context, and formulate coherent texts related to the topic.
By using content-generating AI within a conversational AI framework, systems can better understand the finer aspects of language, maintain the interconnected context during the conversation, and provide more interactive and human-like answers.
This integration enables conversational AI to more effectively simulate natural dialogues and meet the needs of a wide range of users across various applications.
Walid Juma, CEO, Amkins International, said: “Our generative conversation AI solutions represent a powerful combination of cutting-edge technologies that aim to revolutionize organizational interactions.
It serves as an engine for NLP that supports more than 45 languages, meaning it will play a crucial role in the field of intelligent virtual assistant.
These solutions are a testament to our mission to boost productivity and achieve organisational satisfaction in the transformation journey. ”
Organizations will be able to significantly improve their interaction with users, enhance efficiency, accuracy, and save time and cost by leveraging dialogue automation powered by the potential of content-generating AI.
This integration allows answers to be generated automatically for a wide range of situations and forms, making it easier to handle common questions and reducing the need for manual handling or training.
In the field of human resources, conversational AI can facilitate the process of recruiting and training new employees, as well as conducting surveys.
It improves IT support office operations and boosts sales by improving customer relationship management capabilities and product visualizations.
It can transform administrative and financial processes by simplifying expense handling, invoice processing and detailed reporting.
Amid rapid changes in organizational efficiency, AMNX International renews its commitment to empowering organizations in the digital transformation journey, a commitment that is reflected in the delivery of practical solutions that redefine operational standards.
Prioritizing productivity and user satisfaction supports AMNX International ’ s drive to streamline operations and achieve success across industries.
# Company Data
- Done.

"Voice cloning technology, such as VALL-E 2, has the potential to be used for malicious purposes, including scams and impersonation, due to its ability to generate highly realistic and convincing speech in the voice of a particular person."

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

The technology used to create synthetic voices is based on neural networks, as demonstrated by Microsoft's VALL-E 2, which can clone voices with high quality and has surpassed previous text-to-speech systems.

Individuals can protect themselves from voice cloning scams by being cautious of unusual audio content, verifying authenticity, and understanding the capabilities and limitations of voice cloning technology.

Title:

Content: Technology

AI-enabled scams will proliferate

Ultra-realistic digital trickery will help fraudsters deceive people on an entirely new scale

Jeff Clune is an associate professor of computer science at the University of British Columbia and Canada CIFAR AI Chair at the Vector Institute.

(This illustration was created by Maclean’s art director Anna Minzhulina using the generative AI image program Imagine. Minzhulina spent weeks feeding prompts into the program, inspired by the essay.)

Money-grabbing scams have been happening for longer than we can remember: con artistry, Ponzi schemes, online phishing, even snail mail gambits. But the advent of more sophisticated artificial intelligence will soon make these tricks far more common, complex and convincing. Knowing who or what to trust online is about to get much more challenging—and we had better be prepared.

Photographs and videos used to be one way of verifying if things are true. Now, AI programs have opened the door to forms of scamming that are much harder to detect. Criminals can simply use software like Midjourney or DALL-E 2 to generate any kind of realistic photos. AI can also mimic someone’s voice, and soon AI-generated videos will be able to clone their appearances and facial expressions too. There are already deepfakes of Elon Musk telling people to invest their money in crypto, Tucker Carlson promoting new trading platforms and Ron DeSantis appearing in an episode of The Office as Michael Scott. We are losing our core methods of verification in ways most of us could not even have imagined just three years ago.

We have to prepare to face elaborate scams that take advantage of our trust. Picture this: in the near future, you might receive a video call from a family member who is asking for money because they are in a tight spot. It probably would not seem possible that you are talking to a deepfake, but this type of trickery—though still rare—is already spreading. Scammers can easily find existing videos or podcasts of somebody online and train an AI on that voice and facial expressions to create an uncanny resemblance. Because it is already possible to imitate my voice on a voice call, I have created a secret password for my family so we can verify each others’ identity if we ever get suspicious of each other over the phone.

The quantity of AI scams will also increase. Back in the ’80s, people would occasionally receive spam letters in snail mail, but those attempts were few and far between because con artists did not want to pay for paper and postage. Email removed the cost of sending mail, and the number of attempted scams skyrocketed. Just like email did a few decades ago, AI is making scamming far easier and cheaper. This could enable disruptive levels of manipulation in the near future. Rather than spending hours trying to defraud one person or paying 1,000 scam employees to work 40-hour weeks, a single scammer could train an AI model to deceive 100 million people simultaneously.

AI-generated, human-sounding robo-calls will contact millions of people at once. Instead of listening to a recorded message, the person will carry on a back-and-forth conversation without realizing the person on the other end of the line is not human. AI scammers will impersonate police officers or civil servants and ask for donations to certain charities, for example. Such scams will also be politically motivated—like an AI calling every Canadian to feed them false information about a political figure, or dictators flooding information channels with fake videos, comments, likes and emojis that subtly, yet relentlessly, repeat the party line. Criminals will wield AI to disrupt finance markets by pumping up worthless penny stocks or driving down the value of other stocks with fake news.

For now, scammers still need to be tech-savvy to create powerful AI-driven schemes. But in technology, what is hard now will be easy soon. As we develop better and more user-friendly AI software, a 12-year-old kid might be able to orchestrate a worldwide phishing attempt from his or her bedroom. Once it becomes cheap, quick and easy to program something that is convincingly human, we are in trouble. It will become incredibly difficult to know which information is trustworthy. Unless we invent technological and sociological solutions to these problems, I am afraid that we will soon not be able to trust most of what we see online, and that makes me deeply concerned about the future of our information landscape.

As we prepare for AI scams to proliferate, the best advice I can offer is for people to seek out and hold onto the sources they trust most—whether that is the New York Times or a particular reporter. But even then they must make sure they are in fact getting information from that source. We can also protect ourselves from scams by better understanding what technology can and cannot do. From now on, we should always second-guess what we see in text, websites and photos. Deepfakes are still rare, and most videos are trustworthy, but that will likely change. If a video seems surprising, do an independent search to see if people are reporting that it is fake. And if you have been scammed, tell others how it happened, so that they do not also fall prey.

Scams work best when they pull on heartstrings—and humans tend to relate and respond to other humans, especially those they know and trust. The better AI can impersonate a flesh-and-blood person, the more turmoil we can expect. As the cost of deception slides towards zero, we will need to build our individual and societal immune systems to handle an army of new threats. As in the real world, an ounce of prevention is worth a pound of cure. The best vaccination for scams is knowledge and a sizable dose of skepticism.

We reached out to Canada’s top AI thinkers in fields like ethics, health and computer science and asked them to predict where AI will take us in the coming years, for better or worse. The results may sound like science fiction—but they’re coming at you sooner than you think. To stay ahead of it all, read the other essays that make up our AI cover story, which was published in the November 2023 issue of Maclean’s.

Looking for more?

Get the Best of Maclean's sent straight to your inbox. Sign up for news, commentary and analysis.
FILED UNDER:

Microsoft's VALL-E neural network can accurately simulate human voices after listening for just three seconds, raising potential applications and concerns in areas like entertainment, accessibility, and scams.

Title:

Content: • Text size
News feed
Today, 14: 37
418
Today, 14: 37
418
Photo: en.oxu.az
“Fraudsters will be able to call the voice of your mother ”: Microsoft has created a new neural network
Microsoft has introduced a new project in the field of artificial intelligence.
The development called VALL-E can very accurately simulate any human voice, after listening to it for only three seconds, BaigeNews.kz reports with reference to IChip.
Moreover, artificial intelligence is able to imitate a person while preserving both the timbre and the emotional coloring of his voice.
Positioned as a language model of the neural codec development relies on EnCodec technology.
VALL-E was taught at the LibriLight library, which contains about 60,000 hours of speech received from more than 7,000 people.
However, for now this is all exclusively speech in English, so domestic telephone fraudsters will still have to wait before launching a mass call to residents of the post-Soviet space.
Subscribe to our Telegram channel and get the news first!
Share:
Partners news:
Back to top

What is necessary for voice cloning to work?

The AI voice cloning tool by ElevenLabs can clone voices with just a three-second sample clip.

Title:

Content: Language No Barrier: New AI tool can clone voice and make it say anything in multiple languages

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

Mehul Reuben Das May 03, 2023 13:42:20 IST

Imagine former US President Donald Trump speaking in flawless Hindi. A new AI voice cloning tool by ElevenLabs can clone voices and make them say anything in a bunch of different languages. All it needs is a three-second sample clip and a bit of text as the prompt.

As advanced as AI-based voice cloning has been, there were a few limitations to it. For example, voice generators were mainly bound by the language of the source they were trained in or rather the language of the prompt that was given to them. Now, ElevenLabs, an American AI software developing company has come up with a tool that does away with that limitation.

ElevenLabs’ new AI tool can clone the voice of a person and make it say anything in a bunch of different languages. All it needs is a clear voice sample of about 3 seconds, although it also suggests that the longer the sample, the better will be the results. The new tool even manages to maintain the speaker’s original tone of voice.

Limitless possibilities
The creators expect that this would ‘extend the possibilities’ in a variety of industries such as publishing, gaming creation, and media. “Introducing Eleven Multilingual v1: Our New Speech Synthesis Model! We’re thrilled to launch our new model supporting seven new languages: French, German, Hindi, Italian, Polish, Portuguese, and Spanish.”

“This advancement expands the horizons for creators, game developers, and publishers, and it paves the way for using generative media to create more localized, accessible, and imaginative content,” the company said.

Following the announcement, Twitter was flooded with comments, with users testing the software on various famous faces.

To demonstrate just how capable the new voice cloning AI tool is, Eluna AI, a platform for AI-content creators experimented with a sample clip of former US President Donald Trump.

In their demo, Eluna AI showcased a small clip of Donald Trump, speaking in his native tongue, English, followed by French, Spanish, German, Hindi and Italian, almost perfectly. The generated samples even gets the accent right, almost if he was a native speaker of the new target language.

Another user changed David Attenborough’s voice to German while the BBC broadcaster discussed the prospects of AI. “With this tool, anyone can do it,” stated the Twitter user. “It’s also worth noting that fraudsters will undoubtedly exploit this one.”

ElevenLabs says that its model was designed to understand the emotion and reasoning underlying words in order to produce natural-sounding and persuasive audio. ElevenLabs has said that some numerals and symbols are currently spoken wrongly, but that it is striving to rectify this.

Who is this new tool meant to help?
The US-based company believes its technology will be valuable in a variety of areas, including education and journalism.

Game developers and publishers can build engaging, localised experiences for worldwide audiences, breaking through language barriers and connecting with players and listeners to maximise engagement and efficiency while maintaining quality and accuracy.

“Educational institutions now have the ability to develop audio content for varied users in their target languages, enhancing language comprehension and even pronunciation abilities, as well as responding to different teaching methods and learning demands,” says the report.

Because of the model’s capacity to produce unique character-like voices, audiobook and content developers may also find it beneficial.

The conundrum of AI voice genertors
Despite its benefits, ElevenLabs’ launch comes amid widespread concern about the wave of new voice cloning technology. An unidentified TikTok user went popular last month after sharing an AI-generated Drake song starring The Weeknd.

It sparked concerns about the grey area of AI-created music and whether it constitutes a copyright violation. Nonetheless, ElevenLabs claims to be ‘fully committed’ to respecting creators’ rights in the midst of technological advancements.

“At Eleven, we think that we should seek to make the best use of emerging technology, but not at any expense,” it stated.

“As we create them, we make every effort to put suitable controls in place that reduce the possibility of detrimental abuse. With this in mind, we are entirely committed to both protecting intellectual property rights and taking action against infringement.”

Read all the Latest NewsTrending NewsCricket NewsBollywood News,
India News and Entertainment News here. Follow us on FacebookTwitter and Instagram.

Updated Date:

also read

World

Music labels are worried because of AI, thanks to a surprising new song ft. Drake X The Weeknd

Someone used AI to create a whole new song featuring Drake and The Weeknd. But because the singers never sang the song, artists and music labels are worried, how AI voice modulation and AI-generated songs can disrupt the industry.

World

Artificial Imposter: 47% of Indian phone users have experienced AI voice scams, highest in the world

About half of Indian adults, or 47%, have experienced AI voice scams, nearly double the global average of 25%. Furthermore, nearly 69% of adults say they can't differentiate between a real and an AI-generated voice.

What company created an AI tool that could mimic the voices of deceased movie stars?

What is necessary for voice cloning to work?

A potential misuse of AI voice clones, as warned by law enforcement, is using them to extort money from loved ones over the phone.

Title:

Content: OpenAI's Johansson gaffe pushes voice cloning into spotlight

Law enforcement warned that AI clones could be used to extort money from loved ones over the phone

By AFP

  • Follow us on

Scarlett Johansson voiced an AI character in the film "Her". — Reuters file

Published: Mon 27 May 2024, 7:51 PM

Last updated: Mon 27 May 2024, 7:52 PM

OpenAI was forced to apologise to actor Scarlett Johansson last week for using her voice -- or something very similar -- on its latest chatbot, throwing the spotlight on to voice-cloning tech.

Although OpenAI denied the voice they used was Johansson's, their case was not helped by CEO Sam Altman flagging the new model with a one-word message on social media -- "Her".

Johansson voiced an AI character in the film "Her", which Altman has previously said is his favourite film about the technology.

Right from the start, AI voice cloning has proved problematic.

Last year, British firm Elevenlabs went viral for all the wrong reasons when it released its voice-cloning software.

Internet pranksters immediately began pushing out deepfaked celebrities -- Harry Potter star Emma Watson was shown reading Hitler's Mein Kampf.

Law enforcement warned that AI clones could be used to extort money from loved ones over the phone.

The technology has developed rapidly in the past year becoming far more realistic and nuanced.

Danish entrepreneur Victor Riparbelli, CEO of British AI firm Synthesia, told AFP it was largely down to a program called Tortoise that was released two years ago.

The program's developers threw thousands of hours of voice data into their model in an unstructured way and discovered it not only learnt what to say but how to say it.

"That was a pretty big paradigm shift," Riparbelli said on the sidelines of last week's VivaTech conference in Paris.

Tortoise was an open source program and Elevenlabs was the first to go to market using it.

OpenAI uses similar systems though they do not release any details.

Much of the controversy around voice cloning has focused on concerns over people misusing the software.

But the claim against OpenAI is unusual because it is the company itself accused of playing fast and loose.

"It was very unfortunate that OpenAI did that -- really not very good," Katya Laine, CEO of TALKR.ai, told AFP at VivaTech.

"If they actually cloned her voice without her knowing then I think that's very very bad," said Riparbelli.

The two entrepreneurs are among hundreds harnessing AI voice programs for uses that they argue will make companies more efficient.

Laine's firm provides virtual voice assistants -- essentially AI customer service agents.

She said her firm's system could now resolve 25 to 30 percent of calls without any human involvement.

Synthesia specialises in video avatars, which Riparbelli said allowed any office worker to turn text or slides into a video performed by a realistic AI.

Both Riparbelli and Laine allow their clients to use their own avatars, off-the-shelf products or those supplied by the likes of OpenAI and Elevenlabs.

Riparbelli said Synthesia used actors whose likenesses and voices were licensed for two years with an option to renew after the initial period.

The problems arise if actors' voices are used without their consent.

The fiasco overshadowed a developer conference in Paris last week when OpenAI was showing off a suite of new tools.

In front of a big screen in an auditorium, Romain Huet, OpenAI's Head of Developer Experience, breezily chatted into his phone.

Seconds later, his short voice sample had been processed and could be heard commentating over a generated video -- in five languages.

The demonstration showed how quickly the field is moving, but the headlines had already been written.

The Washington Post asked in a newsletter "How dumb is OpenAI?", other commentators were suggesting wunderkind Altman was nothing more than a huckster.

Nonetheless, Riparbelli was open to OpenAI's argument that they had used another actor who just sounded liked Johansson.

"If it's not her but someone who sounds a lot like her... where do you draw that line," Riparbelli asked.

"If they're not allowed to use someone who sounds a lot like her, then it sets a very odd precedent."

More news from World