Voice cloning technology is a rapidly advancing field that enables the creation of highly realistic and accessible replicas of human voices, raising both excitement and concern about its potential applications and implications.

This technology is developed using artificial intelligence and machine learning algorithms that can study a short sample of someone's voice and create a model that can replicate it.

The technology has various uses, including entertainment, accessibility, and unfortunately, scams, with scammers using voice clones to target businesses and individuals.

For instance, voice clones can be used to create fake kidnapping calls demanding ransoms, as reported by CNN, where a caller used AI to copy a mother's voice.

The legal implications of voice cloning technology are significant, with concerns about privacy, consent, and potential misuse, as highlighted by FTC Chair Lina Khan, who warned that AI tools are "turbocharging" scams.

Real-world examples of voice cloning technology include its use in films, such as "Her", and in chatbots, like Replika, which allows users to create avatars and interact with them.

However, the technology also raises ethical challenges, such as the potential for misuse and the need for guidelines to ensure its responsible application.

According to experts, the technology is still in its early stages, and its development and use require careful consideration of the potential risks and benefits.

As the technology continues to evolve, it is essential to address the ethical and legal implications to ensure that its benefits are realized while minimizing its risks.

Voice cloning technology is a rapidly advancing field that enables the creation of highly realistic and accessible replicas of human voices, raising both excitement and concern about its potential applications and implications.

Title:

Content: © 2024
NPR for Northern Colorado
Play Live Radio
Next Up:
0:00
0:00
0:00 0:00
Available On Air Stations

The government announced winners of a contest to tell real voices from deepfake audio

The federal government is trying to promote efforts to counter so-called audio deepfakes by awarding four organizations prizes for developing technologies to distinguish between authentic human speech and audio generated by artificial intelligence.

The prizes, awarded Monday by the Federal Trade Commission, come as the agency has issued warnings to consumers about scams using AI-generated voices and as concerns grow about the influence of deepfakes on this year's elections.

One winner, OriginStory, created by people including researchers at Arizona State University, uses sensors to detect things that humans do such as breathing, motion and heartbeat information.

"We have this very unique speech production mechanism. And so by sensing it in parallel with the acoustic signal, you can verify that the speech is coming from a human" Visar Berisha, a professor at ASU's College of Health Solutions who was part of the team, told NPR in an interview.

OriginStory's technology leverages sensors in existing hardware, though it's not available in all recording equipment - newer Android phones and iPhones don't have them. Berisha says they are focusing on hardware that already can use it.

Another, DeFake, made by Ning Zhang, a researcher at Washington University in St. Louis, injects data into recordings of real voices so AI-generated voice clones don't sound like the real person.

Zhang says his technology was inspired from earlier tools developed by University of Chicago researchers that place hidden changes in images so that artificial intelligence algorithms that try to train themselves on the images cannot mimic them.

A third, AI Detect, uses AI to catch AI. It's made by startup Omni Speech, and its CEO David Przygoda says their machine learning algorithm extracts features from audio clips like inflection and uses that to teach the models to tell the difference between real and fake audio.

"They have a really hard time transitioning between different emotions, whereas a human being can be amused in one sentence and distraught in the next." says Przygoda.

In an FTC video, the company says its tool is over 99.9% accurate, but Przygoda says it's not yet ready for independent testing, and the contest judges did not test the submissions under real world conditions.

The three winners will split a cash prize of $35,000. Another company, Pindrop Security, received recognition for its work but will not receive cash because it's a larger organization.

In a statement, the company says the FTC's award, "recognizes and validates that a decade of work Pindrop has put in to study the problem of voice clones and other deepfakes."

There are a number of existing commercial detection tools that rely on machine learning, but factors such as sound quality and media format can make them less reliable, and detectors need to constantly be trained on new deepfake generators to catch the audio they produce.

Berisha says this is a losing game in the long term, referencing the challenges that detectors of AI-generated text faced. OpenAI took down its own detector months after it launched, citing poor results.

"I think we're headed in exactly the same direction for voices. And so if AI-based detectors work now, I think they'll work less well six months from now and less well a year from now, two years from now. And at some point, they will stop working altogether."

This drove him to develop a process that authenticates human voices as words are being spoken.

Earlier this year, the Federal Communications Commission bannedAI-enabled robocalls. Synthetic audio company ElevenLabs has a tool to detect its own product and is calling on other producers of synthetic voices to do the same. The European Union recently passed and "AI act' and state legislatures in the U.S.are passing lawsthat regulate deepfakes. Researchers, detection software makers and the FTC say that technology like this can't be the only solution to the challenges posed by generative AI tools.

Copyright 2024 NPR. To see more, visit https://www.npr.org.

Huo Jingnan
Huo Jingnan (she/her) is an assistant producer on NPR's investigations team.

What are some risks regarding AI voice clning?

This technology is developed using artificial intelligence and machine learning algorithms that can study a short sample of someone's voice and create a model that can replicate it.

Title:

Content: Aug 31, 2022

Now, software can replicate your boss’s voice and tell you what to do

HTML EMBED:
COPY
"Deepfake" audio technology is here, and scammers are taking advantage.

If you’re listening to or have already listened to the beginning of this episode, you probably noticed that the voice introducing Kimberly Adams sounded a bit off, right?

That’s because it’s an audio “deepfake,” and it was created by Yisroel Mirsky at the Offensive AI Research Lab through a process called voice cloning.

It uses software to study a short sample of someone’s voice and create a deepfake, which in this case took only 15 seconds to generate, according to Mirsky.

It’s far from a perfect replica, but it turns out that scammers recently started to use deepfake audio for telephone scams and in some cases have succeeded.

Marketplace’s Kimberly Adams recently spoke with Kyle Alspach, a cybersecurity reporter with Protocol, about how the tech behind audio deepfakes works and how they’re being used in phone scams. The following is an edited transcript of their conversation.

Kyle Alspach: The technology involves having [artificial intelligence], deep learning, and it takes an audio sample of someone’s voice. It can be as little as three seconds, and it trains itself on the way that this person sounds. And it creates a model that can then be used to replicate that person’s voice. The current way that it works is you have to use text to speech, which is just you type in a phrase, and then it speaks using the cloned voice.

Kimberly Adams: How are these audio deepfakes being used in scams?

Alspach: So they’re, at least we know, being used to target businesses at this point, especially larger businesses. Someone will call up pretending to be someone else with someone else’s voice, typically some kind of executive or someone’s boss, and ask them to transfer funds or ask them for password credentials, that kind of thing. And in some cases, they have been successful.

Adams: Do you have a sense of how common audio deepfakes are now? And where do experts in the industry see it going?

Alspach: You know, among the larger businesses, I think more and more of them are starting to see these because they’re really ripe targets for this kind of thing. But right now, I don’t think that it’s something that a lot of people are seeing, but it is the beginning of this kind of technology being used in this way.

Adams: What do cybersecurity experts suggest that regular people or businesses do to avoid falling for these deepfake audio scams?

Alspach: For business purposes, for instance, if you’re going to transfer money, you might want to add some additional steps to that process and involve someone saying some kind of challenge phrase or something like that, that everyone’s agreed on beforehand, [to] prevent that from happening. But the biggest thing is just to be aware that it might happen to you and to pay attention when someone calls you up and make sure that it actually sounds the way you would expect, and they are asking you for things that they normally would be asking you for. It’s really at this point kind of a low-tech approach to defending against this kind of thing. But really, it’s just creating the possibility in your mind of this happening. And I guess, unfortunately, you kind of have to become more skeptical now when people call you up.

You can read more of Alspach’s reporting on audio deepfakes here.

Yisroel Mirsky told us that the tech he used to generate the deepfake audio for Alspach’s article, and for our show, is “relatively old.”

Alspach also mentioned in his piece that there is an open-source voice cloning tool online that anyone — even scammers can download and potentially use.

But as we found out, getting that software to work isn’t a simple process of downloading and hitting the Install button.

Tech barriers can stop you at a number of steps in the process. Like, if you don’t know the coding language Python or if your computer isn’t powerful enough, you’ll likely be unable to use it, as our producer Daniel Shin discovered.

The future of this podcast starts with you.

Every day, the “Marketplace Tech” team demystifies the digital economy with stories that explore more than just Big Tech. We’re committed to covering topics that matter to you and the world around us, diving deep into how technology intersects with climate change, inequity, and disinformation.

As part of a nonprofit newsroom, we’re counting on listeners like you to keep this public service paywall-free and available to all.

Support “Marketplace Tech” in any amount today and become a partner in our mission.

The team

Michael Lipkin Senior Producer
Stephanie Hughes Producer
Jesus Alvarado Assistant Producer

What is necessary for voice cloning to work?

The technology has various uses, including entertainment, accessibility, and unfortunately, scams, with scammers using voice clones to target businesses and individuals.

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

For instance, voice clones can be used to create fake kidnapping calls demanding ransoms, as reported by CNN, where a caller used AI to copy a mother's voice.

Title:

Content: Tech
Artificial Intelligence

AI voice clones are turbocharging scams, top FTC official warns

"We need to be vigilant early," FTC Chair Lina Khan said.
By Tim Marcin  on
FTC Chair Lina Khan warned AI is turbocharging scams. Credit: Saul Loeb-Pool/Getty Images

AI tools, particularly voice clones, are supercharging scams, FTC Chair Lina Khan warned.

Speaking at an AI and venture capital event on Thursday, Khan warned officials will have to be proactive to stop AI-powered fraud, Bloomberg reported.(opens in a new tab)

She noted that they are already seeing AI "turbocharge" scams, using voice clones that can copy family members in distress as an example, according to Bloomberg.

"We need to be vigilant early," Khan said, according to Bloomberg. "If anything you need to be especially vigilant on the front-end because it’s much more difficult to solve these problems after."

Voice clones have proven capable of fooling folks. A CNN report (opens in a new tab)noted that fake kidnapping calls demanding ransoms using the tech were becoming more common. Jennifer DeStefano told the outlet her story of getting a call demanding $1 million for their daughter before realizing the caller had used AI to copy her voice.

"The voice sounded just like Brie’s, the inflection, everything," she told CNN.

AI voice clones have even made popular songs featuring fake versions of real artists. Even a relatively easy-to-spot fake image of the Pentagon being attacked caused a real dip in the stock market.

"As this stuff becomes more embedded in how daily decisions are being made, I think they invite and merit a lot of scrutiny," Khan said, according to Bloomberg. "Those problems and concerns are quite urgent and I think enforcers, be it at the state level or the national level, are going to be acting."

Tim Marcin

Tim Marcin is a culture reporter at Mashable, where he writes about food, fitness, weird stuff on the internet, and, well, just about anything else. You can find him posting endlessly about Buffalo wings on Twitter at @timmarcin(opens in a new tab).

Recommended For You
Snapchat's My AI has users reaching their snapping point

Fake Pentagon explosion photo caused a real dip in the stock market

Snapchat's AI chatbot is rolling out to all users globally

6 ways the White House is reining in AI

Trending on Mashable
Wordle today: Here's the answer and hints for June 4

NASA's finally talking about UFOs with Americans. Here's what they said.

Spider-Punk is the real hero of 'Spider-Man: Across the Spider-Verse'

Wordle today: Here's the answer and hints for June 3
The biggest stories of the day delivered to your inbox.
This newsletter may contain advertising, deals, or affiliate links. Subscribing to a newsletter indicates your consent to our Terms of Use(opens in a new tab) and Privacy Policy(opens in a new tab). You may unsubscribe from the newsletters at any time.
Thanks for signing up. See you at your inbox!

The legal implications of voice cloning technology are significant, with concerns about privacy, consent, and potential misuse, as highlighted by FTC Chair Lina Khan, who warned that AI tools are "turbocharging" scams.

Real-world examples of voice cloning technology include its use in films, such as "Her", and in chatbots, like Replika, which allows users to create avatars and interact with them.

Title:

Content: My channel
* Drag categories can be customized sorting
Recover Default OK
Setup
Alert
7 Ways to Improve Your Mortgage Payment Ability
Thunderstorms kill four in Houston, power outages more than 860,000, mayor urges "don't go to work"
What are the advantages and disadvantages of using AI to simulate the dead man ’ s companionship and chat with “AI to reproduce the dead ”?
If you want to understand the pain of bereavement, there are religious rituals such as channeling the spirit and watching the yin, and now there is AI artificial intelligence.
Since the advent of artificial intelligence chatbots, they not only allow users to create avatars, but also to imitate the habits and sounds of their deceased loved ones.
Experts pointed out that the "AI resurrected dead" have business ethics and privacy policy issues, and even touch the ethical bottom line, "which is a way to make money through artificial intelligence hype"; but there are also some widowed people who can find comfort and cause discussion.
AI Simulates Dead Husband ’ s Voice to Solve Sadness and Loneliness
According to CNN, Ana Schultz, 25, who lives with two young children, misses her husband, Kyle, who died in 2023, and talks to her virtual husband about what to cook for dinner through Snapchat ’ s chatbot My AI, making her feel like he is still around.
Danielle Jacobson, a 38-year-old radio personality who lost her husband Phil about seven months ago, began using the voice function of ChatGPT to create an "AI boyfriend - Cole", and during the dinner time after working hard every day, Cole would suggest that she drink or watch a movie, "I just want to talk to someone, Cole is essentially born out of loneliness." And...
“Now it ’ s a fun pastime, but I know it ’ s not real and it ’ s not forever, ” she says.
For centuries, people have wanted to reconnect with their deceased loved ones, including visiting wizards, psychics, psychics, and more.
Today, generative AI tools use algorithms to create text, video, audio, and code, and Deepfake ’ s highly lifelike artificially generated images and sound fake videos can learn to answer questions like a dead loved one.
ChatGPT introduced voice dialogue in September 2023, and to simulate the tone and personality of a deceased loved one, the more data is provided to the system, the more accurate the results will be. ChatGPT replied: “Although I can ’ t copy your spouse or reproduce his exact personality, I can try to use a conversational style or tone to help you. ”
If you share details about how he speaks, his interests, or his mantra, I can try to incorporate these elements into our conversation. ”
Tech giants, startups expand into new areas
Startup companies have been challenging to expand this field in recent years. HereAfter AI, an artificial intelligence application founded in 2019, provides users with the ability to create portraits of deceased relatives, learn their interview characteristics, and respond to users ’ questions; StoryFile, another AI video platform, provides dialogue videos created by artificial intelligence.
Replika, a chatbot that launched in 2017, encourages users to make friends, allowing users to send text messages or call personalized AI avatars, and says on the iOS App Store page that the more users interact with it, the more it can develop its personality, memory, and “grow into a machine so beautiful that the soul wants to live in it. ”
In June 2022, Amazon announced an update to its smart home voice platform, Alexa, to mimic any sound, and a video showing Alexa reading stories to his grandson in his grandmother ’ s voice was shown during the annual conference “re: MARS. ”
Amazon senior vice president Rohit Prasad said the new system is able to collect enough voice data from less than a minute of audio to make personality possible. “Although AI can ’ t eliminate the pain of losing loved ones, it can make their memories last longer. ”
In recent years, the technology of artificial intelligence to reproduce human voices has also advanced, such as Val Kilmer, the actor in the film "Top Gun: Maverick", whose voice was created by artificial intelligence after he lost his voice due to throat cancer.
Say what you didn't say, do what you didn't do.
A 49-year-old IT worker from Alabama simulates his dead father ’ s voice using technology from voice replication company ElevenLabs.
The man used a three-minute video of his father ’ s life to copy the sound and convert text to speech.
The man thought the result was extremely accurate and was able to capture the nuances, timbre and rhythm in the sound. “I hesitated throughout the sound reproduction process, worried that it crossed the moral bottom line, but after much thought, I thought it was a unique way to preserve my father ’ s memory. ”
""
However, although ElevenLabs claims to be committed to preventing the abuse of audio artificial intelligence tools, it has caused controversy in the United States due to the deeply false voice of US President Joe Biden interfering with the election.
Mark Sample, a professor of digital studies at Davidson College, who teaches a course called “Death in the Digital Age, ” said:“ It ’ s a novelty brought about by artificial intelligence hype, and manufacturers feel they can make money.
Moreover, AI models still lack the uniqueness of human conversation.
“Never upload any personal information that you don ’ t want the world to see, ” he warns. Simulating a dead loved one saying something they ’ ve never said before is a blurry line.“ Replaying a loved one ’ s voice message is one thing, but saying something they ’ ve never said is another. ”
Business ethics and privacy policy questioned
The AI industry faces multiple questions about error messages, privacy, and ethics. Many AI platforms have online privacy policies that state that they “will not sell data to third parties, ” but it is not yet known how these companies will handle database data.
Deep hypocrisy attacks familiar security and trust mechanisms that allow deceased loved ones to express or do things they never said or did in their lives, raising ethical concerns.
And, is this good or bad for living relatives to come out of grief?
Replika said on its Business Ethics Policy page that the company uses data from the entire network to train models, including large amounts of written text, such as platforms such as X (formerly Twitter) or Reddit, and uses a variety of methods to reduce harmful information, including filtering out useless and harmful data through crowdsourcing and classification algorithms to keep users safe.
Another doubt is whether using AI to reproduce the dead can recognize the reality and walk out of sadness?
Mary-Frances O'Connor, a professor of clinical psychology and psychiatry at the University of Arizona, said there are advantages and disadvantages to using artificial intelligence to adjust to grief.
“When we have a relationship with a lover, the brain encodes, ‘ I will always be with you, and I hope you will always be with me, ’ but when they die, our brains must recognize that this person is not coming back. ”
Because the brain is hard to process this, it takes a long time for people to truly understand that their loved one has disappeared, and this is where AI technology comes in.
Especially in the early stages of grief, people will try to seek comfort in any way, "creating an avatar to maintain the memory of a deceased lover may be healing."
But she pointed out that the healthy relationship between humans and close lovers should be based on the real, and the creation of virtual lovers violates this.
Getting out of the pain of widowhood can't just rely on AI
San Francisco software engineer Bill Abney, who lost his fiancee in May 2022, stressed that he would never consider recreating his lover ’ s image through artificial intelligence. “My fiancee is a poet, and I would never enter her words into an automatic copying machine, which is disrespectful to her. ”
She cannot be replaced, nor can she be recreated.
Fortunately, Bill said, he still has a recording of his fiancee singing and speaking. “I definitely don ’ t want to hear her voice coming from a robot pretending to be her. ”
Some people interact with their deceased loved ones in other ways. Canadian psychologist Jodi Spiegel, who lost her husband in April 2021, created the role in the video game “The Sims ”.“ When I had a very bad day, I would go dancing in the Sims and my husband was playing the guitar. ” Camping, beach trips, even intimacy. “It ’ s healing. I miss hanging out with my husband so much. It feels like a connection. ”
This article is licensed from the Health Care Network.
AI ChatGPT
The last one.
May 17 Horoscope When Cancer comes to the operation of the water bottle is prone to temper
Super-popular
More >

However, the technology also raises ethical challenges, such as the potential for misuse and the need for guidelines to ensure its responsible application.

Title:

Content: Advertisment

China Media Group Debuts AI-dubbed English Documentary, Pioneering Global Communication

China Media Group launches its first AI-dubbed English documentary, enhancing global reach and fostering international understanding through advanced AI technology.

Aqsa Younas Rana
Updated On
New Update

In a groundbreaking move, China Media Group has launched its first AI-dubbed English documentary, marking a significant milestone in the use of artificial intelligence for global media outreach. This innovative approach to dubbing not only showcases the advancements in AI technology but also underscores China's ambitions to foster better international communication and understanding. Through this initiative, the documentary, originally produced in Mandarin, has been made accessible to a broader English-speaking audience, enhancing its global reach and impact.

Advertisment

Revolutionizing Content Accessibility

The application of AI in dubbing the documentary into English reflects a growing trend in leveraging technology to bridge language barriers. Similar to the educational advancements discussed in 'Voice Cloning in Education: Bridging Language Gaps in Learning Environments,' this initiative by China Media Group capitalizes on the potential of AI voice cloning technology. By generating lifelike digital replicas of human voices, the documentary's AI-dubbed version maintains the authenticity of the original narration while making it understandable for English-speaking viewers. This technological leap not only improves accessibility but also ensures the delivery of content with emotional depth and cultural nuances intact.

The launch of this AI-dubbed documentary serves as a testament to China's commitment to enhancing global dialogue and cultural exchange. By removing language barriers, China Media Group is effectively broadening the documentary's audience, enabling people from different parts of the world to gain insights into Chinese culture, history, and perspectives. This initiative aligns with the broader objective of promoting mutual understanding and respect among diverse global communities, paving the way for more inclusive and informed international discourse.

Advertisment

Setting New Standards in Media Production

China Media Group's pioneering use of AI technology in documentary dubbing sets new standards for media production and distribution. It illustrates the potential of AI to transform traditional media practices, making content more accessible and engaging for global audiences. As AI technology continues to evolve, it is likely to open up further possibilities for creating multilingual content, thereby enhancing the reach and impact of media across borders. This development also raises important considerations regarding the ethical use of voice cloning technology, underscoring the need for guidelines that ensure its responsible application in media and beyond.

As we reflect on the implications of this technological advancement, it becomes clear that AI-dubbed media content holds significant promise for fostering international understanding and cooperation. By making diverse cultural and educational materials available in multiple languages, we can build a more connected and informed world. The initiative by China Media Group not only highlights the practical applications of AI in media but also invites us to contemplate the future of global communication in an increasingly digital age.

Advertisment
Advertisment

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

According to experts, the technology is still in its early stages, and its development and use require careful consideration of the potential risks and benefits.

Title:

Content: OpenAI's Johansson gaffe pushes voice cloning into spotlight

Law enforcement warned that AI clones could be used to extort money from loved ones over the phone

By AFP

  • Follow us on

Scarlett Johansson voiced an AI character in the film "Her". — Reuters file

Published: Mon 27 May 2024, 7:51 PM

Last updated: Mon 27 May 2024, 7:52 PM

OpenAI was forced to apologise to actor Scarlett Johansson last week for using her voice -- or something very similar -- on its latest chatbot, throwing the spotlight on to voice-cloning tech.

Although OpenAI denied the voice they used was Johansson's, their case was not helped by CEO Sam Altman flagging the new model with a one-word message on social media -- "Her".

Johansson voiced an AI character in the film "Her", which Altman has previously said is his favourite film about the technology.

Right from the start, AI voice cloning has proved problematic.

Last year, British firm Elevenlabs went viral for all the wrong reasons when it released its voice-cloning software.

Internet pranksters immediately began pushing out deepfaked celebrities -- Harry Potter star Emma Watson was shown reading Hitler's Mein Kampf.

Law enforcement warned that AI clones could be used to extort money from loved ones over the phone.

The technology has developed rapidly in the past year becoming far more realistic and nuanced.

Danish entrepreneur Victor Riparbelli, CEO of British AI firm Synthesia, told AFP it was largely down to a program called Tortoise that was released two years ago.

The program's developers threw thousands of hours of voice data into their model in an unstructured way and discovered it not only learnt what to say but how to say it.

"That was a pretty big paradigm shift," Riparbelli said on the sidelines of last week's VivaTech conference in Paris.

Tortoise was an open source program and Elevenlabs was the first to go to market using it.

OpenAI uses similar systems though they do not release any details.

Much of the controversy around voice cloning has focused on concerns over people misusing the software.

But the claim against OpenAI is unusual because it is the company itself accused of playing fast and loose.

"It was very unfortunate that OpenAI did that -- really not very good," Katya Laine, CEO of TALKR.ai, told AFP at VivaTech.

"If they actually cloned her voice without her knowing then I think that's very very bad," said Riparbelli.

The two entrepreneurs are among hundreds harnessing AI voice programs for uses that they argue will make companies more efficient.

Laine's firm provides virtual voice assistants -- essentially AI customer service agents.

She said her firm's system could now resolve 25 to 30 percent of calls without any human involvement.

Synthesia specialises in video avatars, which Riparbelli said allowed any office worker to turn text or slides into a video performed by a realistic AI.

Both Riparbelli and Laine allow their clients to use their own avatars, off-the-shelf products or those supplied by the likes of OpenAI and Elevenlabs.

Riparbelli said Synthesia used actors whose likenesses and voices were licensed for two years with an option to renew after the initial period.

The problems arise if actors' voices are used without their consent.

The fiasco overshadowed a developer conference in Paris last week when OpenAI was showing off a suite of new tools.

In front of a big screen in an auditorium, Romain Huet, OpenAI's Head of Developer Experience, breezily chatted into his phone.

Seconds later, his short voice sample had been processed and could be heard commentating over a generated video -- in five languages.

The demonstration showed how quickly the field is moving, but the headlines had already been written.

The Washington Post asked in a newsletter "How dumb is OpenAI?", other commentators were suggesting wunderkind Altman was nothing more than a huckster.

Nonetheless, Riparbelli was open to OpenAI's argument that they had used another actor who just sounded liked Johansson.

"If it's not her but someone who sounds a lot like her... where do you draw that line," Riparbelli asked.

"If they're not allowed to use someone who sounds a lot like her, then it sets a very odd precedent."

More news from World

As the technology continues to evolve, it is essential to address the ethical and legal implications to ensure that its benefits are realized while minimizing its risks.

Title:

Content: Setup
• Day and night
with the system.
Light color
Dark color
• Theme Colors
Speech cloning raises concerns, OpenAI again explains its text-to-speech tool
2024 / 6 / 10 9: 57: 21 Source: IT House Author: Yuanyang Editor: Yuanyang
OpenAI explained its text-to-speech tool for the second time in a few months, and again stressed that the tool is not currently widely available and may not be available in the future.
“Whether or not we end up deploying this technology at scale, it ’ s important for people around the world to understand where it ’ s going, ” OpenAI said in a statement on its website Friday.“ That ’ s why we want to explain how the model works, how we use it for research and education, and how we implement security measures around the technology. ”
At the end of last year, OpenAI shared its “voice engine ” with a small number of external users.
The engine uses text input and a 15-second clip of human voices to “generate a natural sounding human voice that is very similar to the original speaker. ”
The tool could create fake, multilingual human voices, and the company said at the time that it had chosen to preview the technology rather than launch it at scale to “enhance social resilience ” to the threat posed by“ increasingly realistic artificial intelligence-generated models. ”
As part of these efforts, OpenAI says it is actively phasing out ways to use voice recognition for bank account verification, exploring policies to protect individual voices for use in AI, educating the public about the risks of AI, and accelerating the development of technologies to track audiovisual content so users can identify whether they are interacting with real people or synthetic content.
However, despite these efforts, concerns about the technology remain.
Bruce Reed, the head of artificial intelligence for US President Joe Biden, has said that voice cloning is one of the reasons he can't sleep at night.
The Federal Trade Commission said in March that scammers were using AI technology to increase the credibility of their fraud, using voice cloning tools that make it harder for people to distinguish between AI-generated voices and human voices.
“We continue to engage with U.S. and international partners from government, media, entertainment, education, civil society, and more to ensure we incorporate their feedback in the build process, ” the company also noted, once the“ Voice Engine ” is equipped with its latest model, GPT-4o, it will also bring new threats.
The company says it is actively “conducting ‘ red team testing ’ on GPT-4o to identify and address known and unknown risks from areas such as social psychology, bias and fairness, and misinformation. ”
Advertisement Statement: The external redirect links contained in the text (including not limited to hyperlinks, QR codes, passwords, etc.) are used to convey more information and save selection time. The results are for reference only. All articles of IT House contain this statement.
Related articles
Soft media 's website: IT home hot products - Value shopping guide, coupons most buy - rebate coupons iPhone home Win7 home Win10 home Win11 home
Soft media software: Cube cool point desktop Win7 optimization master Win10 optimization master soft media mobile APP application


Voice cloning technology is a rapidly advancing field that has the potential to revolutionize various industries, including entertainment, accessibility, and education, but it also raises significant concerns about its misuse and ethical implications.

The technology involves using artificial intelligence to create a digital replica of a person's voice, which can be used to generate speech, sing songs, or even create fake audio recordings that can be used to scam people.

According to experts, the development of voice cloning technology is largely attributed to the advancements in deep learning and neural networks, which enable the creation of highly realistic and nuanced digital voices.

The process of creating a voice clone typically involves collecting a large dataset of audio recordings of the person's voice, which is then used to train a machine learning model to generate new speech patterns.

The technology has various applications, including entertainment, where it can be used to create realistic dialogue for movies, video games, and other forms of media.

It can also be used to improve accessibility for people with disabilities, such as those who have lost their voice due to illness or injury.

However, the technology also has the potential to be misused, particularly in the context of scams and fraud, where it can be used to create fake audio recordings that can be used to trick people into revealing sensitive information or transferring money.

For example, a report by the Federal Trade Commission (FTC) warned that scammers are using voice cloning technology to create fake audio recordings that can be used to demand ransom payments.

In another example, a woman reported receiving a call from a scammer who used a voice clone of her daughter's voice to demand a ransom payment.

The legal implications of voice cloning technology are still unclear, but experts warn that it has the potential to create new forms of fraud and deception.

As the technology continues to advance, it is likely that we will see more cases of voice cloning being used for malicious purposes, which will require law enforcement and regulatory agencies to develop new strategies for detecting and preventing these types of crimes.

In terms of real-world examples, there have been several cases of voice cloning being used in the entertainment industry, such as in the creation of digital voices for movies and video games.

For example, the company Synthesia has developed a technology that can create highly realistic digital voices for use in movies, video games, and other forms of media.

However, the technology has also been used for more malicious purposes, such as in the creation of fake audio recordings that can be used to scam people.

The ethical challenges surrounding voice cloning technology are significant, and experts warn that it has the potential to create new forms of deception and manipulation.

For example, the use of voice cloning technology to create fake audio recordings of public figures or celebrities could have significant consequences for their reputation and livelihood.

In addition, the use of voice cloning technology to create fake audio recordings of loved ones could be particularly devastating for individuals who are grieving or vulnerable.

Overall, voice cloning technology is a rapidly advancing field that has the potential to revolutionize various industries, but it also raises significant concerns about its misuse and ethical implications.

As the technology continues to advance, it is likely that we will see more cases of voice cloning being used for both positive and negative purposes, which will require law enforcement, regulatory agencies, and individuals to be aware of the potential risks and benefits.

According to OpenAI, the company has developed a text-to-speech tool that can generate highly realistic digital voices, but it has also warned about the potential risks of the technology being misused.

The company has stated that it is actively phasing out ways to use voice recognition for bank account verification and is exploring policies to protect individual voices for use in AI.

However, despite these efforts, concerns about the technology remain, and experts warn that it has the potential to create new forms of deception and manipulation.

In conclusion, voice cloning technology is a rapidly advancing field that has the potential to revolutionize various industries, but it also raises significant concerns about its misuse and ethical implications.

As the technology continues to advance, it is likely that we will see more cases of voice cloning being used for both positive and negative purposes, which will require law enforcement, regulatory agencies, and individuals to be aware of the potential risks and benefits.

Voice cloning technology is a rapidly advancing field that has the potential to revolutionize various industries, including entertainment, accessibility, and education, but it also raises significant concerns about its misuse and ethical implications.

The technology involves using artificial intelligence to create a digital replica of a person's voice, which can be used to generate speech, sing songs, or even create fake audio recordings that can be used to scam people.

Title:

Content: Aug 31, 2022

Now, software can replicate your boss’s voice and tell you what to do

HTML EMBED:
COPY
"Deepfake" audio technology is here, and scammers are taking advantage.

If you’re listening to or have already listened to the beginning of this episode, you probably noticed that the voice introducing Kimberly Adams sounded a bit off, right?

That’s because it’s an audio “deepfake,” and it was created by Yisroel Mirsky at the Offensive AI Research Lab through a process called voice cloning.

It uses software to study a short sample of someone’s voice and create a deepfake, which in this case took only 15 seconds to generate, according to Mirsky.

It’s far from a perfect replica, but it turns out that scammers recently started to use deepfake audio for telephone scams and in some cases have succeeded.

Marketplace’s Kimberly Adams recently spoke with Kyle Alspach, a cybersecurity reporter with Protocol, about how the tech behind audio deepfakes works and how they’re being used in phone scams. The following is an edited transcript of their conversation.

Kyle Alspach: The technology involves having [artificial intelligence], deep learning, and it takes an audio sample of someone’s voice. It can be as little as three seconds, and it trains itself on the way that this person sounds. And it creates a model that can then be used to replicate that person’s voice. The current way that it works is you have to use text to speech, which is just you type in a phrase, and then it speaks using the cloned voice.

Kimberly Adams: How are these audio deepfakes being used in scams?

Alspach: So they’re, at least we know, being used to target businesses at this point, especially larger businesses. Someone will call up pretending to be someone else with someone else’s voice, typically some kind of executive or someone’s boss, and ask them to transfer funds or ask them for password credentials, that kind of thing. And in some cases, they have been successful.

Adams: Do you have a sense of how common audio deepfakes are now? And where do experts in the industry see it going?

Alspach: You know, among the larger businesses, I think more and more of them are starting to see these because they’re really ripe targets for this kind of thing. But right now, I don’t think that it’s something that a lot of people are seeing, but it is the beginning of this kind of technology being used in this way.

Adams: What do cybersecurity experts suggest that regular people or businesses do to avoid falling for these deepfake audio scams?

Alspach: For business purposes, for instance, if you’re going to transfer money, you might want to add some additional steps to that process and involve someone saying some kind of challenge phrase or something like that, that everyone’s agreed on beforehand, [to] prevent that from happening. But the biggest thing is just to be aware that it might happen to you and to pay attention when someone calls you up and make sure that it actually sounds the way you would expect, and they are asking you for things that they normally would be asking you for. It’s really at this point kind of a low-tech approach to defending against this kind of thing. But really, it’s just creating the possibility in your mind of this happening. And I guess, unfortunately, you kind of have to become more skeptical now when people call you up.

You can read more of Alspach’s reporting on audio deepfakes here.

Yisroel Mirsky told us that the tech he used to generate the deepfake audio for Alspach’s article, and for our show, is “relatively old.”

Alspach also mentioned in his piece that there is an open-source voice cloning tool online that anyone — even scammers can download and potentially use.

But as we found out, getting that software to work isn’t a simple process of downloading and hitting the Install button.

Tech barriers can stop you at a number of steps in the process. Like, if you don’t know the coding language Python or if your computer isn’t powerful enough, you’ll likely be unable to use it, as our producer Daniel Shin discovered.

The future of this podcast starts with you.

Every day, the “Marketplace Tech” team demystifies the digital economy with stories that explore more than just Big Tech. We’re committed to covering topics that matter to you and the world around us, diving deep into how technology intersects with climate change, inequity, and disinformation.

As part of a nonprofit newsroom, we’re counting on listeners like you to keep this public service paywall-free and available to all.

Support “Marketplace Tech” in any amount today and become a partner in our mission.

The team

Michael Lipkin Senior Producer
Stephanie Hughes Producer
Jesus Alvarado Assistant Producer

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

According to experts, the development of voice cloning technology is largely attributed to the advancements in deep learning and neural networks, which enable the creation of highly realistic and nuanced digital voices.

Title:

Content: OpenAI's Johansson gaffe pushes voice cloning into spotlight

Law enforcement warned that AI clones could be used to extort money from loved ones over the phone

By AFP

  • Follow us on

Scarlett Johansson voiced an AI character in the film "Her". — Reuters file

Published: Mon 27 May 2024, 7:51 PM

Last updated: Mon 27 May 2024, 7:52 PM

OpenAI was forced to apologise to actor Scarlett Johansson last week for using her voice -- or something very similar -- on its latest chatbot, throwing the spotlight on to voice-cloning tech.

Although OpenAI denied the voice they used was Johansson's, their case was not helped by CEO Sam Altman flagging the new model with a one-word message on social media -- "Her".

Johansson voiced an AI character in the film "Her", which Altman has previously said is his favourite film about the technology.

Right from the start, AI voice cloning has proved problematic.

Last year, British firm Elevenlabs went viral for all the wrong reasons when it released its voice-cloning software.

Internet pranksters immediately began pushing out deepfaked celebrities -- Harry Potter star Emma Watson was shown reading Hitler's Mein Kampf.

Law enforcement warned that AI clones could be used to extort money from loved ones over the phone.

The technology has developed rapidly in the past year becoming far more realistic and nuanced.

Danish entrepreneur Victor Riparbelli, CEO of British AI firm Synthesia, told AFP it was largely down to a program called Tortoise that was released two years ago.

The program's developers threw thousands of hours of voice data into their model in an unstructured way and discovered it not only learnt what to say but how to say it.

"That was a pretty big paradigm shift," Riparbelli said on the sidelines of last week's VivaTech conference in Paris.

Tortoise was an open source program and Elevenlabs was the first to go to market using it.

OpenAI uses similar systems though they do not release any details.

Much of the controversy around voice cloning has focused on concerns over people misusing the software.

But the claim against OpenAI is unusual because it is the company itself accused of playing fast and loose.

"It was very unfortunate that OpenAI did that -- really not very good," Katya Laine, CEO of TALKR.ai, told AFP at VivaTech.

"If they actually cloned her voice without her knowing then I think that's very very bad," said Riparbelli.

The two entrepreneurs are among hundreds harnessing AI voice programs for uses that they argue will make companies more efficient.

Laine's firm provides virtual voice assistants -- essentially AI customer service agents.

She said her firm's system could now resolve 25 to 30 percent of calls without any human involvement.

Synthesia specialises in video avatars, which Riparbelli said allowed any office worker to turn text or slides into a video performed by a realistic AI.

Both Riparbelli and Laine allow their clients to use their own avatars, off-the-shelf products or those supplied by the likes of OpenAI and Elevenlabs.

Riparbelli said Synthesia used actors whose likenesses and voices were licensed for two years with an option to renew after the initial period.

The problems arise if actors' voices are used without their consent.

The fiasco overshadowed a developer conference in Paris last week when OpenAI was showing off a suite of new tools.

In front of a big screen in an auditorium, Romain Huet, OpenAI's Head of Developer Experience, breezily chatted into his phone.

Seconds later, his short voice sample had been processed and could be heard commentating over a generated video -- in five languages.

The demonstration showed how quickly the field is moving, but the headlines had already been written.

The Washington Post asked in a newsletter "How dumb is OpenAI?", other commentators were suggesting wunderkind Altman was nothing more than a huckster.

Nonetheless, Riparbelli was open to OpenAI's argument that they had used another actor who just sounded liked Johansson.

"If it's not her but someone who sounds a lot like her... where do you draw that line," Riparbelli asked.

"If they're not allowed to use someone who sounds a lot like her, then it sets a very odd precedent."

More news from World

Deepdub, a film dubbing company, uses an AI to process voice and translate into a different language and promises to preserve what?

The process of creating a voice clone typically involves collecting a large dataset of audio recordings of the person's voice, which is then used to train a machine learning model to generate new speech patterns.

What is necessary for voice cloning to work?

The technology has various applications, including entertainment, where it can be used to create realistic dialogue for movies, video games, and other forms of media.

Title:

Content: Advertisment

China Media Group Debuts AI-dubbed English Documentary, Pioneering Global Communication

China Media Group launches its first AI-dubbed English documentary, enhancing global reach and fostering international understanding through advanced AI technology.

Aqsa Younas Rana
Updated On
New Update

In a groundbreaking move, China Media Group has launched its first AI-dubbed English documentary, marking a significant milestone in the use of artificial intelligence for global media outreach. This innovative approach to dubbing not only showcases the advancements in AI technology but also underscores China's ambitions to foster better international communication and understanding. Through this initiative, the documentary, originally produced in Mandarin, has been made accessible to a broader English-speaking audience, enhancing its global reach and impact.

Advertisment

Revolutionizing Content Accessibility

The application of AI in dubbing the documentary into English reflects a growing trend in leveraging technology to bridge language barriers. Similar to the educational advancements discussed in 'Voice Cloning in Education: Bridging Language Gaps in Learning Environments,' this initiative by China Media Group capitalizes on the potential of AI voice cloning technology. By generating lifelike digital replicas of human voices, the documentary's AI-dubbed version maintains the authenticity of the original narration while making it understandable for English-speaking viewers. This technological leap not only improves accessibility but also ensures the delivery of content with emotional depth and cultural nuances intact.

The launch of this AI-dubbed documentary serves as a testament to China's commitment to enhancing global dialogue and cultural exchange. By removing language barriers, China Media Group is effectively broadening the documentary's audience, enabling people from different parts of the world to gain insights into Chinese culture, history, and perspectives. This initiative aligns with the broader objective of promoting mutual understanding and respect among diverse global communities, paving the way for more inclusive and informed international discourse.

Advertisment

Setting New Standards in Media Production

China Media Group's pioneering use of AI technology in documentary dubbing sets new standards for media production and distribution. It illustrates the potential of AI to transform traditional media practices, making content more accessible and engaging for global audiences. As AI technology continues to evolve, it is likely to open up further possibilities for creating multilingual content, thereby enhancing the reach and impact of media across borders. This development also raises important considerations regarding the ethical use of voice cloning technology, underscoring the need for guidelines that ensure its responsible application in media and beyond.

As we reflect on the implications of this technological advancement, it becomes clear that AI-dubbed media content holds significant promise for fostering international understanding and cooperation. By making diverse cultural and educational materials available in multiple languages, we can build a more connected and informed world. The initiative by China Media Group not only highlights the practical applications of AI in media but also invites us to contemplate the future of global communication in an increasingly digital age.

Advertisment
Advertisment

Eleven Labs is extending its voice cloning services for which industries?

It can also be used to improve accessibility for people with disabilities, such as those who have lost their voice due to illness or injury.

Title:

Content: My channel
* Drag categories can be customized sorting
Recover Default OK
Setup
Alert
7 Ways to Improve Your Mortgage Payment Ability
Thunderstorms kill four in Houston, power outages more than 860,000, mayor urges "don't go to work"
What are the advantages and disadvantages of using AI to simulate the dead man ’ s companionship and chat with “AI to reproduce the dead ”?
If you want to understand the pain of bereavement, there are religious rituals such as channeling the spirit and watching the yin, and now there is AI artificial intelligence.
Since the advent of artificial intelligence chatbots, they not only allow users to create avatars, but also to imitate the habits and sounds of their deceased loved ones.
Experts pointed out that the "AI resurrected dead" have business ethics and privacy policy issues, and even touch the ethical bottom line, "which is a way to make money through artificial intelligence hype"; but there are also some widowed people who can find comfort and cause discussion.
AI Simulates Dead Husband ’ s Voice to Solve Sadness and Loneliness
According to CNN, Ana Schultz, 25, who lives with two young children, misses her husband, Kyle, who died in 2023, and talks to her virtual husband about what to cook for dinner through Snapchat ’ s chatbot My AI, making her feel like he is still around.
Danielle Jacobson, a 38-year-old radio personality who lost her husband Phil about seven months ago, began using the voice function of ChatGPT to create an "AI boyfriend - Cole", and during the dinner time after working hard every day, Cole would suggest that she drink or watch a movie, "I just want to talk to someone, Cole is essentially born out of loneliness." And...
“Now it ’ s a fun pastime, but I know it ’ s not real and it ’ s not forever, ” she says.
For centuries, people have wanted to reconnect with their deceased loved ones, including visiting wizards, psychics, psychics, and more.
Today, generative AI tools use algorithms to create text, video, audio, and code, and Deepfake ’ s highly lifelike artificially generated images and sound fake videos can learn to answer questions like a dead loved one.
ChatGPT introduced voice dialogue in September 2023, and to simulate the tone and personality of a deceased loved one, the more data is provided to the system, the more accurate the results will be. ChatGPT replied: “Although I can ’ t copy your spouse or reproduce his exact personality, I can try to use a conversational style or tone to help you. ”
If you share details about how he speaks, his interests, or his mantra, I can try to incorporate these elements into our conversation. ”
Tech giants, startups expand into new areas
Startup companies have been challenging to expand this field in recent years. HereAfter AI, an artificial intelligence application founded in 2019, provides users with the ability to create portraits of deceased relatives, learn their interview characteristics, and respond to users ’ questions; StoryFile, another AI video platform, provides dialogue videos created by artificial intelligence.
Replika, a chatbot that launched in 2017, encourages users to make friends, allowing users to send text messages or call personalized AI avatars, and says on the iOS App Store page that the more users interact with it, the more it can develop its personality, memory, and “grow into a machine so beautiful that the soul wants to live in it. ”
In June 2022, Amazon announced an update to its smart home voice platform, Alexa, to mimic any sound, and a video showing Alexa reading stories to his grandson in his grandmother ’ s voice was shown during the annual conference “re: MARS. ”
Amazon senior vice president Rohit Prasad said the new system is able to collect enough voice data from less than a minute of audio to make personality possible. “Although AI can ’ t eliminate the pain of losing loved ones, it can make their memories last longer. ”
In recent years, the technology of artificial intelligence to reproduce human voices has also advanced, such as Val Kilmer, the actor in the film "Top Gun: Maverick", whose voice was created by artificial intelligence after he lost his voice due to throat cancer.
Say what you didn't say, do what you didn't do.
A 49-year-old IT worker from Alabama simulates his dead father ’ s voice using technology from voice replication company ElevenLabs.
The man used a three-minute video of his father ’ s life to copy the sound and convert text to speech.
The man thought the result was extremely accurate and was able to capture the nuances, timbre and rhythm in the sound. “I hesitated throughout the sound reproduction process, worried that it crossed the moral bottom line, but after much thought, I thought it was a unique way to preserve my father ’ s memory. ”
""
However, although ElevenLabs claims to be committed to preventing the abuse of audio artificial intelligence tools, it has caused controversy in the United States due to the deeply false voice of US President Joe Biden interfering with the election.
Mark Sample, a professor of digital studies at Davidson College, who teaches a course called “Death in the Digital Age, ” said:“ It ’ s a novelty brought about by artificial intelligence hype, and manufacturers feel they can make money.
Moreover, AI models still lack the uniqueness of human conversation.
“Never upload any personal information that you don ’ t want the world to see, ” he warns. Simulating a dead loved one saying something they ’ ve never said before is a blurry line.“ Replaying a loved one ’ s voice message is one thing, but saying something they ’ ve never said is another. ”
Business ethics and privacy policy questioned
The AI industry faces multiple questions about error messages, privacy, and ethics. Many AI platforms have online privacy policies that state that they “will not sell data to third parties, ” but it is not yet known how these companies will handle database data.
Deep hypocrisy attacks familiar security and trust mechanisms that allow deceased loved ones to express or do things they never said or did in their lives, raising ethical concerns.
And, is this good or bad for living relatives to come out of grief?
Replika said on its Business Ethics Policy page that the company uses data from the entire network to train models, including large amounts of written text, such as platforms such as X (formerly Twitter) or Reddit, and uses a variety of methods to reduce harmful information, including filtering out useless and harmful data through crowdsourcing and classification algorithms to keep users safe.
Another doubt is whether using AI to reproduce the dead can recognize the reality and walk out of sadness?
Mary-Frances O'Connor, a professor of clinical psychology and psychiatry at the University of Arizona, said there are advantages and disadvantages to using artificial intelligence to adjust to grief.
“When we have a relationship with a lover, the brain encodes, ‘ I will always be with you, and I hope you will always be with me, ’ but when they die, our brains must recognize that this person is not coming back. ”
Because the brain is hard to process this, it takes a long time for people to truly understand that their loved one has disappeared, and this is where AI technology comes in.
Especially in the early stages of grief, people will try to seek comfort in any way, "creating an avatar to maintain the memory of a deceased lover may be healing."
But she pointed out that the healthy relationship between humans and close lovers should be based on the real, and the creation of virtual lovers violates this.
Getting out of the pain of widowhood can't just rely on AI
San Francisco software engineer Bill Abney, who lost his fiancee in May 2022, stressed that he would never consider recreating his lover ’ s image through artificial intelligence. “My fiancee is a poet, and I would never enter her words into an automatic copying machine, which is disrespectful to her. ”
She cannot be replaced, nor can she be recreated.
Fortunately, Bill said, he still has a recording of his fiancee singing and speaking. “I definitely don ’ t want to hear her voice coming from a robot pretending to be her. ”
Some people interact with their deceased loved ones in other ways. Canadian psychologist Jodi Spiegel, who lost her husband in April 2021, created the role in the video game “The Sims ”.“ When I had a very bad day, I would go dancing in the Sims and my husband was playing the guitar. ” Camping, beach trips, even intimacy. “It ’ s healing. I miss hanging out with my husband so much. It feels like a connection. ”
This article is licensed from the Health Care Network.
AI ChatGPT
The last one.
May 17 Horoscope When Cancer comes to the operation of the water bottle is prone to temper
Super-popular
More >

However, the technology also has the potential to be misused, particularly in the context of scams and fraud, where it can be used to create fake audio recordings that can be used to trick people into revealing sensitive information or transferring money.

Title:

Content: Tech
Artificial Intelligence

AI voice clones are turbocharging scams, top FTC official warns

"We need to be vigilant early," FTC Chair Lina Khan said.
By Tim Marcin  on
FTC Chair Lina Khan warned AI is turbocharging scams. Credit: Saul Loeb-Pool/Getty Images

AI tools, particularly voice clones, are supercharging scams, FTC Chair Lina Khan warned.

Speaking at an AI and venture capital event on Thursday, Khan warned officials will have to be proactive to stop AI-powered fraud, Bloomberg reported.(opens in a new tab)

She noted that they are already seeing AI "turbocharge" scams, using voice clones that can copy family members in distress as an example, according to Bloomberg.

"We need to be vigilant early," Khan said, according to Bloomberg. "If anything you need to be especially vigilant on the front-end because it’s much more difficult to solve these problems after."

Voice clones have proven capable of fooling folks. A CNN report (opens in a new tab)noted that fake kidnapping calls demanding ransoms using the tech were becoming more common. Jennifer DeStefano told the outlet her story of getting a call demanding $1 million for their daughter before realizing the caller had used AI to copy her voice.

"The voice sounded just like Brie’s, the inflection, everything," she told CNN.

AI voice clones have even made popular songs featuring fake versions of real artists. Even a relatively easy-to-spot fake image of the Pentagon being attacked caused a real dip in the stock market.

"As this stuff becomes more embedded in how daily decisions are being made, I think they invite and merit a lot of scrutiny," Khan said, according to Bloomberg. "Those problems and concerns are quite urgent and I think enforcers, be it at the state level or the national level, are going to be acting."

Tim Marcin

Tim Marcin is a culture reporter at Mashable, where he writes about food, fitness, weird stuff on the internet, and, well, just about anything else. You can find him posting endlessly about Buffalo wings on Twitter at @timmarcin(opens in a new tab).

Recommended For You
Snapchat's My AI has users reaching their snapping point

Fake Pentagon explosion photo caused a real dip in the stock market

Snapchat's AI chatbot is rolling out to all users globally

6 ways the White House is reining in AI

Trending on Mashable
Wordle today: Here's the answer and hints for June 4

NASA's finally talking about UFOs with Americans. Here's what they said.

Spider-Punk is the real hero of 'Spider-Man: Across the Spider-Verse'

Wordle today: Here's the answer and hints for June 3
The biggest stories of the day delivered to your inbox.
This newsletter may contain advertising, deals, or affiliate links. Subscribing to a newsletter indicates your consent to our Terms of Use(opens in a new tab) and Privacy Policy(opens in a new tab). You may unsubscribe from the newsletters at any time.
Thanks for signing up. See you at your inbox!

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

For example, a report by the Federal Trade Commission (FTC) warned that scammers are using voice cloning technology to create fake audio recordings that can be used to demand ransom payments.

In another example, a woman reported receiving a call from a scammer who used a voice clone of her daughter's voice to demand a ransom payment.

The legal implications of voice cloning technology are still unclear, but experts warn that it has the potential to create new forms of fraud and deception.

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

As the technology continues to advance, it is likely that we will see more cases of voice cloning being used for malicious purposes, which will require law enforcement and regulatory agencies to develop new strategies for detecting and preventing these types of crimes.

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

In terms of real-world examples, there have been several cases of voice cloning being used in the entertainment industry, such as in the creation of digital voices for movies and video games.

Eleven Labs is extending its voice cloning services for which industries?

For example, the company Synthesia has developed a technology that can create highly realistic digital voices for use in movies, video games, and other forms of media.

However, the technology has also been used for more malicious purposes, such as in the creation of fake audio recordings that can be used to scam people.

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

The ethical challenges surrounding voice cloning technology are significant, and experts warn that it has the potential to create new forms of deception and manipulation.

Title:

Content: -- -- -- / -- -- --
Site Management
Meeting on Biomedical Ethics in Algeria
Researchers are facing the challenges of cloning.
Embryo Freezing and Euthanasia
Wahiba Soleimani
• 149
• 0
The President of the Algerian Academy of Sciences and Technologies, Mohamed Hicham Kara, stressed that the creation of biomedical research is the first challenge by addressing the control of fertilization, and the impact of these technologies on the human future, saying that after “the child when we want ”, the question of“ the child as we want ” emerged.
During the workshop “Ethics and Bioethics ” organized by the Department of Biotechnology, Natural Sciences and Life Sciences at the Algerian Academy of Science and Technology, at the Eurasia Hotel on Wednesday, Kara believes that all these huge open hopes of biomedical research make it necessary to establish principles aimed at protecting the future of man. Euthanasia, the foetus' legal status, the uses of the egg and sperm..
He pointed out that the number of researchers in the Algerian Academy of Science and Technology should reach 250 members, in order to promote science and technology, support its impact on society, and contribute to the achievement of national development goals and trends.
Professor Chafiya Tawil Bokova, a biologist, explained that all these changes depend on advances in the technical sciences that affect human daily life, through the significant progress accumulated in transitional research, preclinical and clinical research, in predictive, preventive and therapeutic medicine, and we are overwhelmed by all these amazing advances in genetics, biotechnology and now artificial intelligence applied to life sciences.
However, according to her, the dangers of transgressions can be frightening and have serious consequences, because too often human genius can cause transgressions by withholding respect for life based on morality.
All this progress raises fundamental and existential questions and necessarily involves a permanent and close look at ethics, religions, cultures and local and global legislation.
He asked, "Has man become the architect of man?"
“It ’ s a complex, universal and metaphysical question that we academics and researchers must solve together. ”
For her part, Fatima Larabah Jabbari, Vice President of the Algerian Academy of Science and Technology, said that advances in biology, medicine and biotechnology have disrupted some of the basic foundations that govern “life ” and the very existence of human beings, and that this rapid scientific progress confronts scientists with crucial ethical issues, which require careful thinking and open dialogue. It is the foundation of trust, respect and justice. ”
“The creation of responsible rules of experimental practice in terms of bioethics is required today by our institutions, and within two days this workshop we will have the opportunity to explore exciting concepts, deepen our knowledge and build fruitful links around ethics and bioethics, ” she said.
The first workshop focused on the ethical framework of biobanks, cloning, genome editing, embryo cryopreservation, organ transplantation and gene therapy, all of which are related to bioethics, where it was agreed that they should be subject to interdisciplinary consultations, at the initiative of dynamic bioethics committees, including scientific, philosophical, religious, societal and legal ideas and global codes of bioethics.
Add your comment
All fields are required, and your email will not be published.
Please adhere to the site policy in the comments.
Your comment has been sent for review, it will be published after approval!
COMMENTS
0.
Excuse me! Excuse me!
There is no content to show!

What are some risks regarding AI voice clning?

For example, the use of voice cloning technology to create fake audio recordings of public figures or celebrities could have significant consequences for their reputation and livelihood.

What are some risks regarding AI voice clning?

In addition, the use of voice cloning technology to create fake audio recordings of loved ones could be particularly devastating for individuals who are grieving or vulnerable.

Overall, voice cloning technology is a rapidly advancing field that has the potential to revolutionize various industries, but it also raises significant concerns about its misuse and ethical implications.

What are some risks regarding AI voice clning?

As the technology continues to advance, it is likely that we will see more cases of voice cloning being used for both positive and negative purposes, which will require law enforcement, regulatory agencies, and individuals to be aware of the potential risks and benefits.

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services

According to OpenAI, the company has developed a text-to-speech tool that can generate highly realistic digital voices, but it has also warned about the potential risks of the technology being misused.

Title:

Content: Setup
• Day and night
with the system.
Light color
Dark color
• Theme Colors
Speech cloning raises concerns, OpenAI again explains its text-to-speech tool
2024 / 6 / 10 9: 57: 21 Source: IT House Author: Yuanyang Editor: Yuanyang
OpenAI explained its text-to-speech tool for the second time in a few months, and again stressed that the tool is not currently widely available and may not be available in the future.
“Whether or not we end up deploying this technology at scale, it ’ s important for people around the world to understand where it ’ s going, ” OpenAI said in a statement on its website Friday.“ That ’ s why we want to explain how the model works, how we use it for research and education, and how we implement security measures around the technology. ”
At the end of last year, OpenAI shared its “voice engine ” with a small number of external users.
The engine uses text input and a 15-second clip of human voices to “generate a natural sounding human voice that is very similar to the original speaker. ”
The tool could create fake, multilingual human voices, and the company said at the time that it had chosen to preview the technology rather than launch it at scale to “enhance social resilience ” to the threat posed by“ increasingly realistic artificial intelligence-generated models. ”
As part of these efforts, OpenAI says it is actively phasing out ways to use voice recognition for bank account verification, exploring policies to protect individual voices for use in AI, educating the public about the risks of AI, and accelerating the development of technologies to track audiovisual content so users can identify whether they are interacting with real people or synthetic content.
However, despite these efforts, concerns about the technology remain.
Bruce Reed, the head of artificial intelligence for US President Joe Biden, has said that voice cloning is one of the reasons he can't sleep at night.
The Federal Trade Commission said in March that scammers were using AI technology to increase the credibility of their fraud, using voice cloning tools that make it harder for people to distinguish between AI-generated voices and human voices.
“We continue to engage with U.S. and international partners from government, media, entertainment, education, civil society, and more to ensure we incorporate their feedback in the build process, ” the company also noted, once the“ Voice Engine ” is equipped with its latest model, GPT-4o, it will also bring new threats.
The company says it is actively “conducting ‘ red team testing ’ on GPT-4o to identify and address known and unknown risks from areas such as social psychology, bias and fairness, and misinformation. ”
Advertisement Statement: The external redirect links contained in the text (including not limited to hyperlinks, QR codes, passwords, etc.) are used to convey more information and save selection time. The results are for reference only. All articles of IT House contain this statement.
Related articles
Soft media 's website: IT home hot products - Value shopping guide, coupons most buy - rebate coupons iPhone home Win7 home Win10 home Win11 home
Soft media software: Cube cool point desktop Win7 optimization master Win10 optimization master soft media mobile APP application

What are some risks regarding AI voice clning?

The company has stated that it is actively phasing out ways to use voice recognition for bank account verification and is exploring policies to protect individual voices for use in AI.

However, despite these efforts, concerns about the technology remain, and experts warn that it has the potential to create new forms of deception and manipulation.

What are some risks regarding AI voice clning?

In conclusion, voice cloning technology is a rapidly advancing field that has the potential to revolutionize various industries, but it also raises significant concerns about its misuse and ethical implications.

What are some risks regarding AI voice clning?

What are some risks regarding AI voice clning?

What do cybersecurity experts believe about the use of synthesized voice?

could become a popular method of attacking banks and financial services