{"id":115014,"date":"2023-03-24T11:09:01","date_gmt":"2023-03-24T11:09:01","guid":{"rendered":"https:\/\/yogaesoteric.net\/?p=115014"},"modified":"2023-03-24T11:09:01","modified_gmt":"2023-03-24T11:09:01","slug":"ai-startup-under-fire-after-trolls-used-its-voice-cloning-tool-to-make-celebrities-say-offensive-words","status":"publish","type":"post","link":"https:\/\/yogaesoteric.net\/en\/ai-startup-under-fire-after-trolls-used-its-voice-cloning-tool-to-make-celebrities-say-offensive-words\/","title":{"rendered":"AI startup under fire after trolls used its voice cloning tool to make celebrities say \u201coffensive words\u201d"},"content":{"rendered":"<p>The firm ElevenLabs, maker of the Prime Voice artificial intelligence voice cloner, is currently under fire as trolls have flooded social media with audio deep fakes, featuring celebrity voices making racist statements and calling for violence using its tool.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-115015\" src=\"https:\/\/yogaesoteric.net\/wp-content\/uploads\/2023\/03\/1-51-300x200.jpg\" alt=\"\" width=\"500\" height=\"334\" srcset=\"https:\/\/yogaesoteric.net\/wp-content\/uploads\/2023\/03\/1-51-300x200.jpg 300w, https:\/\/yogaesoteric.net\/wp-content\/uploads\/2023\/03\/1-51.jpg 619w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\" \/><\/p>\n<p>The startup, which recently released the tool that allows people to upload recordings of anyone speaking and use this to generate an artificial voice, will introduce additional \u201c<em>safeguards<\/em>\u201d following the misuse, reports said.<\/p>\n<p>Found on the image-based bulletin board website <em>4chan<\/em>, internet trolls used the said AI tool to make renowned personalities say \u201c<em>offensive<\/em>\u201d words. Among the celebrities whose voices have been deep faked were David Attenborough and <em>Harry Potter<\/em> star Emma Watson.<\/p>\n<p>Attenborough\u2019s voice was used to create a sweary rant about his career in the Navy Seals while Watson\u2019s was used to read passages from the book <em>Mein Kampf<\/em>, an autobiographical manifesto by Nazi Party leader Adolf Hitler. In one audio example, the fake voice of Joe Biden was used to announce the invasion of Russia.<\/p>\n<p>Other well-known people whose voices were faked were Joe Rogan, James Cameron and Tom Cruise as well as a range of fictional characters reading racist and misogynist hate speech.<\/p>\n<p>\u201c<em>Crazy weekend \u2013 thank you to everyone for trying out our Beta platform. While we see our tech being overwhelmingly applied to beneficial use, we also see an increasing number of voice cloning misuse cases. We want to reach out to the Twitter community for thoughts and feedback!<\/em>\u201d The company tweeted and replied to the same thread with: \u201c<em>While we can trace back any generated audio back to the user, we\u2019d like to address this by implementing additional safeguards<\/em>.\u201d<\/p>\n<p>The firm\u2019s current plan of action includes additional account verifications to enable voice cloning, such as payment info or even full ID verification; verifying copyright to the voice by submitting a sample with prompt text; and drop voice lab altogether and manually verify each cloning request.<\/p>\n<p>At the moment, the tool is still in the same state as the company aims to give people access to \u201c<em>compelling, rich and lifelike voices<\/em>\u201d for storytelling. Despite the controversy, the tool has been described by some as \u201c<em>the most realistic AI text-to-voice platform seen<\/em>.\u201d<\/p>\n<p>ElevenLabs was founded by Mati Staniszewski, an ex-Palantir deployment strategist, and Piotr Dabkowski, an ex-Google machine learning engineer. The two also created voice cloning and dubbing abilities for film and publishing industries. They declared they received funding of \u00a31.6 million ($1.93 million).<\/p>\n<p><strong>Microsoft: Voice cloning tools can be used by cybercriminals for scamming and fraudulent purposes<\/strong><\/p>\n<p>Earlier in the year, another artificial intelligence advancement from Big Tech company Microsoft was introduced to the market. The program, called VALL-E, designed for text-to-speech synthesis, can clone the voice after hearing a person speak for a mere three seconds.<\/p>\n<p>According to PCMag\u2019s Michael Kan, a team of the tech giant\u2019s researchers created the technology by having the system listen to 60,000 hours of English audiobook narration from over 7,000 different speakers to get it to reproduce human-sounding speech. This sample is hundreds of times larger than what other text-to-speech programs have been built on.<\/p>\n<p>According to the makers, the AI-powered program can manipulate the cloned voice to say whatever is desired and replicate emotion in a person\u2019s voice or be configured into different speaking styles.<\/p>\n<p>\u201c<em>Since VALL-E could synthesize speech that maintains speaker identity, it may carry potential risks in misuse of the model, such as spoofing voice identification or impersonating a specific speaker<\/em>,\u201d the Microsoft researchers wrote in their paper.<\/p>\n<p>\u201c<em>The technology, while impressive, would make it easy for cybercriminals to clone people\u2019s voices for scam and identity fraud purposes<\/em>,\u201d Kan commented, adding that it\u2019s actually not hard to imagine the same technology fueling cybercrime when even the inventor of the technology acknowledges potential threats.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>yogaesoteric<br \/>\nMarch 24, 2023<\/strong><\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The firm ElevenLabs, maker of the Prime Voice artificial intelligence voice cloner, is currently under fire as trolls have flooded social media with audio deep fakes, featuring celebrity voices making racist statements and calling for violence using its tool. The startup, which recently released the tool that allows people to upload recordings of anyone speaking [&hellip;]<\/p>\n","protected":false},"author":5,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_uf_show_specific_survey":0,"_uf_disable_surveys":false,"footnotes":""},"categories":[1374],"tags":[],"class_list":["post-115014","post","type-post","status-publish","format-standard","hentry","category-the-threat-of-artificial-intelligence-3480-en"],"_links":{"self":[{"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/posts\/115014","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/comments?post=115014"}],"version-history":[{"count":1,"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/posts\/115014\/revisions"}],"predecessor-version":[{"id":115020,"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/posts\/115014\/revisions\/115020"}],"wp:attachment":[{"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/media?parent=115014"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/categories?post=115014"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/yogaesoteric.net\/en\/wp-json\/wp\/v2\/tags?post=115014"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}