{"id":9326,"date":"2024-10-14T19:47:24","date_gmt":"2024-10-14T19:47:24","guid":{"rendered":"https:\/\/journals.law.unc.edu\/ncjolt\/?p=9326"},"modified":"2024-10-30T12:59:38","modified_gmt":"2024-10-30T12:59:38","slug":"how-bad-should-the-deepfake-have-to-get-before-the-creator-is-punished%ef%bf%bc","status":"publish","type":"post","link":"https:\/\/journals.law.unc.edu\/ncjolt\/blogs\/how-bad-should-the-deepfake-have-to-get-before-the-creator-is-punished%ef%bf%bc\/","title":{"rendered":"How Bad Should the Deepfake Have to get Before the Creator is Punished?"},"content":{"rendered":"\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" src=\"https:\/\/journals.law.unc.edu\/ncjolt\/wp-content\/uploads\/sites\/4\/2024\/10\/AI1.png\" alt=\"\" class=\"wp-image-9327\" width=\"682\" height=\"689\" srcset=\"https:\/\/journals.law.unc.edu\/ncjolt\/wp-content\/uploads\/sites\/4\/2024\/10\/AI1.png 507w, https:\/\/journals.law.unc.edu\/ncjolt\/wp-content\/uploads\/sites\/4\/2024\/10\/AI1-297x300.png 297w\" sizes=\"(max-width: 682px) 100vw, 682px\" \/><figcaption>This image is generated by ChatGPT with the following prompt: \u201cGenerate a representative image for a deepfake.&#8221;<\/figcaption><\/figure>\n\n\n\n<p>Photos and videos have long been considered reliable sources of information. Because photographs and videos require their subjects\u2019 physical presence, such media tends to be fairly reliable in conveying information. However, that may no longer be the case.<\/p>\n\n\n\n<p>The advancement of artificial intelligence brought the rise of deepfakes. A deepfake is \u201c<a href=\"https:\/\/www.merriam-webster.com\/dictionary\/deepfake\">an image or recording that has been convincingly altered and manipulated to misrepresent someone as doing or saying something that was not actually done or said<\/a>.\u201d This means that with deepfakes, people can create realistic photographs and videos without the presence of real subjects.<\/p>\n\n\n\n<p><a href=\"https:\/\/pmc.ncbi.nlm.nih.gov\/articles\/PMC8602050\/\">The problem is that people generally cannot discern whether the pictures or videos are deepfake, despite their belief that they can<\/a>. This problem leaves society more susceptible to defamation. The American Bar Association took note of the <a href=\"https:\/\/www.americanbar.org\/groups\/public_interest\/election_law\/american-democracy\/resources\/deepfakes-american-elections\/\">potential problems that deepfakes present on elections<\/a> if the videos are left unchecked. For example, people can easily create videos that are altered to defame political candidates. Once created, social media would enable the video to reach a larger audience, because social media is not significantly regulated to handle this development in technology. Imagine someone posted a deepfake video of a presidential candidate engaging in a bar fight. How would people not be drawn to watch the video? Since social media would enable widespread viewership, the candidate would likely have their political career in peril.<\/p>\n\n\n\n<p>Recognizing this problem, California enacted <a href=\"https:\/\/leginfo.legislature.ca.gov\/faces\/billNavClient.xhtml?bill_id=201920200AB2329\">AB 2329<\/a> which restricts \u201c<a href=\"https:\/\/www.westlaw.com\/Document\/I3d039ef0817c11efa080ca124f8a912c\/View\/FullText.html?transitionType=Default&amp;contextData=(sc.Default)&amp;VR=3.0&amp;RS=cblt1.0\">any false or materially deceptive content that is \u2018reasonably likely\u2019 to harm the \u2018reputation or electoral prospects of a candidate<\/a>&#8216;\u201d (more than just defamation) according to the U.S. District Court in the Eastern District of California in <em>Khols v. Bonta<\/em>. But on October 2, 2024, the <em>Khols<\/em> court ruled that the law \u201c<a href=\"https:\/\/www.westlaw.com\/Document\/I3d039ef0817c11efa080ca124f8a912c\/View\/FullText.html?transitionType=Default&amp;contextData=(sc.Default)&amp;VR=3.0&amp;RS=cblt1.0\">does not pass constitutional scrutiny because the law does not use the least restrictive means available for advancing the State\u2019s interest.<\/a>\u201d Simply put, the court ruled AB 2329 unconstitutional because even \u201c<a href=\"https:\/\/www.westlaw.com\/Document\/I3d039ef0817c11efa080ca124f8a912c\/View\/FullText.html?transitionType=Default&amp;contextData=(sc.Default)&amp;VR=3.0&amp;RS=cblt1.0\">deliberate lies (said with \u201cactual malice\u201d) about the government are constitutionally protected<\/a>\u201d from prosecution, though not from civil liability.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote\"><p>the government should act to determine the &#8216;least restrictive means&#8217; to stop the harm caused by deepfake defamation.<\/p><\/blockquote>\n\n\n\n<p>But the <em>Khols<\/em> court understands that \u201c<a href=\"https:\/\/www.westlaw.com\/Document\/I3d039ef0817c11efa080ca124f8a912c\/View\/FullText.html?transitionType=Default&amp;contextData=(sc.Default)&amp;VR=3.0&amp;RS=cblt1.0\">California has a valid interest in protecting the integrity and reliability of the electoral process<\/a>.\u201d The court implies that AB 2329 could have been constitutional if the law had \u201c<a href=\"https:\/\/www.westlaw.com\/Document\/I3d039ef0817c11efa080ca124f8a912c\/View\/FullText.html?transitionType=Default&amp;contextData=(sc.Default)&amp;VR=3.0&amp;RS=cblt1.0\">the narrow tailoring and least restrictive alternative that a content based law requires under strict scrutiny.<\/a>\u201d Exactly what constitutes the \u201c<a href=\"https:\/\/www.westlaw.com\/Document\/I3d039ef0817c11efa080ca124f8a912c\/View\/FullText.html?transitionType=Default&amp;contextData=(sc.Default)&amp;VR=3.0&amp;RS=cblt1.0\">narrow tailoring and least restrictive alternative<\/a>\u201d remains unknown. Whether it would be proper to narrow the law\u2019s applicability to just defamation is also unknown. But one thing is clear: overcoming the \u201cstrict scrutiny\u201d is extremely difficult.&nbsp;<\/p>\n\n\n\n<p>The <em>Khols<\/em> court highlights the importance of freedom of speech while recognizing the need for the law to protect \u201c<a href=\"https:\/\/www.westlaw.com\/Document\/I3d039ef0817c11efa080ca124f8a912c\/View\/FullText.html?transitionType=Default&amp;contextData=(sc.Default)&amp;VR=3.0&amp;RS=cblt1.0\">the integrity and reliability of the electoral process.<\/a>\u201d But many questions remain unanswered. Is civil liability enough to safeguard the public and political candidates from defamation? Shouldn\u2019t there be more protection? How defaming should the deepfake need to be for the law to meet the \u201cnarrow tailoring?\u201d Clearly, posting a mere lie on social media is different from posting a realistic fake video. The aforementioned hypothetical presidential candidate would be much more harmed from the deepfake video of them engaging in a bar fight than from a mere claim or a parody video of the claim that they engaged in a bar fight. Accordingly, voters will be much more susceptible to these deepfakes, and the politician will be left with too much damage in reputation.<\/p>\n\n\n\n<p>This is another challenge that the advance in technology has presented. Exactly how society can resolve this challenge is unknown. But putting resources into resolving this problem is necessary to protect, not just political candidates, but the entire public from defamation.<\/p>\n\n\n\n<p><strong>Sunghyun Shin<\/strong><\/p>\n\n\n\n<p>Sunghyun Shin is a 2L at UNC School of Law and a staff member of the Journal of Law and Technology.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Photos and videos have long been considered reliable sources of information. Because photographs and videos require their subjects\u2019 physical presence, such media tends to be fairly reliable in conveying information. However, that may no longer be the case. The advancement of artificial intelligence brought the rise of deepfakes. A deepfake is \u201can image or recording <a href=\"https:\/\/journals.law.unc.edu\/ncjolt\/blogs\/how-bad-should-the-deepfake-have-to-get-before-the-creator-is-punished%ef%bf%bc\/\" class=\"more-link\">&#8230;<\/a><\/p>\n","protected":false},"author":4,"featured_media":9328,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[51],"tags":[416,297,573,429,575,574],"_links":{"self":[{"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/posts\/9326"}],"collection":[{"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/comments?post=9326"}],"version-history":[{"count":7,"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/posts\/9326\/revisions"}],"predecessor-version":[{"id":9370,"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/posts\/9326\/revisions\/9370"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/media\/9328"}],"wp:attachment":[{"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/media?parent=9326"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/categories?post=9326"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/journals.law.unc.edu\/ncjolt\/wp-json\/wp\/v2\/tags?post=9326"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}