AIセキュリティポータル K Program
Can deepfakes be created by novice users?
Share
Abstract
Recent advancements in machine learning and computer vision have led to the proliferation of Deepfakes. As technology democratizes over time, there is an increasing fear that novice users can create Deepfakes, to discredit others and undermine public discourse. In this paper, we conduct user studies to understand whether participants with advanced computer skills and varying levels of computer science expertise can create Deepfakes of a person saying a target statement using limited media files. We conduct two studies; in the first study (n = 39) participants try creating a target Deepfake in a constrained time frame using any tool they desire. In the second study (n = 29) participants use pre-specified deep learning-based tools to create the same Deepfake. We find that for the first study, 23.1% of the participants successfully created complete Deepfakes with audio and video, whereas, for the second user study, 58.6% of the participants were successful in stitching target speech to the target video. We further use Deepfake detection software tools as well as human examiner-based analysis, to classify the successfully generated Deepfake outputs as fake, suspicious, or real. The software detector classified 80% of the Deepfakes as fake, whereas the human examiners classified 100% of the videos as fake. We conclude that creating Deepfakes is a simple enough task for a novice user given adequate tools and time; however, the resulting Deepfakes are not sufficiently real-looking and are unable to completely fool detection software as well as human examiners
CG 101: A Computer Graphics Industry Reference
T. Masson
Published: 1999
Zao’s deepfake face-swapping app shows uploading your photos is riskier than ever
Alexandros Antoniou
Published: 2019
Faceforensics++: Learning to detect manipulated facial images
Andreas Rossler, Davide Cozzolino, Luisa Verdoliva, Christian Riess, Justus Thies, Matthias Nießner
Published: 2019
Generative adversarial nets
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, Yoshua Bengio
Published: 2014
Face2face: Real-time face capture and reenactment of rgb videos
Justus Thies, Michael Zollhofer, Marc Stamminger, Christian Theobalt, Matthias Nießner
Published: 2016
Deep voice 3: Scaling text-to-speech with convolutional sequence learning
Wei Ping, Kainan Peng, Andrew Gibiansky, Sercan O Arik, Ajay Kannan, Sharan Narang, Jonathan Raiman, John Miller
Published: 2018
Forged authenticity: governing deepfake risks
Aengus Collins
Published: 2019
Am i a real or fake celebrity? evaluating face recognition and verification apis under deepfake impersonation attack
Shahroz Tariq, Sowon Jeon, Simon S. Woo
Published: 2022
Augmenting image classifiers using data augmentation generative adversarial networks
Antreas Antoniou, Amos Storkey, Harrison Edwards
Published: 2018
Deepfakes and disinformation: Exploring the impact of synthetic political video on deception, uncertainty, and trust in news
Cristian Vaccari, Andrew Chadwick
Published: 2020
Do (microtargeted) deepfakes have real effects on political attitudes?
Tom Dobber, Nadia Metoui, Damian Trilling, Natali Helberger, Claes de Vreese
Published: 2021
Synthesizing obama: learning lip sync from audio
Supasorn Suwajanakorn, Steven M Seitz, Ira Kemelmacher-Shlizerman
Published: 2017
A lip sync expert is all you need for speech to lip generation in the wild
KR Prajwal, Rudrabha Mukhopadhyay, Vinay P Namboodiri, CV Jawahar
Published: 2020
First order motion model for image animation
Aliaksandr Siarohin, St´ephane Lathuili`ere, Sergey Tulyakov, Elisa Ricci, Nicu Sebe
Published: 2019
Joint face detection and alignment using multi-task cascaded convolutional networks
K. Zhang, Z. Zhang, Z. Li, Y. Qiao
Published: 2016
Efficientnet: Rethinking model scaling for convolutional neural networks
Mingxing Tan, Quoc Le
Published: 2019
Mesonet: a compact facial video forgery detection network
Darius Afchar, Vincent Nozick, Junichi Yamagishi, Isao Echizen
Published: 2018
Towards solving the deepfake problem: An analysis on improving deepfake detection using dynamic face augmentation
Sowmen Das, Selim Seferbekov, Arup Datta, Md Islam, Md Amin
Published: 2021
The creation and detection of deepfakes: A survey
Y. Mirsky, W. Lee
Published: 2021
Deepfakes and beyond: A survey of face manipulation and fake detection
Ruben Tolosana, Ruben Vera-Rodriguez, Julian Fierrez, Aythami Morales, Javier Ortega-Garcia
Published: 2020
Seeing is believing: Exploring perceptual differences in deepfake videos
Rashid Tahir, Brishna Batool, Hira Jamshed, Mahnoor Jameel, Mubashir Anwar, Faizan Ahmed, Muhammad Adeel Zaffar, Muhammad Fareed Zaffar
Published: 2021
Fooled twice: People cannot detect deepfakes but think they can
Nils C K¨obis, Barbora Doleˇzalov´a, Ivan Soraperra
Published: 2021
Deepfake detection by human crowds, machines, and machine-informed crowds
Matthew Groh, Ziv Epstein, Chaz Firestone, Rosalind Picard
Published: 2022
Dispelling misconceptions and characterizing the failings of deepfake detection
Neal Mangaokar, Atul Prakash
Published: 2021
Deepfake creation using generative adversarial network
Hrutuja Satpute, Samruddhi Raut, Pragati Sapke, Mrudul Dixit
Published: 2020
Dispelling misconceptions and characterizing the failings of deepfake detection
Neal Mangaokar, Atul Prakash
Published: 2021
Master thesis: Real-time voice cloning
Corentin Jemine, et al.
Published: 2019
Natural tts synthesis by conditioning wavenet on mel spectrogram predictions
J. Shen, R. Pang, R. J. Weiss, M. Schuster, N. Jaitly, Z. Yang, Z. Chen, Y. Zhang, Y. Wang, R. Skerrv-Ryan, R. A. Saurous, Y. Agiomvrgianakis, Y. Wu
Published: 2018
Image-to-image translation with conditional adversarial networks
Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, Alexei A Efros
Published: 2017
A review on generative adversarial networks: Algorithms, theory, and applications
Jie Gui, Zhenan Sun, Yonggang Wen, Dacheng Tao, Jieping Ye
Published: 2021
Share