Log in to save to my catalogue

TALL: Thumbnail Layout for Deepfake Video Detection

TALL: Thumbnail Layout for Deepfake Video Detection

https://devfeature-collection.sl.nsw.gov.au/record/TN_cdi_proquest_journals_2838442720

TALL: Thumbnail Layout for Deepfake Video Detection

About this item

Full title

TALL: Thumbnail Layout for Deepfake Video Detection

Publisher

Ithaca: Cornell University Library, arXiv.org

Journal title

arXiv.org, 2024-02

Language

English

Formats

Publication information

Publisher

Ithaca: Cornell University Library, arXiv.org

More information

Scope and Contents

Contents

The growing threats of deepfakes to society and cybersecurity have raised enormous public concerns, and increasing efforts have been devoted to this critical topic of deepfake video detection. Existing video methods achieve good performance but are computationally intensive. This paper introduces a simple yet effective strategy named Thumbnail Layout (TALL), which transforms a video clip into a pre-defined layout to realize the preservation of spatial and temporal dependencies. Specifically, consecutive frames are masked in a fixed position in each frame to improve generalization, then resized to sub-images and rearranged into a pre-defined layout as the thumbnail. TALL is model-agnostic and extremely simple by only modifying a few lines of code. Inspired by the success of vision transformers, we incorporate TALL into Swin Transformer, forming an efficient and effective method TALL-Swin. Extensive experiments on intra-dataset and cross-dataset validate the validity and superiority of TALL and SOTA TALL-Swin. TALL-Swin achieves 90.79\(\%\) AUC on the challenging cross-dataset task, FaceForensics++ \(\to\) Celeb-DF. The code is available at https://github.com/rainy-xu/TALL4Deepfake....

Alternative Titles

Full title

TALL: Thumbnail Layout for Deepfake Video Detection

Authors, Artists and Contributors

Identifiers

Primary Identifiers

Record Identifier

TN_cdi_proquest_journals_2838442720

Permalink

https://devfeature-collection.sl.nsw.gov.au/record/TN_cdi_proquest_journals_2838442720

Other Identifiers

E-ISSN

2331-8422

How to access this item