Log in to save to my catalogue

1st Place Solution for 5th LSVOS Challenge: Referring Video Object Segmentation

1st Place Solution for 5th LSVOS Challenge: Referring Video Object Segmentation

https://devfeature-collection.sl.nsw.gov.au/record/TN_cdi_proquest_journals_2908927612

1st Place Solution for 5th LSVOS Challenge: Referring Video Object Segmentation

About this item

Full title

1st Place Solution for 5th LSVOS Challenge: Referring Video Object Segmentation

Publisher

Ithaca: Cornell University Library, arXiv.org

Journal title

arXiv.org, 2024-01

Language

English

Formats

Publication information

Publisher

Ithaca: Cornell University Library, arXiv.org

Subjects

Subjects and topics

More information

Scope and Contents

Contents

The recent transformer-based models have dominated the Referring Video Object Segmentation (RVOS) task due to the superior performance. Most prior works adopt unified DETR framework to generate segmentation masks in query-to-instance manner. In this work, we integrate strengths of that leading RVOS models to build up an effective paradigm. We first obtain binary mask sequences from the RVOS models. To improve the consistency and quality of masks, we propose Two-Stage Multi-Model Fusion strategy. Each stage rationally ensembles RVOS models based on framework design as well as training strategy, and leverages different video object segmentation (VOS) models to enhance mask coherence by object propagation mechanism. Our method achieves 75.7% J&F on Ref-Youtube-VOS validation set and 70% J&F on test set, which ranks 1st place on 5th Large-scale Video Object Segmentation Challenge (ICCV 2023) track 3. Code is available at https://github.com/RobertLuo1/iccv2023_RVOS_Challenge....

Alternative Titles

Full title

1st Place Solution for 5th LSVOS Challenge: Referring Video Object Segmentation

Identifiers

Primary Identifiers

Record Identifier

TN_cdi_proquest_journals_2908927612

Permalink

https://devfeature-collection.sl.nsw.gov.au/record/TN_cdi_proquest_journals_2908927612

Other Identifiers

E-ISSN

2331-8422

How to access this item