Channel-shuffled transformers for cross-modality person re-identification in video
3
Issued Date
2025-12-01
Resource Type
eISSN
20452322
Scopus ID
2-s2.0-105003867722
Journal Title
Scientific Reports
Volume
15
Issue
1
Rights Holder(s)
SCOPUS
Bibliographic Citation
Scientific Reports Vol.15 No.1 (2025)
Suggested Citation
Kasantikul R., Kusakunniran W., Wu Q., Wang Z. Channel-shuffled transformers for cross-modality person re-identification in video. Scientific Reports Vol.15 No.1 (2025). doi:10.1038/s41598-025-00063-w Retrieved from: https://repository.li.mahidol.ac.th/handle/123456789/109962
Title
Channel-shuffled transformers for cross-modality person re-identification in video
Author(s)
Author's Affiliation
Corresponding Author(s)
Other Contributor(s)
Abstract
Effective implementation of person re-identification (Re-ID) across different modalities (such as daylight vs night-vision) is crucial for Surveillance applications. Information from multiple frames is essential for effective re-identification, where visual components from individual frames become less reliable. While transformers can enhance the temporal information extraction, the large number of channels required for effective feature encoding introduces scaling challenges. This could lead to overfitting and instability during training. Therefore, we proposed a novel Channel-Shuffled Temporal Transformer (CSTT) for processing multi-frame sequences in conjunction with a ResNet backbone to form Hybrid Channel-Shuffled Transformer Net (HCSTNET). Replacing fully connected layers in standard multi-head attention with ShuffleNet-like structures is important for integration of transformer attention with a ResNet backbone. Applying ShuffleNet-like structures reduces overfitting through parameter reduction with channel-grouping, and further improves learned attention using channel-shuffling. According to our tests with the SYSU-MM01 dataset in comparison against simple averaging of multiple frames, only the temporal transformer with channel-shuffling achieved a measurable improvement over the baseline. We have also investigated the optimal partitioning of feature maps therein.