Multi-hop Video Super Resolution with Long-Term Consistency (MVSRGAN)
Issued Date
2023-01-01
Resource Type
ISSN
13807501
eISSN
15737721
Scopus ID
2-s2.0-85160078194
Journal Title
Multimedia Tools and Applications
Rights Holder(s)
SCOPUS
Bibliographic Citation
Multimedia Tools and Applications (2023)
Suggested Citation
Aditya W., Shih T.K., Thaipisutikul T., Lin C.Y. Multi-hop Video Super Resolution with Long-Term Consistency (MVSRGAN). Multimedia Tools and Applications (2023). doi:10.1007/s11042-023-15351-8 Retrieved from: https://repository.li.mahidol.ac.th/handle/123456789/82904
Title
Multi-hop Video Super Resolution with Long-Term Consistency (MVSRGAN)
Author(s)
Author's Affiliation
Other Contributor(s)
Abstract
Utilizing deep learning, and especially Generative Adversarial Networks (GANs), for super-resolution images has yielded auspicious results. However, performing super resolutions with a big difference in scaling between input and output will add a certain degree of difficulty. In this paper we propose a super resolution with multiple steps, which means scaling the image gradually to stimulate maximum results. Video super resolution (VSR) needs different treatment from single image super resolution (SISR). It requires a temporal connection in between the frames, but this has not been fully explored by most of the existing studies. This temporal feature is significant to maintain the video consistency, in term of video quality and motion continuity. Using this loss functions, we can avoid the inconsistent failure in the image which accumulate continuously over time. Finally, our method has been shown to generate a super-resolution video that maintains both the video quality and its motion continuity. The quantitative result has higher Peak Signal to Noise Ratio (PSNR) scores for the Vimeo90K, Vid4, and Fireworks datasets with 37.70, 29.91, and 31.28 respectively compared to the state-of-the-art methods. The result shows that our models is better than other state-of-the-art methods using a different dataset.