An Enhanced Rate-Distortion Performance Enabling 3D Video Adaptation Framework


Nur Yılmaz G. (Yürütücü), Çimtay Y.

Yükseköğretim Kurumları Destekli Proje, 2022 - 2023

  • Proje Türü: Yükseköğretim Kurumları Destekli Proje
  • Başlama Tarihi: Şubat 2022
  • Bitiş Tarihi: Ekim 2023

Proje Özeti

"A 3 Dimensional (3D) video is a new form of multimedia experience enabling a great realism and enjoyment of visual scenes due to the depth perception integrated into it. Even though this new multimedia form devises this advantage, it brings out several challenges to the 3D video service and technology providers due to the demand of the users for an enhanced level of the depth perception experience. This challenge is improved even more considering big multimedia data enabled through the heterogeneity of terminals, networks, user preferences, and viewing environment conditions. The spatial, temporal, and quality scalability options ensured by Scalable Video Coding (SVC) provide an attractive solution to cope with these challenges. While implementing the SVC, the latest encoding standards enable these options to be adapted in a within sequence prioritization manner while fulfilling the requirements of the network conditions. In addition, the enhancement layers of the quality scalability option are only symmetrically prioritized while achieving the target bit rate of a communication network. Moreover, a similar adaptation operation is carried out for each 3D video content in these standards. However, these manners cannot provide flexibility to the video adaptation operations, and adapting all of the 3D video contents in a similar way cannot enable an enhanced depth perception experience for each user. In the light of these facts, in this project, a novel 3D video adaptation framework will be developed to provide augmented Rate-Distortion (R-D) performances in terms of the improvement of the depth perception experience for the users and/or bit rate usage for the communication networks considering a flexible and symmetric/ asymmetric scalability option prioritization adaptation concept. This concept will be in line with different 3D video content features having an effect on the depth perception experience of the users. The color video and depth map-based 3D video representation form will be exploited in this framework due to the cost and efficiency advantages it has compared to the other representation forms. Considering these novel approaches, 3D video adaptation experiments will be conducted and prioritization schemes enabling priority assignment to the scalability option related parameters based on their content feature characteristics will be devised within this framework. It is envisaged that notable findings that will be devised as an outcome of this project can enable to development of intelligent 3D video technologies in a timely manner. Moreover, these technologies can lead to improvements in the application areas ranging from health to education, defense to game, and automotive to enjoyment. It should also be stressed that the 3D video adaptation framework outcome of this novel project is expected to be protected by a patent. Moreover, all of the outcomes of this research project will be published in prestigious international conferences and journals. In addition, the graduate students will be educated throughout the project and these students will join the researchers working in the project field. In addition to all these, the experiences that will be gained throughout this project will lead to other project applications."