TY - JOUR
T1 - TVG-Streaming
T2 - Learning User Behaviors for QoE-Optimized 360-Degree Video Streaming
AU - Hu, Miao
AU - Chen, Jiawen
AU - Wu, Di
AU - Zhou, Yipeng
AU - Wang, Yi
AU - Dai, Hong Ning
N1 - Funding information:
This work was supported in part by the Key-Area Research and Development Program of Guangdong Province under Grant 2019B121204009; in part by the National Natural Science Foundation of China under Grant 62072486, Grant U1911201, Grant U2001209, Grant 61802452, and Grant 61872420; in part by the Guangdong Institute of Chinese Engineering Development Strategies under Grant 2019-GD-13 and Grant ARC DE180100950; in part by the Guangdong Basic and Applied Basic Research Foundation under Grant 2019B1515120031; in part by the Macao Science and Technology Development Fund under Grant 0026/2018/A1; and in part by the project “FANet: PCL Future Greater-Bay Area Network Facilities for Large-scale Experiments and Applications under Grant LZC0019.
Publisher copyright:
© 2020 IEEE.
PY - 2021/10
Y1 - 2021/10
N2 - 360-degree video streaming shows great potential to revolutionize the streaming market, by providing much better immersive experience than standard video streams. However, its wide adoption is hindered by the surging demand of network bandwidth due to multi-screen video transmission. To reduce the bandwidth cost, one promising approach is to predict a user’s field of view (FoV), and then prefetch video tiles that a user will view a few seconds ahead. The challenge lies in that user behaviors cannot be properly captured with very limited information, especially the viewing time spent on each tile and the FoV switching behavior are hard to predict. In this paper, we propose a novel 360-degree video streaming algorithm called TVG-Streaming to optimize user experiences by learning user view behaviors. Different from previous approaches, our idea is to exploit tile-view graphs (TVGs) generated by real user behaviors and accurately estimate the probability that each tile falls in the FoV. With the tile view probability, we can determine the bitrate of each tile for delivery and buffering with limited bandwidth budget so as to maximize users’ quality of experience (QoE). For evaluation, we conduct extensive experiments using real traces and the results show that our proposed TVG-Streaming algorithm significantly outperforms other algorithms by at least 20% improvement in terms of users’ QoE.
AB - 360-degree video streaming shows great potential to revolutionize the streaming market, by providing much better immersive experience than standard video streams. However, its wide adoption is hindered by the surging demand of network bandwidth due to multi-screen video transmission. To reduce the bandwidth cost, one promising approach is to predict a user’s field of view (FoV), and then prefetch video tiles that a user will view a few seconds ahead. The challenge lies in that user behaviors cannot be properly captured with very limited information, especially the viewing time spent on each tile and the FoV switching behavior are hard to predict. In this paper, we propose a novel 360-degree video streaming algorithm called TVG-Streaming to optimize user experiences by learning user view behaviors. Different from previous approaches, our idea is to exploit tile-view graphs (TVGs) generated by real user behaviors and accurately estimate the probability that each tile falls in the FoV. With the tile view probability, we can determine the bitrate of each tile for delivery and buffering with limited bandwidth budget so as to maximize users’ quality of experience (QoE). For evaluation, we conduct extensive experiments using real traces and the results show that our proposed TVG-Streaming algorithm significantly outperforms other algorithms by at least 20% improvement in terms of users’ QoE.
KW - 360-degree video
KW - streaming
KW - tile-view graph
UR - https://www.scopus.com/inward/record.uri?eid=2-s2.0-85098768396&doi=10.1109%2fTCSVT.2020.3046242&partnerID=40&md5=f0e35cb4892262b3989eb45fb24d9b15
U2 - 10.1109/TCSVT.2020.3046242
DO - 10.1109/TCSVT.2020.3046242
M3 - Journal article
SN - 1051-8215
VL - 31
SP - 4107
EP - 4120
JO - IEEE Transactions on Circuits and Systems for Video Technology
JF - IEEE Transactions on Circuits and Systems for Video Technology
IS - 10
ER -