research-article Free Access
- Authors:
- Felix Hechler University of Duisburg-Essen,
- Michael Rudolph University of Duisburg-Essen,
- Amr Rizk University of Duisburg-Essen
MMSys '24: Proceedings of the 15th ACM Multimedia Systems ConferenceApril 2024Pages 89–99https://doi.org/10.1145/3625468.3647614
Published:17 April 2024Publication History
- 0citation
- 7
- Downloads
Metrics
Total Citations0Total Downloads7Last 12 Months7
Last 6 weeks7
- Get Citation Alerts
New Citation Alert added!
This alert has been successfully added and will be sent to:
You will be notified whenever a record that you have chosen has been cited.
To manage your alert preferences, click on the button below.
Manage my Alerts
New Citation Alert!
Please log in to your account
- Publisher Site
- eReader
MMSys '24: Proceedings of the 15th ACM Multimedia Systems Conference
Just-in-Time Transcoding of 360° Video Streams
Pages 89–99
PreviousChapterNextChapter
ABSTRACT
Adaptive streaming of 360° tiled video requires encoding tiles to multiple qualities to support client decisions in the light of fluctuating bandwidth and dynamic view-ports. Some static approaches allocate fixed encoding resources independently of the scene complexity introducing a significant resource overhead while other static approaches add a substantial time delay relative to the source. As tiles of 360 ° video have a skewed popularity with a statistical concentration of the user requests static approaches are resource inefficient. Specifically, in live streaming the tile popularity and encoding time statistics are not present beforehand.
We present JITENC, a 360° streaming backend for network edge deployment that employs just-in-time encoding in response to incoming tile requests. JITENC leverages encoding time prediction to optimize the scheduling of tile encoding tasks, hence, it can also be used for live streaming given a real-time transcoding time deadline. Our prototype demonstrates that JITENC can achieve a perceived quality that is comparable to oversized static systems that encode all tiles in every quality while significantly reducing the computing resource utilization and power consumption.
References
- Prateek Agrawal, Anatoliy Zabrovskiy, Adithyan Ilangovan, Christian Timmerer, and Radu Prodan. 2021. FastTTPS: fast approach for video transcoding time prediction and scheduling for HTTP adaptive streaming videos. Cluster Computing 24, 3 (2021), 1605--1621.Google Scholar
Digital Library - Bastian Alt, Trevor Ballard, Ralf Steinmetz, Heinz Koeppl, and Amr Rizk. 2019. CBA: Contextual Quality Adaptation for Adaptive Bitrate Video Streaming. In IEEE INFOCOM - Conference on Computer Communications.Google Scholar
- Trevor Ballard, Carsten Griwodz, Ralf Steinmetz, and Amr Rizk. 2019. RATS: adaptive 360-degree live streaming. In Proc. of ACM Multimedia Systems Conference MMSys. 308--311.Google ScholarDigital Library
- Yixuan Ban, Lan Xie, Zhimin Xu, Xinggong Zhang, Zongming Guo, and Yue Wang. 2018. Cub360: Exploiting cross-users behaviors for viewport prediction in 360 video adaptive streaming. In IEEE International Conference on Multimedia and Expo (ICME). 1--6.Google ScholarCross Ref
- Yanan Bao, Tianxiao Zhang, Amit Pande, Huasen Wu, and Xin Liu. 2017. Motion-prediction-based multicast for 360-degree video transmissions. In IEEE International Conference on Sensing, Communication, and Networking (SECON). 1--9.Google ScholarDigital Library
- Abdelhak Bentaleb, Bayan Taani, Ali C Begen, Christian Timmerer, and Roger Zimmermann. 2018. A survey on bitrate adaptation schemes for streaming media over HTTP. IEEE Communications Surveys & Tutorials 21, 1 (2018), 562--585.Google ScholarCross Ref
- Divyashri Bhat, Amr Rizk, Michael Zink, and Ralf Steinmetz. 2018. SABR: Network-Assisted Content Distribution for QoE-Driven ABR Video Streaming. ACM Trans. Multimedia Comput. Commun. Appl. 14, 2s, Article 32 (apr 2018).Google ScholarDigital Library
- Syed Muhammad Ammar Hassan Bukhari, Emna Baccour, Kashif Bilal, Junaid Shuja, Aiman Erbad, and Muhammad Bilal. 2023. To transcode or not? A machine learning based edge video caching and transcoding strategy. Computers and Electrical Engineering 109 (2023), 108741.Google ScholarDigital Library
- Xavier Corbillon, Francesca De Simone, and Gwendal Simon. 2017. 360-degree video head movement dataset. In Proceedings of the 8th ACM on Multimedia Systems Conference. 199--204.Google ScholarDigital Library
- Xavier Corbillon, Gwendal Simon, Alisa Devlic, and Jacob Chakareski. 2017. Viewport-adaptive navigable 360-degree video delivery. In IEEE International Conference on Communications (ICC). 1--7.Google ScholarCross Ref
- Sunny Dutta, Tarik Taleb, Pantelis A Frangoudis, and Adlen Ksentini. 2016. On-the-fly QoE-aware transcoding in the mobile edge. In IEEE Global Communications Conference (GLOBECOM). 1--6.Google ScholarDigital Library
- Omar Eltobgy, Omar Arafa, and Mohamed Hefeeda. 2020. Mobile streaming of live 360-degree videos. IEEE Transactions on Multimedia 22, 12 (2020), 3139--3152.Google ScholarDigital Library
- Alireza Erfanian, Hadi Amirpour, Farzad Tashtarian, Christian Timmerer, and Hermann Hellwagner. 2021. LwTE: light-weight transcoding at the edge. IEEE Access 9 (2021), 112276--112289.Google ScholarCross Ref
- Ivan Farris, Tarik Taleb, Hannu Flinck, and Antonio Iera. 2018. Providing ultrashort latency to user-centric 5G applications at the mobile network edge. Transactions on Emerging Telecommunications Technologies 29, 4 (2018).Google ScholarDigital Library
- Xianglong Feng, Yao Liu, and Sheng Wei. 2020. LiveDeep: Online viewport prediction for live virtual reality streaming using lifelong deep learning. In IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 800--808.Google ScholarCross Ref
- Yashuang Guo, F. Richard Yu, Richard Yu, Jianping An, Kai Yang, Kun Yang, Chuqiao Yu, and Victor C. M. Leung. 2020. Adaptive Bitrate Streaming in Wireless Networks With Transcoding at Network Edge Using Deep Reinforcement Learning. IEEE Transactions on Vehicular Technology (2020).Google Scholar
- Fatima Haouari, Emna Baccour, Aiman Erbad, Amr Mohamed, and Mohsen Guizani. 2019. Transcoding resources forecasting and reservation for crowdsourced live streaming. In IEEE Global Communications Conference. 1--7.Google ScholarDigital Library
- Mohammad Hosseini. 2017. View-aware tile-based adaptations in 360 virtual reality video streaming. In IEEE Virtual Reality (VR). 423--424.Google Scholar
- Mohammad Hosseini and Viswanathan Swaminathan. 2016. Adaptive 360 VR video streaming: Divide and conquer. In IEEE International Symposium on Multimedia (ISM). 107--110.Google ScholarCross Ref
- Telephone Installations and Local Line. 1999. Subjective video quality assessment methods for multimedia applications. Networks 910, 37 (1999), 5.Google Scholar
- Fareed Jokhio, Adnan Ashraf, Sebastien Lafond, Ivan Porres, and Johan Lilius. 2013. Prediction-based dynamic resource allocation for video transcoding in cloud computing. In Euromicro International Conference on Parallel, Distributed, and Network-Based Processing. 254--261.Google ScholarDigital Library
- Pierre Lebreton and Kazuhisa Yamagishi. 2019. Study on user quitting rate for adaptive bitrate video streaming. In IEEE 21st International Workshop on Multimedia Signal Processing (MMSP). 1--6.Google ScholarCross Ref
- Chen Li, Mai Xu, Lai Jiang, Shanyi Zhang, and Xiaoming Tao. 2019. Viewport proposal CNN for 360° video quality assessment. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 10169--10178.Google Scholar
- Chunxi Li, Hongna Zhao, Yongxiang Zhao, Baoxian Zhang, Cheng Li, and Cheng Li. 2021. Joint Transcoding- and Recommending-Based Video Caching at Network Edges. IEEE Systems Journal (2021).Google Scholar
- Anahita Mahzari, Afshin Taghavi Nasrabadi, Aliehsan Samiei, and Ravi Prakash. 2018. Fov-aware edge caching for adaptive 360 video streaming. In Proceedings of the ACM International Conference on Multimedia. 173--181.Google ScholarDigital Library
- Konstantin Miller, Nicola Corda, Savvas Argyropoulos, Alexander Raake, and Adam Wolisz. 2013. Optimal adaptation trajectories for block-request adaptive video streaming. In International Packet Video Workshop. 1--8.Google ScholarCross Ref
- Hyunwoo Nam, Kyung-Hwa Kim, and Henning Schulzrinne. 2016. QoE matters more than QoS: Why people stop watching cat videos. In IEEE International Conference on Computer Communications INFOCOM. 1--9.Google ScholarDigital Library
- Hyunwoo Nam, Henning Schulzrinne, Hyunwoo Nam, Kyung-Hwa Kim, Henning Schulzrinne, Martín Varela, Hyunwoo Nam, Henning Schulzrinne, Toni Mäki, Hyunwoo Nam, et al. 2016. Youslow: What influences user abandonment behavior for internet video? Columbia University Rcp (2016).Google Scholar
- Afshin Taghavi Nasrabadi, Aliehsan Samiei, and Ravi Prakash. 2020. Viewport prediction for 360 videos: a clustering approach. In Proc. of ACM NOSSDAV. 34--39.Google ScholarDigital Library
- Duc V Nguyen, Huyen TT Tran, Anh T Pham, and Truong Cong Thang. 2019. An optimal tile-based approach for viewport-adaptive 360-degree video streaming. IEEE J. on Emerging and Selected Topics in Circuits and Systems (2019), 29--42.Google Scholar
- Cagri Ozcinar, Ana De Abreu, Sebastian Knorr, and Aljosa Smolic. 2017. Estimation of optimal encoding ladders for tiled 360 VR video in adaptive streaming systems. In IEEE International Symposium on Multimedia (ISM). 45--52.Google ScholarCross Ref
- Pekka Pääkkönen, Antti Heikkinen, and Tommi Aihkisalo. 2019. Online architecture for predicting live video transcoding resources. Journal of Cloud Computing 8, 1 (2019), 1--24.Google ScholarDigital Library
- Roger Pantos and William May. 2017. HTTP live streaming. Technical Report.Google Scholar
- Jounsup Park, Mingyuan Wu, Kuan-Ying Lee, Bo Chen, Klara Nahrstedt, Michael Zink, and Ramesh Sitaraman. 2020. SEAWARE: Semantic Aware View Prediction System for 360-degree Video Streaming. In IEEE International Symposium on Multimedia (ISM). 57--64.Google ScholarCross Ref
- Waqas Ur Rahman, Dooyeol Yun, and Kwangsue Chung. 2016. A client side buffer management algorithm to improve QoE. IEEE Transactions on Consumer Electronics 62, 4 (2016), 371--379.Google ScholarCross Ref
- Iraj Sodagar. 2011. The mpeg-dash standard for multimedia streaming over the Internet. IEEE multimedia 18, 4 (2011), 62--67.Google ScholarDigital Library
- Kevin Spiteri, Rahul Urgaonkar, and Ramesh K Sitaraman. 2020. BOLA: Near-optimal bitrate adaptation for online videos. IEEE/ACM Transactions on Networking 28, 4 (2020), 1698--1711.Google ScholarDigital Library
- Denny Stohr, Alexander Frömmgen, Amr Rizk, Michael Zink, Ralf Steinmetz, and Wolfgang Effelsberg. 2017. Where are the Sweet Spots? A Systematic Approach to Reproducible DASH Player Comparisons. In Proceedings of the 25th ACM International Conference on Multimedia. 1113--1121.Google ScholarDigital Library
- Wei Sun, Xiongkuo Min, Guangtao Zhai, Ke Gu, Huiyu Duan, and Siwei Ma. 2019. MC360IQA: A multi-channel CNN for blind 360-degree image quality assessment. IEEE Journal of Selected Topics in Signal Processing 14, 1 (2019), 64--77.Google ScholarCross Ref
- Truong Cong Thang, Hung T Le, Anh T Pham, and Yong Man Ro. 2014. An evaluation of bitrate adaptation methods for HTTP live streaming. IEEE Journal on Selected Areas in Communications 32, 4 (2014), 693--705.Google ScholarCross Ref
- E. Thomas, M.O. van Deventer, T. Stockhammer, A.C. Begen, and J. Famaey. 2015. Enhancing MPEG dash performance via server and network assistance. IET Conference Proceedings (2015).Google Scholar
- Mengbai Xiao, Chao Zhou, Yao Liu, and Songqing Chen. 2017. Optile: Toward optimal tiling in 360-degree video streaming. In Proceedings of ACM International Conference on Multimedia. 708--716.Google ScholarDigital Library
- Lan Xie, Zhimin Xu, Yixuan Ban, Xinggong Zhang, and Zongming Guo. 2017. 360probdash: Improving qoe of 360 video streaming using tile-based http adaptive streaming. In Proc. ACM International Conference on Multimedia. 315--323.Google ScholarDigital Library
- Abid Yaqoob, Ting Bi, and Gabriel-Miro Muntean. 2020. A survey on adaptive 360 video streaming: Solutions, challenges and opportunities. IEEE Communications Surveys & Tutorials 22, 4 (2020), 2801--2838.Google ScholarCross Ref
- Jun Yi, Md Reazul Islam, Shivang Aggarwal, Dimitrios Koutsonikolas, Y Charlie Hu, and Zhisheng Yan. 2020. An analysis of delay in live 360°video streaming systems. In Proc. of ACM International Conference on Multimedia. 982--990.Google Scholar
- Anatoliy Zabrovskiy, Prateek Agrawal, Roland Matha, Christian Timmerer, and Radu Prodan. 2020. ComplexCTTP: complexity class based transcoding time prediction for video sequences using artificial neural network. In IEEE International conference on multimedia big data (BigMM). 316--325.Google ScholarCross Ref
- Anatoliy Zabrovskiy, Prateek Agrawal, Christian Timmerer, and Radu Prodan. 2021. FAUST: fast per-scene encoding using entropy-based scene detection and machine learning. In Conference of Open Innovations Association FRUCT. 292--302.Google ScholarCross Ref
- Mohammad Reza Zakerinasab and Mea Wang. 2015. Does chunk size matter in distributed video transcoding?. In IEEE International Symposium on Quality of Service (IWQos). 69--70.Google ScholarCross Ref
- Xuan Kelvin Zou, Jeffrey Erman, Vijay Gopalakrishnan, Emir Halepovic, Rittwik Jana, Xin Jin, Jennifer Rexford, and Rakesh K Sinha. 2015. Can accurate predictions improve video streaming in cellular networks?. In Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications. 57--62.Google ScholarDigital Library
Cited By
View all
Recommendations
- Video encoding and transcoding using machine learning
MDM '08: Proceedings of the 9th International Workshop on Multimedia Data Mining: held in conjunction with the ACM SIGKDD 2008
Machine learning has been widely used in video analysis and search applications. In this paper, we describe a non-traditional use of machine learning in video processing - video encoding and transcoding. Video encoding and transcoding are ...
Read More
- FastTTPS: fast approach for video transcoding time prediction and scheduling for HTTP adaptive streaming videos
Abstract
HTTP adaptive streaming of video content becomes an integrated part of the Internet and dominates other streaming protocols and solutions. The duration of creating video content for adaptive streaming ranges from seconds or up to several hours or ...
Read More
- Multiview video transcoding: from multiple views to single view
PCS'09: Proceedings of the 27th conference on Picture Coding Symposium
As multiview video is gaining more and more attentions, Multiview Video Coding (MVC) standard has been under development by the Joint Video Team as an extension to H.264/AVC. There will be increasingly more multiview video sources for both high end and ...
Read More
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in
Full Access
Get this Publication
- Information
- Contributors
Published in
MMSys '24: Proceedings of the 15th ACM Multimedia Systems Conference
April 2024
557 pages
ISBN:9798400704123
DOI:10.1145/3625468
Copyright © 2024 ACM
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [emailprotected].
Sponsors
In-Cooperation
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
- Published: 17 April 2024
Permissions
Request permissions about this article.
Check for updates
Author Tags
- HTTP adaptive streaming
- Transcoding time prediction
- adaptive streaming
- transcoding
- video complexity
- video encoding
Qualifiers
- research-article
- Research
- Refereed limited
Conference
Acceptance Rates
Overall Acceptance Rate176of530submissions,33%
Funding Sources
Other Metrics
View Article Metrics
- Bibliometrics
- Citations0
Article Metrics
- View Citations
Total Citations
7
Total Downloads
- Downloads (Last 12 months)7
- Downloads (Last 6 weeks)7
Other Metrics
View Author Metrics
Cited By
This publication has not been cited yet
PDF Format
View or Download as a PDF file.
eReader
View online with eReader.
eReader
Digital Edition
View this article in digital edition.
View Digital Edition
- Figures
- Other
Close Figure Viewer
Browse AllReturn
Caption
View Table of Contents
Export Citations
Your Search Results Download Request
We are preparing your search results for download ...
We will inform you here when the file is ready.
Download now!
Your Search Results Download Request
Your file of search results citations is now ready.
Download now!
Your Search Results Download Request
Your search export query has expired. Please try again.
