A Transcoding Task Offloading and Routing Decision-Making Scheme in Live Transmission Architecture Based on Computing Power Network

Shujie Yang

¹ State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing 100876, China

In recent years, there has been a significant increase in the demand for high-bit-rate live broadcast services, which has led to the widespread use of edge transcoding technology. Edge transcoding can effectively reduce the throughput of streaming media transmission, making it a popular and extensively researched technology. However, due to the real-time requirements of live broadcasting, the edge server needs to have the sufficient computing power to ensure low-latency calculations, which makes computing power allocation and traffic distribution become quite difficult. Inspired by the real-time and flexible computing power scheduling ability of the Computing Power Network, this paper explores reasonable edge task offloading and efficient traffic routing path planning to ensure overall low latency. This paper proposes a live stream transmission architecture based on the computing power network to solve the problems mentioned above to some degree. The paper first models the computing power network in the scene and then designs a task offloading algorithm based on Deep Reinforcement Learning (DQN) to determine the device for executing the computing task. Furthermore, a hybrid Simulated Annealing Genetic Algorithm (SAGA) is proposed for routing decisions. The effectiveness and superiority of the scheme are validated through simulation experiments.

Live streaming architecture, computing power network, DQN-based task offloading, routing path decision, simulated annealing genetic algorithm

Zitong Li, Shuai Peng, Han Xiao, Shujie Yang and Changqiao Xu (2023). A Transcoding Task Offloading and Routing Decision-Making Scheme in Live Transmission Architecture Based on Computing Power Network. Journal of Networking and Network Applications, Volume 3, Issue 1, pp. 19–31. https://doi.org/10.33969/J-NaNA.2023.030103.

[1] Cisco, "Cisco Annual Internet Report (2018–2023) White Paper," March 2022. [Online]. Available:  https://www.cisco.com/c/en/us/solutions/collateral/executiveperspectives/annual-internet-report/white-paper-c11-741490.html.

[2] M. Dai, Z. Su, R. Li and S. Yu, "A Software-Defined-Networking-Enabled Approach for Edge-Cloud Computing in the Internet of Things," in IEEE Network, vol. 35, no. 5, pp. 66-73, September/October 2021.

[3] X. Wang, Z. Ning, L. Guo, S. Guo, X. Gao and G. Wang, "Online Learning for Distributed Computation Offloading in Wireless Powered Mobile Edge Computing Networks," in IEEE Transactions on Parallel and Distributed Systems, vol. 33, no. 8, pp. 1841-1855, 1 Aug. 2022.

[4] N. Hu, Z. Tian, X. Du, N. Guizani and Z. Zhu, "Deep-Green: A Dispersed Energy-Efficiency Computing Paradigm for Green Industrial IoT," in IEEE Transactions on Green Communications and Networking, vol. 5, no. 2, pp. 750-764, June 2021.

[5] J. Li, Z. Li, R. Lu, K. Xiao, S. Li, J. Chen, J. Yang, C. Zong, A. Chen, Q. Wu, C. Sun, G. Tyson, and H. Liu, "LiveNet: A Low-Latency Video Transport Network for Large-Scale Live Streaming," in Proc. ACM SIGCOMM, New York, NY, USA, Aug. 2022, pp. 812-825.

[6] E. Kwong, K. Pan, C. Lafata, and R. Puri, "Ingesting Live Video Streams at Global Scale," Twitch, Apr. 26, 2022. [On-line]. Available: https://blog.twitch.tv/zh-tw/2022/04/26/ingesting-live-video-streams-at-global-scale/.

[7] Q. Jia, R. Ding, H. Liu, C. Zhang, and R. Xie, "Survey on research progress for compute first networking," Chinese Journal of Network and Information Security, vol. 7, no. 3, pp. 1-12, Mar. 2021.

[8] M. Król, S. Mastorakis, D. Oran and D. Kutscher, "Compute First Net-working: Distributed Computing meets ICN," 2019 6th ACM Conference on Information-Centric Networking (ICN), Macao, SAR, China, 2019, pp.

67- 77.

[9] P. Rahimzadeh et al., "SPARCLE: Stream Processing Applications over Dispersed Computing Networks," 2020 IEEE 40th International Confer-ence on Distributed Computing Systems (ICDCS), 2020, pp. 1067-1078.

[10] Q. Chen, F. R. Yu, T. Huang, R. Xie, J. Liu and Y. Liu, "Joint Resource Allocation for Software-Defined Networking, Caching, and Computing," in IEEE/ACM Transactions on Networking, vol. 26, no. 1, pp. 274-287, Feb. 2018.

[11] X. Xu, J. Liu and X. Tao, "Mobile Edge Computing Enhanced Adaptive Bitrate Video Delivery With Joint Cache and Radio Resource Allocation," in IEEE Access, vol. 5, pp. 16406-16415, 2017.

[12] C. Liang and S. Hu, "Dynamic video streaming in caching-enabled wireless mobile networks," arXiv preprint arXiv:1706.09536, 2017.

[13] H. A. Pedersen and S. Dey, "Enhancing Mobile Video Capacity and Quality Using Rate Adaptation, RAN Caching and Processing," in IEEE/ACM Transactions on Networking, vol. 24, no. 2, pp. 996-1010, April 2016.

[14] Z. Wang, L. Sun, C. Wu, W. Zhu, Q. Zhuang and S. Yang, "A Joint Online Transcoding and Delivery Approach for Dynamic Adaptive Streaming," in IEEE Transactions on Multimedia, vol. 17, no. 6, pp. 867-879, June 2015.

[15] Y. Zheng, D. Wu, Y. Ke, C. Yang, M. Chen and G. Zhang, "Online Cloud Transcoding and Distribution for Crowdsourced Live Game Video Streaming," in IEEE Transactions on Circuits and Systems for Video Technology, vol. 27, no. 8, pp. 1777-1789, Aug. 2017.

[16] T. X. Tran, A. Hajisami, P. Pandey and D. Pompili, "Collaborative Mobile Edge Computing in 5G Networks: New Paradigms, Scenarios, and Challenges," in IEEE Communications Magazine, vol. 55, no. 4, pp.

54- 61, April 2017.

[17] T. Zahavy, N. Ben-Zrihem, and S. Mannor, "Graying the black box: Un-derstanding DQNs," in Proceedings of The 33rd International Conference on Machine Learning, M. F. Balcan and K. Q. Weinberger, Eds., vol. 48, New York, NY, USA, PMLR, 2016, pp. 1899-1908.

[18] G. Zhang, B. Tang, J. Sun and J. Li, "Ant colony routing strategy based on distribution uniformity degree for content-centric network," Journal on Communications, vol. 36, no. 6, pp. 2015126-1-2015126-12, Jun. 2015.

[19] F. Muchtar, A. A. Hanan, H. Suhaidi, K. A. Tajudin, and Z. K. Zuhairi. "Energy conservation of content routing through wireless broadcast control in NDN based MANET: A review," Journal of Network and Computer Applications, vol. 131, pp. 109-132, 2019, ISSN 1084-8045.

[20] H. Schulzrinne, A. Rao, R. Lanphier, M. Westerlund, and M. Stiemer-ling, “Real-Time Streaming Protocol Version 2.0,” in IEEE, RFC 7826, DOI 10.17487/RFC7826, Dec. 2016, pp. 1-102.

[21] K. Spiteri, R. Urgaonkar and R. K. Sitaraman, "BOLA: Near-Optimal Bitrate Adaptation for Online Videos," in IEEE/ACM Transactions on Networking, vol. 28, no. 4, pp. 1698-1711, Aug. 2020.

[22] A. Tamar, D. Di Castro, and S. Mannor, "Temporal Difference Methods for the Variance of the Reward To Go," in Proceedings of the 30th International Conference on Machine Learning, Sanjoy Dasgupta and David McAllester, Eds., vol. 28, no. 3, Atlanta, Georgia, USA, 17-19 Jun. 2013, pp. 495-503.

[23] J. H. Holland, "Genetic Algorithms and the Optimal Allocation of Trials," SIAM Journal on Computing, vol. 2, no. 2, pp. 88-105, 1973.

[24] R. Benedetti, M. M. Dickson, G. Espa, F. Pantalone and F. Piersimoni, "A simulated annealing-based algorithm for selecting balanced samples," in Computational Statistics, vol. 37, no. 1, pp. 491-505, Mar. 2022.

[25] R. Aparicio-Pardo, K. Pires, A. Blanc, and G. Simon, "Transcoding Live Adaptive Video Streams at a Massive Scale in the Cloud," in Proceedings of the 6th ACM Multimedia Systems Conference, MMSys ’15, Portland, Oregon, 2015, pp. 49-60.

[26] Z. Zhang, R. Wang, F. R. Yu, F. Fu and Q. Yan, "QoS Aware Transcoding for Live Streaming in Edge-Clouds Aided HetNets: An Enhanced Actor-Critic Approach," in IEEE Transactions on Vehicular Technology, vol. 68, no. 11, pp. 11295-11308, Nov. 2019, doi: 10.1109/TVT.2019.2942629.

[27] V. M. Vishnevsky, O. V. Semenova, and D. T. Bui, "Investigation of the Stochastic Polling System and Its Applications to Broadband Wireless Networks," Automation and Remote Control, vol. 82, no. 9, pp. 1607-1613, Sep. 2021.

[28] G. Malkin, "RIP Version 2," STD 56, RFC 2453, DOI: 10.17487/RFC2453, Nov. 1998.

[29] J. Moy, "OSPF Version 2," in STD 54, RFC 2328, Apr. 1998.