Machine Learning Approaches for Resource Allocation in Heterogeneous Cloud-Edge Computing
DOI:
https://doi.org/10.32628/CSEIT25112758Keywords:
cloud computing, edge computing, machine learning, resource allocation, reinforcement learning, federated learning, deep learning, heterogeneous computing, quality of service, energy efficiencyAbstract
Heterogeneous cloud-edge computing environments present unique challenges in resource allocation due to their distributed nature, varying computational capabilities, and dynamic workload patterns. This paper presents a comprehensive analysis of machine learning approaches for optimizing resource allocation in these environments. I categorize and evaluate various ML techniques including reinforcement learning, deep learning, and federated learning approaches, highlighting their strengths and limitations. A comparative analysis of these techniques demonstrates that hybrid approaches combining reinforcement learning with deep neural networks achieve 18-22% better resource utilization and 15% lower latency compared to traditional heuristic methods. I also propose a novel adaptive resource allocation framework that dynamically adjusts allocation policies based on changing network conditions and application requirements, demonstrating superior performance in real-world testbeds.
Downloads
References
W. Shi, J. Cao, Q. Zhang, Y. Li, and L. Xu, "Edge computing: Vision and challenges," IEEE Internet of Things Journal, vol. 3, no. 5, pp. 637–646, Oct. 2016.
A. Yousefptheet al., "All one needs to know about fog computing and related edge computing paradigms: A complete survey," Journal of Systems Architecture, vol. 98, pp. 289–330, 2019.
L. Kleinrock, "Queueing Systems, Volume 1: Theory," Wiley-Interscience, 1975.
M. Satyanarayanan, "The emergence of edge computing," Computer, vol. 50, no. 1, pp. 30–39, Jan. 2017.
V. Cardellini, V. De Nitto Persone, V. Di Valerio, F. Facchinei, V. Grassi, F. Lo Presti, and V. Piccialli, "A game-theoretic approach to computation offloading in mobile cloud computing," Mathematical Programming, vol. 157, no. 2, pp. 421–449, 2016.
Y. Mao, C. You, J. Zhang, K. Huang, and K. B. Letaief, "A survey on mobile edge computing: The communication perspective," IEEE Communications Surveys & Tutorials, vol. 19, no. 4, pp. 2322–2358, 2017.
N. Wang, B. Varghese, M. Matthaiou, and D. S. Nikolopoulos, "ENORM: A framework for edge node resource management," IEEE Transactions on Services Computing, vol. 13, no. 6, pp. 1086–1099, 2020.
H. Li, M. Dong, K. Ota, and M. Guo, "Pricing and repurchasing for big data processing in multi-clouds," IEEE Transactions on Emerging Topics in Computing, vol. 4, no. 2, pp. 266–277, 2016.
R. Yu, G. Xue, and X. Zhang, "QoS-aware and reliable traffic steering for service function chaining in mobile networks," IEEE Journal on Selected Areas in Communications, vol. 35, no. 11, pp. 2522–2531, 2017.
C. J. C. H. Watkins and P. Dayan, "Q-learning," Machine Learning, vol. 8, pp. 279–292, 1992.
V. Mnih et al., "Human-level control through deep reinforcement learning," Nature, vol. 518, no. 7540, pp. 529–533, 2015.
X. Chen, H. Zhang, C. Wu, S. Mao, Y. Ji, and M. Bennis, "Optimized computation offloading performance in virtual edge computing systems via deep reinforcement learning," IEEE Internet of Things Journal, vol. 6, no. 3, pp. 4005–4018, 2019.
R. S. Sutton, D. McAllester, S. Singh, and Y. Mansour, "Policy gradient methods for reinforcement learning with function approximation," in Advances in Neural Information Processing Systems, 2000, pp. 1057–1063.
C. Zhang, Z. Liu, B. Gu, K. Yamori, and Y. Tanaka, "A deep reinforcement learning based approach for cost- and energy-aware multi-flow mobile data offloading," IEICE Transactions on Communications, vol. E102.B, no. 3, pp. 502–510, 2019.
L. Buşoniu, R. Babuška, and B. De Schutter, "Multi-agent reinforcement learning: An overview," in Innovations in Multi-Agent Systems and Applications, 2010, pp. 183–221.
T. Wang, X. Wang, Z. Cui, Y. Cao, and C. Sutton, "Multi-agent deep reinforcement learning for joint task offloading and resource allocation in edge computing networks," IEEE Transactions on Vehicular Technology, vol. 71, no. 4, pp. 4252–4266, 2022.
S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural Computation, vol. 9, no. 8, pp. 1735–1780, 1997.
J. Liu, H. Guo, J. Xiong, N. Kato, J. Zhang, and Y. Zhang, "Smart and resilient EV charging in SDN-enhanced vehicular edge computing networks," IEEE Journal on Selected Areas in Communications, vol. 38, no. 1, pp. 217–228, 2020.
A. Krizhevsky, I. Sutskever, and G. E. Hinton, "ImageNet classification with deep convolutional neural networks," in Advances in Neural Information Processing Systems, 2012, pp. 1097–1105.
C. Zhou and R. C. Paffenroth, "Anomaly detection with robust deep autoencoders," in Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2017, pp. 665–674.
B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas, "Communication-efficient learning of deep networks from decentralized data," in Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, 2017, pp. 1273–1282.
Q. Yang, Y. Liu, T. Chen, and Y. Tong, "Federated machine learning: Concept and applications," ACM Transactions on Intelligent Systems and Technology, vol. 10, no. 2, pp. 1–19, 2019.
K. Bonawitz et al., "Towards federated learning at scale: System design," in Proceedings of the 2nd SysML Conference, 2019.
T. P. Lillicrap et al., "Continuous control with deep reinforcement learning," in International Conference on Learning Representations, 2016.
Z. Xu, J. Tang, J. Meng, W. Zhang, Y. Wang, C. H. Liu, and D. Yang, "Experience-driven networking: A deep reinforcement learning based approach," in IEEE INFOCOM 2018, 2018, pp. 1871–1879.
S. J. Pan and Q. Yang, "A survey on transfer learning," IEEE Transactions on Knowledge and Data Engineering, vol. 22, no. 10, pp. 1345–1359, 2010.
J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, "Proximal policy optimization algorithms," arXiv preprint arXiv:1707.06347, 2017.
E. Cortez, A. Bonde, A. Muzio, M. Russinovich, M. Fontoura, and R. Bianchini, "Resource central: Understanding and predicting workloads for improved resource management in large cloud platforms," in Proceedings of the 26th Symposium on Operating Systems Principles, 2017, pp. 153–167
Downloads
Published
Issue
Section
License
Copyright (c) 2025 International Journal of Scientific Research in Computer Science, Engineering and Information Technology
This work is licensed under a Creative Commons Attribution 4.0 International License.