A Review on Offloading Algorithms in Edge/Cloud Environment
A Review on Offloading Algorithms
Edge computing is a new paradigm to provide cloud computing capabilities at the edge of pervasive radio access networks close to mobile users. Efficient offloading algorithms are needed to allow mobile devices and the edge cloud to work together. This review article investigates the key issues, methods, and various state-of-the-art efforts related to the offloading problem. We aim to draw an overall “big picture” on the existing efforts and research directions through comprehensive discussions. Our study also indicates that the offloading algorithms in the edge cloud have demonstrated profound potentials for future technology and application development.
 M. Aazam, S. Zeadally, and K. A. Harras, "Offloading in fog computing for IoT: Review, enabling technologies, and research opportunities," Future Generation Computer Systems, vol. 87, pp. 278-289, 2018.
 R. Buyya, R. Ranjan, and R. N. Calheiros, "Modeling and simulation of scalable Cloud computing environments and the CloudSim toolkit: Challenges and opportunities," in 2009 international conference on high performance computing & simulation, 2009, pp. 1-11: IEEE.
 X. Chen, L. Jiao, W. Li, and X. Fu, "Efficient multi-user computation offloading for mobile-edge cloud computing," IEEE/ACM Transactions on Networking, vol. 24, no. 5, pp. 2795-2808, 2015.
 A. Shahidinejad and S. Barshandeh, "Sink selection and clustering using fuzzy‐based controller for wireless sensor networks," International Journal of Communication Systems, vol. 33, no. 15, p. e4557, 2020.
 M. Chiang, P. Hande, and T. Lan, Power control in wireless cellular networks. Now Publishers Inc, 2008.
 A. Shahidinejad and M. Ghobaei‐Arani, "Joint computation offloading and resource provisioning for e dge‐cloud computing environment: A machine learning‐based approach," Software: Practice and Experience, vol. 50, no. 12, pp. 2212-2230, 2020.
 B. Dab, N. Aitsaadi, and R. Langar, "Q-learning algorithm for joint computation offloading and resource allocation in edge cloud," in 2019 IFIP/IEEE Symposium on Integrated Network and Service Management (IM), 2019, pp. 45-52: IEEE.
 Y. Dong, S. Guo, J. Liu, and Y. Yang, "Energy-efficient fair cooperation fog computing in mobile edge networks for smart city," IEEE Internet of Things Journal, vol. 6, no. 5, pp. 7543-7554, 2019.
 H. Gupta, A. Vahid Dastjerdi, S. K. Ghosh, and R. Buyya, "iFogSim: A toolkit for modeling and simulation of resource management techniques in the Internet of Things, Edge and Fog computing environments," Software: Practice and Experience, vol. 47, no. 9, pp. 1275-1296, 2017.
 K. Ha, Z. Chen, W. Hu, W. Richter, P. Pillai, and M. Satyanarayanan, "Towards wearable cognitive assistance," in Proceedings of the 12th annual international conference on Mobile systems, applications, and services, 2014, pp. 68-81.
 D. Huang, P. Wang, and D. Niyato, "A dynamic offloading algorithm for mobile computing," IEEE Transactions on Wireless Communications, vol. 11, no. 6, pp. 1991-1995, 2012.
 S. Hochreiter and J. Schmidhuber, "Long short-term memory," Neural computation, vol. 9, no. 8, pp. 1735-1780, 1997.
 A. Shahidinejad et al., "Network system engineering by controlling the chaotic signals using silicon micro ring resonator," in 2012 International Conference on Computer and Communication Engineering (ICCCE), 2012, pp. 765-769: IEEE.
 L. Huang, X. Feng, C. Zhang, L. Qian, and Y. Wu, "Deep reinforcement learning-based joint task offloading and bandwidth allocation for multi-user mobile edge computing," Digital Communications and Networks, vol. 5, no. 1, pp. 10-17, 2019.
 A. Shahidinejad, A. Nikoukar, T. Anwar, and A. Selamat, "Optical wireless quantum communication coding system using decimal convertor," Optical and Quantum Electronics, vol. 45, no. 5, pp. 449-457, 2013.
 X. Huang, Y. Cui, Q. Chen, and J. Zhang, "Joint Task Offloading and QoS-aware Resource Allocation in Fog-enabled Internet of Things Networks," IEEE Internet of Things Journal, 2020.
 G. Huerta-Canepa and D. Lee, "An adaptable application offloading scheme based on application behavior," in 22nd International Conference on Advanced Information Networking and Applications-Workshops (aina workshops 2008), 2008, pp. 387-392: IEEE.
 P. Jamshidi, A. M. Sharifloo, C. Pahl, A. Metzger, and G. Estrada, "Self-learning cloud controllers: Fuzzy q-learning for knowledge evolution," in 2015 International Conference on Cloud and Autonomic Computing, 2015, pp. 208-211: IEEE.
 L. U. Khan, I. Yaqoob, N. H. Tran, S. A. Kazmi, T. N. Dang, and C. S. Hong, "Edge computing enabled smart cities: A comprehensive survey," IEEE Internet of Things Journal, 2020.
 A. Shahidinejad, M. Ghobaei-Arani, and L. Esmaeili, "An elastic controller using Colored Petri Nets in cloud computing environment," Cluster Computing, pp. 1-27, 2019.
 N. Kiran, C. Pan, S. Wang, and C. Yin, "Joint resource allocation and computation offloading in mobile edge computing for SDN based wireless networks," Journal of Communications and Networks, vol. 22, no. 1, pp. 1-11, 2019.
 D. López-Pérez, X. Chu, A. V. Vasilakos, and H. Claussen, "On distributed and coordinated resource allocation for interference mitigation in self-organizing LTE networks," IEEE/ACM Transactions on Networking, vol. 21, no. 4, pp. 1145-1158, 2012.
 Y. Mao, C. You, J. Zhang, K. Huang, and K. B. Letaief, "A survey on mobile edge computing: The communication perspective," IEEE Communications Surveys & Tutorials, vol. 19, no. 4, pp. 2322-2358, 2017.
 A. P. Miettinen and J. K. Nurminen, "Energy efficiency of mobile clients in cloud computing," HotCloud, vol. 10, no. 4-4, p. 19, 2010.
 A. Shahidinejad and S. Fathi, "Wireless-assisted multiple network on chip using microring resonators," Microprocessors and Microsystems, vol. 63, pp. 190-198, 2018.
 G. Mitsis, P. A. Apostolopoulos, E. E. Tsiropoulou, and S. Papavassiliou, "Intelligent dynamic data offloading in a competitive mobile edge computing market," Future Internet, vol. 11, no. 5, p. 118, 2019.
 K. S. Narendra and S. Mukhopadhyay, "Mutual Learning: Part I-Learning Automata," in 2019 American Control Conference (ACC), 2019, pp. 916-921: IEEE.
 A. Shahidinejad, E. Nikoogoftar, and R. Ahsan, "Software as a Service Placement in the Cloud Computing Using Genetic Algorithm," International Journal Series in Engineering Science (IJSES)(ISSN: 2455-3328), vol. 6, pp. 22-33, 2020.
 K. S. Narendra and M. A. Thathachar, Learning automata: an introduction. Courier corporation, 2012.
 Q.-V. Pham, T. Leanh, N. H. Tran, B. J. Park, and C. S. Hong, "Decentralized computation offloading and resource allocation for mobile-edge computing: A matching game approach," IEEE Access, vol. 6, pp. 75868-75885, 2018.
 A. Rezvanian, B. Moradabadi, M. Ghavipour, M. M. D. Khomami, and M. R. Meybodi, "Introduction to Learning Automata Models," in Learning Automata Approach for Social Networks: Springer, 2019, pp. 1-49.
 K. Smagulova and A. P. James, "A survey on LSTM memristive neural network architectures and applications," The European Physical Journal Special Topics, vol. 228, no. 10, pp. 2313-2324, 2019.
 A. Shahidinejad, "Elasticity Management in Cloud Computing Using Colored Petri Net," TABRIZ JOURNAL OF ELECTRICAL ENGINEERING, vol. 50, no. 3, pp. 1261-1272, 2020.
 R. S. Sutton and A. G. Barto, Reinforcement learning: An introduction. MIT press, 2018.
 U. Tadakamalla and D. A. Menascé, "Characterization of IoT Workloads," in International Conference on Edge Computing, 2019, pp. 1-15: Springer.
 H. Van Hasselt, A. Guez, and D. Silver, "Deep reinforcement learning with double q-learning," in Thirtieth AAAI conference on artificial intelligence, 2016.
 A. Shahidinejad, I. S. Amiri, and T. Anwar, "Enhancement of indoor wavelength division multiplexing-based optical wireless communication using microring resonator," Reviews in Theoretical Science, vol. 2, no. 3, pp. 201-210, 2014.
 L. Wang, H. Qu, S. Liu, and C. Chen, "Optimizing the joint replenishment and channel coordination problem under supply chain environment using a simple and effective differential evolution algorithm," Discrete Dynamics in Nature and Society, vol. 2014, 2014.
 X. Wang, Y. Han, V. C. Leung, D. Niyato, X. Yan, and X. Chen, "Convergence of edge computing and deep learning: A comprehensive survey," IEEE Communications Surveys & Tutorials, vol. 22, no. 2, pp. 869-904, 2020.
 A. Shahidinejad, M. Ghobaei-Arani, and M. Masdari, "Resource provisioning using workload clustering in cloud computing environment: a hybrid approach," Cluster Computing, pp. 1-24, 2020.
 Y. Wang, K. Wang, H. Huang, T. Miyazaki, and S. Guo, "Traffic and computation co-offloading with reinforcement learning in fog computing for industrial applications," IEEE Transactions on Industrial Informatics, vol. 15, no. 2, pp. 976-986, 2018.
 C. Xian, Y.-H. Lu, and Z. Li, "Adaptive computation offloading for energy conservation on battery-powered systems," in 2007 International conference on parallel and distributed systems, 2007, pp. 1-8: IEEE.
 J. Xu, L. Chen, and S. Ren, "Online learning for offloading and autoscaling in energy harvesting mobile edge computing," IEEE Transactions on Cognitive Communications and Networking, vol. 3, no. 3, pp. 361-373, 2017.
 J. Yan, S. Bi, and Y.-J. A. Zhang, "Offloading and Resource Allocation with General Task Graph in Mobile Edge Computing: A Deep Reinforcement Learning Approach," IEEE Transactions on Wireless Communications, 2020.
 Z. Yang, Y. Liu, Y. Chen, and L. Jiao, "Learning automata based Q-learning for content placement in cooperative caching," IEEE Transactions on Communications, 2020.
 S. Yi, Z. Hao, Z. Qin, and Q. Li, "Fog computing: Platform and applications," in 2015 Third IEEE Workshop on Hot Topics in Web Systems and Technologies (HotWeb), 2015, pp. 73-78: IEEE.
 J. Zhang, J. Du, Y. Shen, and J. Wang, "Dynamic Computation Offloading with Energy Harvesting Devices: A Hybrid Decision Based Deep Reinforcement Learning Approach," IEEE Internet of Things Journal, 2020.
 J. Zhang, W. Xia, F. Yan, and L. Shen, "Joint computation offloading and resource allocation optimization in heterogeneous networks with mobile edge computing," IEEE Access, vol. 6, pp. 19324-19337, 2018.
 A. Shahidinejad, A. Azarpira, T. Anwar, and O. Spaniol, "Quantum cryptography coding system for optical wireless communication," Journal of Optoelectronics and Advanced Materials, vol. 16, no. July-August 2014, pp. 892-897, 2014.
 W. Zhang, Z. Zhang, S. Zeadally, H.-C. Chao, and V. C. Leung, "Energy-efficient Workload Allocation and Computation Resource Configuration in Distributed Cloud/Edge Computing Systems With Stochastic Workloads," IEEE Journal on Selected Areas in Communications, vol. 38, no. 6, pp. 1118-1132, 2020.
 Y. Zhang, B. Di, P. Wang, J. Lin, and L. Song, "HetMEC: Heterogeneous Multi-Layer Mobile Edge Computing in the 6 G Era," IEEE Transactions on Vehicular Technology, vol. 69, no. 4, pp. 4388-4400, 2020.
 A. Zhu, S. Guo, B. Liu, M. Ma, J. Yao, and X. Su, "Adaptive Multiservice Heterogeneous Network Selection Scheme in Mobile Edge Computing," IEEE Internet of Things Journal, vol. 6, no. 4, pp. 6862-6875, 2019.