Optimized Q-Learning-Based Handover Decision Algorithm for Femtocells Using Load Balancing in LTE-A Networks
DOI:
https://doi.org/10.24203/c5q9y864Keywords:
LTE-A; Q-Learning; Load Balancing; Macrocell; Femtocell; CBR; VoIP.Abstract
The rapid growth of mobile devices and demand for mobile data has made it challenging to maintain capacity, high coverage, and data speed. With the emergence of small cell networks, the Long-Term Evolution (LTE) system helped to address these issues, Femtocell technology is being deployed to provide improved indoor coverage. However, a major challenge is the frequent handover and unequal distribution of cell loads, which lead to a reduction in call and data rates. Small cells have changing and unplanned load distribution over time, resulting in certain cells suffering high user density and strong resource competition, while others are having low user density and wasteful resource due to low consumption. This imbalance in cell load distribution greatly influences overall network performance and prevents Femtocells from realizing their full potential. Despite several efforts by researchers to enhance network communication, handover is still a challenging issue, many related works have been done in the field but still it needs improvement. This research proposes an Optimized Q-learning-based Handover Decision Algorithm for Femtocells using Load Balancing in LTE-A Networks to improve overall network performance. The algorithm learns to prioritize and select cells with low load during target cell selection and not only provides good Quality of Service (QoS) but also has a low load, resulting in better traffic distribution across the cells. Several simulations were performed using LTE-Sim. Results proved the outperformance of the proposed algorithm over the existing algorithm in terms of QoS with a packet loss ratio for CBR packet transmission of 512 bytes with a rate of 8 packets/second intervals, 88.53%, and VoIP packet transmission of 32 bytes per 20 ms/time interval, 89.24% respectively.
References
B. D.K and V. P. A.M, “A Novel Handover Algorithm for LTE Based Macro-Femto Heterogeneous Networks,” Int. J. VLSI Des. Commun. Syst., vol. 6, no. 4, pp. 25–33, 2015, doi: 10.5121/vlsic.2015.6403.
D. Xenakis, N. Passas, L. Merakos, and C. Verikoukis, “Mobility management for femtocells in LTE-advanced: Key aspects and survey of handover decision algorithms,” IEEE Commun. Surv. Tutorials, vol. 16, no. 1, pp. 64–91, 2014, doi: 10.1109/SURV.2013.060313.00152.
D. Xenakis, N. Passas, L. Merakos, and C. Verikoukis, “Mobility Management for Femtocells in LTE-Advanced : Key Aspects and Survey of Handover Decision Algorithms,” pp. 1–28, 2013.
Z. Pan, M. Saito, J. Liu, and S. Shimamoto, “P-persistent energy-Aware handover decisions employing rf fingerprint for adaptive-sized heterogeneous cellular networks,” IEEE Access, vol. 7, pp. 52929–52944, 2019, doi: 10.1109/ACCESS.2019.2912328.
B. Zhang, W. Qi, and J. Zhang, “An energy efficiency and ping-pong handover ratio optimization in two-tier heterogeneous networks,” 2018 IEEE 8th Annu. Comput. Commun. Work. Conf. CCWC 2018, vol. 2018-Janua, pp. 532–536, 2018, doi: 10.1109/CCWC.2018.8301767.
A. HUSSAIN++, Z. M. , M. ASHRAF, S. JAN, and Faculty, “An Optimized Handover Algorithm for LTE-A Femtocell Networks,” vol. 51, no. 01, pp. 81–86, 2019.
M. Mandour, F. Gebali, A. Elbayoumy, and G. Mabrouk, “Enhanced handover algorithm in LTE femtocells network,” J. Eng. Sci. Mil. Technol., vol. 2, no. 4, pp. 161–171, 2018, doi: 10.21608/ejmtc.2019.4877.1090.
M. Rajabizadeh, J. Abouei, and S. Member, “An Efficient Femtocell-to-Femtocell Handover Decision Algorithm in LTE Femtocell Networks,” no. May 2015, 2018, doi: 10.1109/IranianCEE.2015.7146212.
K. Da Costa Silva, Z. Becvar, and C. R. L. Frances, “Adaptive Hysteresis Margin Based on Fuzzy Logic for Handover in Mobile Networks with Dense Small Cells,” IEEE Access, vol. 6, pp. 17178–17189, 2018, doi: 10.1109/ACCESS.2018.2811047.
M. Network, K. Shrirang, and B. Sachin, “Handover Management in Two-Tier Femtocell –,” Wirel. Pers. Commun., 2017, doi: 10.1007/s11277-017-5004-7.
H. Zhou, D. Hu, S. Mao, P. Agrawal, and S. A. Reddy, “Cell association and handover management in femtocell networks,” IEEE Wirel. Commun. Netw. Conf. WCNC, pp. 661–666, 2013, doi: 10.1109/WCNC.2013.6554642.
W. Nasrin and J. Xie, “A self-adaptive handoff decision algorithm for densely deployed closed-group femtocell networks,” 2015 12th Annu. IEEE Int. Conf. Sensing, Commun. Networking, SECON 2015, pp. 390–398, 2015, doi: 10.1109/SAHCN.2015.7338339.
K. E. Suleiman, A. E. M. Taha, and H. S. Hassanein, “Handover-related self-optimization in femtocells: A survey and an interaction study,” Comput. Commun., vol. 73, pp. 82–98, 2016, doi: 10.1016/j.comcom.2015.08.013.
C. Peng and Y. Li, “Demystify undesired handoff in cellular networks,” 2016 25th Int. Conf. Comput. Commun. Networks, ICCCN 2016, 2016, doi: 10.1109/ICCCN.2016.7568506.
M. Mandour, F. Gebali, A. D. Elbayoumy, G. M. A. Hamid, and A. Abdelaziz, “Handover Optimization and User Mobility Prediction in LTE Femtocells Network,” 2019 IEEE Int. Conf. Consum. Electron., pp. 1–6, 2019.
K. Ronoh, “Load Balancing in Heterogeneous LTE-A Networks Wondmeneh Awoke Mengistie Load Balancing in Heterogeneous LTE-A Networks Examensarbete utfört i elektroteknik Wondmeneh Awoke Mengistie Kennedy Ronoh,” no. June 2012, 2012, doi: 10.13140/RG.2.2.32170.70088.
C.-H. Lai, L.-H. Shen, and K.-T. Feng, “Intelligent Load Balancing and Resource Allocation in O-RAN: A Multi-Agent Multi-Armed Bandit Approach,” 2023, [Online]. Available: http://arxiv.org/abs/2303.14355
R. Raheem, A. Lasebae, and A. Raheem, “Novel group handover mechanism for Cooperative and Coordinated Mobile Femtocells technology in railway environment,” Array, vol. 15, p. 100223, 2022, doi: 10.1016/j.array.2022.100223.
U. D. Maiwada, K. U. Danyaro, A. B. Sarlan, and A. A. Muazu, “Hanover Decision Algorithm to Improve the Energy Efficiency in Advanced LTE Systems,” 2022 Int. Conf. Digit. Transform. Intell. ICDI 2022 - Proc., no. Icdi, pp. 29–38, 2022, doi: 10.1109/ICDI57181.2022.10007257.
G. Alsuhli, H. A. Ismail, K. Alansary, M. Rumman, M. Mohamed, and K. G. Seddik, “Deep reinforcement learning-based CIO and energy control for LTE mobility load balancing,” 2021 IEEE 18th Annu. Consum. Commun. Netw. Conf. CCNC 2021, no. January, 2021, doi: 10.1109/CCNC49032.2021.9369525.
A. Bathich, S. I. Suliman, H. Mohd, and A. Hj, “Cell Selection Mechanism Based on Q-learning Environment in Femtocell LTE-A Networks,” vol. 15, no. 1, pp. 56–70, 2021, doi: 10.5614/itbj.ict.res.appl.2021.15.1.4.
N. ‘Ain Amirrudin, S. H. S. Ariffin, N. N. N. Nik Noordini, and N. E. Ghazali, “Analysis of Handover Performance in LTE Femtocells Network,” Wirel. Pers. Commun., vol. 97, no. 2, pp. 1929–1946, 2017, doi: 10.1007/s11277-017-4222-3.
S. Deswal and A. Singhrova, “A vertical handover algorithm in integrated macrocell femtocell networks,” Int. J. Electr. Comput. Eng., vol. 7, no. 1, pp. 299–308, 2017, doi: 10.11591/ijece.v7i1.pp299-308.
O. O. Omitola and V. M. Srivastava, “An Enhanced Handover Algorithm in LTE-Advanced Network,” Wirel. Pers. Commun., vol. 97, no. 2, pp. 2925–2938, 2017, doi: 10.1007/s11277-017-4642-0.
D. K. Bhargavi and V. P. A. M, “Bhargavi D K 1 and Dr.Vijaya Prakash A M 2 1,2,” vol. 6, no. 4, pp. 25–33, 2015.
T. F. Z. BADRI, R. SAADANE, S. MBARKI, and M. WAHBI, “Call Admission Control Scheme and Handover Management in LTE Femtocell-Macrocell Integrated Networks,” Comput. Inf. Sci., vol. 8, no. 1, pp. 135–150, 2015, doi: 10.5539/cis.v8n1p135.
F. Yang, H. Deng, F. Jiang, and X. Deng, “Handover Optimization Algorithm in LTE High-Speed Railway Environment,” Wirel. Pers. Commun., vol. 84, no. 2, pp. 1577–1589, 2015, doi: 10.1007/s11277-015-2704-8.
R. Chaganti, V. Sathya, S. A. Ahammed, R. Rex, and B. R. Tamma, “Efficient SON handover scheme for enterprise Femtocell networks,” 2013 IEEE Int. Conf. Adv. Networks Telecommun. Syst. ANTS 2013, pp. 1–6, 2013, doi: 10.1109/ANTS.2013.6802870.
A. Ben Cheikh, M. Ayari, R. Langar, G. Pujolle, and L. A. Saidane, “Optimized handover algorithm for two-tier macro-femto cellular LTE networks,” Int. Conf. Wirel. Mob. Comput. Netw. Commun., pp. 608–613, 2013, doi: 10.1109/WiMOB.2013.6673420.
N. Sinclair, D. Harle, I. A. Glover, J. Irvine, and R. C. Atkinson, “An advanced SOM algorithm applied to handover management within lte,” IEEE Trans. Veh. Technol., vol. 62, no. 5, pp. 1883–1894, 2013, doi: 10.1109/TVT.2013.2251922.
H. Zhang, W. Ma, W. Li, W. Zheng, and X. Wen, “Signalling Cost Evaluation of Handover Management Schemes in LTE-Advanced Femtocell,” pp. 2–6, 2012.
D. Xenakis, N. Passas, and C. Verikoukis, “An energy-centric handover decision algorithm for the integrated LTE macrocell-femtocell network,” Comput. Commun., vol. 35, no. 14, pp. 1684–1694, 2012, doi: 10.1016/j.comcom.2012.04.024.
N. Sinclair, D. Harle, I. A. Glover, J. Irvine, and R. C. Atkinson, “Parameter optimization for LTE handover using an advanced SOM algorithm,” IEEE Veh. Technol. Conf., no. June, 2013, doi: 10.1109/VTCSpring.2013.6692692.
A. Rath and S. Panwar, “Fast handover in cellular networks with femtocells,” IEEE Int. Conf. Commun., pp. 2752–2757, 2012, doi: 10.1109/ICC.2012.6363687.
Z. Becvar and P. Mach, “Adaptive hysteresis margin for handover in femtocell networks,” Proc. - 6th Int. Conf. Wirel. Mob. Commun. ICWMC 2010, pp. 256–261, 2010, doi: 10.1109/ICWMC.2010.17.
A. Bathich, S. I. Suliman, H. M. A. H. Mansor, S. G. A. Ali, and R. Abdulla, “Cell selection mechanism based on q-learning environment in femtocell lte-a networks,” J. ICT Res. Appl., vol. 15, no. 1, pp. 56–70, 2021, doi: 10.5614/itbj.ict.res.appl.2021.15.1.4.
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Babangida Abubakar Albaba, Aliyu Saidu, Muhammad Sani Iliyasu, Abdulhamid Usman Nuruddeen, Kamal Sabo Wada
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
The articles published in International Journal of Computer and Information Technology (IJCIT) is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
