Article

Deep Reinforcement Learning-Based Joint Trajectory Design and Resource Allocation for Secure and Energy-Efficient UAV Networks

Aug 01, 2025

DOI: 10.1109/OJCOMS.2025.3594373

Published in: IEEE Open Journal of the Communications Society

Publisher: IEEE

Abdulmalik Alwarafy Suhib Bani Melhem Rand Abou Chahine Batool Said Maitha Alharethi Latifa Almazrouei

Unmanned Aerial Vehicles (UAVs) have been extensively used recently for wireless networks. However, such networks encounter several challenges that remain unsolved. In this paper, we address the issue of joint optimization of trajectory design and resource allocation in UAV-based wireless networks in the presence of eavesdroppers. We first formulate an optimization problem with the objective to maximize a utility function defined in terms of secrecy rate, energy utilization efficiency, and interference. Due to the high dimensionality and non-convex nature of the formulated problem, we propose a Proximal Policy Optimization (PPO)-based Deep Reinforcement Learning (DRL) algorithm to solve the problem and learn the environment. Our proposed PPO algorithm solves the problem by jointly controlling the 3D position of UAVs, power, and energy harvesting. Simulation results demonstrate the efficiency of the proposed algorithm in solving the problem, learning the environment dynamics, and its superiority over some existing conventional and DRL-based methods.

Other Researches

EdgeAI-Powered Hybrid ESN-GRU Model for High-Accuracy and Efficient Short-Term Load Forecasting in Smart Grids

With the widespread use of renewable energy sources (RES) in the smart grid, the next generation power system, short-term load forecasting (STLF) is of critical importance in grid stability and energy optimization. Traditional STLF models include is...

LENS: Lightweight and Explainable LLM-Based APT Detection at the Edge for 6G Security

Expected to be deployed in the early 2030s, sixth-generation (6G) wireless networks, with their high speed and integration with cutting-edge technology such as intelligent edge computing, expand the attack surface and face serious cyber threat risks...

LLM-Driven APT Detection for 6G Wireless Networks: A Systematic Review and Taxonomy

Sixth Generation (6G) wireless networks, which are expected to be deployed in the 2030s, have already created great excitement in academia and the private sector with their extremely high communication speed and low latency rates. However, despite t...

Supervised methods of machine learning for email classification: a literature survey

In today’s digital landscape, email is acknowledged as a critical conduit for global data exchanges. With a surge in data volume, malefactors exploit user identities, leading to data misuse. Cybercriminals employ electronic transgressions such as ph...

Cybersecurity activities for education and curriculum design: A survey

Cyber threats are one of the main concerns in this growing technology epoch. To tackle this issue, highly skilled and motivated cybersecurity professionals are increasingly in demand to prevent, detect, respond to, or even mitigate the effects of su...

Dynamic Resource Management for Cloud Spot Markets

Resource management for cloud computing environments that are characterized by many layers emerges as a critical task for cloud computing providers. Such providers are compelled by the demands and strategies of stochastic customers to adopt dynamic ...

Dynamic mobility load balancing for 5G small-cell networks based on utility functions

Deployment of small cells was introduced to support high data rate services and expand macro cell coverage for the envisioned 5G networks. A small cell network, which has a smaller size, along with the user equipment (UE) mobility, frequently underg...

Markov prediction model for host load detection and VM placement in live migration

The design of good host overload/underload detection and virtual machine (VM) placement algorithms plays a vital role in assuring the smoothness of VM live migration. The presence of the dynamic environment that leads to a changing load on the VMs m...

Soap-based vs. restful web services: A case study for multimedia conferencing

RESTful Web services are now emerging as an alternative to SOAP-based Web services and might be a more suitable choice in some cases. A comparison of two Web programming interfaces — the standard Parlay-X multimedia SOAP-based Web service and a REST...