A Soft Actor-Critic Approach to Complex Dynamic Flight Control for a Flying Firefighter Robot with Water-Jet Propulsion

Authors

  • Syafiqah Lagiman Faculty of Electrical and Electronic Engineering, Universiti Tun Hussein Onn Malaysia, Batu Pahat Johor, Malaysia
  • Abu Ubaidah Shamsudin Faculty of Electrical and Electronic Engineering, Universiti Tun Hussein Onn Malaysia, Batu Pahat Johor, Malaysia
  • Zubair Adil Soomro Faculty of Electrical and Electronic Engineering, Universiti Tun Hussein Onn Malaysia, Batu Pahat Johor, Malaysia
  • Mohamad Hafiz Abu Bakar Faculty of Electrical and Electronic Engineering, Universiti Tun Hussein Onn Malaysia, Batu Pahat Johor, Malaysia
  • Ruzairi Abdul Rahim Faculty of Electrical Engineering, Universiti Teknologi Malaysia, 81300 Johor Bahru, Johor, Malaysia
  • Carl John Salaan College of Engineering and Technology, Mindanao State University-Iligan Institute of Technology, Iligan City, Philippines

DOI:

https://doi.org/10.37934/araset.34.2.271286

Keywords:

Deep Reinforcement Learning (DRL), Soft Actor Critic (SAC), flying fire fighter robot

Abstract

Most of the robots nowadays become more intelligent in line AI technology are being applied in industry. Deep Reinforcement Learning (DRL) is involves gaining knowledge by making errors and fixing them. Hence, the robot will learn from mistakes and keep improving by process. Deep Reinforcement Learning is a kind of machine learning method that focuses on teaching models to act in ways that maximize rewards in an environment. Since the algorithm receives feedback in the form of rewards or consequences for its actions, this is often accomplished through trial and error. Soft Actor Critic (SAC) is the most recent Deep Reinforcement Learning technique. In this research, to design a simulation robot that can be trained by using Soft-Actor Critic. This purpose is to train and evaluate the performance of robot in MATLAB and VMware platform. According to this study, robots might learn and adapt to their surroundings more quickly and effectively with the aid of a system that utilises a suitable reward together with a guidance technique. Decisively, the simulation shows that the Soft Actor Critic algorithm successfully simulates the control of flying fire fighter robot in terms of stability.

Downloads

Download data is not yet available.

Author Biographies

Syafiqah Lagiman, Faculty of Electrical and Electronic Engineering, Universiti Tun Hussein Onn Malaysia, Batu Pahat Johor, Malaysia

syafiqahlagiman95@gmail.com

Abu Ubaidah Shamsudin, Faculty of Electrical and Electronic Engineering, Universiti Tun Hussein Onn Malaysia, Batu Pahat Johor, Malaysia

ubaidah@uthm.edu.my

Zubair Adil Soomro, Faculty of Electrical and Electronic Engineering, Universiti Tun Hussein Onn Malaysia, Batu Pahat Johor, Malaysia

zubairadil4@gmail.com

Mohamad Hafiz Abu Bakar, Faculty of Electrical and Electronic Engineering, Universiti Tun Hussein Onn Malaysia, Batu Pahat Johor, Malaysia

apiz.bakar@gmail.com

Ruzairi Abdul Rahim, Faculty of Electrical Engineering, Universiti Teknologi Malaysia, 81300 Johor Bahru, Johor, Malaysia

ruzairi@fke.utm.my

Carl John Salaan, College of Engineering and Technology, Mindanao State University-Iligan Institute of Technology, Iligan City, Philippines

carljohn.salaan@g.msuiit.edu.ph

Published

2023-12-08

Issue

Section

Articles

Most read articles by the same author(s)