Abstract

In this paper, we propose a decentralized learning algorithm to restore communication connectivity during multi-agent formation control. The time-varying connectivity profile of a mobile multi-agent system represents the dynamic information exchange capabilities among agents. While connected to the neighbors, each mobile agent in the proposed scheme learns to raise the team connectivity. When the inter-agent communication is lost, the associated trained neural network generates appropriate control actions to restore connectivity. The proposed learning technique leverages an adaptive control formalism, wherein a neural network tries to mimic the negative gradient of a value that relies on the agent-to-neighbor distances. All agents use the conventional consensus protocol during the connected multi-agent dynamics, and under communication loss, only the lost agent executes the neural network predicted actions to come back to the fleet. Simulation results demonstrate the effectiveness of our proposed approach for single/multiple agent loss even in the presence of velocity disturbances.

Abstract

This paper discusses the development of autopilot hardware for small fixed-wing air vehicles. Weight constraint is the critical factor in developing such hardware. The sensors and communication devices are selected based on the requirements and constraints of these air vehicles. The sensors used in the hardware are calibrated using a three-axis rotating platform. The software written in the autopilot hardware is flexible enough to incorporate complex estimation and control algorithms along with the hardware-in-loop simulations. Linear output feedback controllers are designed for fixed wing micro and nano air vehicles. Successful flight trials are conducted to demonstrate the utility of the autopilot hardware for small fixed-wing air vehicles

Abstract

Unmanned Aerial Vehicle (UAV) based remote sensing system incorporated with computer vision has demonstrated potential for assisting building construction and in disaster management like damage assessment during earthquakes. The vulnerability of a building to earthquake can be assessed through inspection that takes into account the expected damage progression of the associated component and the component’s contribution to structural system performance. Most of these inspections are done manually, leading to high utilization of manpower, time, and cost. This paper proposes a methodology to automate these inspections through UAV-based image data collection and a software library for post-processing that helps in estimating the seismic structural parameters. The key parameters considered here are the distances between adjacent buildings, building plan-shape, building

Abstract

The control system design specifications for dynamical systems are typically provided in terms of the desired transient response and steady-state response. Meeting such requirements for dynamical systems whose mathematical models are unavailable is a challenging task. In this paper, we propose a learning-based controller to achieve the desired control system design specifications for unknown dynamical systems. We consider a SoTA model-free reinforcement learning agent (TD3) in the continuous state and action space setting where the agent has no knowledge of system dynamics. The selection of an appropriate reward function is a key factor that shapes the response of the dynamical system when the learning-based controller is implemented. The resulting controller is trained and tested for first-order and second-order linear systems, as well as a nonlinear system. The resulting trajectories of the closed-loop systems indicate that the transient and steady-state response can be altered by choosing the appropriate reward function while adhering to the constraints imposed on the control input.

Abstract

Deep Reinforcement Learning is quickly becoming a popular method for training autonomous Unmanned Aerial Vehicles (UAVs). Our work analyzes the effects of measurement uncertainty on the performance of Deep Reinforcement Learning (DRL) based waypoint navigation and obstacle avoidance for UAVs. Measurement uncertainty originates from noise in the sensors used for localization and detecting obstacles. Measurement uncertainty/noise is considered to follow a Gaussian probability distribution with unknown non-zero mean and variance. We evaluate the performance of a DRL agent, trained using the Proximal Policy Optimization (PPO) algorithm in an environment with continuous state and action spaces. The environment is randomized with different numbers of obstacles for each simulation episode in the presence of varying degrees of noise, to capture the effects of realistic sensor measurements. Denoising techniques like the low pass filter and Kalman filter improve performance in the presence of unbiased noise. Moreover, we show that artificially injecting noise into the measurements during evaluation actually improves performance in certain scenarios. Extensive training and testing of the DRL agent under various UAV navigation scenarios are performed in the PyBullet physics simulator. To evaluate the practical validity of our method, we port the policy trained in simulation onto a real UAV without any further modifications and verify the results in a real-world environment.

Abstract

This paper presents a novel algorithm for a swarm of unmanned aerial vehicles to search for an unknown source. The proposed method is inspired by the well-known particle swarm optimization (PSO) algorithm and is called accelerationbased particle swarm optimization (APSO) to address the sourceseeking problem with no a priori information. Unlike the conventional particle swarm optimization algorithm, where the particle velocity is updated based on the self-cognition and socialcognition information, here the update is performed on the particle acceleration. A theoretical analysis is provided, showing the stability and convergence of the proposed acceleration-based particle swarm optimization algorithm. Conditions on the parameters of the resulting third-order update equations are obtained using Jury’s stability test. High-fidelity simulations performed in CoppeliaSim, show the improved performance of the proposed acceleration-based particle swarm optimization algorithm for searching an unknown source when compared with the state-ofthe-art particle swarm-based source-seeking algorithms. From the obtained results, it is observed that the proposed method performs better than the existing methods under scenarios like different inter unmanned aerial vehicle communication network topologies, varying numbers of unmanned aerial vehicles in the swarm, different sizes of search regions, restricted source movement, and in the presence of measurements noise.

Abstract

In this paper, we propose a predictive and cooperative optimal control based autonomous navigation and collision avoidance for multiple fixed-wing aircraft (FWA) that also takes into account the physical constraints of the aircraft. The proposed method is implemented in a cooperative framework, analogous to the Reciprocal Velocity Obstacle (RVO) framework for autonomous navigation and collision avoidance for FWA swarm moving in a three dimensional (3D) space. Also, the change in performance with respect to varying prediction horizon is analyzed through numerical simulations. As a result of predictive optimal control and cooperation, we get less conservative maneuvers, reduced path lengths, and less deviation from the shortest path when compared to the conventional method without prediction and cooperation. Simulation results are provided, highlighting the advantages of the proposed method when compared to a popular method (Optimal reciprocal collision avoidance) for collision avoidance in 3D for FWA swarm and also against FGA algorithm (Fast geometric avoidance algorithm).

Abstract

The plants of nano air vehicles (NAVs) are generally unstable, adversely coupled, and uncertain. Besides, the autopilot hardware of a NAV has limited sensing and computational capabilities. Hence, these vehicles need a single controller referred to as robust simultaneously stabilizing decoupling (RSSD) output feedback controller that achieves simultaneous stabilization (SS), desired decoupling, robustness, and performance for a finite set of unstable multi-input-multioutput adversely coupled uncertain plants. To synthesize an RSSD output feedback controller, a new method that is based on a central plant is proposed in this article. Given a finite set of plants for SS, we considered a plant in this set that has the smallest maximum v-gap metric as the central plant. Following this, the sufficient condition for the existence of a simultaneous stabilizing controller associated with such a plant is described. The decoupling feature is then appended to this controller using the properties of the eigenstructure assignment method. Afterward, the sufficient conditions for the existence of an RSSD output feedback controller are obtained. Using these sufficient conditions, a new optimization problem for the synthesis of an RSSD output feedback controller is formulated. To solve this optimization problem, a new genetic algorithm-based offline iterative algorithm is developed. The effectiveness of this iterative algorithm is then demonstrated by generating an RSSD controller for a fixed-wing NAV. The performance of this controller is validated through numerical and hardware-in-the-loop simulations.

Abstract

Some of the issues associated with the prac- tical applications of consensus of multi-agent systems (MAS) include switching topologies, attrition and inclusion of agents from an existing network, and model uncertain- ties of agents. In this paper, a single distributed dynamic state-feedback protocol referred to as the Robust Attrition- Inclusion Distributed Dynamic (RAIDD) consensus proto- col, is synthesized for achieving the consensus of MAS with attrition and inclusion of linear time-invariant higher-order uncertain homogeneous agents and switching topologies. A state consensus problem termed as the Robust Attrition- Inclusion (RAI) consensus problem is formulated to find this RAIDD consensus protocol. To solve this RAI con- sensus problem, first, the sufficient condition for the exis- tence of the RAIDD protocol is obtained using the ν-gap metric-based simultaneous stabilization approach. Next, the RAIDD consensus protocol is attained using the Glover- McFarlane robust stabilization method if the sufficient con- dition is satisfied. The performance of this RAIDD protocol is validated by numerical simulations.

Abstract

Unmanned Aerial Vehicle (UAV) based remote sensing system incorporated with computer vision has demonstrated potential for assisting building construction and in disaster management like damage assessment during earthquakes. The vulnerability of a building to earthquake can be assessed through inspection that takes into account the expected damage progression of the associated component and the component’s contribution to structural system performance. Most of these inspections are done manually, leading to high utilization of manpower, time, and cost. This paper proposes a methodology to automate these inspections through UAV-based image data collection and a software library for post-processing that helps in estimating the seismic structural parameters. The key parameters considered here are the distances between adjacent buildings, building plan-shape, building plan area, objects on the rooftop and rooftop layout. The accuracy of the proposed methodology in estimating the above-mentioned parameters is verified through field measurements taken using a distance measuring sensor and also from the data obtained through Google Earth. Additional details and code can be accessed from h