Environment-Agent Interaction in Autonomous Networked Teams with Applications to Minimum-Time Coordinated Control of Multi-Agent Systems

This research develops computationally efficient motion coordination strategies for networked autonomous teams, utilizing generalized Voronoi diagrams to capture agent dynamics and environmental interactions

Advances in autonomous vehicles and networked control systems have created a need for more flexible mission planning and execution architectures than the traditional single-platform, monolithic paradigm allows, in military and civilian applications alike. A network of autonomous vehicles promises more robust planning and execution at higher levels of autonomy, across applications from environmental monitoring and distributed surveillance to resource allocation and the tracking of multiple targets. This network-centric paradigm has teams of aerial, terrestrial and underwater vehicles working in unison, exchanging information to plan and execute a common mission in a decentralized yet cooperative manner, and it brings with it a slew of hard problems: persistent communication, coordinated task assignment and prioritization, distributed estimation and distributed decision-making.

These challenges are sharper still for small UAVs and MAVs, whose dynamic response is dominated by short time scales and which interact strongly with their environment — winds, pop-up threats — while carrying limited computational and power resources on board. The objective of this research was therefore to develop coordination strategies for teams of such vehicles that account for the interaction with the environment, and to do so efficiently enough to run on board.

Motion coordination and path planning were approached through state-dependent performance metrics that capture the vehicle’s interaction with the environment, the mission objectives and the system-theoretic attributes of the network. The generalized Zermelo-Voronoi diagram plays the central role. A standard Voronoi decomposition partitions space by Euclidean distance; a generalized Zermelo-Voronoi diagram partitions it by a metric that reflects the agents’ dynamics, such as the estimated time of arrival in the presence of a wind field, which is what actually determines which agent should service which point.

A square domain partitioned into ten cells by dashed straight lines, each cell containing a labelled generator point marked with a cross and surrounded by nested closed level curves of the time-to-go A generalized Voronoi partition. Each cell collects the points that one agent reaches before any other, with the nested curves marking equal time-to-go from that agent.

Two problems follow from this. The first is computational: building generalized Voronoi diagrams with respect to a suitable generalized metric, by algorithms simple and efficient enough to be distributed, with the partition tailored to the mission at hand. The second is to use those diagrams to characterize the proximity relations between agents, and between agents and a set of targets. Together they support decentralized and distributed control strategies across a wide spectrum of applications: environmental monitoring, distributed surveillance, multiple target allocation, coordinated intercept and landing-site selection.

Four panels in two rows, each a square domain scattered with red and green crosses and partitioned by heavy black curves overlaid on a lighter blue straight-line Voronoi diagram. The upper pair compares the Zermelo-Voronoi diagram with its dual for one wind field, the lower pair for a second wind field, and in both cases the curved partition departs markedly from the straight-line one The Zermelo-Voronoi diagram and its dual, for two different wind fields, drawn over the Euclidean Voronoi diagram of the same generators. The wind alone is enough to reassign large regions from one agent to another.

The same construction answers a pursuit problem. When several pursuers chase a single evader in a flow field, it is wasteful for all of them to chase at once; the relay pursuit scheme instead assigns the pursuit to the one pursuer that can reach the evader soonest, and hands it off as the evader moves and that assignment changes. The hand-off rule falls directly out of the partition, which is what makes the scheme cheap enough to run online. Alongside this, we characterized time-optimal and feedback navigation for a vehicle in a known wind field, and studied pursuit-evasion games in which the dynamics are stochastic, where the saddle-point solution is obtained by linking the game to a stochastic optimal control problem.

Sponsors

This project is supported by NSF.

Selected Publications and Presentations

1.

Bakolas, E. and Tsiotras, P., “Optimal Synthesis of the Zermelo-Markov-Dubins Problem in a Constant Drift Field,” Journal of Optimization Theory and Applications, Vol. 155, No. 2, Nov. 2012.

2.

Bakolas, E., and Tsiotras, P., “Relay Pursuit of a Maneuvering Target Using Dynamic Voronoi Diagrams,” Automatica, Vol. 48, pp. 2213-2220, Aug. 2012.

3.

Bakolas, E. and Tsiotras, P., “Feedback Navigation in an Uncertain Flow-Field and Connections with Pursuit Strategies,” AIAA Journal of Guidance, Control, and Dynamics, Vol. 35, No. 4, pp. 1268-1279, July-August 2012.

4.

Bakolas, E. and Tsiotras, P., “Time-Optimal Synthesis for the Zermelo-Markov-Dubins Problem: the Constant Wind Case,” American Control Conference, Baltimore, MD, June 30-July 2, 2010.

5.

Bakolas, E. and Tsiotras, P., “Minimum-Time Paths for a Light Aircraft in the Presence of Regionally-Varying Strong Winds,” Infotech at Aerospace, Atlanta, GA, April 20-22, 2010.

6.

Bakolas, E. and Tsiotras, P., “Optimal Pursuit of Moving Targets using Dynamic Voronoi Diagrams,” 49th IEEE Conference on Decision and Control, Atlanta, GA, Dec. 15-17, 2010, pp. 7431-7436.

7.

Bakolas, E. and Tsiotras. P., “On the Relay Pursuit of a Maneuvering Target,” 50th IEEE Conference on Decision and Control and European Control Conference, Orlando, FL, Dec.12-15, 2011, pp. 4270-4275.

8.

Sun, W. and Tsiotras, P., “An Optimal Evader Strategy in a Two-Pursuer One-Evader Problem,” 53rd IEEE Conference on Decision and Control, Los Angeles, CA, Dec. 15-17, 2014, pp. 4266-4271.

9.

Sun, W., Theodorou, E., and Tsiotras, P., “Continuous-Time Differential Dynamic Programming with Terminal Constraints,” IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning, Orlando, FL, Dec. 9-12, 2014, pp. 289-294.

10.

Sun, W., and Tsiotras, P., “Pursuit Evasion Game of Two Players under an External Flow Field,” American Control Conference, Chicago, IL, July 1-3, 2015, pp. 5617-5622.

11.

Sun, W., Theodorou, E. and Tsiotras, P., “Game Theoretic Continuous Time Differential Dynamic Programming,” American Control Conference, Chicago, IL, July 1-3, 2015, pp. 5593-5598.