Drones + Augmented Reality = Help for Firefighters

ScanEagles soar over active fires, while viewers explore the scene using holograms.

Boeing: UAVs. Holograms. Wildfire.

The Boeing subsidiary Insitu is looking at a new way to help fight wildfires by combining its ScanEagle drone with another hot technology, augmented reality. The system dramatically increases firefighters’ understanding of a blaze by showing data streamed real-time from the ScanEagle as it flies above the fire. The real-time imagery is combined with a high-resolution digital terrain model and other data, and displayed to a viewer wearing Microsoft’s HoloLens glasses. The drone can loiter over a fire for up to 24 hours, letting a viewer keep constant watch over the fire and track its development.

Not only do the images show flames and embers invisible to the naked eye (that can catch unknowing firefighters off guard), the system is able to “see through” overgrowth and brush thanks to a thermal infrared scanner that detects variations in temperature, day or night. The HoloLens glasses show the viewer a three-dimensional hologram of the fire with all key elements of the scene clearly identified. The wearer can even control the ScanEagle using the system, and eventually will be able to control an entire fleet of drones. Microsoft is among those working on gaze control, whereby drone operators control the vehicles simply by looking around the AR scene and re-directing their eyes.

Get the latest stories in your inbox every weekday.