Skip to main content

How engineers for NASA’s Ingenuity helicopter do tech support on another planet

Ingenuity Helicopter in 3D: NASA's Ingenuity Mars Helicopter is seen here in 3D using images taken June 6, 2021, by the left and right Mastcam-Z cameras aboard NASA’s Perseverance Mars rover.
Ingenuity Helicopter in 3D: NASA’s Ingenuity Mars Helicopter is seen here in 3D using images taken June 6, 2021, by the left and right Mastcam-Z cameras aboard NASA’s Perseverance Mars rover. NASA/JPL-Caltech/ASU/MSSS

NASA’s Ingenuity helicopter has captured the world’s imagination with its exploration of Mars from the air. It recently completed its eighth successful flight, but as an experimental piece of technology it hasn’t all been smooth sailing for the plucky little helicopter — it has also had to deal with two software issues during its operations. Now, Ingenuity Operations Lead Teddy Tzanetos has shared some insights into how the team fixes software problems on a piece of tech on another planet.

Recommended Videos

The first issue arose in the preparations for flight four when the rotors failed to spin up correctly. The Ingenuity team report that the helicopter was having a problem transitioning into its “flight-state” mode, which stopped the blades from spinning up to full speed. This turned out to be due to overcautious software, in which the Field Programmable Gate Array (FPGA) component was detecting very slight variations in timing and was therefore preventing the helicopter from flying.

This issue was fixed by creating a temporary workaround to allow the helicopter to keep performing its flights. But there was a possibility that the issue could reoccur and require multiple attempts at flights in the future. Now, the team has updated the Flight Controller software to permanently fix this issue which they tested with a slow-spin test of the blades last week.

The second issue is to do with the camera that the helicopter uses to position itself. The helicopter has both color and black and white cameras which it uses to capture images of the ground below and make rapid adjustments to its movements, up to 500 times per second. To maneuver effectively, the helicopter needs exact timestamps for the images it captures so it can make these adjustments correctly.

The problem that arose during flight six was a glitch in the pipeline for processing images. When using the color camera, this glitch caused one single frame to be dropped. But this meant that timestamps on subsequent images were incorrect, which lead to the helicopter trying to overcorrect its movements and it ended up swinging back and forward.

Fortunately, the helicopter was able to land safely, but the team decided not to use the color camera on subsequent flights seven and eight. They think it is the more intense processing requirements for color images that lead to the glitch, so they have stuck with the less demanding and therefore safer black and white cameras for now.

Fixing this issue will require updating a large portion of the helicopter’s software. The team will create a software addition that detects if a frame has been dropped and which will correct any subsequent timestamps, allowing them to use the color camera once again. They are planning to make this update in the next few days.

Georgina Torbet
Georgina has been the space writer at Digital Trends space writer for six years, covering human space exploration, planetary…
How to watch NASA’s oldest active astronaut launch to the ISS on Wednesday
NASA astronaut Don Pettit.

NASA Astronaut Don Pettit Soyuz MS-26 Launch

Don Pettit isn't your average senior citizen. Instead of enjoying life in the slow lane, he's getting ready for a rocket ride to the International Space Station (ISS) on Wednesday.

Read more
How NASA is using AI on the Perseverance rover to study Mars rocks
akdjf alkjdhf lk

Space engineers have been using AI in rovers for some time now -- hence why today's Mars explorers are able to pick a safe landing site and to drive around a region autonomously. But something they haven't been able to do before now is to do science themselves, as most of that work is done by scientists on Earth who analyze data and point the rover toward targets they want to investigate.

Now, though, NASA's Perseverance rover is taking the first steps toward autonomous science investigation on Mars. The rover has been testing out an AI capability for the last three years, which allows it to search for and identify particular minerals in Mars rocks. The system works using the rover's PIXL instrument (Planetary Instrument for X-ray Lithochemistry), a spectrometer that uses light to analyze what rocks are made of. The software, called adaptive sampling, looks though PIXL's data and identifies minerals to be studied in more detail.

Read more
This is how a NASA astronaut will swab the ISS exterior for microbes
An animation showing a preview of NASA's first spacewalk of 2024.

Two astronauts will soon be embarking on NASA’s first spacewalk of 2024 at the International Space Station (ISS).

Today, Americans Tracy C. Dyson and Matt Dominick will conduct some maintenance work and also swab exterior surfaces on the station’s Destiny and Quest modules for analysis that should determine whether microorganisms released through station vents can survive the external, and very hostile, microgravity environment.

Read more