‘The next frontier in robotics’

{"value":"\n\nBefore joining Zoox, Olivier Toupet spent nine years working at NASA’s Jet Propulsion Laboratory. He says his work at Zoox is \"similar to what I was just doing at JPL, where I developed the path-planner for the Perseverance Mars rover, but the problem is a lot more challenging.\"\n\nCOURTESY OF OLIVIER TOUPET\n\nOlivier Toupet has dedicated his career to making the impossible possible — on Earth and in space.\n\n“I've always worked on futuristic technologies,” said the principal software engineer for [Zoox](http://www.zoox.com/), an independent Amazon subsidiary that is building a self-driving, purpose-built, electric robotaxi fleet. “It’s what keeps me motivated.”\n\nHis career is certainly proof of that.\n\nBefore joining Zoox in November 2021, Toupet spent nine years working at NASA’s Jet Propulsion Laboratory (JPL), where he supervised the Robotic Aerial Mobility group. The group “[develops novel robotic technologies](https://www-robotics.jpl.nasa.gov/who-we-are/groups/347T/) for unmanned aerial vehicles (UAVs) and provides robotic solutions tailored to unique challenges associated with aerial robots—with a focus on guidance, navigation and control to expand autonomy and mobility capabilities.”\n\n#### **Upward trajectory**\n\nFor Toupet, a job that involved aerial robots was a perfect fit for a kid who grew up fascinated by flying.\n\nToupet was born and raised in the South of France, where his passion for aeronautics was fueled by his family’s frequent travels. “My mother worked for a French airline, so we got to fly a lot,” Toupet recalled. “And I remember my dad teaching me the names of all the airplanes at the airport and wanting to be a pilot when I grew up.”\n\nHe studied at the prestigious [French Institute of Aeronautics and Aerospace](https://www.isae-supaero.fr/en/) in Toulouse before moving to the United States to pursue a Master’s in Aeronautics and Astronautics at the Massachusetts Institute of Technology (MIT). There, he was able to pursue his dream of working on cutting-edge aircraft. [Boeing Phantom Works](https://www.boeing.com/defense/phantom-works/index.page) funded his graduate research into autonomous path-planning and decision-making for unmanned helicopters.\n\nAfter graduating in 2006, he spent a 10-month stint working on some of the first aerobatic helicopter drones. He then moved to senior engineering roles with Aurora Flight Sciences (which Boeing acquired in 2007) and Zee.Aero (now Wisk), where he developed artificial intelligence (AI) for unconventional electric vertical take-off and landing (eVTOL) aircraft. Or, as he calls them, flying cars.\n\n<video src=\"https://dev-media.amazoncloud.cn/fc3ef31b241646cc9897ccbda537485a_Olivier%20Toupet%20%28JPL%29%20-%20An%20Overview%20of%20the%20Mars%202020%20Perseverance%20Rover%27s%20Advanced%20Path%20Planner.mp4\" class=\"manvaVedio\" controls=\"controls\" style=\"width:160px;height:160px\"></video>\n\n“eVTOLs are closer to what I am now doing at Zoox,” explained Toupet, who has a private pilot’s license. “However while flying does come with its own set of challenges, including FAA regulations, the aerial environment is less cluttered and more predictable than driving in a busy city. The contrast is even starker with the Martian environment, where nothing moves except for the rover, at 0.1 miles per hour, making path-planning much easier to perform.”\n\n#### **From flying cars to driving rovers**\n\nToupet joined JPL in 2013 where he developed novel technologies for the Mars rovers, including traction control for Curiosity and self-driving for Perseverance. He received two NASA honor awards for that work, the [Exceptional Engineering Achievement Medal](https://www.nasa.gov/centers/wstf/about_us/awards_and_certifications/nasa_Exceptional_Service_Medal.html) in 2017 and the [Exceptional Technology Achievement Medal](https://en.wikipedia.org/wiki/NASA_Exceptional_Technology_Achievement_Medal#:~:text=The%20NASA%20Exceptional%20Technology%20Achievement,in%20achieving%20significant%20technology%20transfer) in 2022.\n\n\n\nOlivier Toupet celebrating the deployment of the Ingenuity helicopter.\n\nCOURTESY OF OLIVIER TOUPET\n\nDuring his tenure at JPL, Toupet drove three Mars rovers — Opportunity, Curiosity, and Perseverance — and flew the Ingenuity helicopter. “It was a truly unique and amazing experience,” he recalled. “There is a lot of specialized training involved — it takes over a year to get certified for both mobility and robotic arm operations. I loved learning how the spacecraft works and how to control it with flight software.”\n\nAs part of the Mars rover operations team, he also learned to handle the pressure that comes with being responsible for the safety of a multi-billion dollar national space asset.\n\n“We often had to make critical decisions quickly to ensure we had trustworthy commands to send to a rover during the limited communications window when it’s in line of sight with the orbiter,” he added.\n\nHe divided his time at JPL between technology development and robotics operations. That approach enabled him to see the impact of his work in action and better understand the operational context and gaps that required additional research.\n\n“Exploring regions of Mars never seen by human eyes before was extremely cool, of course,” he added. “But what I remember enjoying most was the incredible people from different backgrounds I had the privilege to work with, and the great camaraderie we shared.”\n\n\n\nOlivier Toupet said he joined Zoox because \"no one has been able to produce a vehicle capable of driving itself fully autonomously in the rich and varied environment of a busy city.\"\n\nHungry for his next challenge, in 2021 he pursued what he saw as a once-in-a-lifetime role at Zoox.\n\n“No one has been able to produce a vehicle capable of driving itself fully autonomously in the rich and varied environment of a busy city,” Toupet said. “To me this is the new frontier in robotics not only because it’s so challenging at every level of the robotics software stack — perception, planning, prediction, control — but also because I believe that technology is attainable in the next few years. The self-driving car industry is an incredibly innovative and booming sector, with great potential for making a really big impact on our society in the near future. That’s why I find it the most exciting place to be for a robotics engineer.”\n\n#### **Robotics for a better world**\n\nToday, as principal software engineer, Toupet is developing cutting-edge AI algorithms that enable the self-driving Zoox vehicle to understand and make decisions based on its surroundings, and to optimize trajectories to reach its destination safely and comfortably.\n\nZoox vehicles employ advanced perception systems that, among other things, detect and identify cars, pedestrians, bicyclists, and other mobile elements that might affect the vehicle’s path. The challenge lies not just in spotting those elements, but also in predicting their future motion.\n\n“In a way, it’s similar to what I was just doing at JPL, where I developed the path-planner for the Perseverance Mars rover, but the problem is a lot more challenging for a fast-moving self-driving car in a dense, rich and dynamic urban environment,” Toupet said. “We are using machine learning — specifically, [self-supervised](https://www.amazon.science/tag/self-supervised-learning) and [reinforcement learning](https://www.amazon.science/tag/reinforcement-learning)— to better predict the intent of surrounding vehicles based on past data collected, and to improve the potential actions our vehicle can take.”\n\nToupet’s team is actively testing their algorithms, experiencing their behavior first-hand by riding in the Zoox vehicles. They’re also using virtual simulations to stress-test the technology, running many instances in parallel on the cloud to drive many more miles than would be otherwise achievable and test for edge cases that rarely occur in the real world.\n\n“Zoox brings together the best of all worlds,” Toupet concluded. “At Zoox, I work collaboratively with some of the most talented robotics experts in the industry and together, we design, implement, and test state-of-the-art AI algorithms running on cutting-edge hardware, that will have a big, near-term impact on society by making public transportation safer, greener, and more enjoyable for everyone.”\n\nABOUT THE AUTHOR\n\n#### **[Jay Moye](https://www.amazon.science/author/jay-moye)**\n\nJay Moye is a writer, editor, and communications consultant based in Asheville, N.C.","render":"<p><img src=\"https://dev-media.amazoncloud.cn/73d8a54199c5455ea2ee1ea0ac31b36b_image.png\" alt=\"image.png\" /></p>\n<p>Before joining Zoox, Olivier Toupet spent nine years working at NASA’s Jet Propulsion Laboratory. He says his work at Zoox is “similar to what I was just doing at JPL, where I developed the path-planner for the Perseverance Mars rover, but the problem is a lot more challenging.”</p>\n<p>COURTESY OF OLIVIER TOUPET</p>\n<p>Olivier Toupet has dedicated his career to making the impossible possible — on Earth and in space.</p>\n<p>“I’ve always worked on futuristic technologies,” said the principal software engineer for <a href=\"http://www.zoox.com/\" target=\"_blank\">Zoox</a>, an independent Amazon subsidiary that is building a self-driving, purpose-built, electric robotaxi fleet. “It’s what keeps me motivated.”</p>\n<p>His career is certainly proof of that.</p>\n<p>Before joining Zoox in November 2021, Toupet spent nine years working at NASA’s Jet Propulsion Laboratory (JPL), where he supervised the Robotic Aerial Mobility group. The group “<a href=\"https://www-robotics.jpl.nasa.gov/who-we-are/groups/347T/\" target=\"_blank\">develops novel robotic technologies</a> for unmanned aerial vehicles (UAVs) and provides robotic solutions tailored to unique challenges associated with aerial robots—with a focus on guidance, navigation and control to expand autonomy and mobility capabilities.”</p>\n<h4><a id=\"Upward_trajectory_14\"></a><strong>Upward trajectory</strong></h4>\n<p>For Toupet, a job that involved aerial robots was a perfect fit for a kid who grew up fascinated by flying.</p>\n<p>Toupet was born and raised in the South of France, where his passion for aeronautics was fueled by his family’s frequent travels. “My mother worked for a French airline, so we got to fly a lot,” Toupet recalled. “And I remember my dad teaching me the names of all the airplanes at the airport and wanting to be a pilot when I grew up.”</p>\n<p>He studied at the prestigious <a href=\"https://www.isae-supaero.fr/en/\" target=\"_blank\">French Institute of Aeronautics and Aerospace</a> in Toulouse before moving to the United States to pursue a Master’s in Aeronautics and Astronautics at the Massachusetts Institute of Technology (MIT). There, he was able to pursue his dream of working on cutting-edge aircraft. <a href=\"https://www.boeing.com/defense/phantom-works/index.page\" target=\"_blank\">Boeing Phantom Works</a> funded his graduate research into autonomous path-planning and decision-making for unmanned helicopters.</p>\n<p>After graduating in 2006, he spent a 10-month stint working on some of the first aerobatic helicopter drones. He then moved to senior engineering roles with Aurora Flight Sciences (which Boeing acquired in 2007) and Zee.Aero (now Wisk), where he developed artificial intelligence (AI) for unconventional electric vertical take-off and landing (eVTOL) aircraft. Or, as he calls them, flying cars.</p>\n<p><video src=\"https://dev-media.amazoncloud.cn/fc3ef31b241646cc9897ccbda537485a_Olivier%20Toupet%20%28JPL%29%20-%20An%20Overview%20of%20the%20Mars%202020%20Perseverance%20Rover%27s%20Advanced%20Path%20Planner.mp4\" controls=\"controls\"></video></p>\n<p>“eVTOLs are closer to what I am now doing at Zoox,” explained Toupet, who has a private pilot’s license. “However while flying does come with its own set of challenges, including FAA regulations, the aerial environment is less cluttered and more predictable than driving in a busy city. The contrast is even starker with the Martian environment, where nothing moves except for the rover, at 0.1 miles per hour, making path-planning much easier to perform.”</p>\n<h4><a id=\"From_flying_cars_to_driving_rovers_28\"></a><strong>From flying cars to driving rovers</strong></h4>\n<p>Toupet joined JPL in 2013 where he developed novel technologies for the Mars rovers, including traction control for Curiosity and self-driving for Perseverance. He received two NASA honor awards for that work, the <a href=\"https://www.nasa.gov/centers/wstf/about_us/awards_and_certifications/nasa_Exceptional_Service_Medal.html\" target=\"_blank\">Exceptional Engineering Achievement Medal</a> in 2017 and the <a href=\"https://en.wikipedia.org/wiki/NASA_Exceptional_Technology_Achievement_Medal#:~:text=The%20NASA%20Exceptional%20Technology%20Achievement,in%20achieving%20significant%20technology%20transfer\" target=\"_blank\">Exceptional Technology Achievement Medal</a> in 2022.</p>\n<p><img src=\"https://dev-media.amazoncloud.cn/11c5e773bcc846a69af243b47d9e75a6_image.png\" alt=\"image.png\" /></p>\n<p>Olivier Toupet celebrating the deployment of the Ingenuity helicopter.</p>\n<p>COURTESY OF OLIVIER TOUPET</p>\n<p>During his tenure at JPL, Toupet drove three Mars rovers — Opportunity, Curiosity, and Perseverance — and flew the Ingenuity helicopter. “It was a truly unique and amazing experience,” he recalled. “There is a lot of specialized training involved — it takes over a year to get certified for both mobility and robotic arm operations. I loved learning how the spacecraft works and how to control it with flight software.”</p>\n<p>As part of the Mars rover operations team, he also learned to handle the pressure that comes with being responsible for the safety of a multi-billion dollar national space asset.</p>\n<p>“We often had to make critical decisions quickly to ensure we had trustworthy commands to send to a rover during the limited communications window when it’s in line of sight with the orbiter,” he added.</p>\n<p>He divided his time at JPL between technology development and robotics operations. That approach enabled him to see the impact of his work in action and better understand the operational context and gaps that required additional research.</p>\n<p>“Exploring regions of Mars never seen by human eyes before was extremely cool, of course,” he added. “But what I remember enjoying most was the incredible people from different backgrounds I had the privilege to work with, and the great camaraderie we shared.”</p>\n<p><img src=\"https://dev-media.amazoncloud.cn/0cca63301b0142cd9af05cd3c780b57a_image.png\" alt=\"image.png\" /></p>\n<p>Olivier Toupet said he joined Zoox because “no one has been able to produce a vehicle capable of driving itself fully autonomously in the rich and varied environment of a busy city.”</p>\n<p>Hungry for his next challenge, in 2021 he pursued what he saw as a once-in-a-lifetime role at Zoox.</p>\n<p>“No one has been able to produce a vehicle capable of driving itself fully autonomously in the rich and varied environment of a busy city,” Toupet said. “To me this is the new frontier in robotics not only because it’s so challenging at every level of the robotics software stack — perception, planning, prediction, control — but also because I believe that technology is attainable in the next few years. The self-driving car industry is an incredibly innovative and booming sector, with great potential for making a really big impact on our society in the near future. That’s why I find it the most exciting place to be for a robotics engineer.”</p>\n<h4><a id=\"Robotics_for_a_better_world_56\"></a><strong>Robotics for a better world</strong></h4>\n<p>Today, as principal software engineer, Toupet is developing cutting-edge AI algorithms that enable the self-driving Zoox vehicle to understand and make decisions based on its surroundings, and to optimize trajectories to reach its destination safely and comfortably.</p>\n<p>Zoox vehicles employ advanced perception systems that, among other things, detect and identify cars, pedestrians, bicyclists, and other mobile elements that might affect the vehicle’s path. The challenge lies not just in spotting those elements, but also in predicting their future motion.</p>\n<p>“In a way, it’s similar to what I was just doing at JPL, where I developed the path-planner for the Perseverance Mars rover, but the problem is a lot more challenging for a fast-moving self-driving car in a dense, rich and dynamic urban environment,” Toupet said. “We are using machine learning — specifically, <a href=\"https://www.amazon.science/tag/self-supervised-learning\" target=\"_blank\">self-supervised</a> and <a href=\"https://www.amazon.science/tag/reinforcement-learning\" target=\"_blank\">reinforcement learning</a>— to better predict the intent of surrounding vehicles based on past data collected, and to improve the potential actions our vehicle can take.”</p>\n<p>Toupet’s team is actively testing their algorithms, experiencing their behavior first-hand by riding in the Zoox vehicles. They’re also using virtual simulations to stress-test the technology, running many instances in parallel on the cloud to drive many more miles than would be otherwise achievable and test for edge cases that rarely occur in the real world.</p>\n<p>“Zoox brings together the best of all worlds,” Toupet concluded. “At Zoox, I work collaboratively with some of the most talented robotics experts in the industry and together, we design, implement, and test state-of-the-art AI algorithms running on cutting-edge hardware, that will have a big, near-term impact on society by making public transportation safer, greener, and more enjoyable for everyone.”</p>\n<p>ABOUT THE AUTHOR</p>\n<h4><a id=\"Jay_Moyehttpswwwamazonscienceauthorjaymoye_70\"></a><strong><a href=\"https://www.amazon.science/author/jay-moye\" target=\"_blank\">Jay Moye</a></strong></h4>\n<p>Jay Moye is a writer, editor, and communications consultant based in Asheville, N.C.</p>\n"}