Despite major advancements in control design that are robust to unplanned disturbances, bipedal robots are still susceptible to falling over and struggle to negotiate rough terrains. By utilizing thrusters in our bipedal robot, we can perform additional posture manipulation and expand the modes of locomotion to enhance the robot’s stability and ability to negotiate rough and difficult-to-navigate terrains. In this paper, we present our efforts in designing a controller based on capture point control for our thruster-assisted walking model named Harpy and explore its control design possibilities. While capture point control based on centroidal models for bipedal systems has been extensively studied, the incorporation of external forces that can influence the dynamics of linear inverted pendulum models, often used in capture point-based works, has not been explored before. The inclusion of these external forces can lead to interesting interpretations of locomotion, such as virtual buoyancy studied in aquatic-legged locomotion. This paper outlines the dynamical model of our robot, the capture point method we use to assist the upper body stabilization, and the simulation work done to show the controller’s feasibility.

In a multi-modal system which combines thruster and legged locomotion such our state-of-the-art Harpy platform to perform dynamic locomotion. Therefore, it is very important to have a proper estimate of Thruster force. Harpy is a bipedal robot capable of legged-aerial locomotion using its legs and thrusters attached to its main frame. we can characterize thruster force using a thrust stand but it generally does not account for working conditions such as battery voltage. In this study, we present a momentum-based thruster force estimator. One of the key information required to estimate is terrain information. we show estimation results with and without terrain knowledge. In this work, we derive a conjugate momentum thruster force estimator and implement it on a numerical simulator that uses thruster force to perform thruster-assisted walking.

Wing-assisted inclined running (WAIR) observed in some young birds, is an attractive maneuver that can be extended to legged aerial systems. This study proposes a control method using a modified Variable Length Inverted Pendulum (VLIP) by assuming a fixed zero moment point and thruster forces collocated at the center of mass of the pendulum. A QP MPC is used to find the optimal ground reaction forces and thruster forces to track a reference position and velocity trajectory. Simulation results of this VLIP model on a slope of 40 degrees is maintained and shows thruster forces that can be obtained through posture manipulation. The simulation also provides insight to how the combined efforts of the thrusters and the tractive forces from the legs make WAIR possible in thruster-assisted legged systems.

Our work aims to make significant strides in understanding unexplored locomotion control paradigms based on the integration of posture manipulation and thrust vectoring. These techniques are commonly seen in nature, such as Chukar birds using their wings to run on a nearly vertical wall. In this work, we developed a capture-point-based controller integrated with a quadratic programming (QP) solver which is used to create a thruster-assisted dynamic bipedal walking controller for our state-of-the-art Harpy platform. Harpy is a bipedal robot capable of legged-aerial locomotion using its legs and thrusters attached to its main frame. While capture point control based on centroidal models for bipedal systems has been extensively studied, the use of these thrusters in determining the capture point for a bipedal robot has not been extensively explored. The addition of these external thrust forces can lead to interesting interpretations of locomotion, such as virtual buoyancy studied in aquatic-legged locomotion. In this work, we derive a thruster-assisted bipedal walking with the capture point controller and implement it in simulation to study its performance.

Legged-aerial multimodal robots can make the most of both legged and aerial systems. In this paper, we propose a control framework that bypasses heavy onboard computers by using an optimization-free Explicit Reference Governor that incorporates external thruster forces from an attitude controller. Ground reaction forces are maintained within friction cone constraints using costly optimization solvers, but the ERG framework filters applied velocity references that ensure no slippage at the foot end. We also propose a Conjugate momentum observer, that is widely used in Disturbance Observation to estimate ground reaction forces and compare its efficacy against a constrained model in estimating ground reaction forces in a reduced-order simulation of Husky.

Multi-modal mobility in robots can enable versatile, adaptable, and plastic locomotion in various environments. The additional mode of mobility can allow the robot to perform maneuvers that it can’t do with a single mode of locomotion and expand the range of locomotion that the robot can do. In this work, we look at a legged-thruster multi-modal robot, Harpy, to perform a multiple wall jump maneuver and vertically climb inside a vent. The problem is defined using a simplified planar reduced order model using a single inertial body and a hybrid model. The controller utilized MPC while on the wall to satisfy the no-slip ground constraints, and the controller’s performance is shown in simulations.

Our work aims to make significant strides in understanding unexplored locomotion control paradigms based on the integration of posture manipulation and thrust vectoring. These techniques are commonly seen in nature, such as Chukar birds using their wings to run on a nearly vertical wall. In this work, we show quadratic programming with contact constraints which is then given to the whole body controller to map on robot states to produce a thruster-assisted slope walking controller for our state-of-the-art Harpy platform. Harpy is a bipedal robot capable of legged-aerial locomotion using its legs and thrusters attached to its main frame. The optimization-based walking controller has been used for dynamic locomotion such as slope walking, but the addition of thrusters to perform inclined slope walking has not been extensively explored. In this work, we derive a thruster-assisted bipedal walking with the quadratic programming (QP) controller and implement it in simulation to study its performance.

Inspired by Chukars wing-assisted incline running (WAIR), in this work, we employ a high-fidelity model of our Husky Carbon quadrupedal-legged robot to walk over steep slopes of up to 45 degrees. Chukars use the aerodynamic forces generated by their flapping wings to manipulate ground contact forces and traverse steep slopes and even overhangs. By exploiting the thrusters on Husky, we employed a collocation approach to rapidly resolving the joint and thruster actions. Our approach uses a polynomial approximation of the reducedorder dynamics of Husky, called HROM, to quickly and efficiently find optimal control actions that permit high-slope walking without violating friction cone conditions.

Autonomous robots operating in real environments are often faced with decisions on how best to navigate their surroundings. In this work, we address a particular instance of this problem: how can a robot autonomously decide on the energetically optimal path to follow given a high-level objective and information about the surroundings? To tackle this problem we developed a self-supervised learning method that allows the robot to estimate the cost of transport of its surroundings using only vision inputs. We apply our method to the multi-modal mobility morphobot (M4), a robot that can drive, fly, segway, and crawl through its environment. By deploying our system in the real world, we show that our method accurately assigns different cost of transports to various types of environments e.g. grass vs smooth road. We also highlight the low computational cost of our method, which is deployed on an Nvidia Jetson Orin Nano robotic compute unit. We believe that this work will allow multi-modal robotic platforms to unlock their full potential for navigation and exploration tasks.

In nature, animals such as birds impressively showcase multiple modes of mobility including legged and aerial locomotion. They are capable of performing robust locomotion over large walls, tight spaces, and can recover from unpredictable situations such as sudden gusts or slippery surfaces. Inspired by these animals’ versatility and ability to combine legged and aerial mobility to negotiate their environment, our main goal is to design and control legged robots that integrate two completely different forms of locomotion, ground and aerial mobility, in a single platform. Our robot, the Husky Carbon, is being developed to integrate aerial and legged locomotion and to transform between legged and aerial mobility. This work utilizes a Reference Governor (RG) based on low-level control of Husky’s dynamical model to maintain the efficiency of legged locomotion, uses Probabilistic Road Maps (PRM) and 3D A⋆ algorithms to generate an optimal path based on the energetic cost of transport for legged and aerial mobility.

Animals, such as birds, widely use multi-modal locomotion by combining legged and aerial mobility with dominant inertial effects. The robotic biomimicry of this multimodal locomotion feat can yield ultra-flexible systems in terms of their ability to negotiate their task spaces. The main objective of this paper is to discuss the challenges in achieving multimodal locomotion, and to report our progress in developing our quadrupedal robot capable of multi-modal locomotion (legged and aerial locomotion), the Husky Carbon. We report the mechanical and electrical components utilized in our robot, in addition to the simulation and experimentation done to achieve our goal in developing a versatile multi-modal robotic platform.

The feasibility of performing airborne and ground manipulation, perception, and reconnaissance using wheeled rovers, unmanned aerial vehicles, CubeSats, SmallSats and more have been evaluated before. Among all of these solutions, balloon-based systems possess merits that make them extremely attractive, e.g., a simple operation mechanism and endured operation time. However, there are many hurdles to overcome to achieve robust loitering performance in balloon-based applications. We attempt to identify design and control challenges, and propose a novel robotic platform that allows for the application of balloons in the reconnaissance and perception of Mars craters. This work briefly covers our suggested actuation and Model Predictive Control design framework for steering such balloon systems. We propose the coordinated servoing of multiple unmanned ground vehicles (UGVs) to regulate tension forces in a cable-driven balloon to which an underactuated hanging payload is attached.

This research explores an innovative thruster-assisted bipedal robot called Harpy, designed for Mars exploration. The project addresses the significant mobility challenges posed by Mars’ rough terrain and uncertain surface conditions, which have historically limited traditional rover capabilities. By combining legged locomotion with thruster assistance, Harpy represents a novel approach to planetary exploration. The robot utilizes lightweight legs for surface interaction and thrusters for posture control during hopping movements, potentially offering more versatile mobility in Mars’ partial gravity environment. This research highlights the growing importance of multi-modal mobility in space exploration, following the success of NASA’s Perseverance rover and Ingenuity helicopter. The project focuses on developing advanced control systems and hardware solutions while exploring efficient motion planning algorithms for Mars’ unique conditions.

The research investigates the integration of thrusters into bipedal robotic systems to enhance stability, robustness, and performance in dynamic and challenging environments. The Harpy robot, developed at Northeastern University, employs thrusters for advanced gait stabilization, obstacle negotiation, and robust locomotion on rough terrains. Leveraging optimization-free methods, this study demonstrates the capability to maintain gait feasibility, mitigate fallovers, and stabilize hybrid dynamics under perturbations. This approach provides a novel solution to traditional challenges in bipedal robotics, such as under actuation and computational complexity, while offering insights into the potential of combining aerial and terrestrial mobility for applications in disaster response, agriculture, and more.

Real-time constraint satisfaction for robots can be quite challenging due to the high computational complexity that arises when accounting for the system dynamics and environmental interactions, often requiring simplification in modelling that might not necessarily account for all performance Criteria. We instead propose an optimization-free approach where reference trajectories are manipulated to satisfy constraints brought on by ground contact as well as those prescribed for states and inputs. Unintended changes to trajectories especially ones optimized to produce periodic gaits can adversely affect gait stability, however we will show our approach can still guarantee stability of a gait by employing the use of coaxial thrusters that are unique to our robot.

Numerous mobile robots in various forms specialize in either ground or aerial locomotion, whereas very few robots can perform complex locomotion tasks beyond simple walking and flying. We present the design and control of a multimodal locomotion robotic platform called LEONARDO, which bridges the gap between two different locomotion regimes of flying and walking using synchronized control of distributed electric thrusters and a pair of multijoint legs. By combining two distinct locomotion mechanisms, LEONARDO achieves complex maneuvers that require delicate balancing, such as walking on a slackline and skateboarding, which are challenging for existing bipedal robots. LEONARDO also demonstrates agile walking motions, interlaced with flying maneuvers to overcome obstacles using synchronized control of propellers and leg joints. The mechanical design and synchronized control strategy achieve a unique multimodal locomotion capability that could potentially enable robotic missions and operations that would be difficult for single-modal locomotion robots.

We are seeking control design paradigms for legged systems that allow bypassing costly algorithms that depend on heavy on-board computers widely used in these systems and yet being able to match what they can do by using less expensive optimization-free frameworks. In this work, we present our preliminary results in modeling and control design of a quadrupedal robot called Husky Carbon, which under development at Northeastern University (NU) in Boston. In our approach, we utilized a supervisory controller and an Explicit Reference Governor (ERG) to enforce ground reaction force constraints. These constraints are usually enforced using costly optimizations. However, in this work, the ERG manipulates the state references applied to the supervisory controller to enforce the ground contact constraints through an updated law based on Lyapunov stability arguments. As a result, the approach is much faster to compute than the widely used optimization based methods.

This work tries to contribute to the design of legged robots with capabilities boosted through thruster-assisted locomotion. Our long-term goal is the development of robots capable of negotiating unstructured environments, including land and air, by leveraging legs and thrusters collaboratively. These robots could be used in a broad number of applications including search and rescue operations, space exploration, automated package handling in residential spaces and digital agriculture, to name a few. In all of these examples, the unique capability of thruster-assisted mobility greatly broadens the locomotion designs possibilities for these systems. In an effort to demonstrate thrusters effectiveness in the robustification and efficiency of bipedal locomotion gaits, this work explores their effects on the gait limit cycles and proposes new design paradigms based on shaping these center manifolds with strong foliations. Unilateral contact force feasibility conditions are resolved in an optimal control scheme.

We are seeking control design paradigms for legged systems that allow bypassing costly algorithms that depend on heavy on-board computers widely used in these systems and yet being able to match what they can do by using less expensive optimization-free frameworks. In this work, we present our preliminary results in modeling and control design of a quadrupedal robot called Husky Carbon, which under development at Northeastern University (NU) in Boston. In our approach, we utilized a supervisory controller and an Explicit Reference Governor (ERG) to enforce ground reaction force constraints. These constraints are usually enforced using costly optimizations. However, in this work, the ERG manipulates the state references applied to the supervisory controller to enforce the ground contact constraints through an updated law based on Lyapunov stability arguments. As a result, the approach is much faster to compute than the widely used optimization based methods.

This work tries to contribute to the design of legged robots with capabilities boosted through thruster-assisted locomotion. Our long-term goal is the development of robots capable of negotiating unstructured environments, including land and air, by leveraging legs and thrusters collaboratively. These robots could be used in a broad number of applications including search and rescue operations, space exploration, automated package handling in residential spaces and digital agriculture, to name a few. In all of these examples, the unique capability of thruster-assisted mobility greatly broadens the locomotion designs possibilities for these systems. In an effort to demonstrate thrusters effectiveness in the robustification and efficiency of bipedal locomotion gaits, this work explores their effects on the gait limit cycles and proposes new design paradigms based on shaping these center manifolds with strong foliations. Unilateral contact force feasibility conditions are resolved in an optimal control scheme.

In this paper, we report our preliminary simulation-based e orts in designing feedback for the thruster-assisted walking of a bipedal robot, called Harpy, currently being developed at Northeastern University. The biped is equipped with a total of eight actuators, and two pairs of coaxial thrusters fixed to its torso. Each leg is equipped with three actuated joints, the actuators located at the hip allow the legs to move sideways and actuation in the lower portion of the legs is realized through a parallelogram mechanism. Two extra actuators rotate the thrusters with respect to the torso, therefore, they provide more flexibility in control.

We will report our efforts in designing feedback for the thruster-assisted walking of a bipedal robot. We will assume for well-tuned supervisory controllers and will focus on fine-tuning the desired joint trajectories to satisfy the performance being sought. In doing this, we will devise an intermediary filter based on the emerging idea of reference governors. Since these modifications and impact events lead to deviations from the desired periodic orbits, we will guarantee hybrid invariance in a robust fashion by applying predictive schemes within a short time envelope during the double support phase of a gait cycle. To achieve the hybrid invariance, we will leverage the unique features in our robot, i.e., the thruster.

In this paper, we will report our efforts in designing closed-loop feedback for the thrusterassisted walking of bipedal robots. We will assume for well-tuned supervisory controllers and will focus on fine-tuning the joints desired trajectories to satisfy the performance being sought. In doing this, we will devise an intermediary filter based on reference governors that guarantees the satisfaction of performance-related constraints. Since these modifications and impact events lead to deviations from the desired periodic orbits, we will guarantee hybrid invariance in a robust way by applying predictive schemes withing a very short time envelope during the gait cycle. To achieve the hybrid invariance, we will leverage the unique features in our model, that is, the thrusters. The merit of our approach is that unlike existing optimization-based nonlinear control methods, satisfying performance-related constraints during the single support phase does not rely on expensive numeric approaches. In addition, the overall structure of the proposed thruster-assisted gait control allows for exploiting performance and robustness enhancing capabilities during specific parts of the gait cycle, which is unusual and not reported before.

This paper develops feedback controllers for walking in 3D, on level ground, with energy efficiency as the performance objective. Assume The Robot Is A Sphere (ATRIAS) 2.1 is a new robot that has been designed for the study of 3D bipedal locomotion, with the aim of combining energy efficiency, speed, and robustness with respect to natural terrain variations in a single platform. The robot is highly underactuated, having 6 actuators and, in single support, 13 degrees of freedom. Its sagittal plane dynamics are designed to embody the spring loaded inverted pendulum (SLIP), which has been shown to provide a dynamic model of the body center of mass during steady running gaits of a wide diversity of terrestrial animals. A detailed dynamic model is used to optimize walking gaits with respect to the cost of mechanical transport (CMT), a dimensionless measure of energetic efficiency, for walking speeds ranging from 0.5 ðm=sÞ to 1.4 ðm=sÞ. A feedback controller is designed that stabilizes the 3D walking gaits, despite the high degree of underactuation of the robot. The 3D results are illustrated in simulation. In experiments on a planarized (2D) version of the robot, the controller yielded stable walking.

This paper reports on an underactuated 3D bipedal robot with passive feet that can start from a quiet standing position, initiate a walking gait, and traverse the length of the laboratory (approximately 10 m) at a speed of roughly 1 m/s. The controller was developed using the method of virtual constraints, a control design method first used on the planar point-feet robots Rabbit and MABEL. For the preliminary experiments reported here, virtual constraints were experimentally tuned to achieve robust planar walking and then 3D walking. A key feature of the controller leading to successful 3D walking is the particular choice of virtual constraints in the lateral plane, which implement a lateral balance control strategy similar to SIMBICON. To our knowledge, MARLO is the most highly underactuated bipedal robot to walk unassisted in 3D.