Marcelo Jacinto

Marcelo Jacinto

PhD Candidate @ Institute for Systems and Robotics (ISR)

Instituto Superior Técnico, Lisbon, Portugal

I am a PhD candidate at the Dynamical Systems and Ocean Robotics (DSOR) group in ISR/IST, under the supervision of Prof. Rita Cunha. My current research focuses on the intersection of vision-aided estimation, control and motion planning for target tracking.

I am also the developer of Pegasus Simulator and the Pegasus GNC projects. Previously, I worked as an R&D engineer at DSOR/ISR on the MEDUSA class of marine vehicles and the EU BlueRoSES project under the supervision of Prof. António Pascoal.

Languages

Python C C++ MATLAB & Simulink

Robotics

ROS / ROS2 PX4 Gazebo Isaac Sim Jetson Jetpack CAD (Onshape)

Vision + ML + Optimization

OpenCV PyTorch CasADi CVXPY Eigen (C++)

Tools

Docker CMake Git Bash

Experience / CV

Education
Research & Industry
Teaching & Outreach
2023 - Jan 2027 Ongoing · Education Research
PhD in Electrical and Computer Engineering
Thesis: Distributed Target Tracking, Motion Planning and Control of Aerial Vehicles
Instituto Superior Técnico · Lisbon Institute for Systems and Robotics (ISR)

Supervisor

Prof. Rita Cunha

Expected Delivery

January 2027

Associated Projects

Pegasus Simulator, Pegasus GNC

Training & Summer Schools

  • IEEE RAS Summer School on Multi-Robot Systems (Jul 30 - Aug 5, 2025, 50h) · Czech Technical University in Prague · Certificate
  • EECI 2024 Summer School on Control (Jun 17-21, 2024, 21h) · NTNU Norway · Equivariant Observers with Prof. Robert Mahony, Jochen Trumpf, Tarek Hamel · Certificate

Selected Publications

View all publications

Apr 29, 2024 · 2h Workshop
ROS 2 Workshop
Institute for Systems and Robotics (ISR) · Lisbon
Slides: Presentation

ISR Workshop: 2-hour session introducing ROS 2 to lab members. Organized following my Teaching Assistant role in the Autonomous Systems course, at the invitation of Prof. Rodrigo Ventura.

2022 - 2023 · P4 S2 Teaching
Teaching Assistant · Autonomous Systems
Instituto Superior Técnico · Lisbon

Second semester - 4 period. Concurrent with the start of the PhD.

Lab Classes: Kalman Filter, Mapping & SLAM and ROS 1
2020/2021 · S2 Teaching
Teaching Assistant · Programming
Instituto Superior Técnico · Lisbon

Second semester. Concurrent with the development of the MSc thesis and research work at DSOR/ISR.

Lab Classes: Programming in C
Supervision: Prof. Nuno Horta
Jan-Fev 2021 · 2 months Outreach
Online Instructor · Volunteer
TreeTree2 AfterSchool · Remote

Teaching kids ages 15-17 the basics of computer architectures (from a simple NAND gate to a complete RAM circuit).

2019 - 2021 Education
MSc in Electrical and Computer Engineering
Instituto Superior Técnico · Lisbon
Specialization: Decision Systems, Control & Robotics
Average Grade: 19/20
2016 - 2019 Education
BSc in Electrical and Computer Engineering
Instituto Superior Técnico · Lisbon
Average Grade: 17/20
Oct - Dec 2022 Visiting Scholar
Visiting Researcher
AirLab · CMU · Pittsburgh

Three-month visiting scholar at AirLab under the CMU-Portugal program, affiliated with ISR-Lisbon throughout.

Sep 2019 - 2022 Research
Research Engineer
Institute for Systems and Robotics (ISR) · Lisbon
Focus Areas: Autonomous Underwater Vehicles (AUV) and Unmanned Aerial Vehicles (UAV) multirotors

Research on nonlinear distributed cooperative control, path following (PF), and cooperative path following (CPF). Ran concurrently with the MSc thesis.

Theory: Nonlinear PF & CPF for AUVs and quadrotors in pre-defined formations; B-Spline and 2-D point cloud path-planning.

Implementation: PF/CPF algorithms in C++ (ROS1); B-Spline planner in Python; Gazebo 3D simulation tools for the MEDUSA AUVs.

Field & Integration: Adapted DSOR stack to BlueROV; prepared final demos for the OceanTech HROV and BlueRoSES EU projects.

Summer 2019 Industry
Software Engineering Intern
Mercedes-Benz.io · Lisbon

Backend developer intern at Mercedes-Benz.io using Kotlin and Spring Framework.

Learned: Deploying micro-services in Kubernetes; connecting Kotlin backend to a Javascript frontend via REST and gRPC.

Stack: Kotlin, Spring, Docker, Kubernetes, PostgreSQL · Agile/Scrum.


Projects

Lead Author

Open Source · UAV Simulation Pegasus Simulator

Pegasus Simulator is a modular UAV simulation framework built on top of NVIDIA Isaac Sim. It supports PX4, ArduPilot and ROS 2 integration, multi-vehicle scenarios, and fully custom controller backends. Designed for both GUI and scripted standalone workflows. It was created in 2023 with the original purpose of serving my PhD workplan.

Python Isaac Sim PX4 ROS2 USD Aerial Robotics
Pegasus Simulator
Open Source · GNC Library Pegasus GNC

ROS 2 GNC framework for autonomous drones, built around PX4 - the backbone of PhD experimental validation.

  • C++ Plugin-based autopilot with swappable operation modes, controllers a modular state machine
  • PX4 interface + Pegasus Simulator & Gazebo for software-in-the-loop testing
  • Custom drone models - CAD files and hardware setup guide included
  • Still under development
Python C++ ROS 2 PX4 GNC CAD Jetson Electronics Aerial Robotics
Pegasus GNC

Previous Lab Projects

EU-funded Lab Project · Contributor BlueRoSES

Developing remote underwater vehicle operation capabilities, integrating DSOR's MEDUSA codebase with ArduSub and enabling full remote operation from a custom-built mobile app.

  • Wrote from scratch a Flutter mobile app to control the vehicle remotely via MQTT
  • Worked on the video transmission pipeline for remote operation at distance
  • Worked on hardware integration, motor force allocation, inner-loop control, ...
  • Built Python joystick teleoperation supporting both ROS 1 and MQTT interfaces
  • Gazebo simulation environment, ArduSub integration and field trials execution
C++ ROS1 MQTT Dart+Flutter BlueROV Marine Robotics
BlueRoSES Mission

Field trials, May 2-4, 2022

Marina de Portimão, Portugal

Lab Codebase · Contributor Medusa

Multi-vehicle GNC stack for DSOR's marine robots. Contributed across the full stack from control algorithms to simulation and DevOps infrastructure.

  • Implemented new ROS 1 packages for path following, cooperative path following, and path parameterization
  • Developed Gazebo simulation environments for AUV testing
  • Created a C++ AUV dynamics simulation package following Fossen's Handbook of Marine Craft
  • Built auxiliary math and reference frames libraries
  • Proposed and implemented the submodule structure adopted for the codebase
  • Helped fix CMakeFiles during the ROS port: Kinetic → Melodic → Noetic
  • Jenkins automatic documentation pipeline and Docker images for reproducible deployment
C++ Python ROS1 Docker Jenkins Marine Robotics
Medusa Vehicles
Industry/Lab Project · Field Trials OceanTech

Joined towards the end of the project, contributing to field trials and basic hardware and software setup. A great experience working with a multidisciplinary team in a real operational marine environment.

C++ ROS 1 Jetson TX2 Field Work Hardware Marine Robotics
OceanTech field trials

Field trials, April 28, 2022

Doca dos Olivais, Portugal


Publications

Distributed consensus-based observer design for target state estimation with bearing measurements
Accepted for Publication in Automatica, 2026
Distributed consensus-based observer design for target state estimation with bearing measurements
Marcelo Jacinto, Pedro Trindade, Francisco Rego, Rita Cunha
MATLAB Control Theory Multi-Agent

Abstract

This paper introduces a novel distributed consensus-based observer design that enables a group of agents in an undirected communication network to solve the problem of target tracking, where the target is modeled as a chain of integrators of arbitrary order. Each agent is assumed to know its own position and simultaneously measure bearing vectors relative to the target. We start by introducing a general continuous time observer design tailored to systems whose state dynamics are modeled as chains of integrators and whose measurement model follows a particular nonlinear but observer-suited form. This design leverages a correction term that combines innovation and consensus components, allowing each agent to broadcast only a part of the state estimate to its neighbours, which effectively reduces the data flowing across the network. To provide uniform exponential stability guarantees, a novel result for a class of nonlinear closed-loop systems in a generalized observer form is introduced and subsequently used as the main tool to derive stability conditions on the observer gains. Then, by exploring the properties of orthogonal projection matrices, the proposed design is used to solve the distributed target tracking problem and provide explicit stability conditions that depend on the target-agents geometric formation. Practical examples are derived for a target modeled as first-, second-, and third-order integrator dynamics, highlighting the design procedure and the stability conditions imposed. Finally, numerical results showcase the properties of the proposed algorithm.

Distributed consensus-based observer design for target state estimation with bearing measurements
Equivariant Observer for Bearing Estimation with Linear and Angular Velocity Inputs
Accepted for presentation @ European Control Conference (ECC), 2026
Equivariant Observer for Bearing Estimation with Linear and Angular Velocity Inputs
Gil Serrano, Marcelo Jacinto, Bruno Guerreiro, Rita Cunha
MATLAB Control Theory

Abstract

This work addresses the problem of designing an equivariant observer for a first order dynamical system on the unit-sphere. Building upon the established case of unit bearing vector dynamics with angular velocity inputs, we introduce an additional linear velocity input projected onto the unit-sphere tangent space. This extended formulation is particularly useful in image-based visual servoing scenarios where stable bearing estimates are required and the relative velocity between the vehicle and target features must be accounted for. Leveraging lifted kinematics to the Special Orthogonal group, we design an observer for the bearing vector and prove its almost global asymptotic stability. Additionally, we demonstrate how the equivariant observer can be expressed in the original state manifold. Numerical simulation results validate the effectiveness of the proposed algorithm.

Equivariant Observer for Bearing Estimation with Linear and Angular Velocity Inputs
Vision-Based Multirotor Control for Spherical Target Tracking: A Bearing-Angle Approach
European Control Conference (ECC), 2025
Vision-Based Multirotor Control for Spherical Target Tracking: A Bearing-Angle Approach
Marcelo Jacinto, Rita Cunha
MATLAB Control Theory Vision

Abstract

This work addresses the problem of designing a visual servo controller for a multirotor vehicle, with the end goal of tracking a moving spherical target with unknown radius. To address this problem, we first transform two bearing measurements provided by a camera sensor into a bearing-angle pair. We then use this information to derive the system’s dynamics in a new set of coordinates, where the angle measurement is used to quantify a relative distance to the target. Building on this system representation, we design an adaptive nonlinear control algorithm that takes advantage of the properties of the new system geometry and assumes that the target follows a constant acceleration model. Simulation results illustrate the performance of the proposed control algorithm.

Vision-Based Multirotor Control for Spherical Target Tracking: A Bearing-Angle Approach
Leader-Follower Formation Tracking Control of Quadrotor UAVs Using Bearing Measurements
IEEE Conference on Control Technology and Applications (CCTA), 2025
Leader-Follower Formation Tracking Control of Quadrotor UAVs Using Bearing Measurements
Sander Doodeman, Zhiqi Tang, Marcelo Jacinto, Rita Cunha, Carlos Silvestre
MATLAB ROS 2 Control Theory Field Experiments

Abstract

This work addresses the practical problem of distributed formation tracking control of a group of quadrotor vehicles in a relaxed sensing graph topology with a very limited sensor set, where only one leader vehicle can access the global position. Other vehicles in the formation are assumed to only have access to inter-agent bearing (direction) measurements and relative velocities with respect to their neighbor agents. A hierarchical control architecture is adopted for each quadrotor, combining a high-gain attitude inner-loop and an outer-loop bearing-based formation controller with collision avoidance augmentation. The proposed method enables a group of quadrotors to track arbitrary bearing persistently exciting desired formations, including time-varying shapes and rotational maneuvers, such that each quadrotor only requires relative measurements to at least one neighboring quadrotor. The effective performance of the control strategy is validated by numerical simulations in MATLAB and real-world experiments with three quadrotors.

Leader-Follower Formation Tracking Control of Quadrotor UAVs Using Bearing Measurements
Physics-Informed Neural Network for Multirotor Slung Load Systems Modeling
IEEE International Conference on Robotics and Automation (ICRA), 2024
Physics-Informed Neural Network for Multirotor Slung Load Systems Modeling
Gil Serrano*, Marcelo Jacinto*, José Ribeiro Gomes*, João Pinto*, Bruno Guerreiro, Rita Cunha
* Equal contribution
Python PyTorch Deep Learning

Abstract

Recent advances in aerial robotics have enabled the use of multirotor vehicles for autonomous payload transportation. Resorting only to classical methods to reliably model a quadrotor carrying a cable-slung load poses significant challenges. On the other hand, purely data-driven learning methods do not comply by design with the problem’s physical constraints, especially in states that are not densely represented in training data. In this work, we explore the use of physics-informed neural networks to learn an end-to-end model of the multirotor-slung-load system and, at a given time, estimate a sequence of the future system states. An LSTM encoder-decoder with an attention mechanism is used to capture the dynamics of the system. To guarantee the cohesiveness between the multiple predicted states of the system, we propose the use of a physics-based term in the loss function, which includes a discretized physical model derived from first principles together with slack variables that allow for a small mismatch between expected and predicted values. To train the model, a dataset using a real-world quadrotor carrying a slung load was curated and is made available. Prediction results are presented and corroborate the feasibility of the approach. The proposed method outperforms both the first principles physical model and a comparable neural network model trained without the physics regularization proposed.

Physics-Informed Neural Network for Multirotor Slung Load Systems Modeling
Pegasus Simulator: An Isaac Sim Framework for Multiple Aerial Vehicles Simulation
International Conference on Unmanned Aircraft Systems (ICUAS), 2024
Pegasus Simulator: An Isaac Sim Framework for Multiple Aerial Vehicles Simulation
Marcelo Jacinto, João Pinto, Jay Patrikar, John Keller, Rita Cunha, Sebastian Scherer, António Pascoal
Python ROS 2 Isaac Sim PX4

Abstract

Developing and testing novel control and motion planning algorithms for aerial vehicles can be a challenging task, with the robotics community relying more than ever on 3D simulation technologies to evaluate the performance of new algorithms in a variety of conditions and environments. In this work, we introduce the Pegasus Simulator, a modular framework implemented as an NVIDIA ® Isaac Sim extension that enables real-time simulation of multiple multirotor vehicles in photo-realistic environments, while providing out-of-the-box integration with the widely adopted PX4-Autopilot and ROS2 through its modular implementation and intuitive graphical user interface. To demonstrate some of its capabilities, a nonlinear controller was implemented and simulation results for two drones performing aggressive flight maneuvers are presented. Code and documentation for this framework are also provided as supplementary material.

Pegasus Simulator: An Isaac Sim Framework for Multiple Aerial Vehicles Simulation
A review of path following control strategies for autonomous robotic vehicles: Theory, simulations, and experiments
Journal of Field Robotics, 2023
A review of path following control strategies for autonomous robotic vehicles: Theory, simulations, and experiments
Nguyen Hung, Francisco Rego, Joao Quintas, Joao Cruz, Marcelo Jacinto, David Souto, Andre Potes, Luis Sebastiao, Antonio Pascoal
C++ ROS 1 MATLAB Control Theory

Abstract

This article presents an in-depth review of path following control strategies that are applicable to a wide range class of marine, ground, and aerial autonomous robotic vehicles. From a control system standpoint, path following can be formulated as the problem of stabilizing a path following error system that describes the dynamics of position and possibly orientation errors of a vehicle with respect to a path, with the errors defined in an appropriate reference frame. In spite of the large variety of path following methods described in the literature we show that, in principle, most of them can be categorized in two groups: stabilization of the path following error system expressed either in the vehicle's body frame or in a frame attached to a “reference point” moving along the path, such as a Frenet-Serret (F-S) frame or a Parallel Transport (P-T) frame. With this observation, we provide a unified formulation that is simple but general enough to cover many methods available in the literature. We then discuss the advantages and disadvantages of each method, comparing them from the design and implementation standpoint. We further show experimental results of the path following methods obtained from field trials testing with under-actuated and over-actuated autonomous marine vehicles. In addition, we introduce open-source Matlab and Gazebo/ROS simulation toolboxes that are helpful in testing path following methods before their integration in the combined guidance, navigation, and control systems of autonomous vehicles.

A review of path following control strategies for autonomous robotic vehicles: Theory, simulations, and experiments
The Blue-RoSES Project: a Gate for Remote Exploration of the Seas
IFAC World Congress, 2023
The Blue-RoSES Project: a Gate for Remote Exploration of the Seas
Marco Bibuli, Massimo Caccia, Claudia Presicci, Luis Sebastiao, David Cabecinhas, André Potes, João Quintas, Marcelo Jacinto, Antonio Pascoal
C++ ROS 1 MQTT Dart+Flutter BlueROV

Abstract

This paper focuses on the description of the Blue-RoSES project, an European funded activity devoted to the development and exploitation of a reliable infrastructure for the remote employment of Remotely Operated Vehicles (ROVs) for both professional and recreational applications in coastal environments, marinas and yachting. The paper firstly provides an overall view of the concept and then summarizes the main modules composing the architecture that is responsible for reliable and stable remote piloting of ROVs. Analysis of the critical issues related to remote piloting and control is carried out and measurements of the communication lags and delays are performed to obtain a statistical characterization, also providing a quantitative measure of the communication service. The reliability and performance of the complete system are demonstrated through experimental campaigns in real case scenarios.

The Blue-RoSES Project: a Gate for Remote Exploration of the Seas
Chemical Spill Encircling Using a Quadrotor and Autonomous Surface Vehicles: A Distributed Cooperative Approach
MDPI Sensors, 2022
(Special Issue - Motion Optimization and Control of Single and Multiple Autonomous Aerial, Land, and Marine Robots)
Chemical Spill Encircling Using a Quadrotor and Autonomous Surface Vehicles: A Distributed Cooperative Approach
Marcelo Jacinto, Rita Cunha, António Pascoal
C++ ROS 1 MATLAB Gazebo Control Theory Multi-Agent Vision Field Experiments

Abstract

This article addresses the problem of formation control of a quadrotor and one (or more) marine vehicles operating at the surface of the water with the end goal of encircling the boundary of a chemical spill, enabling such vehicles to carry and release chemical dispersants used during ocean cleanup missions to break up oil molecules. Firstly, the mathematical models of the Medusa class of marine robots and quadrotor aircrafts are introduced, followed by the design of single vehicle motion controllers that allow these vehicles to follow a parameterised path individually using Lyapunov-based techniques. At a second stage, a distributed controller using event-triggered communications is introduced, enabling the vehicles to perform cooperative path following missions according to a pre-defined geometric formation. In the next step, a real-time path planning algorithm is developed that makes use of a camera sensor, installed on-board the quadrotor. This sensor enables the detection in the image of which pixels encode parts of a chemical spill boundary and use them to generate and update, in real time, a set of smooth B-spline-based paths for all the vehicles to follow cooperatively. The performance of the complete system is evaluated by resorting to 3-D simulation software, making it possible to visually simulate a chemical spill. Results from real water trials are also provided for parts of the system, where two Medusa vehicles are required to perform a static lawn-mowing path following mission cooperatively at the surface of the water.

Chemical Spill Encircling Using a Quadrotor and Autonomous Surface Vehicles: A Distributed Cooperative Approach
Underwater geophysical navigation using a particle filter approach to multi-sensor fusion
CONFERENCE OCEANS, 2021
Underwater geophysical navigation using a particle filter approach to multi-sensor fusion
Marcelo Jacinto, André Potes, David Souto, Yusen Gong, João Quintas, João Cruz, Shubham Garg, António Pascoal
C++ ROS 1 MATLAB Particle Filter & Kalman Filter

Abstract

This paper addresses the problem of underwater navigation of autonomous underwater vehicles via a Monte Carlo estimation approach that relies on the use of a prior digital elevation map of the seabed and bathymteric data acquired with a Multibeam Echosounder. The Monte Carlo estimation procedure is implemented in the form of a particle filter, as part of a multi-sensor fusion framework for underwater geophysical navigation. The contribution of this paper focuses on two main topics: i) development of a particle filter as a solution to a terrain-based Bayesian vehicle positioning problem, followed by filter implementation and simulation and ii) integration of the particle filter structure in a multi-sensor fusion architecture for vehicle navigation with a view to increasing navigation accuracy. The results of realistic simulations with a dedicated marine robotics system simulator illustrate the navigation performance achieved with the proposed solution.

Underwater geophysical navigation using a particle filter approach to multi-sensor fusion

Dissertations

Under Construction
PhD Thesis (UNDER DEVELOPMENT)
Distributed Target Tracking, Motion Planning and Control of Aerial Vehicles
Supervisor: Prof. Rita Cunha
Instituto Superior Técnico - Expected Delivery Date: January/2027
Cooperative Motion Control of Aerial and Marine Vehicles for Environmental Applications
MSc ThesisBest Thesis Video Award by DEEC/IST
Cooperative Motion Control of Aerial and Marine Vehicles for Environmental Applications
Supervisors: Prof. Rita Cunha and Prof. António Pascoal
Instituto Superior Técnico, 2021

Abstract

This work addresses the problem of formation control of a quadrotor and one (or more) marine vehicles operating at the surface of the water with the end goal of encircling the boundary of a chemical spill. Firstly, the mathematical models of the Medusa class of marine robots, and quadrotor aircrafts are introduced, followed by the design of single vehicle motion controllers that allow these vehicles to follow a parameterized path individually. Inner-outer loop schemes coupled with Lyapunov based techniques are used for control design. At a second stage, a distributed coordination controller using event triggered communications is introduced, enabling the vehicles to perform cooperative path following missions according to a pre-defined geometric formation. In the next step, a real time path planning algorithm is developed that makes use of a camera sensor, installed on-board the quadrotor. This sensor enables the detection in the image of which pixels encode parts of a chemical spill boundary and use them to generate and update in real time a set of smooth B-spline based paths for all the vehicles to follow cooperatively. The performance of the complete system is evaluated by resorting to 3-D simulation software, making it possible to simulate visually a chemical spill. Results from real water trials are also provided for parts of the system, where two Medusa vehicles are required to perform a static lawn-mowing path following mission cooperatively at the surface of the water.

Cooperative Motion Control of Aerial and Marine Vehicles for Environmental Applications

Awards