I am an Assistant Professor at Robot Dynamics Section as part of the Department of Cognitive Robotics, Faculty of Mechanical, Maritime and Materials Engineering (3mE), Delft University of Technology.

I have a broad interest in robot dynamics by combining (Bayesian) machine learning and the principles of dynamic control. Currently, I am interested in Bayesian deep learning and (multi-agent) reinforcement learning for system identification, state estimation, planning and control.

Recent News

• June 30, Our paper “Reinforcement Learning Compensated Extended Kalman Filter for Attitude Estimation” accepted to IROS! Well done, Yujie!
• June 8, One Postdoc position openning on “Bayesian Learning for Robotics”. Apply Now!
• May 29, Our paper “Finite-Time Fuzzy Adaptive Constrained Tracking Control for Hypersonic Flight Vehicles with Singularity-Free Switching” accepted to IEEE Transactions on Mechatronics!
• May 28, Our paper “Model-Reference Reinforcement Learning for Collision-Free Tracking Control of Autonomous Surface Vehicles” accepted to IEEE Transactions on Intelligent Transportation Systems! Well done, Qingrui!
• April 12, Our paper “Secure Control for Cyber-Physical Systems under Malicious Attacks” accepted to IEEE Transactions on Control of Network Systems! Well done, Chengwei!
• April 7, 2021, I will serve as an Area Chair for CoRL 2021.
• March 25, 2021, Our paper “Reinforcement Learning Control of Constrained Dynamic Systems with Uniformly Ultimate Boundedness Stability Guarantee” accepted to Automatica! Well done, Minghao and Yuan!
• February 28, 2021, Our paper “Reinforcement Learning for Orientation Estimation Using Inertial Sensors with Performance Guarantee” accepted to ICRA! Well done, Yujie!
• February 17, 2021, I will serve as an Associate Editor for IROS 2021.
• Januray 20, 2021, Our paper “Learning Tracking Control for Cyber-Physical Systems” accepted to IEEE Internet of Things Journal! Well done, Chengwei!
• Januray 4, 2021, Dr Zhipeng Zhou join our group as a PostDoc. Welcome, Zhipeng!
• Januray 4, 2021, Ms Yujie Tang join our group as a PhD student. Welcome, Yujie!
• Januray 1, 2021, We received a gift from HUAWEI UK. Thanks, HUAWEI!
• December 17, 2020, I join the Personnel Committee (Onderdeelcommissie) for the faculty of Mechanical, Maritime and Materials Engineering (3mE).
• October 14, 2020, Our paper “Social-VRNN: One-Shot Multi-modal Trajectory Prediction for Interacting Pedestrians” accepted to CoRL!
• October 1, 2020, Mr Robert Cornet join our group as a research engineer. Welcome, Robert!
• September 11, 2020, Our paper “Zero-Sum Game Based Optimal Secure Control under Actuator Attacks” accepted to IEEE Transactions on Automatic Control!
• September 2, 2020, Our paper “Dynamic Network Reconstruction from Heterogeneous Datasets” accepted to Automatica!
• July 16, 2020, Our paper “Model-Reference Reinforcement Learning Control of Autonomous Surface Vehicles with Uncertainties” accepted to CDC! Check extended version
• July 7, 2020, Our paper “Lyapunov-Based Reinforcement Learning for Decentralized Multi-Agent Control” accepted to DAI！
• July 6, 2020, I will serve as an Aera Chair for CoRL 2020.
• July 1, 2020, Our paper “Actor-Critic Reinforcement Learning for Control with Stability Guarantee” accepted to RA-L and IROS!
• April 1, 2020, Dr Chengchao Bai from Harbin Institue of Technology joined our group as a PostDoc. Welcome, Chengchao!
• February 3, 2020, I will serve as an Associate Editor for IROS 2020.
• Janurary 15, 2020, Two Postdoc positions openning on “Safe Reinforcement Learning for Motion Planning” funded by AnKobot. One position is on Simulator. One position is on Theory.
• Janurary 14, 2020, Our paper “Towards Lossless Binary Convolutional Neural Networks Using Piecewise Approximation” accepted to ECAI, 2020. Well done, Baozhou.
• October 25, 2019, Our paper “Data Driven Discovery of Cyber Physical Systems” is published in Nature Communications!
• October 22, 2019, Our paper “Asynchronous Observer Design for Switched Linear Systems: A Tube-Based Approach” is published in IEEE/CAA Journal of Automatica Sinica.
• October 2, 2019, Our paper “H∞ Model-free Reinforcement Learning with Robust Stability Guarantee” is accepted to NeurIPS 2019 Workshop on Robot Learning.
• September 12, 2019. Dr Qingrui Zhang from University of Toronto joined our group as a PostDoc, co-supervised by Dr Vasso Reppa from Department of Maritime and Transport Technology. Welcome, Qingrui!
• April 22, 2019. Our paper “BayesNAS: A Bayesian Approach for Neural Architecture Search” accepted to ICML 2019! Hongpeng also got the ICML Travel Award. Well done, Hongpeng and Minghao.
• April 11, 2019. Hongpeng gave a talk on “Sparse Bayesian Deep Neural Networks for Nonlinear System Identification” at Nonlinear System Identification Benchmarks, Eindhoven.
• April 1, 2019. Talk at Huawei Noah’s Ark Lab, London, UK.
• Febrary 11, 2019. One Postdoc position openning on “Learning for Self-healing of Multi-Machine Systems”, apply here
• Febrary 8, 2019. Two abstracts accepted to Benelux Meeting.
• December 21, 2018. Our paper Probabilistic Recursive Reasoning for Multi-Agent Reinforcement Learning accepted to ICLR 2019!
• May 1, 2018. Start my research group in the Department of Cognitive Robotics, TU Delft. Thanks to the amazing colleagues in DJI! Thanks Shenzhen!