I look for the delicate balance between physics and learning that lets intelligence interact with the physical world.
My work treats physics as a set of constraints that models should obey. I study how differentiable simulation, energy-based dynamics, and world models can be integrated to keep perception, prediction, and action physically consistent, allowing models built from imperfect real-world observations to behave like the physical systems they represent.
My long-term goal is robust and trustworthy construction robotics: machines that can robustly inspect, assemble, and interact with the complex and dynamic built environment under conditions not represented in their training data, with behaviour that engineers can understand and rely on.
I am a Research Associate in the Department of Engineering at the University of Cambridge, working with Brian Sheil at the Centre for Smart Infrastructure and Construction and the Laing O’Rourke Centre. I received my DPhil from the University of Oxford in 2025 under the supervision of Sinan Acikgoz and Brian Sheil. I also co-supervise research students through collaborations with Oxford, TUM, MIT, Harvard, and PolyU.
I previously served as Head of AI at InfraMind Labs, where I led the development of its AI algorithms. My role concluded on . The methods I developed during my DPhil formed the core of the company’s digital inspector, translating my research into infrastructure inspection tools.
Inspecting every bridge and tunnel across a country by hand is simply impractical. I develop an end-to-end pipeline that uses deep learning to segment large-scale infrastructure point clouds into structural components, then applies unsupervised learning to identify geometric anomalies indicative of defects without labelled defect data. Designed for surveys containing hundreds of millions of points, the pipeline was commercialised through InfraMind Labs’ digital inspection product line.
A digital world is useful only if it behaves like the physical system it represents. I combine differentiable simulation, neural dynamics, system identification, and generative models to reconstruct physically consistent digital environments and build world models that preserve the behaviour of their real-world counterparts.
Physically grounded world models can predict how objects will behave during interaction, but prediction alone is not enough. The next challenge is to enable robots to understand long-horizon tasks and translate the reasoning capabilities of large language models into robust physical action. I explore multimodal systems that combine RGB images, point clouds, and tactile sensing to ground robotic planning and manipulation in scene geometry, predicted mechanical behaviour, and real-time physical feedback.
My role concluded on .
During my time at InfraMind Labs, I led the AI team and the development of an end-to-end pipeline for infrastructure inspection and monitoring. This work translated my research on point-cloud segmentation and unsupervised defect detection into a digital inspection platform for bridges and tunnels.
From paper to product. The synthetic-data segmentation methods behind BridgeNet and Tunnel Scanner enabled the platform to label previously unseen assets. The unsupervised anomaly detection developed in 3D-Multi-FPFHI identified defects without labelled defect examples.
Trials and deployments during my tenure: Jacobs · National Highways · Transport for London · Network Rail
Bold denotes my name; † denotes corresponding author; ∗ denotes equal contribution.
Department of Engineering, University of Cambridge
yj401@cam.ac.uk ·
jyx.civil@gmail.com
Open to collaborations on physics-grounded 3D learning, embodied manipulation and infrastructure AI.