School of Computer Science · Open Lab on Human Robot Interaction
My research focuses on 3D perception, world-action models, and simulation for embodied AI, aiming to connect scene understanding with robotic manipulation. I study geometric and semantic representations for 6D object pose estimation, including generalization to unseen objects and the use of relationships between objects. I also build language-guided simulation pipelines for synthetic data generation and develop perception-guided dexterous grasping prototypes on real robots.
Learning robot actions and future geometric states from sparse 3D robot–object skeletons. The model achieves 85.9% success on LIBERO-Plus with 57.1M parameters.
My contribution: simulation setup, training and tuning, robustness evaluation, ablations, analysis, writing, and technical figures. The metrics above are team paper results.
Training-free pose estimation for unseen objects using RGB images and CAD-rendered templates. Template poses guide geometric matching, reaching 46.2% mean Average Recall across seven BOP datasets.
My contribution: contributed to the design of the proposed method, prepared figures illustrating its key ideas, and refined the manuscript’s technical content and presentation.
Estimating pose and size for new instances of known categories from RGB-D, using category-guided semantic and geometric features. Reaches 60.6% mAP at 5° / 2 cm on REAL275.
My contribution: contributed to defining the research motivation, carrying out ablation experiments, and refining the manuscript’s technical explanations and overall presentation.
Work in progress · Planned submission to CVPR 2027
Estimating multiple objects’ poses from a single RGB image and posed references, without CAD models or query depth. Reusable object memories and target-wise routing let difficult objects draw on reliable neighbors while retaining independent estimates as candidates.
A research knowledge hub connecting geometric foundations, method taxonomies, datasets, evaluation metrics, and a searchable paper library for 6D object pose estimation.