I’m a fifth-year PhD student majoring in Computer Science at Academic for Engineering & Technology, Fudan University, Shanghai, China.
I am advised by Prof.Xiangyang Xue and co-advised by Prof.Yanwei Fu.
During my PhD journey, I had the opportunity to spend wonderful summers as a research intern at Mech-Mind Robotics. Prior to this, I received my bachelor’s degree in Electrical Engineering from Fuzhou University in June 2019.
My research interest lies at Robotics and 3D Computer Vision. Specifically, I am very interested in the state estimation of rigid objects (6-DoF object pose estimation) and non-rigid objects like liquid, and robotic grasping and manipulation.
Email: htlin19@fudan.edu.cn
Publications
* denotes equal contribution
PourIt!: Weakly-supervised Liquid Perception from a Single Image for Visual Closed-Loop Robotic Pouring
Haitao Lin, Yanwei Fu, Xiangyang Xue.
ICCV, 2023
Webpage •
Paper •
Code •
Dataset
SAR-Net: Shape Alignment and Recovery Network for Category-level 6D Object Pose and Size Estimation
Haitao Lin, Zichang Liu, Chilam Cheang, Yanwei Fu, Guodong Guo, Xiangyang Xue
CVPR, 2022
Webpage •
Paper •
Code
I Know What You Draw: Learning Grasp Detection Conditioned on a Few Freehand Sketches
Haitao Lin, Chilam Cheang, Yanwei Fu, Xiangyang Xue
ICRA, 2022
Webpage •
Paper •
Code
I Know What You Want: A "Smart Bartender" System by Interactive Gaze Following
Haitao Lin, Zhida Ge, Xiang Li, Yanwei Fu, and Xiangyang Xue
ICRA, Stand Alone Video, 2023
Demo
Language Guided Robotic Grasping with Fine-grained Instructions
Qiang Sun*, Haitao Lin*, Ying Fu, Yanwei Fu, Xiangyang Xue
IROS, 2023
Webpage •
Paper •
Code
Learning 6-DoF Object Poses to Grasp Category-level Objects by Language Instructions
Chilam Cheang, Haitao Lin, Yanwei Fu, Xiangyang Xue
ICRA, 2022
Webpage •
Paper •
Code
Neural Pose Transfer by Spatially Adaptive Instance Normalization
Jiashun Wang*, Chao Wen*, Yanwei Fu, Haitao Lin, Tianyun Zou, Xiangyang Xue, Yinda Zhang
CVPR, 2020
Webpage •
Paper •
Code
GeoVLN: Learning Geometry-Enhanced Visual Representation with Slot Attention for Vision-and-Language Navigation
Jingyang Huo*, Qiang Sun*, Boyan Jiang*, Haitao Lin, Yanwei Fu
CVPR, 2023
Paper
Internship
Deep Learning Algorithm and Software Group
Computer Vision Algorithm Intern
2023
Projects
Hybrid Visual and Tactile-Guided Nucleic Acid Throat Swab Sampling Robot
The robotic arm is controlled to gently swab the throat with real-time visual and tactile feedback
2022
Robot Pharmacist
The robotic arm is controlled to fetch bottles with the estimated 6-DoF pose
2021
Legged robot on Webots Simulation
Trotting gait planning and attitude control of a legged robot
2019
Indoor Fire Detection by a Quadcopter
Obtain the video stream from DJI Mavic Pro's camera and perform the fire detection algorithm on a mobile phone
2018
DIY Quadcopter
A quadcopter is controlled using optical flow for position and an ultrasonic sensor for altitude
2016 - 2017
DIY Quadcopter
My DIY quadcopter is flying
2015