Tao Yu

于涛

Room 817B, Central Main Building, Tsinghua University, Beijing, China, 100084· ytrock@126.com

Hi, I am a 4th year PhD Candidate at Beihang University, my supervisor is Prof. Jianhui Zhao.
I also work closely with Prof. Yebin Liu at Tsinghua University since 2014.

My research area is Computer Vision and Computer Graphics.
Specifically, I'm working on Real-time Dynamic 3D Reconstruciton Algorithms for Human Performance Capture.


My goal is to enable convenient & robust & high quality performance capture for everyone.

Publication


HybridFusion: Real-time Performance Capture Using a Single Depth Sensor and Sparse IMUs

Zerong Zheng, Tao Yu, Hao Li, Kaiwen Guo, Qionghai Dai, Lu Fang, Yebin Liu

European Conference on Computer Vision (ECCV 2018)

We propose a light-weight and highly robust real-time human performance capture method based on hybrid depth&IMU sensors. The method can reconstruct challenging motions, detailed geometries and the inner human body shapes of a clothed subject simultaneously in real-time.

[Webpage]  [Paper]  [Video]




DoubleFusion: Real-time Capture of Human Performances with Inner Body Shapes from a Single Depth Sensor

Tao Yu, Zerong Zheng, Kaiwen Guo, Jianhui Zhao, Qionghai Dai, Hao Li, Gerard Pons-Moll, Yebin Liu

IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018 Oral Presentation)

We propose DoubleFusion, a new real-time system that combines volumetric dynamic reconstruction with datadriven template fitting to simultaneously reconstruct detailed geometry, non-rigid motion and the inner human body shape from a single depth camera.

[Webpage]  [Paper]  [Video]




BodyFusion: Real-time Capture of Human Motion and Surface Geometry Using a Single Depth Camera

Tao Yu, Kaiwen Guo, Feng Xu, Yuan Dong, Zhaoqi Su, Jianhui Zhao, Jianguo Li, Qionghai Dai, Yebin Liu

IEEE International Conference on Computer Vision (ICCV 2017)

We propose BodyFusion, a novel real-time geometry fusion method that can track and reconstruct non-rigid surface motion of a human performance using a single consumer-grade depth camera.

[Webpage]  [Paper]  [Video]




Real-time Geometry, Albedo and Motion Reconstruction Using a Single RGBD Camera

Kaiwen Guo, Feng Xu, Tao Yu, Xiaoyang Liu, Qionghai Dai, Yebin Liu

ACM Transactions on Graphics (Present in SIGGRAPH 2017)

This paper proposes a real-time method that uses a single-view RGBD input to simultaneously reconstruct a casual scene with a detailed geometry model, surface albedo, per-frame non-rigid motion and per-frame low-frequency lighting, without requiring any template or motion priors.

[Webpage]  [Paper]  [Video]



Experience

Tsinghua University

Visiting PhD Student
Department of Automation, BBNC Lab
Prof. Yebin Liu
November 2014 - Present

University of Southern California

Graduate Research Associate
Institute for Creative Technologies (ICT), Vision & Graphics Lab
Prof. Hao Li
June 2017 - September 2017

Beihang University

Master & PhD Candidate
Precision Instrument and Machinery
Prof. Jianhui Zhao
September 2012 - Present

Hefei University of Technolgy

Bechelor
Measurement and Control Technolgy
September 2008 - July 2012

Skills

Programming Languages

SoftWares