Tao Yu | 于涛


PostDoc (Shuimu Tsinghua Scholar) @ Department of Automation, Tsinghua University.
My research area is 3D Vision, the intersaction between Computer Vision, Computer Graphics and Machine Learning.
Currently, I'm focusing on 3D/4D Reconstruction, Motion Capture, Neural Rendering, Volumetric Capture, et, al.

You can check out my Youtube Channel for all of my research videos.
Google Scholar: Tao Yu
Email: ytrock@126.com
Address: Room 1-402, FIT Building, Tsinghua University, Beijing, China, 100084.

Publication

Real-time Sparse-view Multi-person Total Motion Capture

Yuxiang Zhang, Zeping Ren, Liang An, Hongwen Zhang, Tao Yu*, Yebin Liu*

Arxiv

[Project] 


OPAL: Occlusion Pattern Aware Loss for Unsupervised Light Field Disparity Estimation

Peng Li*, Jiayin Zhao*, Jingyao Wu, Chao Deng, Haoqian Wang+, Tao Yu+,

Arxiv

[Arxiv] 


HVTR: Hybrid Volumetric-Textural Rendering for Human Avatars

Tao Hu, Tao Yu, Zerong Zheng, He Zhang, Yebin Liu*, Matthias Zwicker

Arxiv

[Project]  [Arxiv] 


Interacting Attention Graph for Single Image Two-Hand Reconstruction

Mengcheng Li, Liang An, Hongwen Zhang, Lianpeng Wu, Feng Chen, Tao Yu, Yebin Liu

IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022 Oral Presentation)

[Project]  [Arxiv] 


Structured Local Radiance Fields for Human Avatar Modeling

Zerong Zheng, Han Huang, Tao Yu, Hongwen Zhang, Yandong Guo, Yebin Liu

IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022)

[Coming Soon] 


DoubleField: Bridging the Neural Surface and Radiance Fields for High-fidelity Human Reconstruction and Rendering

Ruizhi Shao, Hongwen Zhang, He Zhang, Mingjia Chen, Yanpei Cao, Tao Yu, Yebin Liu

IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022)

[Project]  [Arxiv] 


FaceVerse: a Fine-grained and Detail-changeable 3D Neural Face Modelfrom a Hybrid Dataset

Lizhen Wang, Zhiyuan Chen, Tao Yu, Chenguang Ma, Liang Li, Yebin Liu

IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2022)

[Project] 


Robust and Accurate 3D Self-portraits in Seconds

Zhe Li*, Tao Yu*, Zerong Zheng, Yebin Liu

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2022)

[Paper]  [Youtube Coming Soon] 


Lightweight Multi-person Total Motion Capture Using Sparse Multi-view Cameras

Yuxiang Zhang, Zhe Li, Liang An, Mengcheng Li, Tao Yu*, Yebin Liu*

IEEE International Conference on Computer Vision (ICCV 2021)

[Project]  [Arxiv] 


DeepMultiCap: Performance Capture of Multiple Characters Using Sparse Multiview Cameras

Yang Zheng*, Ruizhi Shao*, Yuxiang Zhang, Tao Yu, Zerong Zheng, Qionghai Dai, Yebin Liu

IEEE International Conference on Computer Vision (ICCV 2021)

[Project]  [Arxiv] 


Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensors

Tao Yu, Zerong Zheng, Kaiwen Guo, Pengpeng Liu, Qionghai Dai, Yebin Liu

IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2021 Oral Presentation)

[Project]  [Youtube] 


Deep Implicit Templates for 3D Shape Representations

Zerong Zheng, Tao Yu, Qionghai Dai, Yebin Liu

IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2021 Oral Presentation)

[Project]  [Youtube] 


POSEFusion: Pose-guided Selective Fusion for Single-view Human Volumetric Capture

Zhe Li, Tao Yu, Zerong Zheng, Kaiwen Guo, Yebin Liu

IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2021 Oral Presentation)

[Project]  [Youtube] 


PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstruction

Zerong Zheng, Tao Yu, Yebin Liu, Qionghai Dai

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2020)

[Project]  [Arxiv] 


MulayCap: Multi-layer Human Performance Capture Using A Monocular Video Camera

Zhaoqi Su, Weilin Wan, Tao Yu, Lingjie Liu, Lu Fang, Wenping Wang, Yebin Liu

IEEE Transactions on Visualization and Computer Graphics (TVCG 2020)

[Project]  [Arxiv] 


NormalGAN: Learning Detailed 3D Human from a Single RGB-D Image

Lizhen Wang, Xiaochen Zhao, Tao Yu, Songtao Wang, Yebin Liu

European Conference on Computer Vision (ECCV 2020)

[Project]  [Arxiv] 


RobustFusion: Human Volumetric Capture with Data-driven Visual Cues using a RGBD Camera

Zhuo Su, Xu Lan, Zerong Zheng, Tao Yu, Yebin Liu, Lu Fang

European Conference on Computer Vision (ECCV 2020 Spotlight Presentation)

[Paper] 


4D Association Graph for Realtime Multi-person Motion Capture Using Multiple Video Cameras

Yuxiang Zhang*, Liang An*, Tao Yu, Xiu Li, Kun Li, Yebin Liu

IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020 Oral Presentation)

[Project]  [Arxiv]  [Youtube] 


Robust 3D self-portraits in seconds

Zhe Li, Tao Yu, Zerong Zheng, Yebin Liu

IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020 Oral Presentation)

[Project]  [Arxiv]  [Video] 


DeepHuman: 3D Human Reconstruction from a Single Image

Zerong Zheng, Tao Yu, Yixuan Wei, Qionghai Dai, Yebin Liu

IEEE International Conference on Computer Vision (ICCV 2019 Oral Presentation)

[Project]  [Arxiv]  [Video] 


UnstructuredFusion: Real-time 4D Geometry and Texture Reconstruction using Commercial RGBD Cameras

Lan Xu, Zhuo Su, Lei Han, Tao Yu, Yebin Liu, Lu Fang

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2019)

[Paper]  [Youtube] 


SimulCap: Single-View Human Performance Capture with Cloth Simulation

Tao Yu, Zerong Zheng, Yuan Zhong, Jianhui Zhao, Qionghai Dai, Gerard Pons-Moll, Yebin Liu

IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019)

[Project]  [Arxiv]  [Youtube] [Video] 


HybridFusion: Real-time Performance Capture Using a Single Depth Sensor and Sparse IMUs

Zerong Zheng, Tao Yu, Hao Li, Kaiwen Guo, Qionghai Dai, Lu Fang, Yebin Liu

European Conference on Computer Vision (ECCV 2018)

[Project]  [Paper]  [Youtube] [Video] 


DoubleFusion: Real-time Capture of Human Performances with Inner Body Shapes from a Single Depth Sensor

Tao Yu, Zerong Zheng, Kaiwen Guo, Jianhui Zhao, Qionghai Dai, Hao Li, Gerard Pons-Moll, Yebin Liu

IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018 Oral Presentation)

[Project]  [Arxiv] [Paper]  [Youtube] [Video] [Oral Presentation (Youtube)]  [Software]  [TechCrunch] [Sohu] 


BodyFusion: Real-time Capture of Human Motion and Surface Geometry Using a Single Depth Camera

Tao Yu, Kaiwen Guo, Feng Xu, Yuan Dong, Zhaoqi Su, Jianhui Zhao, Jianguo Li, Qionghai Dai, Yebin Liu

IEEE International Conference on Computer Vision (ICCV 2017)

[Project]  [Paper]  [Youtube] [Video] 


Real-time Geometry, Albedo and Motion Reconstruction Using a Single RGBD Camera

Kaiwen Guo, Feng Xu, Tao Yu, Xiaoyang Liu, Qionghai Dai, Yebin Liu

ACM Transactions on Graphics (Present in SIGGRAPH 2017)

[Project]  [Paper]  [Youtube] [Video] 


Experience

Tsinghua University

PostDoc (Shuimu Tsinghua Scholar)
Department of Automation, BBNC Lab
Prof. Yebin Liu
2020.1 - Present

Tsinghua University

Visiting PhD Student
Department of Automation, BBNC Lab
Prof. Yebin Liu
2014.9 - 2019.10

Beihang University

PhD & Master
Precision Instrument and Machinery
Prof. Jianhui Zhao
2012.9 - 2019.10

University of Southern California

Graduate Research Associate
Institute for Creative Technologies (ICT), Vision & Graphics Lab
Prof. Hao Li
2017.6 - 2017.9

Hefei University of Technolgy

Bechelor
Measurement and Control Technolgy
2008.9 - 2012.7

Skills

Programming Languages

SoftWares