A Real-Time rendering / visualization pipeline for Open CV and Dlib


C-Face: continuously reconstructing facial expressions by deep learning contours of the face with ear-mounted miniature cameras 

To appear on ACM Symposium on User Interface Software and Technology (UIST) UIST ’20

Form factor, CG, Data Processing, Sketching, Paper Writing.

FingerTrak: Continuous 3D Hand Pose Tracking by Deep Learning Hand Silhouettes Captured by Miniature Thermal Cameras on Wrist. (Acknowledged) (IMWUT)/Ubicomp’20

Robotics. Video

Necklace - A necklace prototype to reconstruct facial expressions (To be seen)

Hardware form factors, New facial GroundTruth capturing system, Study Design, Computer Graphics, Paper Writing

A teaser - End to End facial geometric reconstruction and facial tracking system.

3D Model building, Algorithms, Unity APIs

Lab logo and Website

Did it all

©2020 by Songyun Tao