Kaylee Yaxuan Li

Ph.D. Candidate
Computer Science and Engineering
University of Michigan

I am a Ph.D. candidate in Computer Science and Engineering at the University of Michigan, advised by Alanson P. Sample and Kang G. Shin.

My research develops wearable and ubiquitous AI systems that interpret human activity and context from multimodal data. I focus on sensing and efficient semantic representations of daily life, long-horizon memory architectures for scalable reasoning, and proactive assistance on resource-constrained wearable and mobile platforms. My work seeks to transform everyday human experience into persistent, actionable intelligence that augments human perception, memory, reasoning, and decision-making, with broader implications for physical AI and human–agent interaction.

Selected Publications

GOHi: Goal-Oriented Highlight Extraction for Long-Form Egocentric Video

Kaylee Yaxuan Li, Ke Sun, Kang G. Shin, Alanson P. Sample, Amy Karlson, Eric Whitmire, Yifan Wang

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT/UbiComp), vol. 10, no. 4

PDF Paper
EchoScriptor: Automatic Lifelogging Narratives via Activity-Based Audio–Language Model

Kaylee Yaxuan Li, Xinghao Zhou, Haizhong Zheng, Kang G. Shin, Alanson P. Sample

Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI)

PDF Paper
AutoCLC: Towards Automated Assessment and Feedback on Closed-Loop Communication in Team-based Healthcare Simulation Training

Kaylee Yaxuan Li, Kunpeng Huang, Bryan Harmer, Casey Ducharme, Benjamin Heasman, Eleanor Falahee, James M. Cooke, Michael Cole, Alanson P. Sample, Vitaliy Popov

ACM Transactions on Computing for Healthcare, vol. 7, no. 1

PDF Paper
Leveraging AI for Automated Evaluation of Closed-Loop Communication in VR-based Acute Care Team Training

Vitaliy Popov, Kaylee Yaxuan Li, Kunpeng Huang, Alanson P. Sample, Bryan Harmer, James Cooke, Michael Cole

18th International Conference on Computer-Supported Collaborative Learning (CSCL 2025)

PDF Paper
HandSAW: Wearable Hand-based Event Recognition via On-Body Surface Acoustic Waves

Kaylee Yaxuan Li, Yasha Iravantchi, Yichen Zhu, Hyunmin Park, Alanson P. Sample

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT/UbiComp), vol. 9, no. 1

PDF Paper
ECG Signal Construction From Heart Sounds via Single Node, Surface Acoustic Sensing

Kaylee Yaxuan Li, Yasha Iravantchi, Hyunmin Park, Yiming Liu, Alanson P. Sample

2024 46th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)

Paper
BodyTrak: Inferring Full-body Poses from Body Silhouettes Using a Miniature Camera on a Wristband

Hyunchul Lim, Yaxuan Li, Matthew Dressa, Fang Hu, Jae Hoon Kim, Ruidong Zhang, Cheng Zhang

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT/UbiComp), vol. 6, no. 3

PDF Paper
Deep Learning in Human Activity Recognition with Wearable Sensors: A Review on Advances

Shibo Zhang, Yaxuan Li, Shen Zhang, Farzad Shahabi, Stephen Xia, Yu Deng, Nabil Alshurafa

Sensors, vol. 22, no. 4

Best Paper Award

Paper arXiv
SpeeChin: A Smart Necklace for Silent Speech Recognition

Ruidong Zhang, Mingyang Chen, Benjamin Steeper, Yaxuan Li, Zihan Yan, Yizhuo Chen, Songyun Tao, Tuochao Chen, Hyunchul Lim, Cheng Zhang

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT/UbiComp), vol. 5, no. 4

PDF Paper
Towards Context-aware Automatic Haptic Effect Generation for Home Theatre Environments

Yaxuan Li, Yongjae Yoo, Antoine Weill-Duflos, Jeremy R. Cooperstock

27th ACM Symposium on Virtual Reality Software and Technology (VRST 2021)

Paper
NeckFace: Continuously Tracking Full Facial Expressions on Neck-mounted Wearables

Tuochao Chen, Yaxuan Li, Songyun Tao, Hyunchul Lim, Mose Sakashita, Ruidong Zhang, François Guimbretière, Cheng Zhang

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT/UbiComp), vol. 5, no. 2

Paper Video
Safe Navigation of Quadrotors with Jerk Limited Trajectory

Shupeng Lai, Menglu Lan, Yaxuan Li, Ben M. Chen

Frontiers of Information Technology & Electronic Engineering, vol. 20, no. 1

Paper