Postdoctoral Scholar · UCSF TECH Lab

Ja Eun Yu, Ph.D.

Human-centered AI Clinical AI LLM systems Health information Older adults Accessibility
Ja Eun Yu

I'm a Postdoctoral Researcher at the UCSF TECH Lab under Dr. Peter Washington, having recently completed my Ph.D. at UIC. My work sits at the intersection of human-computer interaction, AI-supported interactive systems, and human-in-the-loop design.

I'm drawn to the gap between what technology can do and what people can actually reach. I believe good systems shouldn't ask people to learn their language. They should learn to understand ours. From everyday devices to clinical care, I design and study AI that adapts to people's abilities, contexts, and needs, especially for those technology tends to overlook.

Research areas
Human-centered AI in care
Exploring how AI can support clinical communication and decision-making in ways that are safe, transparent, and grounded in human judgment.
Intent-aware interaction
Designing systems that understand what people mean, not just what they say, so they can reach what they need without technical know-how.
Understanding behavior through interaction
Studying how the ways people interact and collaborate with technology can reveal meaningful signals about cognition, health, and development.
Inclusive and accessible design
Examining how cognitive, perceptual, and experiential differences shape our relationship with technology, and designing for people it tends to leave behind.

Publications

10 peer-reviewed papers · CHI · ASSETS · UbiComp · VRST · INTERACT

2020
ASSETS 2020
JE Yu and D Chattopadhyay · ACM
2020
ASSETS 2020
JE Yu and D Chattopadhyay · ACM
2020
HCII 2020
N Sakhnini, JE Yu, D Chattopadhyay · Springer
2018
UbiComp/ISWC 2018
N Sakhnini, JE Yu, D Chattopadhyay · ACM
★ Best Poster Honorable Mention · top 1.5%
2015
INTERACT 2015
JE Yu and GJ Kim · Springer

Portfolio

Click any card for details

Independent project · 2024–present
AI-assisted Food-Health Information System
Developed a Kotlin Multiplatform app delivering food safety information for expectant mothers. Implemented an LLM-based autonomous pipeline to resolve data sparsity by retrieving and synthesizing unstructured web data. Conducted iterative UX optimizations to ensure reliable interpretation of safety recommendations by non-expert users.
LLM agentsKotlin MultiplatformFastAPIUX research
Live · 2024–present
Dissertation · Phase 1 · Exploratory study
Toward a Good Design for Older Users
Qualitative investigation of how older adults struggle with mobile maps — uncovering that the core issue is feature discoverability, not motor skill or comprehension.
Think-aloudInterviewsAtlas.tin=17
ASSETS 2020
Dissertation · Phase 2 · Wizard-of-Oz
Designing a Voice Assistant for Mobile Navigation
Validated the voice assistant concept through a Wizard-of-Oz study — 88% of participants used it, and 77% of navigation failures were immediately resolved after intervention.
Wizard-of-OzVoice UIWeb appn=15
ASSETS 2020 · CHI 2023
Dissertation · Phase 3 · Controlled experiment
Exploring Effective Visual Cue Design
A/B tested four visual cue designs with older and younger adults. Found that highlighting with context or weighted zoom equalizes task performance across age groups.
A/B testingGLMMWeb appn=56
CHI 2024
Dissertation · Phase 4 · System build
Nav Nudge: Voice Assistant for Mobile UI Navigation
Built a fully working Android app using GPT-3 and Universal Sentence Encoder to interpret verbal queries and highlight matching UI features on-screen. 95% query accuracy in-the-wild.
AndroidGPT-3NLPn=10
CHI 2024
Research project · 2018–2020
myCityMeter / whatIbreathe
Android app measuring PM2.5 and ambient noise — environmental risk factors for cognitive impairment — for older adults and caregivers. Built with RESTful API and multi-sensor data pipeline.
AndroidIoT sensorsREST APImHealth
UbiComp 2018 · HCII 2020
M.Eng. research · 2015–2016
Blurry (Sticky) Finger
AR interaction technique for optical see-through displays: users point at distant real-world objects using a blurred finger and proprioception, eliminating frequent focus shifts and reducing eye strain.
AROpenCVAndroidC/C++
INTERACT 2015 · VRST 2015 · ISMAR 2016 · ICAT 2016
Collaborative research · 2014–2016
3D Crime Scene Reconstruction
3D reconstruction system for indoor crime scenes using smartphone and Kinect. Enables first-person virtual scene exploration and generates textured 3D face models from 2D CCTV footage.
Unity3DKinectOpenCVDlib
National Forensic Service, Republic of Korea

Ja Eun Yu, Ph.D.

yujaaa0219@gmail.com · jaeun.dev · San Francisco Bay Area, CA

Download PDF
Education
2024
Ph.D., Computer Science
University of Illinois Chicago
Thesis: Supporting older adults navigate feature-rich mobile UIs with voice input
2017
M.Eng., Computer Science and Engineering
Korea University, Seoul
Thesis: Proprioceptive pointing and selection of distant objects for optical see-through based AR
2015
B.S., Computer and Communication Engineering
Korea University, Seoul
2012
B.S., Public Health
Ewha Womans University, Seoul
Experience
2026–Present
Postdoctoral Researcher
UCSF TECH Lab, University of California, San Francisco
Developing a SMART-on-FHIR agentic AI clinical triage system and researching digital phenotyping for adolescents.
Summer 2022
Ph.D. Researcher — Internship
Google AR · San Francisco, CA
Demonstrated a novel AI-driven AR interaction method on Microsoft HoloLens.
Summer 2021
Ph.D. Researcher — Internship
Google Health · Remote
Designed and developed an application supporting large-scale data collection and AI model training.
2017–2023
Teaching & Research Assistant
University of Illinois Chicago · Dept. of Computer Science
2015–2016
Research Assistant
Korea University · Dept. of Computer Science and Engineering
Honors & Awards
2023
Graduate Student Award for Exceptional Research Promise
College of Engineering, UIC
2021
Project Grant — Team Leader · $2,000
Korean Federation of Science & Technology Societies
2018
Best Poster Honorable Mention · top 1.5%
UbiComp/ISWC 2018
2018
Project Grant · $5,000
Korean Federation of Science & Technology Societies
2017
Peter and Deborah Wexler Graduate Student Award · $5,000
University of Illinois Chicago
Service — Peer Review
IUI 2023–2026 · CHI 2020, 2022–2024 · MobileHCI 2023–2024 · EICS 2022–2024 · ISMAR 2020–2024 · CUI 2023 · ACMMM 2021 · OzCHI 2020

Ja Eun Yu, Ph.D.
yujaaa0219@gmail.com · San Francisco Bay Area, CA