Welcome to the Augmented Perception Lab at the Human-Computer Interaction Institute at Carnegie Mellon University .

We focus on understanding how perceive and interact with digital information, and to build technology that goes beyond the flat displays of PCs and smartphones to advances our capabilities when interacting with the digital world. To achieve this, we create and study enabling technologies and computational approaches that control when, where and how virtual content is displayed to increase the usability of Augmented Reality and Virtual Reality interfaces.

The Augmented Perception lab is headed by Prof. David Lindlbauer.

Evaluating Dynamic Delivery of Audio+Visual Message Notifications in XR
3:42
Evaluating Dynamic Delivery of Audio+Visual Message Notifications in XR
MiniMates: Miniature Avatars for AR Remote Meetings within Limited Physical Spaces
2:34
MiniMates: Miniature Avatars for AR Remote Meetings within Limited Physical Spaces
Persistent Assistant: Seamless Everyday AI Interactions via Intent Grounding and Multimodal Feedback
3:55
Persistent Assistant: Seamless Everyday AI Interactions via Intent Grounding and Multimodal Feedback
Sensing Noticeability in Ambient Information Environments
1:46
Sensing Noticeability in Ambient Information Environments
TurnAware: Motion-aware Augmented Reality Information Delivery While Walking
3:17
TurnAware: Motion-aware Augmented Reality Information Delivery While Walking
Don’t Block My Stuff: Fostering Personal Object Awareness in Multi-user Mixed Reality Environments
4:02
Don’t Block My Stuff: Fostering Personal Object Awareness in Multi-user Mixed Reality Environments
Push2AR: Enhancing Mobile List Interactions Using Augmented Reality
3:47
Push2AR: Enhancing Mobile List Interactions Using Augmented Reality
New Ears: A Study of Audio Interaction Techniques for Performing Search in Virtual Reality
3:14
New Ears: A Study of Audio Interaction Techniques for Performing Search in Virtual Reality
Auptimize: Optimal Placement of Spatial Audio Cues for Extended Reality
4:35
Auptimize: Optimal Placement of Spatial Audio Cues for Extended Reality
Auptimize: Optimal Placement of Spatial Audio Cues for Extended Reality [Teaser]
0:31
Auptimize: Optimal Placement of Spatial Audio Cues for Extended Reality [Teaser]
SonoHaptics: An Audio-Haptic Cursor for Gaze-Based Object Selection in XR
4:09
SonoHaptics: An Audio-Haptic Cursor for Gaze-Based Object Selection in XR
SonoHaptics: An Audio-Haptic Cursor for Gaze-Based Object Selection in XR [Teaser]
0:31
SonoHaptics: An Audio-Haptic Cursor for Gaze-Based Object Selection in XR [Teaser]
Towards Music-Aware Virtual Assistants
5:31
Towards Music-Aware Virtual Assistants
Towards Music-Aware Virtual Assistants [Teaser]
0:30
Towards Music-Aware Virtual Assistants [Teaser]
MARingBA: Music-Adaptive Ringtones for Blended Audio Notification Delivery
4:23
MARingBA: Music-Adaptive Ringtones for Blended Audio Notification Delivery
Predicting the Noticeability of Dynamic Virtual Elements in Virtual Reality
0:31
Predicting the Noticeability of Dynamic Virtual Elements in Virtual Reality
MARingBA: Music-Adaptive Ringtones for Blended Audio Notification Delivery
0:31
MARingBA: Music-Adaptive Ringtones for Blended Audio Notification Delivery
MineXR: Mining Personalized Extended Reality Interfaces
0:31
MineXR: Mining Personalized Extended Reality Interfaces
BlendMR: A Computational Method To Create Ambient Mixed Reality Interfaces [Talk]
13:48
BlendMR: A Computational Method To Create Ambient Mixed Reality Interfaces [Talk]
BlendMR: A Computational Method To Create Ambient Mixed Reality Interfaces
2:52
BlendMR: A Computational Method To Create Ambient Mixed Reality Interfaces
RealityReplay: Detecting and Replaying Temporal Changes In Situ using Mixed Reality
6:25
RealityReplay: Detecting and Replaying Temporal Changes In Situ using Mixed Reality
User Preference for Navigation Instructions in Mixed Reality (2 min video)
2:28
User Preference for Navigation Instructions in Mixed Reality (2 min video)
User Preference for Navigation Instructions in Mixed Reality (30 sec Teaser)
0:31
User Preference for Navigation Instructions in Mixed Reality (30 sec Teaser)
SemanticAdapt: Optimization-based Adaptation of MR Layouts Leveraging Semantic Connections (Talk)
10:07
SemanticAdapt: Optimization-based Adaptation of MR Layouts Leveraging Semantic Connections (Talk)
SemanticAdapt: Optimization-based Adaptation of MR Layouts Leveraging Semantic Connections (Preview)
0:31
SemanticAdapt: Optimization-based Adaptation of MR Layouts Leveraging Semantic Connections (Preview)
SemanticAdapt: Optimization-based Adaptation of MR Layouts Leveraging Semantic Connections
5:24
SemanticAdapt: Optimization-based Adaptation of MR Layouts Leveraging Semantic Connections
NASA SUITS 2022 - Team Moon Buddy from CMU
3:01
NASA SUITS 2022 - Team Moon Buddy from CMU