ACM UbiComp 2022 Best Poster Award

Posted on October 3, 2022 by admin

A poster we presented at ACM UbiComp 2022 in Cambridge, UK, titled “IoT-Enabled Environment Illuminance Optimization for Augmented Reality“, received the ACM UbiComp’22 Best Poster Award. [ Poster submission  ] [ Poster presented at the conference ]

This poster outlines a system that uses a smart lightbulb, an edge server, and environmental sensors (a camera and a light sensor) to change the level of light in the environment to maximize the performance of two elements of augmented reality, pose tracking and eye tracking. To our knowledge, this is the first automatic environment optimization system for augmented reality that adapts to both environment lighting and textures.

Continue reading →

Posted in Achievement, Augmented reality, Duke University, Funding and Awards, Highlights, Internet of Things, Publications and Demonstrations, Technology, Undergraduate research | Comments Off on ACM UbiComp 2022 Best Poster Award

Two papers appearing at IEEE ISMAR’22

Posted on September 1, 2022 by admin

We are delighted to have two of lab’s papers appear at the top AR/MR conference, IEEE International Symposium on Mixed and Augmented Reality (ISMAR) 2022 (acceptance rate: 21%).

In a paper led by PhD student Sarah Eom titled NeuroLens: Augmented Reality (AR)-based Contextual Guidance through Surgical Tool Tracking in Neurosurgery, we developed a system that provides neurosurgeons with real-time guidance on how to approach a target located inside a patient’s skull. This system, developed in collaboration with Dr. Shervin Rahimpour, was evaluated in a study with 33 medical students, who conducted both AR-guided and unassisted (freehand) trials of catheter insertion into a phantom model of a human head. The study has demonstrated that our system significantly improves students’ targeting accuracy. The study has also revealed important differences in the behavior of participants who achieved different levels of results in AR-assisted settings. More than 93% of the participants agreed or strongly agreed that the developed system is useful for learning to conduct neurosurgical procedures. [ Paper PDF ] Continue reading →

Posted in Achievement, AR-assisted surgery, Augmented reality, Augmented Reality For Good, Gaming engines, Indoor environments, Mobile computing, Publications and Demonstrations, Research | Comments Off on Two papers appearing at IEEE ISMAR’22

AI Institute I3T Lab Showcase

Posted on August 29, 2022 by admin

At the Athena AI Institute‘s 1st Annual Summit held at Duke University in August 2022, 4 members of the lab presented posters and showcased the work of the lab during the I3T Lab Tour.

The projects showcased during the summit covered different elements of next-generation edge computing-supported augmented reality (AR): edge-supported resource-efficient SLAM for AR, edge-coordinated IoT for improving the performance of AR, context-aware AR for neurosurgery, and robust object detection for AR.

Posted in AR-assisted surgery, Augmented reality, Demonstrations, Edge computing, Highlights, Indoor environments, Internet of Things, Lab tours, Mobile computing, Publications and Demonstrations | Comments Off on AI Institute I3T Lab Showcase

Summer REU Presentation: Real-time Object Detection for AR-aided Language Learning

Posted on July 29, 2022 by admin

Jeremy Suh, Grand Challenges in Engineering NSF REU Fellow at the Pratt School of Engineering, who has spent his summer in the I^3T Lab, has presented a poster and a demo of his work at the Duke University summer REU showcase.

Jeremy with his mentors, Tim Scargill and Lin Duan.

Jeremy’s research centered on showcasing how edge computing-supported object detection can be used as part of augmented reality (AR) applications in foreign language learning. The framework Jeremy has created will be used as a foundation for a range of semantically aware AR applications that are being developed in the lab.

Posted in Augmented reality, Edge computing, Students and Mentorship | Comments Off on Summer REU Presentation: Real-time Object Detection for AR-aided Language Learning

IEEE INFOCOM 2022 Paper and Demo

Posted on May 4, 2022 by admin

This week Ying Chen is presenting our work on evaluating and exploiting characteristics of user pose in VR at IEEE INFOCOM’22, in a paper and an accompanying demonstration:

 VR Viewport Pose Model for Quantifying and Exploiting Frame Correlations presents the first statistical model of viewport pose in VR and develops the first analytically grounded algorithm that establishes which contents should be reused across the frames [PDF] [Code and data]

Demo: Pixel Similarity-Based Content Reuse in Edge-Assisted Virtual Reality showcases how adaptive cross-frame content reuse reduces bandwidth requirements in edge computing-supported VR  [Demo abstract PDF] [Video of the demo]

Posted in Communication networks, Conferences, Duke University, Edge computing, Mobile computing, Publications and Demonstrations, Technology, Virtual reality | Comments Off on IEEE INFOCOM 2022 Paper and Demo

CPS-IoT Week 2022: I3T Lab’s Paper, Workshop, and Demo

Posted on May 4, 2022 by admin

We are presenting at 3 CPS-IoT Week sessions this week:

IPSN’22: EyeSyn: Psychology-inspired Eye Movement Synthesis for Gaze-based Activity Recognition presents the first method for synthesizing eye movement data for training eye movement-based activity classifiers for AR and VR without human involvement. [PDF] [Code and data] [NSF Discoveries news item covering this work]

Continue reading →

Posted in Augmented reality, Internet of Things, Publications and Demonstrations, Research, Wearable computing | Comments Off on CPS-IoT Week 2022: I3T Lab’s Paper, Workshop, and Demo

ECE Independent Study Best Poster Award for Alex Xu’s Work

Posted on April 25, 2022 by admin

Heartfelt congratulations to Alex Hu for receiving the Spring 2022 ECE Independent Study Best Poster Award, for his poster titled “Impact of the Environment on Eye Tracking Efficacy in Headset Augmented Reality“. The poster was prepared as part of Alex’s year-long Duke ECE undergraduate Honors Thesis study titled “Eye Tracking for User and Environment-Aware Headset Augmented Reality“.

Posted in Augmented reality, Eye tracking, Funding and Awards, Students and Mentorship, Technology, Undergraduate research, Undergraduate research, Wearable computing | Comments Off on ECE Independent Study Best Poster Award for Alex Xu’s Work

I3T Lab Hiring a Postdoc

Posted on March 28, 2022 by admin
Duke University I^3T Lab has an opening for a postdoc. 

We work in the area of pervasive mobile and sensing systems broadly, and pervasive mobile Augmented Reality (AR) and next-generation intelligence for the Internet of Things in particular. Our work is generously supported by the National Science Foundation (NSF), the Lord Foundation of North Carolina, IBM, Facebook, and DARPA. We are also a part of the NSF AI Institute for Edge Computing Leveraging Next Generation Networks, where our work is focused on building next-generation AI-powered mobile augmented reality.

If you are interested in joining the lab as a postdoc, please e-mail professor Gorlatova (maria.gorlatova /at/ duke.edu) your CV, a brief note about your research interests, and 1-3 papers that you believe represent your best work to date. Candidates for postdoctoral positions should have a track record of publishing their work in top venues of the field, and need to be self-driven and independent. The postdoctoral position start dates are flexible, and can be as early as May 2022 and as late as January 2023. Lab’s previous postdoctoral affiliate Dr. Guohao Lan has successfully secured an independent Assistant Professor position at a top university.

Additional information:

Posted in Augmented reality, Communication networks, Hiring, Internet of Things, Mobile computing, Technology, Wearable computing | Comments Off on I3T Lab Hiring a Postdoc

Two Papers Appearing at Workshops Co-Located with IEEE VR 2022

Posted on January 27, 2022 by admin

Two papers from the group are set to be presented at workshops co-located with IEEE VR 2022. Both papers are centered on end applications of next-generation augmented reality (AR) techniques we are currently developing in our lab. Continue reading →

Posted in Achievement, AR-assisted surgery, Augmented reality, Augmented Reality For Good, Edge computing, Internet of Things, Mobile computing, Technology, Virtual reality, Wearable computing | Comments Off on Two Papers Appearing at Workshops Co-Located with IEEE VR 2022

Fall 2021: 9 BS Independent Studies on Next-Generation AR and VR

Posted on December 17, 2021 by admin

9 ECE and CS independent undergraduate research projects on next-generation AR and VR were completed in the lab over this semester. This work is supported in part by NSF grants CSR-1903136, CNS-1908051, and CAREER-2046072, and by an IBM Faculty Award.

AR-assisted Neurosurgery
Seijung Kim


Experimental setup (left), and the view of holograms overlaid in AR (right)
Seijung worked on improving the AR-assisted surgery platform we have been developing. The current platform runs with two world coordinates from OptiTrack and HoloLens 2, thus requires calibration to convert one coordinate system to another. She designed and built a 3D printed cube with ARToolKit marker to successfully calibrate the two world coordinate systems between OptiTrack and HoloLens 2. Then she worked on enhancing the robustness of optical marker tracking, for stationary and mobile objects. Compared to a stationary phantom model, a surgical tool is a mobile object during surgeries and the tracking suffers from false positives and noise of optical markers. Seijung explored various designs of 3D printed mount for a surgical tool, to determine the optimal configuration in terms of the number of markers, the distance between each marker, and the direction of marker attachments. She will continue working on integrating more contextual guidance into the system and achieving the level of robustness and accuracy of the system for our user studies in clinical settings.

Continue reading →

Posted in AR-assisted surgery, Augmented reality, Duke University, Edge computing, Indoor environments, Internet of Things, Research, Undergraduate research, Virtual reality | Comments Off on Fall 2021: 9 BS Independent Studies on Next-Generation AR and VR