Our paper on image recognition for mobile augmented reality in the presence of image distortions appeared in IEEE/ACM IPSN’20 and received the conference’s Best Research Artifact Award [ Paper PDF ] [ Presentation slides ] [ Video of the presentation ]
CollabAR: System Architecture
Continue reading
Our work on using edge computing to transmit holograms to augmented reality (AR) users has recently appeared in the IEEE SmartEdge Workshop, co-located with IEEE PerCom, as an invited paper. [ Paper PDF ] [ Presentation slides ] [ Video of the presentation ]
High-level architecture: edge computing supporting different users’ augmented reality (AR) experiences.
5 independent undergraduate research projects have been completed in the I^3T lab this semester. In these projects students investigated different elements of mobile augmented reality (AR), including edge-based integration of AR with low-end IoT devices, user perception of different types of shadows, and mechanisms for multi-user coordination for mobile AR. 4 projects are highlighted below.
This work is supported in part by NSF grants CSR-1903136 and CNS-1908051, and by the Lord Foundation of North Carolina. Continue reading
Two demos developed in the lab were presented at ACM SenSys’19 in New York City, NY, in November 2019.
A demo led by Joseph DeChicchis, titled Adaptive AR Visual Output Security Using Reinforcement Learning Trained Policies, demonstrates how reinforcement learning-based policies for hologram positioning perform on Magic Leap One augmented reality sets. This demo builds on the work on learning for hologram positioning in AR led by Surin Ahn, previously evaluated via simulations alone. Joseph’s trip to present this demo at ACM SenSys was partially supported by an ACM SIGMOBILE Travel Grant and by a Duke University Undergraduate Research Office Travel Grant. [Video of the demo] Related work:
Joseph demonstrating how a reinforcement learning-trained policy can move holograms out of the way of a stop sign.
Additionally, a demo led by Jovan Stojkovic, Zida Liu, and Guohao Lan, titled Edge Assisted Collaborative Image Recognition for Augmented Reality, presents a dynamic approach for handling heterogeneous multi-user visual inputs for image recognition in augmented reality, demonstrated on an edge computing-assisted Google ARCore platform. [Video of the demo]
Demo references:
[SenSys19a] J. DeChicchis, S. Ahn, M. Gorlatova, Demo: Adaptive Augmented Reality Visual Output Security Using Reinforcement Learning Trained Policies, in Proc. ACM Conference on Embedded Networked Sensor Systems (ACM SenSys’19), New York City, NY, Nov. 2019. [Demo abstract PDF] [Video of the demo]
[SenSys19b] J. Stojkovic, Z. Liu, G. Lan, C. Joe-Wong, M. Gorlatova, Demo: Edge-assisted Collaborative Image Recognition for Augmented Reality, in Proc. ACM Conference on Embedded Networked Sensor Systems (ACM SenSys’19), New York City, NY, Nov. 2019. [Demo abstract PDF] [Video of the demo]
Two summer Research Experiences for Undergraduates students have presented their summer projects at the Duke University REU showcase.
Courtney Johnson presenting his summer research on precision eye tracking for Magic Leap performance and user experience optimization.
Jovan Stojkovic, Duke ECE REU Fellow and a rising senior at the University of Belgrade, presented his poster titled Edge Computing Platform for Collaborative Augmented Reality. Over the summer, Jovan has built a platform that allows multiple users’ related images, captured with Android phones running Google ARCore, to be processed jointly on an edge server, improving user’s quality of object recognition.
Courtney Johnson, Grand Challenges in Engineering NSF REU Fellow at the Pratt School of Engineering and a rising junior at North Carolina A&T State University, presented his poster titled Intelligent Augmented Reality Adaptation to Users’ Eyes. Over the summer, Courtney has been exploring a range of uses of precision eye tracking, available in modern augmented reality headsets, to optimize the performance of augmented reality systems.
Both Jovan’s and Courtney’s research results will be integrated into paper submissions later this year.
Prof. Gorlatova is part of a Duke University team that received a 2019 National Center for Women and Information Technology (NCWIT) Seed Fund award to support further engagement of undergraduate women in systems and networking research. The award was presented at the 2019 NCWIT Summit in Nashville, TN. [ More information about the award ]
Three undergraduate students have presented the results of their independent studies in CS and ECE poster sessions and demonstrations here at Duke University.
Michael Glushakov presented a poster and a demo of his work on edge computing-supported augmented reality with Google ARCore, demonstrating how edge computing can be used to enable persistent and personalized augmented reality experiences, and developing a portal that allows people without coding background to create personalized AR experiences. Joseph DeChicchis presented a poster and a demo of his work on using reinforcement learning to teach holograms to move out of the way of real-world objects. Joseph’s demonstration showcased this capability on Magic Leap One devices. Madeline Wilkinson presented a poster of her work on using eye tracking to personalize user experiences in augmented reality on Magic Leap One devices.
Michael Glushakov presenting his work on edge-enhanced ARCore experiences.Yale University Prof. Wenjun Hu and Duke University Prof. Maria Gorlatova received an NSF Computer Systems Research (CSR) Small Collaborative grant to examine joint concurrent optimization of multiple applications in multi-tier edge/fog computing architectures. [Award Information]
This post is intended as a “sample point”, and a bit of informal guidance, for people who are on the academic job market, or will be going on it soon. Throughout the different phases of the job market, I’ve relied on the experiences of many people who took the time to describe their experiences. Paying it forward, now, by describing my own.
My application materials, as a reference:
I am writing this post just as my first semester as an Assistant Professor of Electrical and Computer Engineering at Duke University is about to start. My office and my lab are freshly remodeled, and I’ve had fun getting the lab equipped. My graduate seminar class starts on Monday. It is all so exciting.
Getting here required surmounting the challenges of the academic job market. I would not call it the hardest thing I’ve ever done — getting the PhD, for me, was harder, for example. However, the job market months were the most intense of my life. Take your most challenging paper deadline experience, multiply it by ~ 30, and stretch it out to several months — that is roughly the level of intensity of the experience. If you are going on the job market soon, buckle up! It will be one exciting, wild ride.
Below, first, advice to folks on the job market, then my experience in numbers, dates, and pictures. Continue reading
I took pictures of the views from all but one of the hotel rooms I’ve stayed in, during my interviews, February-April of this year. Gorgeous continent’s urban and not-so-urban areas. Nights and days, storms and clear days, sunrises and sunsets. Some on-campus hotels, and some close-to-campus. Job market is a blur of these experiences.
February:
