Possible at Last: Using Large Multimodal Models to Evaluate and Secure
Mixed-Reality Experiences – this was the title of the talk I gave as part of the VT Center for Human-Computer Interaction Seminar. Sincere thanks to the organizers for the opportunity to share my perspective: we are finally, finally at the cusp of being able to provide real-time oversight of AR experiences.
Currently, AR operates in “open loop” configurations, without steps that oversee an experience once it is rendered. In important, safety-critical deployments, this will not do: the technology will not get adopted at scale until its performance can be monitored in real time. With LMMs, we finally have a roadmap for providing exactly the kind of oversight that is required to enable such deployments.
- Video recording of my CHCI@VT Seminar presentation
- PDF of the slides I presented: CHCI@VT – Maria Gorlatova
Sincere thanks to the CHCI@VT organizers for giving me an opportunity to speak at the seminar!