microsoft

Microsoft’s Ambient Computing and Robotics team has been working hard to develop a system that can improve safety and efficiency via connected cameras and other devices. Not only should the system be able to recognize people and objects, but the system should start to learn about the environment, becoming aware of context and policies. Working with the researchers, computer vision and engineering teams to develop on-screen graphics was the first challenge. Once the proof of concept was up and running, explaining how the system worked, and the powerful connections it could make to provide actionable tasks was the next challenge.

I created the related visuals needed to help developers and others understand the system. Conversational interfaces were relied upon heavily to interact with the system. We also created an admin interface to demonstrate how the system was able to learn, be searched and updated. (My first XR design patent). I also worked with the VP and partners to develop a set of storylines that explained how the system could work in the real world, as well as explain some of the technical aspects of the demo. I owned and created set of concept 3D/CGI videos that were used to help further the project, guide developers and get stakeholders on board. As the concept matured, we once again refined the story to deliver a public-facing presentation. The culmination of all this work was showcased at Build 2017.