Integrating Microsoft Teams into HoloLens

Microsoft Dynamics 365 Guides 8.0 - 2022

The latest version of Microsoft D365 Guides enables users to effortlessly switch between operating holographic instructions and remote assistance scenarios using Microsoft Teams on a HoloLens device. During a remote assist call, the technician will have access to a live video feed from the perspective of the person wearing the HoloLens headset. With the HoloLens, users can initiate calls directly or access their calendar to join group meetings.

Touch Interface for Guides on HoloLens

Microsoft Dynamics 365 Guides 7.0 - 2021

With this release of Microsoft D365 Guides, a touch interface has been introduced, making it easy for users to launch activities within the application. The touch window can be summoned or minimized with a simple hand gesture, ensuring that holographic menus are always easily accessible but don't obstruct the physical world. Work instructions can also be performed without using hands, through gaze functionality, ensuring that first line workers always have their hands accessible to get the work done.

Guides for HoloLens - Public Release

Microsoft Dynamics 365 Guides 1.0 - 2018

Introducing Microsoft D365 Guides 1.0, unveiled by Alex Kipman at Mobile World Congress in 2018 alongside the launch of HoloLens 2. This innovative mixed reality software boasts pioneering features such as hands-free gaze interactions, an intelligent instruction card that adjusts to your physical movements, and a helpful tether that points you in the direction of your work. Guides 1.0 sets a new standard for XR technology, and was truly ahead of its time.

vSpline

Immersive 3D Modeling Software for VR - 2017

vSpline provides designers the capability to sketch and edit within a 3D immersive VR environment including input, modification, analysis, and physical output. vSpline can be used to create an immersive digital representation of a concept, form, or prototype, but the resulting 3D printed object also serves to narrow the gap between the digital and the physical design process.

Graduate Research Thesis

Cornell University - 2017

As part of my Master of Science program at Cornell University, I conducted a study to compare the user experience of immersive head mounted displays (HMD) to traditional 2D displays. Participants rated their perceptions of aesthetic value, spatial presence, and emotions after touring two different hotel environments, one viewed on a stereoscopic VR headset and the other on a 65” screen. Results were gathered through a questionnaire completed by participants after each tour. The study provided recommendations for future HMD applications.

Designing in VR

Autodesk Internship - 2016

During my virtual reality UX design internship at Autodesk. I developed innovative VR design prototypes to enhance 3D modeling, interior design, and building information modeling (BIM) experiences. By prototyping in VR, we aimed to revolutionize the design process, allowing for direct iteration within the virtual environment.

Holographic Guides for Kenworth Trucks

Microsoft Customer Engagement

The focus of this project was to enhance employee training through improved customer engagement between Microsoft Dynamics 365 Guides and Kenworth trucks.

Roles and Outcomes:

Successfully tested and improved POC software in close collaboration with Kenworth prior to its general release.
Elevated traditional assembly procedures with the creation of innovative holographic Guides.
Developed educational videos, custom 3D models, and other holographic materials used in the guide procedures.
Validated the effectiveness of the holographic guides through on-site testing and iteration at Kenworth's manufacturing facility in Chillicothe, Ohio.
Worked with employees to assess the potential for scaled deployment of Guides, through individual training sessions.
Contributed to the documentation of the process, earning recognition and exposure in the New York Times and on the Microsoft YouTube channel.

Watch Video

New York Times Article

Holographic Guides for Covid-19 Training

Microsoft Customer Engagement

In response to the early stages of the pandemic, Sheba Hospital in Israel faced the challenge of task shifting healthcare professionals from simulation to intensive care support. To address this, we partnered with trainers at Sheba Hospital to develop holographic guides for ventilator machine usage, allowing for quick and efficient employee onboarding. The guides proved successful, enabling 60 non-specialist biotechnologists to be trained on the ventilators in under an hour, without the need for in-person instruction.

Toyota 4T Academy

Microsoft Customer Engagement

This project showcases the partnership between the Microsoft D365 Guides team and Toyota 4T Academy in Princeton, Indiana. It was highlighted in Satya Nadella’s 2021 Inspire Keynote presentation. The collaboration aimed to bridge a skills gap for Toyota students by developing holographic training materials for hands-on learning before they assemble vehicles.

VR Scaling Experiment

Cornell University - 2016

This study was conducted within the VR Studio at Cornell University under the direction of Donald Greenberg. Participants were tasked with examining 6 objects (3 pieces of furniture and 3 abstract shapes) for 3 minutes each, then scaling their virtual counterparts in a VR headset or on a computer monitor. The study investigated the impact of two variables: the level of environmental context cues and the medium of display. The findings showed that participants were more accurate in scaling virtual objects in VR, regardless of the presence of contextual cues, compared to when using a computer monitor.

Downtown LA - Latent Potential

Gensler Internship - 2014

As part of my summer internship at Gensler in Los Angeles, I led a team of three other interns in producing a visionary video for the Gensler LA Vimeo page. The video delves into the exciting future of Downtown LA as a thriving urban residential hub, exploring the potential transformation of the streetscape in 20 years when the population has grown fourfold. To bring this vision to life, we carefully selected three underserved areas of Downtown LA as case studies and created conceptual drawings to illustrate their immense potential. Our goal was to provide compelling answers to the question, "How will the streetscape of Downtown LA look in 20 years?"

Active Learning Classroom

Cornell University - 2014

The "Active Learning Classroom" project was initiated as a student project at Cornell University's design studio. Impressed by the final designs, Cornell hired three students, including myself, to fully construct the classroom as a pilot test. Our goal was to create a cutting-edge, in-person learning environment that could adapt to a variety of teaching styles, whether through lectures, group work, or a combination of both.

CoreChair Research Study

Cornell University - 2016

As a Master of Science student at Cornell University, I was part of a ground-breaking interdisciplinary team that evaluated the comfort levels of the CoreChair through a comprehensive empirical study. Our team combined pressure mapping and self-report questionnaire data to measure participant comfort levels while using both a standard ergonomic chair and the CoreChair for a typing task. The results were clear: the CoreChair showed, on average, lower pressure points and higher self-reported comfort compared to the standard chair. Our findings were presented to the CEO of CoreChair in a final report and presentation that highlighted the study's impactful outcomes, confirming the superiority of the CoreChair.

Learn More

Hourglass

Interior Design - Restaurant & Hookah Lounge

Hourglass is a visionary cafe, restaurant, and hookah lounge located in the historic Wilson Building in Syracuse, New York. Inspired by the concept of time perception, the establishment features a harmonious blend of angular geometry in the cafe and restaurant, and organic shapes in the lounge and hookah bar. This unique design approach embodies the Wilson Building's mix of old and new, creating a timeless atmosphere. The centerpiece of the facility is a breathtaking double spiral staircase that acts as a central connecting point for all three spaces. I was responsible for bringing this concept to life, delivering detailed designs and stunning 3D renderings using Rhino 3D modeling software and vRay.