At the company’s Ignite digital conference, Microsoft uses 3D capture technology to beam a lifelike image of a person into a virtual scene, and as the first keynote experience is designed entirely for mixed reality, attendants at the conference could experience the show as avatars in a shared holographic world.
The idea is that people can actually feel like they’re in the same place with someone sharing content or can teleport from different mixed reality devices and be present with everyone even when not physically together.
How Microsoft Mesh will actually work?
The main goal of Microsoft Mesh is to enable persons in different locations to share collaborative holographic experiences, using holoportation to project themselves as their lifelike, photorealistic selves.
And the designers or engineers working with 3D physical models could appear as themselves in a shared virtual space to collaborate on holographic models. It is born of years of Microsoft research and development in areas ranging from hand and eye tracking and HoloLens development to creating persistent artificial intelligence models that can create expressive avatars.
Powered by Azure, which is Microsoft’s cloud computing platform, Microsoft Mesh will take advantage of Azure’s enterprise-grade security and privacy features, as well as the vast computational resources, data, AI and mixed reality services.
What Devices are supported for Microsoft Mesh geographically distributed teams?
Mesh will offer a suite of AI-powered tools to developers for creating avatars, session management, spatial rendering, and synchronization across multiple users; with holoportation to build collaborative solutions in mixed reality, and solutions working across many devices such as PCs, smartphones, Hololens 2, virtual reality headsets, and tablets.
In these collaborative experiences, the content isn't on the device or within any application, rather the holographic content is in the cloud. And you only need the special lenses to see it.