Hololens 2 development: use MRTK and simulate gesture input in unity

Use MRTK

MRTK See :https://github.com/microsoft/MixedRealityToolkit-Unity

open https://github.com/microsoft/MixedRealityToolkit-Unity/releases
download Foundation as well as Examples Two unity package

notes ： About environment configuration and Unity Version see ：
https://docs.microsoft.com/zh-cn/windows/mixed-reality/install-the-tools
open Unity New workspace Import two downloaded packages
Open... In Explorer MixedRealityToolkit.Examples\Demos\HandTracking\Scenes
Of HandInteraction scene

Open it as shown in the figure ： If 3D The icon is too large and needs to be Gizmos On 3D Icons The adjustment of

Click on Play Button to start the scene , You can do it in editor mode HoloLens2 Operation simulation . Here are the operating instructions ：
1. Use WSAD You can move back and forth, left and right
2. Press the right mouse button to move the viewing angle
3. Press the spacebar to display the right hand Hold the left shift Key can display the left hand . Press and move the mouse at the same time to move the hand .
4. Use the mouse wheel to move the hand back and forth

5. Use Q/E R/F Z/X The key can rotate the hand
6. Use the left mouse button to change the operation state of the hand （ Hold on / Let go of ）
7. Use T/Y The left... Key can be permanently displayed / one 's right hand Press the key again to cancel

Use the scroll wheel to move the hand to turn off the frame rate indicator :

8. Hold down your hand and click the left mouse button to change the state of your hand , You can grab, zoom and other operations .

The demonstration is as follows ：


Reference resources :https://microsoft.github.io/MixedRealityToolkit-Unity/Documentation/InputSimulation/InputSimulationService.html