当前位置:网站首页>Unity | two ways to realize facial drive
Unity | two ways to realize facial drive
2022-07-06 01:12:00 【Boiled Green Vegetable】
Catalog
One 、 Application unity Live Capture Plug in and iphone Unity Face Capture Software
(1) introduce Live Capture Package
(2) Create an empty object ( name :Recorder), add to Take Recorder Components .
(4) Set up the model ARKit Face Actor In the component mapper.
(5) Set up New FaceDevice Of ARKit Face Device Component's Actor value .
3. iphone download Unity Face Capture Software
Two 、 Control through algorithm data BlendShape The number
One 、 Application unity Live Capture Plug in and iphone Unity Face Capture Software
1. Version for
- unity edition :Unity Editor 2020.3.16f1 or later version
- iphone edition :iOS 14.6 or higher
- Reference documents :About Live Capture | Live Capture | 1.0.1 (unity3d.com)
2. unity In the operation :
(1) introduce Live Capture Package
Live Capture stay Package Manager Pass through git url How to add :
(2) Create an empty object ( name :Recorder), add to Take Recorder Components .
Add ARKit Face Device: It will be in Recorder Automatically create under the object New FaceDevice, There is a ARKit Face Device Components .
(3) Drag the model into the scene , And add ARKit Face Actor Components , Make the model into Prefab.
Pay attention to model import Unity Check... When Import BlendShapes( Just check it ,unity Check... By default ).
stay Project Create a mapper( Right click /Create/Live Capture / ARKit Face Capture / Mapper), Set up mapper Related properties (RigPrefab Specify as generated in the previous step prefab,LeftEye、RightEye、Head To select the corresponding joint . The purpose of this step is to map BlendShape, If our model BlendShape The name matches Apple's ARKit requirement , be AddRender The operation will be mapped automatically , Otherwise, we need to set it manually ).
(4) Set up the model ARKit Face Actor In the component mapper.
(5) Set up New FaceDevice Of ARKit Face Device Component's Actor value .
(6) Create a server .
Click on Window/Live Capture/Connections, Click on Configure FireWall. Click on Create Server/Companion App Server, Click on Start Opening service .
3. iphone download Unity Face Capture Software
Open software ( The software is in iphone 12 Pro Max 15.4.1 Upper pro test stability , stay iphone X It will heat up and flash back ), Input IP And Port, After connecting, you can drive ~( If you can't connect , Probably unity The version does not conform or the network does not conform , Refer to official documents :About Live Capture | Live Capture | 1.0.1 (unity3d.com))
Two 、 Control through algorithm data BlendShape The number .
1. Correlation function
- obtain BlendShape Quantity and corresponding name .
public sealed class Mesh : Object
{
public int blendShapeCount { get; }
public string GetBlendShapeName(int shapeIndex);
}
- Set up BlendShape The weight
public class SkinnedMeshRenderer : Renderer{
public void SetBlendShapeWeight(int index, float value);
}
2. Realization
The data value range provided by the algorithm may be 0-1, So in SetBlendShapeWeight When it comes to *100.
Dictionary<string, int> bs_map;// On the model bs name - Indexes
skinnedMeshRenderer.SetBlendShapeWeight(bs_map["eyebrow_BS.Eyebrows_Sad_L"], 20);
边栏推荐
- Vulhub vulnerability recurrence 74_ Wordpress
- Opinions on softmax function
- I'm interested in watching Tiktok live beyond concert
- esxi的安装和使用
- 现货白银的一般操作方法
- [groovy] compile time metaprogramming (compile time method interception | find the method to be intercepted in the myasttransformation visit method)
- Distributed base theory
- Questions about database: (5) query the barcode, location and reader number of each book in the inventory table
- A preliminary study of geojson
- JVM_ 15_ Concepts related to garbage collection
猜你喜欢
View class diagram in idea
SSH login is stuck and disconnected
JVM_ 15_ Concepts related to garbage collection
MCU通过UART实现OTA在线升级流程
MobileNet系列(5):使用pytorch搭建MobileNetV3并基于迁移学习训练
Exciting, 2022 open atom global open source summit registration is hot
Test de vulnérabilité de téléchargement de fichiers basé sur dvwa
2020.2.13
Cf:d. insert a progression [about the insert in the array + the nature of absolute value + greedy top-down]
Differences between standard library functions and operators
随机推荐
Four commonly used techniques for anti aliasing
直播系统代码,自定义软键盘样式:字母、数字、标点三种切换
Convert binary search tree into cumulative tree (reverse middle order traversal)
Vulhub vulnerability recurrence 75_ XStream
cf:D. Insert a Progression【关于数组中的插入 + 绝对值的性质 + 贪心一头一尾最值】
[groovy] compile time meta programming (compile time method interception | method interception in myasttransformation visit method)
面试必刷算法TOP101之回溯篇 TOP34
Gartner发布2022-2023年八大网络安全趋势预测,零信任是起点,法规覆盖更广
Fibonacci number
golang mqtt/stomp/nats/amqp
Condition and AQS principle
Cf:h. maximum and [bit operation practice + K operations + maximum and]
Blue Bridge Cup embedded stm32g431 - the real topic and code of the eighth provincial competition
curlpost-php
基于DVWA的文件上传漏洞测试
WGet: command line download tool
DOM introduction
Recommended areas - ways to explore users' future interests
A preliminary study of geojson
Logstash clear sincedb_ Path upload records and retransmit log data