当前位置:网站首页>Unity | two ways to realize facial drive
Unity | two ways to realize facial drive
2022-07-06 01:12:00 【Boiled Green Vegetable】
Catalog
One 、 Application unity Live Capture Plug in and iphone Unity Face Capture Software
(1) introduce Live Capture Package
(2) Create an empty object ( name :Recorder), add to Take Recorder Components .
(4) Set up the model ARKit Face Actor In the component mapper.
(5) Set up New FaceDevice Of ARKit Face Device Component's Actor value .
3. iphone download Unity Face Capture Software
Two 、 Control through algorithm data BlendShape The number
One 、 Application unity Live Capture Plug in and iphone Unity Face Capture Software
1. Version for
- unity edition :Unity Editor 2020.3.16f1 or later version
- iphone edition :iOS 14.6 or higher
- Reference documents :About Live Capture | Live Capture | 1.0.1 (unity3d.com)
2. unity In the operation :
(1) introduce Live Capture Package
Live Capture stay Package Manager Pass through git url How to add :
(2) Create an empty object ( name :Recorder), add to Take Recorder Components .
Add ARKit Face Device: It will be in Recorder Automatically create under the object New FaceDevice, There is a ARKit Face Device Components .
(3) Drag the model into the scene , And add ARKit Face Actor Components , Make the model into Prefab.
Pay attention to model import Unity Check... When Import BlendShapes( Just check it ,unity Check... By default ).
stay Project Create a mapper( Right click /Create/Live Capture / ARKit Face Capture / Mapper), Set up mapper Related properties (RigPrefab Specify as generated in the previous step prefab,LeftEye、RightEye、Head To select the corresponding joint . The purpose of this step is to map BlendShape, If our model BlendShape The name matches Apple's ARKit requirement , be AddRender The operation will be mapped automatically , Otherwise, we need to set it manually ).
(4) Set up the model ARKit Face Actor In the component mapper.
(5) Set up New FaceDevice Of ARKit Face Device Component's Actor value .
(6) Create a server .
Click on Window/Live Capture/Connections, Click on Configure FireWall. Click on Create Server/Companion App Server, Click on Start Opening service .
3. iphone download Unity Face Capture Software
Open software ( The software is in iphone 12 Pro Max 15.4.1 Upper pro test stability , stay iphone X It will heat up and flash back ), Input IP And Port, After connecting, you can drive ~( If you can't connect , Probably unity The version does not conform or the network does not conform , Refer to official documents :About Live Capture | Live Capture | 1.0.1 (unity3d.com))
Two 、 Control through algorithm data BlendShape The number .
1. Correlation function
- obtain BlendShape Quantity and corresponding name .
public sealed class Mesh : Object
{
public int blendShapeCount { get; }
public string GetBlendShapeName(int shapeIndex);
}
- Set up BlendShape The weight
public class SkinnedMeshRenderer : Renderer{
public void SetBlendShapeWeight(int index, float value);
}
2. Realization
The data value range provided by the algorithm may be 0-1, So in SetBlendShapeWeight When it comes to *100.
Dictionary<string, int> bs_map;// On the model bs name - Indexes
skinnedMeshRenderer.SetBlendShapeWeight(bs_map["eyebrow_BS.Eyebrows_Sad_L"], 20);
边栏推荐
- ubantu 查看cudnn和cuda的版本
- Use of crawler manual 02 requests
- ORA-00030
- After Luke zettlemoyer, head of meta AI Seattle research | trillion parameters, will the large model continue to grow?
- Building core knowledge points
- In the era of industrial Internet, we will achieve enough development by relying on large industrial categories
- 关于softmax函数的见解
- 关于#数据库#的问题:(5)查询库存表中每本书的条码、位置和借阅的读者编号
- DOM introduction
- Cve-2017-11882 reappearance
猜你喜欢
Pbootcms plug-in automatically collects fake original free plug-ins
Beginner redis
现货白银的一般操作方法
JVM_ 15_ Concepts related to garbage collection
基于DVWA的文件上传漏洞测试
Cf:d. insert a progression [about the insert in the array + the nature of absolute value + greedy top-down]
Condition and AQS principle
MCU realizes OTA online upgrade process through UART
Finding the nearest common ancestor of binary search tree by recursion
Mobilenet series (5): use pytorch to build mobilenetv3 and learn and train based on migration
随机推荐
File upload vulnerability test based on DVWA
3D模型格式汇总
Keepalive component cache does not take effect
VMware Tools安装报错:无法自动安装VSock驱动程序
Unity | 实现面部驱动的两种方式
[groovy] XML serialization (use markupbuilder to generate XML data | set XML tag content | set XML tag attributes)
Zhuhai's waste gas treatment scheme was exposed
Differences between standard library functions and operators
Hundreds of lines of code to implement a JSON parser
Cannot resolve symbol error
SSH login is stuck and disconnected
DOM introduction
Overview of Zhuhai purification laboratory construction details
The third season of ape table school is about to launch, opening a new vision for developers under the wave of going to sea
Five challenges of ads-npu chip architecture design
Paging of a scratch (page turning processing)
China Taiwan strategy - Chapter 8: digital marketing assisted by China Taiwan
Four commonly used techniques for anti aliasing
Introduction to robotics I. spatial transformation (1) posture, transformation
In the era of industrial Internet, we will achieve enough development by relying on large industrial categories