当前位置:网站首页>Unity | two ways to realize facial drive
Unity | two ways to realize facial drive
2022-07-06 01:12:00 【Boiled Green Vegetable】
Catalog
One 、 Application unity Live Capture Plug in and iphone Unity Face Capture Software
(1) introduce Live Capture Package
(2) Create an empty object ( name :Recorder), add to Take Recorder Components .
(4) Set up the model ARKit Face Actor In the component mapper.
(5) Set up New FaceDevice Of ARKit Face Device Component's Actor value .
3. iphone download Unity Face Capture Software
Two 、 Control through algorithm data BlendShape The number
One 、 Application unity Live Capture Plug in and iphone Unity Face Capture Software
1. Version for
- unity edition :Unity Editor 2020.3.16f1 or later version
- iphone edition :iOS 14.6 or higher
- Reference documents :About Live Capture | Live Capture | 1.0.1 (unity3d.com)
2. unity In the operation :
(1) introduce Live Capture Package
Live Capture stay Package Manager Pass through git url How to add :
(2) Create an empty object ( name :Recorder), add to Take Recorder Components .
Add ARKit Face Device: It will be in Recorder Automatically create under the object New FaceDevice, There is a ARKit Face Device Components .
(3) Drag the model into the scene , And add ARKit Face Actor Components , Make the model into Prefab.
Pay attention to model import Unity Check... When Import BlendShapes( Just check it ,unity Check... By default ).
stay Project Create a mapper( Right click /Create/Live Capture / ARKit Face Capture / Mapper), Set up mapper Related properties (RigPrefab Specify as generated in the previous step prefab,LeftEye、RightEye、Head To select the corresponding joint . The purpose of this step is to map BlendShape, If our model BlendShape The name matches Apple's ARKit requirement , be AddRender The operation will be mapped automatically , Otherwise, we need to set it manually ).
(4) Set up the model ARKit Face Actor In the component mapper.
(5) Set up New FaceDevice Of ARKit Face Device Component's Actor value .
(6) Create a server .
Click on Window/Live Capture/Connections, Click on Configure FireWall. Click on Create Server/Companion App Server, Click on Start Opening service .
3. iphone download Unity Face Capture Software
Open software ( The software is in iphone 12 Pro Max 15.4.1 Upper pro test stability , stay iphone X It will heat up and flash back ), Input IP And Port, After connecting, you can drive ~( If you can't connect , Probably unity The version does not conform or the network does not conform , Refer to official documents :About Live Capture | Live Capture | 1.0.1 (unity3d.com))
Two 、 Control through algorithm data BlendShape The number .
1. Correlation function
- obtain BlendShape Quantity and corresponding name .
public sealed class Mesh : Object
{
public int blendShapeCount { get; }
public string GetBlendShapeName(int shapeIndex);
}
- Set up BlendShape The weight
public class SkinnedMeshRenderer : Renderer{
public void SetBlendShapeWeight(int index, float value);
}
2. Realization
The data value range provided by the algorithm may be 0-1, So in SetBlendShapeWeight When it comes to *100.
Dictionary<string, int> bs_map;// On the model bs name - Indexes
skinnedMeshRenderer.SetBlendShapeWeight(bs_map["eyebrow_BS.Eyebrows_Sad_L"], 20);
边栏推荐
- Four commonly used techniques for anti aliasing
- 【第30天】给定一个整数 n ,求它的因数之和
- cf:C. The Third Problem【关于排列这件事】
- The inconsistency between the versions of dynamic library and static library will lead to bugs
- Test de vulnérabilité de téléchargement de fichiers basé sur dvwa
- Condition and AQS principle
- Fibonacci number
- MobileNet系列(5):使用pytorch搭建MobileNetV3并基于迁移学习训练
- Mysql--- query the top 5 students
- Why can't mathematics give machine consciousness
猜你喜欢
VSphere implements virtual machine migration
Recoverable fuse characteristic test
Test de vulnérabilité de téléchargement de fichiers basé sur dvwa
Building core knowledge points
[groovy] XML serialization (use markupbuilder to generate XML data | create sub tags under tag closures | use markupbuilderhelper to add XML comments)
The inconsistency between the versions of dynamic library and static library will lead to bugs
[groovy] XML serialization (use markupbuilder to generate XML data | set XML tag content | set XML tag attributes)
Cannot resolve symbol error
I'm interested in watching Tiktok live beyond concert
Installation and use of esxi
随机推荐
Leetcode 208. 实现 Trie (前缀树)
95后CV工程师晒出工资单,狠补了这个,真香...
Overview of Zhuhai purification laboratory construction details
Recursive method converts ordered array into binary search tree
Dedecms plug-in free SEO plug-in summary
Interview must brush algorithm top101 backtracking article top34
curlpost-php
The inconsistency between the versions of dynamic library and static library will lead to bugs
Installation and use of esxi
FFT 学习笔记(自认为详细)
Leetcode1961. 检查字符串是否为数组前缀
ORA-00030
VSphere implements virtual machine migration
Cannot resolve symbol error
Exciting, 2022 open atom global open source summit registration is hot
Gartner released the prediction of eight major network security trends from 2022 to 2023. Zero trust is the starting point and regulations cover a wider range
Zhuhai's waste gas treatment scheme was exposed
After 95, the CV engineer posted the payroll and made up this. It's really fragrant
Condition and AQS principle
DOM introduction