Using the Spark AR Studio Face Reference Assets

The Face Reference Assets are a set of textures and 3D objects. Use them when you’re creating face effects in Spark AR Studio.

Download the Face Reference Assets here.

Here Is a Video To Guide You

What’s included within the Face Reference Assets
When you open the downloaded files on your computer you will see two folders: Mesh and Textures. The Mesh folder contains 3D meshes and head occluders in several file formats. the feel folder contains 2D texture files.

Mesh

You’ll need to open these objects in 3D software or in Spark AR on to view them.
This folder contains 2 sorts of 3D objects in several file formats:

faceMesh.fbx, faceMesh.dae and faceMesh.obj – the face mesh utilized in our facial tracking. Use it as a scale reference when creating objects and textures.
headOccluder.fbx, headOccluder.dae and headOccluder.obj – use this object to occlude the quantity of the top.
Textures

This folder contains 3 sorts of 2D textures in JPG and PNG format:

faceMesh.png and faceMeshTrackers.png – these textures show the topology and points on the face tracked by Spark AR Studio. Use them for debugging effects.
FaceMeshMask.png – use this texture to blend the sides of a cloth with the face.
faceFeminine.jpg and faceMasculine.jpg – these are textures illustrated to seem like real faces. Use them as templates when creating custom textures for face effects, to offer you a thought of the position of the features of the person using your effect.
faceMesh.fbx, faceMesh.dae and faceMesh.obj
This is the face mesh Spark AR Studio uses to define someone’s face and track it:

Use this mesh to assist you to create assets in external software. We recommend using FaceMesh.fbx for max compatibility.

As a scale reference

Use the face mesh as a scale reference, for instance when you’re creating objects like glasses or hats that you’re going to track to the face.

Using this mesh as a reference will mean objects are the proper size once you import them into Spark AR Studio.

Create facial distortion blendshapes

Use 3D software to manoeuvre the points during this object, to distort the form of the mesh. you’ll then import it into Spark AR Studio, and use it as a blend shape to vary the form of someone’s face when they’re using the effect.

Create custom mask and makeup effects

Use the mesh as a base when you are making textures in external software. for instance, as a start line for creating masks, structure effects or maps to use with the physically-based shader.

headOccluder.fbx, headOccluder.dae and headOccluder.obj
Combine this object with an occluder material to occlude the quantity of the top. The mesh won’t completely match the user’s head, but it can offer you an honest idea.

This is useful when you’re creating effects with items like crowns or hats – because it’ll hide parts of the item that might be covered by the top in the real world.

The face portion is flat. this suggests it won’t interfere with the face mesh you’ll increase the scene, which can reflect the face and movement of the user.

faceMesh.png and faceMeshTrackers.png
These textures represent the UV layout and topology of the face mesh utilized in Spark AR Studio. faceMeshTrackers.png features red dots, highlighting the points on the face that are tracked by our system.

Creating textures using these grids as a reference will assist you to understand where parts of the feel are going to be positioned within the effect.

Keep in mind these textures omit the face outline points.

FaceMeshMask.png
This texture is often wont to fade the sides of cloth applied to someone’s face. this is often useful once you want to blend a cloth or texture with the face.

In the image below, we’ve used FaceMeshMask within the effect on the right:

To add this texture to your project:

Create a cloth for a face mesh in your scene.
Select the fabric within the Assets panel.
In the Inspector panel, check the box next to Alpha.
Import this texture from your computer, using the sink next to Texture.
faceFeminine.jpg and faceMasculine.jpg
Use these textures as templates when creating your own textures for face effects. Import them into the software you employ to make textures, and make your texture on a replacement layer.

They’ll assist you to see countenance are in additional detail – just like the start and end of the eyebrows or the quantity of the lips. These textures are grey in tone.

By shaswat

Hey I Am Shaswat A Augment Reality Creator Running This illusioniar.com a augment reality startup.

Leave a comment

Your email address will not be published. Required fields are marked *