diff --git a/NVIDIA AR SDK Programming Guide.pdf b/NVIDIA AR SDK Programming Guide.pdf index 46924bf..f155ff3 100644 Binary files a/NVIDIA AR SDK Programming Guide.pdf and b/NVIDIA AR SDK Programming Guide.pdf differ diff --git a/samples/FaceTrack/FaceTrack.cpp b/samples/FaceTrack/FaceTrack.cpp index dd3e1b3..2ba4a46 100644 --- a/samples/FaceTrack/FaceTrack.cpp +++ b/samples/FaceTrack/FaceTrack.cpp @@ -755,6 +755,10 @@ DoApp::Err DoApp::initOfflineMode(const char *inputFilename, const char *outputF DoApp::Err DoApp::fitFaceModel() { DoApp::Err doErr = errNone; nvErr = face_ar_engine.fitFaceModel(frame); + if (FLAG_captureOutputs) { + writeFrameAndEstResults(frame, face_ar_engine.output_bboxes, face_ar_engine.getLandmarks()); + writeVideoAndEstResults(frame, face_ar_engine.output_bboxes, face_ar_engine.getLandmarks()); + } if (FaceEngine::Err::errNone == nvErr) { #ifdef VISUALIZE diff --git a/samples/FaceTrack/FaceTrack.exe b/samples/FaceTrack/FaceTrack.exe index 0d9316e..3b63fde 100644 Binary files a/samples/FaceTrack/FaceTrack.exe and b/samples/FaceTrack/FaceTrack.exe differ diff --git a/samples/FaceTrack/Readme.txt b/samples/FaceTrack/Readme.txt index 4ac5e07..4dc0475 100644 --- a/samples/FaceTrack/Readme.txt +++ b/samples/FaceTrack/Readme.txt @@ -1,5 +1,5 @@ -FaceTrack is a sample Windows application that demonstrates the face detection, landmark detection, -and 3D face reconstruction features of the NVIDIA AR SDK. The application requires a video feed +FaceTrack is a sample Windows application that demonstrates the face tracking, landmark tracking, +and 3D mesh tracking features of the NVIDIA AR SDK. The application requires a video feed from a camera connected to the computer running the application, or from a video file, as specified with command-line arguments (enumerated by executing: FaceTrack.exe --help). @@ -7,15 +7,17 @@ The sample application can run in 3 modes which can be toggled through the '1', the keyboard 1 - Face tracking 2 - Facial landmark tracking -3 - 3D face reconstruction +3 - 3D mesh tracking For more controls and configurations of the sample app, please read the SDK programming guide. -3D face fitting requires the model file face_model0.nvf which is not part of the SDK package. -It has to be generated through the steps described below. The sample app can still be used in -mode 1 and 2 without this file. +3D mesh tracking feature requires a 3D Morphable Face Model (3DMM). +NVIDIA AR SDK does not include a 3DMM. Therefore, if you are using the 3D mesh tracking feature, you must configure NVIDIA AR SDK with 3DMM. +Note: To configure NVIDIA AR SDK with 3DMM, you can use the Surrey Face Model, as described in the steps below, or your own model. +The sample app can still be used in mode 1 and 2 without this file. -To generate the face model file face_model0.nvf required for 3D face fitting: +NVIDIA AR SDK provides the ConvertSurreyFaceModel.exe utility to convert 3DMM files to the NVIDIA .nvf format that is required by the SDK. +To generate the face model file face_model0.nvf required for 3D mesh tracking: 1) Download the following Surrey Face Model files from the eos project page on Github: sfm_shape_3448.bin diff --git a/tools/ConvertSurreyFaceModel.exe b/tools/ConvertSurreyFaceModel.exe index cccf157..0ae6758 100644 Binary files a/tools/ConvertSurreyFaceModel.exe and b/tools/ConvertSurreyFaceModel.exe differ