I'm asking you to add a variant analysis that can measure Aus of face sides independently.
Re-training the whole network would be a hassle, but there's an easier method.
The rough algorithm is as follows: take a detected face, mirror it across a middle line, taking the pose into account, then extract AUs for the original and both reflections separately.
Here's the general idea - the face aligned in Openface and mirrored images on both sides.
It can also be seen that here the alignment is rather poor, but mirroring was done manually, without using facial landmarks.
I'm asking you to add a variant analysis that can measure Aus of face sides independently.
Re-training the whole network would be a hassle, but there's an easier method.
The rough algorithm is as follows: take a detected face, mirror it across a middle line, taking the pose into account, then extract AUs for the original and both reflections separately.
Here's the general idea - the face aligned in Openface and mirrored images on both sides.
It can also be seen that here the alignment is rather poor, but mirroring was done manually, without using facial landmarks.