Wednesday, October 30, 2013

The McGurk Effect

This is a very interesting effect...

When you are breaking down a dialogue soundtrack into frames, you learn right away that you don't have to put every mouth position for every frame of sound. What happens is similar to the effect above, you see the mouth switching into different positions almost too quickly especially if each frame is a different mouth. Its ok to have each mouth on two frames instead of one, because you will see the mouth before you hear the sound. Too delayed or shown too soon and the mouth will look out of sync with the sound.

I took the above soundtrack to see if switching a B mouth between a F mouth would have the same effect in animation.Watch the clip below and let me know how many Bahs you see compared to Fahs.

McGurk effect from Toondini on Vimeo.

Here's another example of the McGurk effect...

1 comment:

  1. Very interesting. I've seen instances in my own animation where the lip sync didn't read well and had to fudge how many frames an "B/M/P" or "F/V" mouth was held and had to increase the number of frames well before the sound happened.

    Nice post and blog!