Synchronisation of Senses

 “It’s rare we operate using just a single sense; we make full use of as much information as we can find, integrating sight, touch, our propensity for language, and other inputs. When senses agree, our perception of the world is sharper. We’ll look at how we mix up modes of operating (and how we can’t help doing so, even when we don’t mean to) and what happens when senses disagree.”
– Mind Hacks, Tips & Tools for Using Your Brain
Tom Stafford & Matt Webb

We often hear about audio illusions and visual illusions but what do audiovisual illusions look like? How do we integrate our perceptions – images and sounds – into a unified perceptual experience? How do we use our eyes and ears together?

Start at second 57 – this is an illustration of how a sound alters your vision.

We prefer to use our ears for timing and eyes for determining the location. — In the below experiment, I made a beat which fastens up and slows down in loop and simple buttons blinking in-sync and out-of-sync with the beat.

From the experiment I found that the even though we recognise patterns better with higher resolution e.g. big grids, the illusion is more clear when there is just one button.

I wonder what would happen if I hooked up an eye tracker (the reason I experimented with Joe on the tool last week) to the patches and animate the blinking based on where I’m looking or not looking.

To be continued…

Screen Shot 2562-03-04 at 13.16.44.png

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s