Welcome, Guest
Username Password: Remember me
  • Page:
  • 1

TOPIC: What you see is what you hear?

What you see is what you hear? 2 years, 3 months ago #103269

  • donkpow
  • Pro User
  • OFFLINE
  • Platinum Boarder
  • Posts: 9026
  • 2 years, 3 months ago
Just doing a little web surfing on the topic of multi-sensory integration and the ilk. Since audio/video material is limited to two perceptual senses, it is reasonable to consider the importance of the concept and the principles involved. Actually the "McGurk Effect" is what got me started. A little video on that:

HP Z600 5570
PNY Quadro K620
SB Audigy SE
Windows 7 Pro
ShuttlePRO v2

Re: What you see is what you hear? 2 years, 3 months ago #103281

  • jwrl
  • Moderator
    Pro User
  • OFFLINE
  • Moderator
  • Posts: 8590
  • 2 years, 3 months ago
That effect is the reason why people who are partially deaf can often appear to hear more clearly when they can see the person speaking to them that when they can't. It's a well known effect, but I never knew the name of it before today.
Last Edit: 2 years, 3 months ago by jwrl.

Re: What you see is what you hear? 2 years, 3 months ago #103285

  • donkpow
  • Pro User
  • OFFLINE
  • Platinum Boarder
  • Posts: 9026
  • 2 years, 3 months ago
I had the TV on today and saw a scene that had a speaker addressing a small crowd. The only audio was the speaker's dialog. The cut was from the speaker to a listener. The listener, in the crowd, showed a negative reaction and I lost all sense of what the speaker had intended.

What then takes precedence? In this case, the strong emotion of the listener superseded the dialog. If there is dialog in the presence of competing elements, the face of the speaker being present in the scene will ensure the dialog will hold its position. Voice over can only take precedence in the lull between stronger elements.

??
HP Z600 5570
PNY Quadro K620
SB Audigy SE
Windows 7 Pro
ShuttlePRO v2

Re: What you see is what you hear? 2 years, 3 months ago #103287

  • jwrl
  • Moderator
    Pro User
  • OFFLINE
  • Moderator
  • Posts: 8590
  • 2 years, 3 months ago
That technique is often used by drama editors to emphasize the emotional content of a scene. Cutaways under dialogue can often heighten emotion (or hose it down, for that matter).

Re: What you see is what you hear? 2 years, 3 months ago #103295

  • frandesouza
  • Pro User
  • OFFLINE
  • Platinum Boarder
  • Posts: 674
  • 2 years, 3 months ago
Back in the 90s I bought a CD by an uruguayan band. Wen I listened to the album's main song I tought that the sound of the bass was too low in a specific passage of the music, compared to the videoclip of the same song (the video clip that lead me to buy the album in the first place). The next time I watched the videoclip I realized why: in that specific part of the music there was a close up of the bassist's performance.
Windows 7 Professional 64 bit - Service Pack 1
Intel Core i7 3770 3.4GHz - 16GB RAM DDR3
MoBo: Asus P8H77-M - Graphics: Geforce GT630 2GB DDR3
HDD: WD 500GB SATA II (system drive) + WD 1TB SATA II Black Edition (work drive)
LG M-Disc ready CD/DVD burner.
Audio: Focusrite Scarlett 2i2 & Behringer MS16 monitor speakers
Contour Design Shuttle Pro v2

Re: What you see is what you hear? 2 years, 3 months ago #103301

  • donkpow
  • Pro User
  • OFFLINE
  • Platinum Boarder
  • Posts: 9026
  • 2 years, 3 months ago
If we are able to create reasonable certainty with the coincidence of image and sound, we should be able to create reasonable uncertainty.

One might suppose that inclusion of dissonance in the score during that time would heighten the influence of the scene. I submit dissonance in the score would undermine the affect of the scene by communicating the intent. Perhaps an unsettling air in the sound track would serve the scene better.
HP Z600 5570
PNY Quadro K620
SB Audigy SE
Windows 7 Pro
ShuttlePRO v2

Re: What you see is what you hear? 2 years, 3 months ago #103312

  • lghtwrks
  • OFFLINE
  • Platinum Boarder
  • Posts: 3479
  • 2 years, 3 months ago
o.t.
"mother tongue"

if you speak german, that sounds funny (EN sng -> DE/AT "slang").
there should be some (DE/AT sng. -> EN) examples too?

Last Edit: 2 years, 3 months ago by lghtwrks.

Re: What you see is what you hear? 2 years, 3 months ago #103314

  • donkpow
  • Pro User
  • OFFLINE
  • Platinum Boarder
  • Posts: 9026
  • 2 years, 3 months ago
Funny.

Not limited to across languages. "Misheard lyrics."

I suppose it would be the mind drawing conclusions not intended.
HP Z600 5570
PNY Quadro K620
SB Audigy SE
Windows 7 Pro
ShuttlePRO v2

Re: What you see is what you hear? 2 years, 3 months ago #103316

  • lghtwrks
  • OFFLINE
  • Platinum Boarder
  • Posts: 3479
  • 2 years, 3 months ago
ah,ok.
s

Re: What you see is what you hear? 2 years, 3 months ago #103319

  • jwrl
  • Moderator
    Pro User
  • OFFLINE
  • Moderator
  • Posts: 8590
  • 2 years, 3 months ago
donkpow wrote:
Not limited to across languages. "Misheard lyrics."

Often called "mondegreens" in English. The term is supposed to come from an old folk song where the phrase "...and laid him on the green" was mis-heard as "...and Lady Mondegreen".
Last Edit: 2 years, 3 months ago by jwrl.
  • Page:
  • 1
Time to create page: 0.72 seconds
Scroll To Top