CHANGSTAR: Audiophile Headphone Reviews and Early 90s Style BBS

  • December 31, 2015, 11:09:14 AM
  • Welcome, Guest
Please login or register.

Login with username, password and session length
Advanced search  

Author Topic: Brain uses FFT to quickly process audio?  (Read 1828 times)

0 Members and 1 Guest are viewing this topic.

PelPix

  • Team Linear Magnetic
  • Able Bodied Sailor
  • Pirate
  • ***
  • Brownie Points: +63/-2
  • Offline Offline
  • Posts: 176
Brain uses FFT to quickly process audio?
« on: July 09, 2013, 06:50:02 AM »

Here's something I've noticed: The human brain seems to use FFT to perform basic effects to transform your hearing.

Try this experiment:
Get an annoying buzzing noise.  A looping sound daemon buffer works best (Like when Half-Life 2 crashes).  Something really abnormal and annoying.  Now get something to softly play noise in the background.  An AC unit will work, or a fan.  Play the buzzing noise through headphones for at least 10 seconds, then suddenly stop it and listen closely to the noise.  You'll hear FFT artifacts and a notch from what I can only conclude is a simple noise removal transformation your brain tried to use to remove the buzzing.

This blew my mind the first time I heard it.  I want to see if I'm the only person that hears it and if it is indeed FFT artifacts.
Logged

OJneg

  • Audio Ayatollah / Wow and Fluster
  • Mate
  • Pirate
  • ****
  • Brownie Points: +120/-3
  • Offline Offline
  • Posts: 1245
Re: Brain uses FFT to quickly process audio?
« Reply #1 on: July 09, 2013, 02:58:17 PM »

What does an FFT artifact sound like exactly? I'm familiar with the notch, it's like your brain trying to fill in an empty space when nothing is there aurally. Or like when you're sitting in a very very quiet room and your ear scans for something to latch on to, but all you get is the noise floor.
Logged

PelPix

  • Team Linear Magnetic
  • Able Bodied Sailor
  • Pirate
  • ***
  • Brownie Points: +63/-2
  • Offline Offline
  • Posts: 176
Re: Brain uses FFT to quickly process audio?
« Reply #2 on: July 09, 2013, 06:18:09 PM »

What does an FFT artifact sound like exactly? I'm familiar with the notch, it's like your brain trying to fill in an empty space when nothing is there aurally. Or like when you're sitting in a very very quiet room and your ear scans for something to latch on to, but all you get is the noise floor.

It's very unique.  It sounds like...running water, I guess?
Logged

AstralStorm

  • Speculation and Speculums
  • Able Bodied Sailor
  • Pirate
  • ***
  • Brownie Points: +250/-164
  • Offline Offline
  • Posts: 559
  • Warning: causes nearby electronics to go haywire
Re: Brain uses FFT to quickly process audio?
« Reply #3 on: July 09, 2013, 07:38:54 PM »

No, brain does not use FFT, as it even has higher time/frequency precision that the transform allows for.
What you're descibing is not an "FFT artifact", just something known as temporal masking.
Have a read: https://en.wikipedia.org/wiki/Auditory_masking

FFT does not exhibit such issues, it's provably lossless on its own. You can apply inverse FFT with high enough precision math and you'll get the input signal, bit perfect.

Neurons are a nonlinear filtering system on top of already highly nonlinear cochlea and hair cells with uneven overlapping mapping between "ranges".
Have another, much more technical read on some facts of neural decoding/hearing:
http://www.jhu.edu/strucfunc/strucfunc/2011_files/2011_10_25%20%28handout%29.pdf
http://www.rle.mit.edu/media/pr152/31_PR152.pdf

Yes, human hearing is similar in this regard to cat's.
« Last Edit: July 09, 2013, 07:49:44 PM by AstralStorm »
Logged
For sale: Hifiman HE-500; Paradox; Brainwavz B2. PM me if you would like to buy them.

Marvey

  • The Man For His Time And Place
  • Master
  • Pirate
  • *****
  • Brownie Points: +555/-33
  • Offline Offline
  • Posts: 6698
  • Captain Plankton and MOT: Eddie Current
Re: Brain uses FFT to quickly process audio?
« Reply #4 on: July 09, 2013, 08:28:46 PM »

That would be really weird if the brain used FFT or even DCT (of which FFT is a "cheat" of)
Logged

AstralStorm

  • Speculation and Speculums
  • Able Bodied Sailor
  • Pirate
  • ***
  • Brownie Points: +250/-164
  • Offline Offline
  • Posts: 559
  • Warning: causes nearby electronics to go haywire
Re: Brain uses FFT to quickly process audio?
« Reply #5 on: July 09, 2013, 09:27:22 PM »

See Gabor limit, the variant of uncertainty that limits Fourier transform and any non-interference system. Our hearing bypasses this likely by resolving inter-band interference dynamically and having large amounts of band overlap, often more than one. Human hearing system also trades high short term dynamic range and sensitivity for many dynamic temporal artifacts. We have a kind of overlapping multiband dynamic range compressor built-in.

Likely the one who heard the first danger sounds lived more often, not the one who heard the second or third one... Similarly, positioning and distance cues have been vital and those use interference patterns a lot.
(Also a byproduct is we're very sensitive to signal harmonics, waveform shape and pitch, way more than most algorithms or measures commonly used. I'm actually battling this lousy guesswork/heuristic math at work, currently writing pitch shifters and pitch detectors. FFT is but a tiny building block and has many drawbacks - the logic itself is way more complex than just the analytic transform and FFT actually has major resolution issues in this use case, those have to be worked around.)

For such low latencies our hearing system has, microsecond even, people definitely have something way different, likely a system of nonlinear neural predictors, which is way too complex for even modern hardware to handle, not to mention we don't understand even a quarter of it well.
« Last Edit: July 09, 2013, 09:45:11 PM by AstralStorm »
Logged
For sale: Hifiman HE-500; Paradox; Brainwavz B2. PM me if you would like to buy them.

Marvey

  • The Man For His Time And Place
  • Master
  • Pirate
  • *****
  • Brownie Points: +555/-33
  • Offline Offline
  • Posts: 6698
  • Captain Plankton and MOT: Eddie Current
Re: Brain uses FFT to quickly process audio?
« Reply #6 on: July 10, 2013, 03:18:37 AM »

The hair cells in the inner ear are sort of like organic spectrum analyzers in that individual hair cells detect  frequencies from low to high in the audible range. In humans, there are about 30,000 nerve fibers - I presume one for each hair cell.

So no FFT, DCT, or other transform is necessary as with microphones, which utilize a single diaphragm / detector - in essence resulting in a waveform which must be processed  / transformed into an audio spectrograph.

Think of it as 30,000 specialized microphones / detectors which only respond to certain frequencies from 20Hz to ~20kHz. Now that would be cool spectrum analyzer.
Logged

AstralStorm

  • Speculation and Speculums
  • Able Bodied Sailor
  • Pirate
  • ***
  • Brownie Points: +250/-164
  • Offline Offline
  • Posts: 559
  • Warning: causes nearby electronics to go haywire
Re: Brain uses FFT to quickly process audio?
« Reply #7 on: July 10, 2013, 07:05:27 AM »

Not even just a single frequency, more like a relatively wide range of frequencies for each of them. It's quite amazing.
It is of course processed, but in a very different way.
Logged
For sale: Hifiman HE-500; Paradox; Brainwavz B2. PM me if you would like to buy them.

PelPix

  • Team Linear Magnetic
  • Able Bodied Sailor
  • Pirate
  • ***
  • Brownie Points: +63/-2
  • Offline Offline
  • Posts: 176
Re: Brain uses FFT to quickly process audio?
« Reply #8 on: July 11, 2013, 10:04:33 PM »

So what's with the weird watery artifacts i hear in the above example?
Logged

AstralStorm

  • Speculation and Speculums
  • Able Bodied Sailor
  • Pirate
  • ***
  • Brownie Points: +250/-164
  • Offline Offline
  • Posts: 559
  • Warning: causes nearby electronics to go haywire
Re: Brain uses FFT to quickly process audio?
« Reply #9 on: July 12, 2013, 06:19:08 AM »

I've explained it already. Temporal masking, nothing to do with FFTs.
In addition to the neural mechanism, the cillia themselves tune their sensitivity. (see those two more technical papers)

The mechanism is the same as if you've looked at the image on this page for minutes, then switched to a white page:
https://en.wikipedia.org/wiki/Afterimage
« Last Edit: July 12, 2013, 06:43:43 AM by AstralStorm »
Logged
For sale: Hifiman HE-500; Paradox; Brainwavz B2. PM me if you would like to buy them.