CHANGSTAR: Audiophile Headphone Reviews and Early 90s Style BBS

  • December 31, 2015, 09:38:33 AM
  • Welcome, Guest
Please login or register.

Login with username, password and session length
Advanced search  
Pages: [1] 2 3 4 5 6

Author Topic: MEASUREMENT FAQ  (Read 4807 times)

0 Members and 1 Guest are viewing this topic.

Marvey

  • The Man For His Time And Place
  • Master
  • Pirate
  • *****
  • Brownie Points: +555/-33
  • Offline Offline
  • Posts: 6698
  • Captain Plankton and MOT: Eddie Current
MEASUREMENT FAQ
« on: April 22, 2015, 06:25:00 AM »

MEASUREMENT FAQ

Q: Can't measurements bias one's perception of a headphone?
A:
Of course! However, lots of other things can influence how a headphone is going to sound like. Comfort, fit, construction, build quality, marketing, advertising, Jude's YouTube videos, hype (deserved or undeserved), price, et. al. will also influence how a headphone is going to sound like. The good thing about measurements is we don't have to look at them. Longtime readers of this site will know that I always listen to a headphone first to jot down subjective impressions before taking measurements.

We can also make a counter argument: measurements might help us become better (more critical) listeners.


Q: Can measurements "lie"?
A:
Absolutely. Measurements don't tell the whole story, the information they provide is too limited. This is why I like to post as many different kinds of measurements as easily obtainable: frequency response, cumulative spectral decay, and distortion plots. I like to think of measurements as a tool. Measurements can more easily tell us if something is wrong with a headphone than if a headphone is awesome.

The frequency response measurements have perhaps the strongest correlation to what we hear as tonal balance. CSDs seem to be most effective at discerning any issues (peaks) from the midrange on up; and have some limited correlation to articulation and resolution. Distortion measurements tend to relate to overall clarity, "blackness", "fidelity" of sound; and appear to be the most difficult for measurement newbies to correlate to subjective sound quality.


Q: Should I use measurements to determine whether I should buy a headphone or not.
A:
Best to get the headphone and try it out for yourself. Otherwise use numerous sources. Talk to friends who have heard it. Talk to people you trust. Use measurements. Consider all sources of information for proper due diligence. Use measurements here. Use Tyll's measurements. Most of all, consider negative information, whether they be measurements or subjective impressions. It's impossible to get transducers to do everything right.


Q: Your measurements say bad things about headphones like the Grado, therefore I don't agree with your measurements.
A:
That's fine. I respect John Grado for tuning his headphones according to a vision. He had a vision for a certain sound, and he's certainly hit the target right on the mark. I'd be more worried if Grado headphones sounded all over the place.

While you may not "agree" with the measurements, the measurements do tell us that Grados (RS-1 and below) have a consistent house sound that is very different from that of Audezes headphones. I'd argue that measurements tell us more about the differences between a Grado and an Audeze and than two fanboys arguing over which one is better.

Finally, measurements have nothing to do with personal preference.


Q: Your measurements look different from manufacturer provided measurements.
A:
Measurements can be used as marketing tools or inadvertently improperly presented. One "trick" I've seen recently with measurements is to present distortion graphs using a linear instead of logarithmic scale on the Y-axis. We hear on the logarithm scale. The use of linear scale can hide "problems". Also, SPL is a huge factor in distortion measurements. One way to lower distortion is to run at softer volume levels.

Other methods can involve setting the floor too high on CSD plots, using excessive smoothing, visually compressing the Y-axis while expanding the Y-axis range on frequency response graphs, etc.

I tend to measure at high SPL and present measurement visualizations in a manner which I feel slightly exaggerates issues so we can "see" what is going on. Changstar is not trying to sell headphones or get sponsorships. We want to know all possible issues with a headphone - with the understanding that nothing is perfect.


Q: Can I compare measurements using one method with measurements using another?
A:
In general no, unless you are really familiar with the methods and how they tend to deviate from each other. However, this does not mean you cannot look at a measurement here, and then check InnerFidelity to see if there are certain consistent patterns.


Q: I don't understand the measurements here.
A:
If you own several headphones and we have measurements of them here, a good way to start out is to listen to the headphones and study the measurements. The more we do this, the better we get at understanding measurements. There are various ear training resources on the Internet which might give you a head start in understanding the frequency response measurement. Finally, you can always ask. Asking how measurements work is not a stupid question. Please ask questions.

This site started a few years ago with only a few headphone measurements. It has definitely been a learning experience even for me to see how measurements correlated to qualities of sound.

Like all technical things, it does make a little bit of effort and intelligence to grasp.


Q:
What is the ideal frequency response for your graphs?
A:
This is a tough question to answer. My current V2 measurement rig is set up to be most comparable to a measurement taken at the listening position with a wand microphone for a pair of speakers. The ideal response for me personally is a flat response up to several hundred Hz with a gentle downward slope where by 20kHz it's 6db down more or less. This is pretty standard for how things are setup in a quality mastering studio.

Your ideal frequency response may be different from mine.


Q: Wait, are you saying a flat line on your current measurement rig will sound a little bright?
A:
Yes.


Q: I don't hear this "high" distortion I see on your graphs.
A:
Distortion is probably the trickiest to hear or describe. Distortion in most cases here (which is usually dominated by 2nd order), does not sound like an amplifier clipping. Distorted bass tends to sound muddy and blurred. Distorted midrange tends to sound dirty or unclear. Distorted treble often coincides with peaks an octave higher.

Based on discussions with people here, there seems to be high variability on people's ability to discern certain kinds of distortion. The other factor is what headphones are you comparing against? If you don't hear distortion on a headphone with high levels of measured distortion, perhaps it's likely that the other headphones you've owned have had similar distortion characteristics.

Finally, it's possible that you are not sensitive to distortion. That could be a blessing.





« Last Edit: April 22, 2015, 07:28:21 AM by purr1n »
Logged

MuZo2

  • Able Bodied Sailor
  • Pirate
  • ***
  • Brownie Points: +10/-2
  • Offline Offline
  • Posts: 201
Re: Re: My Measurement Rig Progress / Purrin Reveals All!
« Reply #1 on: April 22, 2015, 06:59:25 AM »

Great post purr1n, may be it needs a sticky in Headphone and IEM measurements forum.
Logged

Marvey

  • The Man For His Time And Place
  • Master
  • Pirate
  • *****
  • Brownie Points: +555/-33
  • Offline Offline
  • Posts: 6698
  • Captain Plankton and MOT: Eddie Current
Re: MEASUREMENT FAQ
« Reply #2 on: April 22, 2015, 07:21:26 AM »

Please ask questions. This includes newcomers or lurkers.
Logged

kothganesh

  • Rebelious Stax Zealot
  • Able Bodied Sailor
  • Pirate
  • ***
  • Brownie Points: +39/-0
  • Offline Offline
  • Posts: 734
Re: MEASUREMENT FAQ
« Reply #3 on: April 22, 2015, 07:26:22 AM »

Marv,

The following has always bothered me: You have a rig, you measure and come up with graphs and plots. Now you use the same HP and connect it to a source, dac and amp. Clearly, the afore-mentioned three will most likely vary from person to person. So what is then the correlation between the generated graphs and what you actually hear ? Granted, it should be very close but source "coloring" could present a different picture right?
Logged

Anaxilus

  • Phallus Belligerantus Analmorticus
  • Pirate
  • **
  • Brownie Points: +65535/-65535
  • Offline Offline
  • Posts: 3493
  • TRS jacks must die
    • The Claw
Re: MEASUREMENT FAQ
« Reply #4 on: April 22, 2015, 07:44:36 AM »

Marv,

The following has always bothered me: You have a rig, you measure and come up with graphs and plots. Now you use the same HP and connect it to a source, dac and amp. Clearly, the afore-mentioned three will most likely vary from person to person. So what is then the correlation between the generated graphs and what you actually hear ? Granted, it should be very close but source "coloring" could present a different picture right?

Not according to the basic measurements or to those that live and die by them only. There's a reason he uses my 'Objective' 2 as the amp for these measurements and initial subjective impressions. Same rig. You can plug and play the upstream of more than 95% of the rigs people use out there and not measure an appreciable difference at the transducer unless something is very wrong or broken.

Besides, the transducer is where most of the measurable stuff is happening. Including that fabled awful tube distortion which is rather inconsequential to what the transducer is presenting anyway.

Remember, most of us here do NOT believe that the basic measurements often presented on many forums tell us the whole story of what we hear. That's not this place, no matter what anyone would have you believe elsewhere.
Logged
"If you do not change direction, you may end up where you are heading." - Lao Tzu

"The Claw is our master. The Claw chooses who will go or who will stay." - The LGM Community

"You're like a dull knife, just ain't cuttin'. Talking loud, saying nothing." - James Brown

Marvey

  • The Man For His Time And Place
  • Master
  • Pirate
  • *****
  • Brownie Points: +555/-33
  • Offline Offline
  • Posts: 6698
  • Captain Plankton and MOT: Eddie Current
Re: MEASUREMENT FAQ
« Reply #5 on: April 22, 2015, 08:01:23 AM »

Marv,

The following has always bothered me: You have a rig, you measure and come up with graphs and plots. Now you use the same HP and connect it to a source, dac and amp. Clearly, the afore-mentioned three will most likely vary from person to person. So what is then the correlation between the generated graphs and what you actually hear ? Granted, it should be very close but source "coloring" could present a different picture right?

Frequency response, CSD, and distortion, etc. are crude measurements only capable of distinguishing gross, but not minute differences.

FR and CSD are based on impulse responses which in turn are derived from noise or sweeps. To get FR or CSD, we need to process the impulse response through a time window. FR is an averaged response for each excited frequency through such a time window. In essence, all information of how a sound wave changes in time is lost. That's the trade-off for getting a nice visualization / presentation that we humans can understand.

We can always look at the waveform through time, however humans cannot decipher waveforms in a visual sense. Waveforms are not a good visualization for helping us understand how something sounds like.

For distortion measurements, those reflect only one excited frequency in a steady-state. Unfortunately, music does not comprise of steady state single frequency signals.

This is why so few measurements on DACs and amps. Unless there is something horribly wrong, the measurement differences are minute and below the theoretical threshold of audibility. In fact, not just minute, but dominated by the transducer. Transducer non-linearities are magnitudes higher than those of DACs and amp.

It's very strange. Global negative feedback will do wonders for measurements like lower distortion, but too much feedback, we collapse the soundstage, kill PRAT, kill liveliness, make things sound dead. The challenge is balancing (clean sounding but dead) vs. (dirty but lively) with the right amount of feedback. The point is that there something missing from the current suite of typically used measurements. As far as I know, there isn't much that can "measure" soundstage or PRAT other than our ears.
Logged

Sorrodje

  • excusez-moi, je suis français
  • Able Bodied Sailor
  • Pirate
  • ***
  • Brownie Points: +68/-8
  • Offline Offline
  • Posts: 617
  • Olivier Le Vasseur - "La Buse" - French Pirate.
    • Tips & tricks for Ubuntu or Debian administration (French)
Re: MEASUREMENT FAQ
« Reply #6 on: April 22, 2015, 08:16:33 AM »

Adding some external links such as Tyll's articles could be helpful and complementary of this FAQ too .

i plan to write to complete series of article in french to sum up the whole problematic :

1. read and understand Measurements
2. Correlate measurements and sound
3. Correlate measurements , sound and music enjoyment.

IMO very few people understand the whole mechanism and I often meet people who don't understand how frequency response can affect the perception of the music. Very few people know something abou harmonics for example. 

Kudos to Pyrates who take the time to share their knowledge.  it"s a small light in an ocean of obscurantism .

knerian

  • Mate
  • Pirate
  • ****
  • Brownie Points: +26/-4
  • Offline Offline
  • Posts: 328
Re: MEASUREMENT FAQ
« Reply #7 on: April 22, 2015, 08:54:22 AM »

Please ask questions. This includes newcomers or lurkers.

Can you recommend some common or popular headphones with high levels of distortion, and those with very low distortion, so that any of us who have heard or own those headphones can try to listen for the difference?
Logged

thegunner100

  • Hentai Master Chief
  • Able Bodied Sailor
  • Pirate
  • ***
  • Brownie Points: +42/-4
  • Offline Offline
  • Posts: 443
  • A chubby anime cat
    • The Emotional Skyscraper
Re: MEASUREMENT FAQ
« Reply #8 on: April 22, 2015, 01:03:26 PM »

Great post, Marv. I think Tyll's talk at Axpona on "Finding Flat: How to Interpret Headphone Measurements" will be a pretty interesting addition to the information that you provided here.
Logged

atomicbob

  • Able Bodied Sailor
  • Pirate
  • ***
  • Brownie Points: +143/-0
  • Offline Offline
  • Posts: 143
Re: MEASUREMENT FAQ
« Reply #9 on: April 22, 2015, 01:36:11 PM »

This may not be the best place for these thoughts but I am reflecting upon measurements biasing impressions of a headphone.

RE: other influences that may bias one's impression of a headphone:

1. acute pain from injury or surgery
2. terrible mood from bad day (work or otherwise)
3. great mood from good day (work or otherwise)
4. libations
5. sleep deprivation
6. stress
7. new toy syndrome

you get the idea. this is not a comprehensive list.

In my opinion, it takes living with a headphone for a period of time, through many situations, to assess how it fits with one's personal preferences. As mentioned, the measurements are a tool, albeit one that is likely to be more consistent over time than we humans.
Logged
auditory illumination
Pages: [1] 2 3 4 5 6