SVS PB12-Ultra vs. Axiom EP-500 Blind Test

B

bray

Audioholic Intern
pfft

brian
I guess you have done some tests also.
Point me to em, I'd like to read.
BTW: I own a VTF3MK2 and like it very much. Do you have any test data on it? Like I said " I appreciate people who spend their own time and $$$ on tests."
 
MacManNM

MacManNM

Banned
Duffinator said:
Brian, this really gets off tangent with the statistical significance of a random sample. Not sure what that would prove anyway as audio preferences are so subjective and personal. I've never seen any reviews/tests done this way before. ;)

Mac, do you have a link for a sub review you can share with us that uses the methodology you previously described? We've all seen plenty of reviews that take measurements of subs but I'm referring to a DBT using separate rooms and all. Thanks.

Duff,
I don't think using 2 rooms is the way to go, as adult humans detailed sonic memory is about as retentive as my 8yr old son and remembering to do his homework. There haven't been a whole lot of DBT's done with subs because of the fact that they are so difficult to get dialed in and such. I am just trying to let people know how difficult a test like this really is.


Craig put a lot of effort into this, and he did a fine job. I just don't want people to base their decision on one test like this, especially when it pretty much disagrees with measurements (that I have seen in the past). Everyone is all up in arms, and I guess I got a little huffy back there too. Sorry about that. I am here to try and help people (mainly new people) by giving them as much information, and advice as I possibly can.
 
Tomorrow

Tomorrow

Audioholic Ninja
What is it here, guys? I really don't understand your objections.

The conditions were explained. It was admittedly a subjective and in-home test. It was meant to be an evening's entertainment, making new friends, having some good chow, and included making some subwoofer comparisons. No one, especially Craig, has said that it was a scientifically correct DBT with all parameters controlled. But he DID tell you WHAT he controlled. No one made any claims beyond what the setup was and what the listening experience was. Several 'subjects'/guests gave their experience of the subs under those conditions and in Craig's listening room. Readers of subsequent posts know all that. No one is representing this as science and/or trying to influence people to buy Axiom subwoofers as you imply, Mac.

I haven't seen one of the reporters say it was a valid test under rigid, controlled conditions. This is no different than me going to a listening room in a Hi-Fi store and auditioning speakers. I can give you my impressions, comparing speaker types, and no one will bash me for not keeping my review to you in the arena that Mac wants from the Axiom/SVS GTG. I'll tell you the conditions and my opinions. Just because he used a panel, makes no matter, nor a difference.

A happy Hsu owner.
 
MacManNM

MacManNM

Banned
rjbudz said:
What is it here, guys? I really don't understand your objections.

The conditions were explained. It was admittedly a subjective and in-home test. It was meant to be an evening's entertainment, making new friends, having some good chow, and included making some subwoofer comparisons. No one, especially Craig, has said that it was a scientifically correct DBT with all parameters controlled. But he DID tell you WHAT he controlled. No one made any claims beyond what the setup was and what the listening experience was. Several 'subjects'/guests gave their experience of the subs under those conditions and in Craig's listening room. Readers of subsequent posts know all that. No one is representing this as science and/or trying to influence people to buy Axiom subwoofers as you imply, Mac.

I haven't seen one of the reporters say it was a valid test under rigid, controlled conditions. This is no different than me going to a listening room in a Hi-Fi store and auditioning speakers. I can give you my impressions, comparing speaker types, and no one will bash me for not keeping my review to you in the arena that Mac wants from the Axiom/SVS GTG. I'll tell you the conditions and my opinions. Just because he used a panel, makes no matter, nor a difference.

A happy Hsu owner.
My objection is that everyone is calling it a DBT, the parameters were set up similar to a DBT, but it was not a DBT. A DBT should be more objective, and as not subjective. The only thing similar is that the panel couldn't see the subs! Anyone who reads this is going to infer that it was done scientifically and that the Axiom is far superior. Not that I care about Axiom or SVS, but the point is, the test is misleading. A review is a review, it is subjective, a DBT is not.
 
Last edited:
brian32672

brian32672

Banned
Duffinator said:
Brian, this really gets off tangent with the statistical significance of a random sample. Not sure what that would prove anyway as audio preferences are so subjective and personal. I've never seen any reviews/tests done this way before. ;)
Well if we were talking about a DBT for coke and Pepsi I would say no.
But there are just to many likes and dislikes when it comes to music.
So for a DBT to truly have some kind of bearing, I would think you would need 11 people that like Rap, 11 that like Rock, 11 that like Classical, etc...
Then numbers could actually be posted on these that have a little bearing.
With movies there should be no problem, becuase the person who may dislike the movie would have seen/heard it with both subs.

Personally I like all music. But I know that when I was younger I just could not stand Rap and Country music. So most 20 and younger would be disgusted to even listen to a music they dislike for a test. So the option to give them their music preference to be listened to on both units IMO would be better. Granted either way it is still subjective.


bray said:
brian
I guess you have done some tests also.
Point me to em, I'd like to read.
BTW: I own a VTF3MK2 and like it very much. Do you have any test data on it? Like I said " I appreciate people who spend their own time and $$$ on tests."
Your replies really require no comment.
Seriously you have not said anything that I have not seen that is not just another persons reply.
Meaning it looks as though you travel between forums and just pick up the idea that these test are great.
And that you are voicing the opinions of what other people say.

Stupid me, I did get involved with this post. So I will answer your question.
Yes I have done some subjective tests. And by no means would I tell someone to go by my tests (I don't think Craig has either).
I would have to clearly say take a subjective test with a grain of salt.
Every person will have likes and dislikes of what sounds good to them.
I am just now starting to get ready and jump the gun to do scientific tests.
And go out and get a Behringer ECM8000 and mic preamp.
Even then, I would say that the measurements although scientific - Should still be based on a persons own listening tests.
Granted true measurements should have more bearing on the tests that were concluded over subjective.
 
Matt34

Matt34

Moderator
MacManNM said:
No that is your opinion. My only point is that to an unknowing person, this fun little experiment could be construed by someone that is not knowledgeable, as pure fact. As all the results tend to be in agreement by the "panel". This would indicate to someone that the Axiom is the superior unit, when in fact all of the 3rd party measurements I've seen indicate that the SVS outperforms the Axiom. Now, obviously sound quality, and measurements can't be correlated, so that means Craig's test is right, and the Axiom is better. I don't believe it. I believe the difference must have been large for all of the people to notice it, and since they all noticed it, it would indicate a flaw in the procedure. Measurements say that the 2 units should sound much more similar.
Actually there was one that didn't put the Axiom first and Rijax called it a "wash" between the two. Reread some of the other comments, it wasn't as clear cut as you believe.

So according to you, all this fuss is for the little guy that might take this "GTG" as being the gospel to testing a subwoofer? Get real.
 
MacManNM

MacManNM

Banned
Matt34 said:
Actually there was one that didn't put the Axiom first and Rijax called it a "wash" between the two. Reread some of the other comments, it wasn't as clear cut as you believe.

So according to you, all this fuss is for the little guy that might take this "GTG" as being the gospel to testing a subwoofer? Get real.

I am real, people do it all the time, we see it time and time again on this forum. Bose comes to mind, or is that something else?
 
Matt34

Matt34

Moderator
Well as the old saying goes, you can lead a horse to water.....;)
 
bossobass

bossobass

Enthusiast
MacManNM said:
Duff,
I don't think using 2 rooms is the way to go, as adult humans detailed sonic memory is about as retentive as my 8yr old son and remembering to do his homework. There haven't been a whole lot of DBT's done with subs because of the fact that they are so difficult to get dialed in and such. I am just trying to let people know how difficult a test like this really is.

I am here to try and help people (mainly new people) by giving them as much information, and advice as I possibly can.
Again, I must say that it's great to have a treasure trove of absolute fact hangin' around to straighten out the noobs.

Though I won't match my 'sonic memory' to your son's homework completion rate, I'll tell ya that this statement is pure hooey in any case. So is saying that blind tests haven't been conducted because it's so hard to dial a sub in.

'Sonic memory' Sheesh.

The listening test was not hard at all. Everyone should try it when auditioning a new sub.

1. Set them in the same spot.
2. Phase and/or polarity optimize them.
3. Level match them.
4. PEQ them to within +/- 3 dB across their bandwidth.
5. Play the same source material through each one.
6. Decide which one sounds the best to you, and why.

Craig took care of steps 1-5, inclusive. I said which one I liked best and why...simple. I've done similar tests to decide which sub I like in my system at least 100 times, using 3 dozen subwoofers.

NOTES:

1. It's entirely impossible to place them identically. One sub is front-firing, one is down-firing. One sub fires into free air, the other fires coupled to a baseplate.
2. A sub may have a phase switch, an all pass filter with continuously variable control, or both. Disadvantage goes to the sub with less control, and so be it.
4. More or less PEQ may be needed for one sub or the other because of a sub's configuration and in-room FR. Disadvantage to the sub that needs more PEQ to arrive at +/- 3 dB and so be it.
5. The source material was decided that day by consensus of the listeners, who all agreed that the movie soundtrack clip would be run at +5 dB, all other material played with the subs leveled to the sats.
6. Saying that one can't remember how the last sub sounded because there was a lapse of 15 minutes in between listening (which included an immediate review of how the last sub sounded on paper, in subjective terms and in score form) is nonsense. Please post links to the various studies that have proven it a fact that an experienced bass player, or the mix enginerr, or the mastering engineer has a sonic memory of only a few seconds instead of telling everyone that this nonsense is true.

Fact is that you can't change a sub's sonic signature within the parameters of Craig's test, which is what all the naysayers have tried to say from the onset.

Fact is that every listener caught the 5 dB hump that Craig induced at 25 Hz on one of the subs, which proves that a nearfield placement will reveal small imperfections regardless of any given human's perceptions of what bass should sound like.

Fact is that, if you were to decide which sub to buy, the test Craig set up is a much better way than to read graphs of subs. The graphs may help you to narrow down your choices based on room size, listening preferences, source material preferences, and like that, but listening in your own system is the bottom line, after which you can use features, size, upgradeability and price to tip the scales, if necessary.

Fact is that you don't want a cross section of people who never heard a MC system or a subwoofer in their lives to offer an opinion of which subwoofer you might want to purchase. If you really do want that...good luck, and let us know how it worked out for you.

Get off your high horse with the DBT factoids. It isn't teaching anyone anything.

Bosso
 
Tomorrow

Tomorrow

Audioholic Ninja
Matt34 said:
So according to you, all this fuss is for the little guy that might take this "GTG" as being the gospel to testing a subwoofer? Get real.
Yep, we gotta save the 'stupid' people from themselves...and we'll do it with scientific protocols, hyper-expensive test equipment and room treatments, non-industry related funding, and a few uber-do-wa-diddy engineering expressions and jargon. THEN, these 'stupid' little-guys will understand...and not be taken in! LOL. You know what...I'll wager that the 'stupid' people, naive as they must be...don't even know or care what the DBT acronym stands for, much less what it is. How will we EVER care for the poor, mentally impoverished, little-guy, 'stupid' people. (Maybe we'll let them actually listen before we make them buy speakers, heh heh.)

Life's challenges are immense. Doncha think?! ;)
 
jaxvon

jaxvon

Audioholic Ninja
I'm with Mac on this one. While Craig's effort was commendable and the test decently exhuastive, it is NOT a DBT. The only true way to perform such a test would be in a laboratory, such as the Harman lab. The Harman lab allows for each speaker/subwoofer undergoing testing to be placed in the exact same position so that as many variables as possible are eliminated. Is this possible in a person's home? No way. Must we test under laboratory conditions to obtain usable data and call it a DBT? Absolutely.
 
MacManNM

MacManNM

Banned
bossobass said:
Again, I must say that it's great to have a treasure trove of absolute fact hangin' around to straighten out the noobs.

Though I won't match my 'sonic memory' to your son's homework completion rate, I'll tell ya that this statement is pure hooey in any case. So is saying that blind tests haven't been conducted because it's so hard to dial a sub in.

'Sonic memory' Sheesh.
Read some papers on human hearing. Humans can only recall sounds to ~+-5db after somewhere around 30 seconds.

bossobass said:
The listening test was not hard at all. Everyone should try it when auditioning a new sub.

1. Set them in the same spot.
2. Phase and/or polarity optimize them.
3. Level match them.
4. PEQ them to within +/- 3 dB across their bandwidth.
5. Play the same source material through each one.
6. Decide which one sounds the best to you, and why.

Craig took care of steps 1-5, inclusive. I said which one I liked best and why...simple. I've done similar tests to decide which sub I like in my system at least 100 times, using 3 dozen subwoofers.

NOTES:

1. It's entirely impossible to place them identically. One sub is front-firing, one is down-firing. One sub fires into free air, the other fires coupled to a baseplate.
2. A sub may have a phase switch, an all pass filter with continuously variable control, or both. Disadvantage goes to the sub with less control, and so be it.
4. More or less PEQ may be needed for one sub or the other because of a sub's configuration and in-room FR. Disadvantage to the sub that needs more PEQ to arrive at +/- 3 dB and so be it.
5. The source material was decided that day by consensus of the listeners, who all agreed that the movie soundtrack clip would be run at +5 dB, all other material played with the subs leveled to the sats.
6. Saying that one can't remember how the last sub sounded because there was a lapse of 15 minutes in between listening (which included an immediate review of how the last sub sounded on paper, in subjective terms and in score form) is nonsense. Please post links to the various studies that have proven it a fact that an experienced bass player, or the mix enginerr, or the mastering engineer has a sonic memory of only a few seconds instead of telling everyone that this nonsense is true.

Fact is that you can't change a sub's sonic signature within the parameters of Craig's test, which is what all the naysayers have tried to say from the onset.

Fact is that every listener caught the 5 dB hump that Craig induced at 25 Hz on one of the subs, which proves that a nearfield placement will reveal small imperfections regardless of any given human's perceptions of what bass should sound like.

Fact is that, if you were to decide which sub to buy, the test Craig set up is a much better way than to read graphs of subs. The graphs may help you to narrow down your choices based on room size, listening preferences, source material preferences, and like that, but listening in your own system is the bottom line, after which you can use features, size, upgradeability and price to tip the scales, if necessary.

Fact is that you don't want a cross section of people who never heard a MC system or a subwoofer in their lives to offer an opinion of which subwoofer you might want to purchase. If you really do want that...good luck, and let us know how it worked out for you.

Get off your high horse with the DBT factoids. It isn't teaching anyone anything.

Bosso
This entire portion of this post by you is worthless. By putting the subs in the same place you guaranteed that it was going to be screwed up. Like I have been saying, one is front firing front vented, the other is down firing, rear vented. that right there pretty much guarantees different modes in the room are going to be excited. Unless of course they were in the middle of the room. Were they in the middle? didn't think so. So I will stay on my high horse, If this is a subjective shootout then just say so, but it is by no means a proper DBT, and you shouldn't be calling it that.
 
bossobass

bossobass

Enthusiast
MacManNM said:
Read some papers on human hearing. Humans can only recall sounds to ~+-5db after somewhere around 30 seconds.
Provide a link to this revelation of yours. Please include a brief statement as to it's relevance to the listening test.

This entire portion of this post by you is worthless. By putting the subs in the same place. Like I have been saying, one is front firing front vented, the other is down firing, rear vented. that right there pretty much guarantees different modes in the room are going to be excited. Unless of course they were in the middle of the room. Were they in the middle? didn't think so. So I will stay on my high horse, If this is a subjective shootout then just say so, but it is by no means a proper DBT, and you shouldn't be calling it that.
I believe that Craig has only ever referred to the session as blind listening. I think you are the one calling it a DBT.

"you guaranteed that it was going to be screwed up." Pretty technical term there.

Placing the subs in the middle of the room would do what, exactly?

Actually, the session turned out quite well. You are free to do it differently and report back to us, as was mentioned earler in the thread, but we all know that will never happen.

Bosso
 
MacManNM

MacManNM

Banned
bossobass said:
Provide a link to this revelation of yours. Please include a brief statement as to it's relevance to the listening test.



I believe that Craig has only ever referred to the session as blind listening. I think you are the one calling it a DBT.

"you guaranteed that it was going to be screwed up." Pretty technical term there.

Placing the subs in the middle of the room would do what, exactly?

Actually, the session turned out quite well. You are free to do it differently and report back to us, as was mentioned earler in the thread, but we all know that will never happen.

Bosso
Here is the first panel member. This was what he and his son thought...


Quote:
My impressions of the subwoofer GTG-DBT

Six people including myself were invited to Craig’s house for the DBT. Craig would not be participating in the evaluations since he was in charge of changing out the subs in between the audio demos. Though we all knew from the forum that there was the potential for six subs to be evaluated, we were not told which ones we would be listening to.
Im not going to provide you with a link. Look it up yourself. There are hundreds of studies out there. Besides If I produced a paper on it you would just discredit it anyhow, just like you guys are trying to do to Illka measurements. Ok instead of "you guaranteed that it was going to be screwed up." I guess i could say that you were introducing different modes with each of the subs due to the fact that the port direction and woofer firing direction is different on the two units. This is why placement and the dialing in of each of the subs is critical.


Placing the subs in the middle of the room would remove any loading characteristics introduced by the walls or nearby corners. Also it would mitigate the directionality of the vent/woofer configurations.

I was not the first to call it a DBT, one of you did.
 
Last edited:
mulester7

mulester7

Audioholic Samurai
silversurfer said:
That's because sound quality and SPL do not have a very direct corolation
.....statement of the thread, imo.....
 
bossobass

bossobass

Enthusiast
MacManNM said:
Im not going to provide you with a link. Look it up yourself. There are hundreds of studies out there. Besides If I produced a paper on it you would just discredit it anyhow, just like you guys are trying to do to Illka measurements. Ok instead of "you guaranteed that it was going to be screwed up." I guess i could say that you were introducing different modes with each of the subs due to the fact that the port direction and woofer firing direction is different on the two units. This is why placement and the dialing in of each of the subs is critical.


Placing the subs in the middle of the room would remove any loading characteristics introduced by the walls or nearby corners. Also it would mitigate the directionality of the vent/woofer configurations.

I was not the first to call it a DBT, one of you did.
I apologize for Jeff's mistaken DBT title. He's new at this hobby, but he's really an intelligent guy. He's catching on very quickly, too. Still, citing this mistake is kinda weak. As I said, Craig has not called it a DBT.

I appreciate the admonishment to look up one of hundreds of 'human hearing studies' that prove that a human can't remember what the sub he listened to 15 minutes ago sounds like, but you can see why I wouldn't do that. Well, no, you wouldn't. It's because there is no such study, let alone hundreds of them.

Please ask Ilkka if I ever attempted in any medium to discredit any measurement he ever took. Quite the opposite. I think he's very adept at the ones he takes, and have said so many times. But then, he'll tell you that himself. (I knew there was a splinter in your butt by your posts, I guess this is it, that is that 'we' have tried to discredit Ilkka, whose measurements clearly somehow show that one sub sounds better than another, so Craig has set everyone up to 'prove' it by rigging a...man, ain't worth the effort to type the rest).

Now, you are saying that a center-of-the-room placement and 'dialing in' are the critical mistakes in Craig's set up?

I just can't get over you arm chair haters. Never did anything to advance the learning curve. Don't know anything about the subject beyond what you googled an hour ago. Quick to discredit anyone, at a moments notice, over nothing.

We can keep this up until someone shuts us down. In the meanwhile, it would be good of you to say something that you can back up.

Bosso
 
Tomorrow

Tomorrow

Audioholic Ninja
TE=jaxvon]I'm with Mac on this one. While Craig's effort was commendable and the test decently exhuastive, it is NOT a DBT. The only true way to perform such a test would be in a laboratory, such as the Harman lab. The Harman lab allows for each speaker/subwoofer undergoing testing to be placed in the exact same position so that as many variables as possible are eliminated. Is this possible in a person's home? No way. Must we test under laboratory conditions to obtain usable data and call it a DBT? Absolutely.
This is a silly game of words. It most assuredly is a DBT. It's not a DBT that follows perfect scientific protocols....but nobody...nobody has said that it did. Further, the 'data' in the form of the reports of the participants is perfectly usable. One must take the reports for what they are. To say it is unusable and the format MUST be scientific is beyond ridiculous. Why should it be scientific? These aren't scientists. They're reporters and listeners, and in Craig's case, a reportedly delightful host.


I thank the participants for their reports and interest in sharing with us. And you're correct, Jax, the effort is commendable.
 
S

silversurfer

Senior Audioholic
agarwalro said:
Incorrect. I am too lazy to find it, but there is research to show that higher SPL is generally perceived as sounding better.
Agreed and for that case, all speaker reviews should have info on how loud the reviewer played the evaluation material.
No...correct. Because something can play louder does not mean it sounds better at normal level.

When comparing speakers, they should be level matched, because the one playing louder is most ofter peceived as sounding better.......maybe that is what you meant.
 
S

silversurfer

Senior Audioholic
mulester7 said:
.....statement of the thread, imo.....
thanks. IMO, people who think louder is better are also the ones that only know how to drive in a straight line. :)
 
Sheep

Sheep

Audioholic Warlord
It can't be a DBT without any Data!

No graphs, No measurements, No nothing, NO DBT.

Craig and the people involved are not calling it a DBT. Its a BLIND LISTENING TEST....BLT! :D mmmm

Anywho, One thing that has been touched on, but never really put out there, is this,

OPINIONS!!! IMO, IMO, IMO!!

Put that at the beginning of every post!

The people partaking in this event offer their OPINIONS.

Use it as a guide line, but until you have measured all these subwoofers, you cannot argue either way.

Come on guys....

SheepStar
 

Latest posts

newsletter

  • RBHsound.com
  • BlueJeansCable.com
  • SVS Sound Subwoofers
  • Experience the Martin Logan Montis
Top