Memory Manufacturers Could be Cheating 223
Mark Brown writes "Tom's Hardware is live-testing DDR2 memory products in order to determine whether memory manufacturers submit cherry-picked products for reviews. 'GeIL DDR2-667 that was claimed to be purchased performed worse than the review samples they got: 471 MHz for the review samples vs. 421 MHz for the retail memory.'"
CHEATING!?! (Score:2, Funny)
In other words, set their affairs in proper order...
Re:CHEATING!?! (Score:2)
No, it's illegal for memory companies to marry other memory companies in the United States (except in Massachusetts).
You can't trust reviewers (or even specs) (Score:3, Funny)
O'RLY (Score:5, Insightful)
I'm shocked!
Re:O'RLY (Score:2, Insightful)
And I doubt that the products they send out differ as much as this.
Re:O'RLY (Score:2)
Re:O'RLY (Score:2)
Notice that the article only posts the results from one review model and one retail model. For all we know, the author could have cherry-picked the retail model just to create a lucrative, ad-revenue-whoring "scandal". Given Tom's history, that's the more likely explanation.
Re:O'RLY (Score:3, Insightful)
Re:O'RLY (Score:2)
Re:O'RLY (Score:3, Informative)
Geil sells over-specced memory, specially targeted at the overclocking crowd. They cost significantly more than "regular" memory because of that ability to be pushed way beyond normal speeds, so that you can run them in sync with the system bus and get the fullest bandwidth, rather than using a clock divider. It's a very unique market, one that doesn't matter to most people because the real-life performance gains are ne
In Other News... (Score:5, Insightful)
... Advertisers are STAGING their product photo shoots
... etc
Quantitative is the key. (Score:2)
If you could say.. foster that doubt sufficiently, you might be able to make a business out of buying and benchmarking hardware, hand picking the good stuff and selling it at a boosted price as "guaranteed best."
Then throw a "credited rating system" around it, and you could potentially have a nice little middleman racke
Re:Quantitative is the key. (Score:2)
Re:In Other News... (Score:2)
Re:In Other News... (Score:2)
Even if they did picked a fast part intentionally, I'd say that's less underhanded then the companies that put out ads themselves (as opposed to a third party doing it for "free" (technically in exchange for the hardware)) and intentionally put non-typical stats in b
No way (Score:5, Funny)
Re:No way (Score:5, Funny)
BEDEVERE: What does it say?
GALAHAD: What language is this?
BEDEVERE: Brother Maynard, you are a scholar.
BROTHER MAYNARD: It is Aramaic!
GALAHAD: Of course. dg41 of Aramathea!
ALL: Of course.
ARTHUR: What does it say?
BROTHER MAYNARD: It reads
*EXCITEMENT*
"No way, there can't be anyone making dishonest or cheap mem... PAGE_FAULT_IN_NONPAGED_AREA"
ARTHUR: What?
BROTHER MAYNARD: "The PAGE_FAULT_IN_NONPAGED_AREA..."
BEDEVERE: What's that?
BROTHER MAYNARD: His computer must have crashed while typing it.
BEDEVERE: Oh, come on.
BROTHER MAYNARD: That's what it says.
ARTHUR: But if his computer was crashing, he wouldn't bother to type "PAGE_FAULT_IN_NONPAGED_AREA". It would just crash.
BROTHER MAYNARD: It's down there typed on slashdot.
GALAHAD: Perhaps he was dictating.
ARTHUR: Shut up. Is that all it says?
BROTHER MAYNARD: That's all. "PAGE_FAULT_IN_NONPAGED_AREA".
ARTHUR: "PAGE_FAULT_IN_NONPAGED_AREA".
Re:No way (Score:2)
-Rick
Re:No way (Score:2)
Well, duh! (Score:5, Insightful)
Re:Well, duh! (Score:3, Insightful)
I don't see nerds lining up to donate money for hardware testing that they will never get to own, however.
Re:Well, duh! (Score:3, Interesting)
Re:Well, duh! (Score:5, Informative)
Product reviews in general are a bit more difficult. Although the aforementioned Consumer Reports has a great thing going for them in purchasing products from stores, the thing is that they can AFFORD to do that. Most publications and websites can't, forcing them to rely on review samples. Car companies in particular are notorious for fine-tuning their review vehicles, which why Consumer Reports is highly respected for their year-end car accolades.
Hardware Swap Idea (Score:5, Interesting)
Re:Hardware Swap Idea (Score:3, Informative)
Re:Hardware Swap Idea (Score:2)
Re:Well, duh! (Score:2)
Yeah, I'm off topic, but you reminded me of the importance of anonymity in big name reviews.
HARDOCP started doing something similar (Score:5, Informative)
What they are doing is having other people buying systems and then reviewing those systems. They will only review systems where they have an agreement with the manufacturer that the computer can be returned at the end of the review. The key is that the manufacturer never knows who is getting a system which may be subject to review.
It actually works well for both parties. Some manufacturers are proactive in the forums and even acted on complaints received, strengthing their processes.
How many did they buy? (Score:4, Insightful)
Re:How many did they buy? (Score:2)
A retailer may have stock that was manufactured several months prior. The direct-sent stock would be the latest most improved stuff. What if they optimized their process in the meantime? Perhaps all current stock matches specs roughly and they've compared old apples to new apples.
Re:How many did they buy? (Score:2)
to be fair they should test many more than that and show a distribution of possibilities.
That may be too expensive for most though.
What's the variance? (Score:4, Insightful)
Re:What's the variance? (Score:2)
Re:What's the variance? (Score:2)
DDR2 comes in 400
Re:What's the variance? (Score:2)
Peak performance for overclocking is defined by most review sites as the maximum frequency at which stable performance can be obtained. There would be no variance, aside from normal component degredation over time, since the test is a "stress test." That is, they run the same test over and over at a given frequency until t
I wonder... (Score:2, Insightful)
Re:I wonder... (Score:2)
Tom's has nothing to complain about (Score:5, Insightful)
Tom's is complaining about something totally different. They are seeing how well the memory will overclock. But the manufacturer makes no claims about how well it will overclock. They explicitly tell you that they cannot guarantee what will happen. This is a reasonable position on their part.
But what Tom's is asking is for all memory from a given manufacturer to overclock the same. This is crazy. The manufacturer has every right to switch production methods and to make other changes which could affect overclocking performance. The only question should be: does the memory perfom as specified.
If you overclock your memory and it works well, good for you. But you have no right to complain if overclocking doesn't work as well as you want!
Re:Tom's has nothing to complain about (Score:2)
Re:Tom's has nothing to complain about (Score:2)
Re:Tom's has nothing to complain about (Score:5, Insightful)
THANK you.
Since the retail product and review sample were both rated as DDR2-667 (or is it 553? Depends on whether you're reading page 2 or page 2 of the "article"), neither one needed to perform reliably at memory clock rates any higher than 333.5MHz. That the retail product didn't fail until it was overclocked to 25% more than its rating suggests to me that it's solid kit.
I would also hesitate to conclude from the findings that any hardware vendor routinely sends out review samples that outperform retail units. We only have TWO data points here, not enough to extrapolate any type of meaningful findings. For all we know, a different review sample from the same manufacturer would fail at only 340MHz.
Re:Tom's has nothing to complain about (Score:2)
I don't know if I care for the methodology here (the sample size seems too small to draw good conclusions), but it certainly could prove to
Re:Tom's has nothing to complain about (Score:4, Insightful)
Some thoughts on DRAM quality (Score:2)
Given that lack of information, I may still be able to explain a bit... Though I no longer work for a memory manufacturer, I do work for a semiconductor manufacturer, and the failure mechanisms of chips are still the same (DRAM or not)...
Re:Tom's has nothing to complain about (Score:2)
If you want ram that will go to Xmhz, buy ram advertised to go to Xmhz. They can put out "DDR-533, but will easily hit XYZ" ram out.
Re:Tom's has nothing to complain about (Score:2)
If Tom's wants to get a
Re:Tom's has nothing to complain about (Score:2)
Personally, I generally don't do overclocking, so maybe I'm a bit biased, but it does seem a bit much to complain that you can "only" get 25% faster than
Re:Tom's has nothing to complain about (Score:2)
I'm sure the majority of
methodology questions (Score:4, Insightful)
I'd be a little happier with running a memory test and running at progressively faster speeds until it detects an error. Some memory errors might not cause the system to crash
2) They have two "identical" systems
How do they know that all the components in the identical systems really have exactly the same specs? It would be more fair use just one system, or after the tests complete to swap the ram and re-run.
Re:methodology questions (Score:2)
I don't really see the problem (Score:5, Insightful)
The ram met and far exceeded it's rated clock speed. Sure the give good stuff to reviewers. If the review sites want to do valid tests of which brand of ram is the best for over clocking they would have to purchase multiple samples of each brand from the retail channel.
When overclocking the truth is your results may very. If you are pushing past specs then some will work and some will not. Heck even different production batches will give different averages.
Re:I don't really see the problem (Score:3, Informative)
Specs are for advertising. (Score:5, Insightful)
Why should this be different? When a company ships a product to be reviewed and tested, they'll ship the best. When they test their own, they'll test the best. You should NEVER accept that specs are factual, and you should spend some time confirming what you bought.
This is the great thing about specs -- if they're lies, just return the product. If a company lies enough, the customers will go elsewhere.
It is really all common sense.
No, not so much (Score:2)
Thus, if your system requires DDR2 667, you need to make sure you buy it, otherwise your sys
Re:Specs are for advertising. (Score:2)
What a lot of it boils down to is that the consumer doesn't do the work requi
manufacture gimmied the motherboard (Score:2, Insightful)
In summary (Score:3, Insightful)
TWW
I could be mistaken... (Score:3, Informative)
Still better than its ratings (Score:3, Insightful)
"Its DDR2-667 memory......"
"maximum clock speed of 471 MHz, which corresponds to DDR2-942"
vs
"a memory clock of 421 MHz (DDR2-842)"
So its more than 20% faster than what it is rated at... Whats the big deal? Everyone knows there are certain processors/memory modules from the same exact part# that outperform others. This has been the case since before the Celeron 300a even. If the memory performed below its rating, then there would be a problem
The Way I See It (Score:2, Insightful)
Naive (Score:5, Insightful)
Recall the hubub from as recently as a half-decade ago, when video card manufacturers were rigging their drivers (or the cards themselves) to recognize when they were being asked to draw the same patterns over and over again (like, say, 10,000 colored boxes, or circles... like benchmark programs do) and would silently decide to perform only a fraction of them to jack the benchmark numbers up?
Never, ever trust the results from an item that the company sent you when they knew you were a reviewer. You should just go out and buy one off the shelf in a store. If you can't afford to do that, buy one from a store and ask the company for a review sample, return the sample to the store and test the, now free, one that you got "in the wild", as it were.
Re:Naive (Score:2)
For example, if Game X were drawing water a specific way, and nVidia cards could render the exact same water more quickly using a different way while retaining the same qual
Cheating what, exactly? (Score:2)
If Tom's Hardware has a problem with this perhaps they should stick to real-world benchmarks and purchase all the equipment they test for review, instead of trusting manufacturers to "help" them. Its very unprofessional of them to work so closely with the businesses they are supposed to be reviewing..
FUD, I'd say (Score:5, Informative)
I'm an engineer who designs memory modules. In most cases, our modules are overclockable, at least to some degree - some go faster than others. At the sort of speed that Tom's Hardware is running, I'm not really surprised that there's more than a 2 or 3% variation in performance, espeically if the chips on those modules came from different manufacturing lots. At the outer limits of memory speed performance, the tiniest changes in parasitic capacitance can be death to performance - and those values change from lot to lot, even from wafer to wafer.
When manufacturers specify that 2% to 3% tolerance, they're referring to the module's performance at its rated speed, and that makes sense. Plug two modules into a system and they will run in virtual lockstep - at their rated speed. There are a million analogies that I could use, but the bottom line is that there are assumptions and statements in Tom's article that just aren't right.
Maybe the module was cherry-picked and maybe it wasn't, but, if nothing else, a sample of two doesn't make for much of a study. After all, if the retail module had been DOA, a pedantic person could say that GeIL cherry-picked the evaluation samples and sends all the defective modules to retail.
-h-
Want a good review of your product? (Score:3, Informative)
Seriously. Many years ago, I worked as a technician for a (now defunct) major audio equipment manufacturer. When a writer from "Stereo Review" or "Audio" magazine came to visit, we'd play with the equipment a little, my Engineering boss would hand him some specs, and they'd go out on the town (leaving me to work the rest of the day {grumble, grumble}). A few months later, we'd see those exact specs printed in the magazine, along with some well-placed ads. I never believe a review I read in a trade publication.
Consumer Reports lacks technical expertise in many areas, but at least their approach has some level of integrity.
Consumer Reports is great (Score:2)
CR takes an approach that is valuable to the very largest number of people possible. Their computer reviews are probably uninteresting to a computer expert, and their auto reviews to a mechanic. But they provide useful high-level information that has one terribly useful characteristic -- it can be trusted.
It is *unbelivably* difficult to get information that can be trusted when you have whole
Re:Consumer Reports is great (Score:2)
No, it's more than that.
It's not an issue of what the average joe is looking for, it's an issue of what matters about a product.
Take the subject of this article, RAM. The person doing the review should be familiar with different types of RAM, key specs, test procedures, worst-case operating conditions, etc. The average Joe really just wants something that is going to work well for him, he is relying on CR to decide what
So If You Want The Best Stuff (Score:3)
just business as usual (Score:2, Interesting)
seriously think about it.... if you had a hot date, would you show up in a yellow wife-beater, messy hair and bad breathe, and ask her to pay the cab that's been waiting for them for the last 30 minutes?
wait wait (Score:2)
god, i wish sometimes that geeks were a tad bit more pragmatic, and would put themselves in the position of manufacturars (or anyone "regular" for that matter)
(no i don't deal in popular opinions. it's not my style)
I guess that's my experience (Score:2)
They say AMD stresses other components. It has been my experience for a couple years that if it says PC2700, for example, I better get PC3200 if I don't want lockups.
This would clarify a few things.
Re:Is this a surprise??? (Score:2, Insightful)
Re:Is this a surprise??? (Score:2)
Re:Is this a surprise??? (Score:2)
Re:Is this a surprise??? (Score:5, Informative)
The part of it that convinced me that they're right anyhow is the memory supply voltages. "Normal" on the cherry picked Gigabyte board was ~2.2V, normal on the storebought was ~1.83V (FVI 1.8V is the DDR2 spec supply voltage). You'll have to take my word for it, but THAT variation is huge. People who build computers do not tolerate voltage discrepancies like that, it's out of spec for the devices which usually allow 5% variation (1.71V-1.89V). You can verify this by going to Hynix/Micron/Infineon and pulling down a DDR2 component datasheet.
The headline is beyond wrong though, it's probably actually criminal. GeIL does not control the memory supply voltage (they make the DIMM), Gigabyte does (they make the mobo). GIGABYTE is cheating.
It's very easy to figure out if memory makers are cheating: take the heatsink off, look at the device part numbers and look them up. There's not a whole lot to tweak that doesn't involve a complete redesign of the DIMM. If they cheat it's almost always because they used a DDR2-400 device but branded their DIMM as DDR2-something_higher.
Re:Is this a surprise??? (Score:2)
As for taking the heat spreader off and looking at the PN's on the memory chips, there's no reason GeIL can't brand a 'DDR2-400' chip as DDR2-533 if it runs stable at that speed. Ditto for branding a 'DDR2-667' capable chip as DDR2-533.
Re:Is this a surprise??? (Score:2)
But the rest you're wrong, or a
Re:Is this a surprise??? (Score:2)
Re:Is this a surprise??? (Score:5, Insightful)
Hardly.
A DDR-667 chip (or more specifically, a PC2-5300 stick) is supposed to run at at 333 MHz. So one runs at 421 MHz and the other runs at 471 MHz. To me, it looks like both of those sticks are performing way faster than the specification requires.
Isn't this just the price the user pays for being too stingy to pay for a memory stick which is actually rated to run at 400 MHz in the first place?
Re:Is this a surprise??? (Score:3, Insightful)
So what you're basically saying is, someone is using the product outside of the product's operating specifications, and then bitching because some other guy was able to use it *further* outside of the operating specifications.
I still don't see the problem here, except perhaps the problem that overclockers are a little too enthusiastic about saving those extra few dollars.
Re:Is this a surprise??? (Score:3, Interesting)
The point is, it doesn't matter what the review was about, or what the user was doing. The reviewer of a product is taking the product, using it, or performing tests on it, and then using the information to inform the public, the consumers.
To really do that, they have to have sample of the product that is representative of what you can buy in the store. Its not like you could go out and buy a new memory stick from a retail store that was tested out and deemed
Re:Is this a surprise??? (Score:2)
Re:Is this a surprise??? (Score:2)
Re:Is this a surprise??? (Score:2)
Re:Is this a surprise??? (Score:2, Insightful)
Re:Is this a surprise??? (Score:5, Interesting)
Actually, it's innate human nature to think of things that way. Put a one pound weight in one hand, and a two pound weight in the other - virtually everybody will be able to tell the difference between the two. Now put a forty pound weight in one hand, and a forty-one pound weight in the other - very few people will be able to tell the difference, despite the fact that it's a difference of one pound in both cases.
The reason we perceive the two cases differently is that, in the first case, "B" is twice as heavy as "A", whereas in the second case, "B" is only 2.5% heavier than "A". Or if you don't have heavy objects handy, get a three-way lightbulb and a lamp to match. Notice how the jump from 50 to 100 watts seems like a bigger jump in brightness than the jump from 100 watts to 150 watts. That's because, in percentage terms, it is a bigger jump. It's how we're wired to see the world, in terms of percentage differences.
Re:Is this a surprise??? (Score:2)
Yes and no, generally speaking human senses work on a logorithmic scale.
Think about how sound loudness is measured. The decibel scale is logorithmic, as the sound gets louder it requires much more force to produce a result we can physically tell is "louder". Same for the other senses.
Re:Is this a surprise??? (Score:2)
>Yes and no, generally speaking human senses work on a logorithmic scale.
your saying the same thing.
I hope you click on the wiki Weber-Fechner law [wikipedia.org] of the other reply to understand that measuring perception that is a percentage change, requires a log scale to measure it, really the best explained math I have read in a while. (he didn't point out you were saying the same thing as the parent.)
Re:Is this a surprise??? (Score:2)
>Yes and no, generally speaking human senses work on a logorithmic scale.
lol, and you aren't wired mathematically.
Weber-Fechner law (Score:2)
Re:Is this a surprise??? (Score:3, Interesting)
Humans also perceive sound in a similar manner.
When the frequency of a sound is doubled, it's perceived one octave higher. (The frequency of a note f(n) = F 2^(n/12) where n is the note, 0 signifying the A above middle C, 1 signifying A#, 2 signifying B etc. and typically F = 440 Hz, i.e. the "concert pitch", or the frequency of the A above middle C.)
The loudness of a sound is also perceived in a logarithmic manner. The level of a sound must increase with an accelerating rate in order for us to perceive
Re:Is this a surprise??? (Score:2, Interesting)
Well, the article says the RAM is DDR2-667 which (I'm pretty sure) implies a clock rate of 333MHz (somebody correct me if I wrong). So gamers are still getting more than they paid for...
What I want to know is where do Tom's Hardware get off thinking this is statiscally significant? Basically their saying "We took one part from the suppliers, and one part from retail sources. The retail parts performed worse. OH MY GOD, that must mean t
Re:Is this a surprise??? (Score:2)
Depends on if my main focus is to sell products with a hint of honesty, or just spread falsities and FUD.
Re:Is this a surprise??? (Score:2)
Re:Is this a surprise??? (Score:3, Insightful)
The only magazine I know of that buys their test samples retail is Consumer Reports, and they do it for this reason (as well as to avoid any conflict of interest).
Re:Is this a surprise??? (Score:2)
Re:Blow me down (Score:3, Insightful)
They aren't necessarily rigging anything -- chip production runs always produce a range of qualities, and they're submitting the best they have. To not do so, especially when everyone else does, would be to sabotage your own reviews. There are no "unbiased" samples.
The only practical way to fix this is to establish a standard for what companies should send in -- preferably something like five to ten random chips that ha
Re:Now this just hurts (Score:2, Funny)
Re:General rant of all things we hold dear! (Score:2)
Re:Not Surprising (Score:4, Interesting)
Let me explain. If a major computer manufacturer, major RAM stick manufacturer, etc. needs parts, they get a contract---usually months or years in advance---with one or more of the vendors that provide that part. In that contract, the chip manufacturer (in this case) agrees to provide a quantity of parts at a particular speed, with guarantees that the RAM stick manufacturer (in this case) will be able to get that many at the speed in question, and at the price specified.
What usually happens in these cases is that the manufacturer of the part can't call it a faster part because that could be in violation of the contract terms for other manufacturers which may specify that they can't sell the faster parts to their competitors at a lower price. Thus, they are required to remark the chips at a lower speed than they were actually built to support in order to comply with their contractual obligations. This sort of thing can happen regularly, particularly if the manufacturer operates fairly close to their maximum yield; it doesn't take much to botch a batch of chips.
Thus, it would not be at all surprising if the DRAM stick vendor ended up making some runs with higher quality parts than they originally specified. There's no reason to assume that the DRAM stick vendor knew that the parts were above-spec parts at the time because they would not have been marked as such.
To assume that the DRAM stick vendor did this on purpose from a single sample is a pretty big stretch. Now if you see a pattern of this, it might be worth looking into. As it is, it just sounds like FUD to me.