IBM Developing Lego-like Storage Brick 181
AaronW writes "According to this story at EE Times IBM is developing a 32TB storage system built around blocks that can be stacked like Lego bricks. Apparently they will be connected in a 3x3x3 mesh using capacitive coupling and will be water cooled."
I sure hope they got a license from LEGO (Score:1, Interesting)
In my Crystal Ball I see... (Score:4, Funny)
Re:In my Crystal Ball I see... (Score:2, Funny)
Re:In my Crystal Ball I see... (Score:2)
Re:In my Crystal Ball I see... (Score:2)
Re:In my Crystal Ball I see... (Score:2)
xxxxx
xxxxx
xxxxx
xxxxx
xxxxx
xxx
xxxxxx
xxxxxx
xxxxxx
xxxx
the square above has a perimiter of 20 units, the more circular shape below has a perimiter of 22 units. The square is the optimal shape for smallest perimiter, and this projects onto higher dimensions.
Re:In my Crystal Ball I see... (Score:2)
Rich
Re:In my Crystal Ball I see... (Score:2)
Rich
Re:In my Crystal Ball I see... (Score:1)
And one extra for a footstool
Obligatory Bewolf Cluster Comment (Score:2, Funny)
Clever naming (Score:5, Funny)
Ice Cube? Lemme guess: They sell a bandwidth package for Internet hosting called "Ice T"
Their bandwidth monitoring and packet sniffer is called "Snoop Dog."
Oh wait...IBM's PS/2 had the MCA bus. Maybe that was a Beastie Boys reference. Maybe IBM has been into Rap and the like for a long time...
Re:Clever naming (Score:1)
Hmm... Let's just hope it won't melt...
"No sir, the server didn't crash, it went down in the drain!"
--
Arkan
OS/2 will be renamed 2Pac (Score:3, Funny)
Re:OS/2 will be renamed 2Pac (Score:2)
Re:Clever naming (Score:2)
Re:Clever naming (Score:1)
Re:Clever naming (Score:2)
The start of a trend? (Score:4, Interesting)
For the first time in the history of
More, the software part will certainly bring some huge advances in clustering, as the challenge of virtualising all those cubes may help in building self-repairing (or should I say self-dumping?) clusters...
Oh, and by the way, here is the first step to assimilation.
--
Arkan
Re:The start of a trend? (Score:1)
Re:The start of a trend? (Score:3, Interesting)
The SGI Origin 3000 is based on modular "bricks" (CPU, I/O, Power, Graphics, Storage). This is also a product that is GA, not vaporware.
Comment removed (Score:4, Insightful)
Re:Water cooled? How to interconnect? (Score:1, Insightful)
Re:Water cooled? How to interconnect? (Score:2)
Do you really though? I envision water pouring into the top of one of these cubes through a little funnel, trickling down through the hot places with the aide of gravity alone, and coming out through the bottom through another hole, ready to enter the cube below and do the same thing. At the very bottom of the whole shebang, the water is chilled and pumped back into the funnel of the top cube again.
Better keep each block upright at all times though!
Re:Water cooled? How to interconnect? (Score:1)
Re:Water cooled? How to interconnect? (Score:1, Redundant)
It can be done without water flowing from one brick to another. If every brick is built in a metal shield/radiator, then the water only flows between the hot parts and that shield within every brick, and the bricks are touching with these metal shields. But I haven't read the article, so I don't know how they actually did it, I just point that it is possible.
Re:Water cooled? How to interconnect? (Score:1)
Re:Water cooled? How to interconnect? (Score:2, Informative)
A water pipe rises through each vertical stack of bricks, linking to heat pipes on each module. The water cooling scheme is cheaper than air cooling, researchers said.
So you connect a vertical stack with some plumbing. The joints are not moving and I doubt the system is pressurized, so maintenance is not a problem. Plumbing is the least of their worries. The vertical stacks probably just connect at ends and channel the water to a chiller. No big deal, really.
The LEGO blocks.... (Score:1)
--Travis
Compatability (Score:1)
2 problems (Score:2, Interesting)
and 2nd, I would change the name.
Rejected IBM storage device shapes (Score:4, Funny)
2. Tinkertoy: storage structures too delicate, engineers kept losing fins for making "windmill" structure.
3: Play-Doh: kept getting stuck in carpet.
4. Erector Set: engineers spent too much time making jokes about name.
Rubik's Cube- (Score:1)
Re:Rubik's Cube- (Score:1, Funny)
Here's an image: Given a one time pad, the security guy goes in every morning and fiddles with the cube to get it to match today's patterm.
Re:Rejected IBM storage device shapes (Score:2)
Old News :) (Score:4, Informative)
Lego isn't the point (Score:1, Interesting)
The two most important improvements are:
The system is watercooled. Imagine this, you have 12 harddisks per cube. You certainly don't want to hear the fans which would be needed to cool all of them.
The second improvement, and you'll instantly see why this is coming from IBM, is that bad disks are not supposed to be replaced in the cube. They are simply turned off and the storage system works around them. If you need more capacity or can't live without the failed storage space, add another cube.
Re: (Score:1)
So when you have a bad disk... (Score:4, Funny)
Re:So when you have a bad disk... (Score:2, Funny)
So when the tenant dies, you leave him in his apartment. Eeeew.
I hope they actually meant "tenet".
yah if you're a t-rex.... (Score:1)
Re:So when you have a bad disk... (Score:2)
Flexibility (Score:1)
I think it's a given that, at least in places that have room for it, there will be some playful constructions made from these things.
Borg Technology (Score:2, Funny)
IBM: resistence is futile!
Websurfing done right! StumbleUpon [stumbleupon.com]
Re:Borg Technology (Score:1)
access? (Score:1, Interesting)
Re:access? (Score:2)
Re:access? (Score:1)
Does IBM somehow believe that floorspace is infinite and free, while regular maintenance is cumbersome and expensive?
Re:access? (Score:1)
Ice Cube - Cube Failure (Score:5, Interesting)
I'm glad they finally announced this project I've been dying to talk about it. I talked to a researcher on this project while I was at IBM's Almaden Research Center.
I was blown away when they described it to me. I have to say that IBM is by far the greatest computer techonology research company. They take the top minds give them boat loads of money, ten years later they blow your mind with the completely innovative technology. I mean come on, cube storage?!?!
Too bad, they just can't make any inroads in the client side market. They invented the harddrive years ago and today they aren't going to even make any more client models.
Anyhow, I just wanted to talk about cube failures. Ice cube uses a 3x3x3 array of 27 cubes. But, the question is what happens if a cube goes bad. Essentially, you can never turn off Ice Cube. It's meant to be continuously running. If a single cube failure occurs the system just routes around it. To compensate you can stick more cubes on the outside. Of course, throughput will be hampered.
I asked the researcher what happens if say all the middle cubes burn out or when the throughput gets too damaged. He responds, "Well, given the failure rate, it probably won't be an issue until about ten years have passed, and by then we'll have much more powerful storage technology."
Finally, anything that is water-cooled is nifty in my book.
Re:Ice Cube - Cube Failure (Score:5, Interesting)
Since the entire system is supposed to be fault-tolerant, if you wanted to reclaim some of the space/performance from the dead cubes, you could just start removing cubes from one end, throw away (or salvage, whatever) the dead ones, and then stick the still-functioning ones back on the other end, wait for them to sync back into the network, and repeat.
Of course, instead of growing, the whole unit would now have a tendency to migrate across the room...
--
Benjamin Coates
Re:Ice Cube - Cube Failure (Score:3, Funny)
Re:Ice Cube - Cube Failure (Score:3, Funny)
Gives a whole new meaning to the term "data migration", doesn't it?
Re:Ice Cube - Cube Failure (Score:2)
Walking drives! [astrian.net] Even in computers, the more things change, the more they stay the same.
Re:Ice Cube - Cube Failure (Score:2, Funny)
You know damn well that the block that fails is *always* going to be the block stuck in the middle!
HUH?? (Score:1)
IBM just got out of HDs? (Score:1)
Websurfing done right! StumbleUpon [stumbleupon.com]
Re:IBM just got out of HDs? (Score:2)
The long-suspected THIRD DIMESION! (Score:1)
This problem is obvious, to anybody with an advanced degree in hyperbolic topology, m-hay.
In SciAm (Score:1)
Lego Mindstorms come of age... (Score:1)
New Scientist Article (Score:2, Informative)
Comment removed (Score:3, Interesting)
Re:Software Hard? (Score:2)
Oh yes, you've thought about it for five minutes and solved all the problems. You're so brilliant. Errr...except that you don't address multiple hosts, recovery from multiple (even non-concurrent) failures, reconfiguration to avoid hotspots, etc. etc. etc. Just about anything is solvable with current technology if you ignore enough parts of the problem. The whole point of this, the whole reason they say that the software is such a challenge, is that they actually want to address the parts of the problem you ignore.
Re:Software Hard? (Score:2)
Fair enough.
The multiple-host problem isn't too bad if the multiple hosts are accessing separate pieces of storage in a statically patritioned system. But that's increasingly unrealistic. For one thing, shared storage is becoming more common. That requires cluster-aware LVMs, filesystems, and databases, which are quite a bit less common, complicated, and expensive than the "vanilla" versions. For another, storage is becoming more fluid. People want to be able to create, delete, resize, and reconfigure volumes on the fly to accomodate changing needs. They might not do it every day, but they do it enough times per year that they will not accept having to take the system offline to do it. Similarly, instant snapshots have almost reached the status of a must-have feature, and people balk at needing to allocate a complete mirror set up front for each snapshot they might ever take; more and more they want to allocate snapshot space on a strictly as-needed basis.
The multiple-failure-recovery problem is very similar, but adds a few more dimensions. User tolerance for staying in a degraded state is decreasing. If a drive fails, for example, you don't want to be regenerating data from parity forever; you want to grab some free storage (anywhere, not a designated "hot spare"), recreate the failed drive's contents on it, and totally forget about the old drive...all automatically. If you've sliced and diced the now-failed drive into 20GB chunks, it might get more interesting; now you might have to recreate chunk 1 that's part of volume X, chunk 2 that's part of volume Y, etc. all in parallel to minimize exposure to a second failure. If you lose a node, with all of its cache including writes that might not have been destaged yet, you have to do a similar kind of rebuild. Then you realize that exactly the same infrastructure can be used to deal with hotspots instead of failures, so you're actually going through this all the time instead of just in response to failures.
What you end up with is a storage system that's constantly reconfiguring itself to adapt to conditions, with many overlapping activities in progress almost all the time, all needing to be carefully coordinated between independent storage nodes. Even something as simple as a write has to be properly coordinated with everything else that might be going on around it, and everything still has to run as fast as possible, so it can get pretty hairy in there. That's the challenge they're trying to tackle, and it most certainly is not addressed by off-the-shelf host-side software.
HP Virtual Array (Score:1)
http://www.hp.com/products1/storage/products/di
Re:Software Hard? (Score:1)
If only we had Tesla coils too... (Score:1)
That would be cool.
2.5" hard drives? (Score:4, Interesting)
/Pedro
/Pedro
Re:2.5" hard drives? (Score:2)
Re:2.5" hard drives? (Score:2, Interesting)
/P
Re:2.5" hard drives? (Score:2, Interesting)
I bet that we will soon see 2 1/2 inch SCSI disks again. They make a lot of sense in blade servers and 1U servers, where laptop IDE drives now reign.
Re:2.5" hard drives? (Score:2, Informative)
Re:2.5" hard drives? (Score:2)
Probably won't be a factor, because of caches and parallelism. If both your reads and writes are served via cache most of the time (the latter to be destaged to disk on the array's own time) then the actual disk speed is less of a factor. Also, if your requests are being served by a relatively large number of disks then a single disk doesn't become a bottleneck. Large transfers can occur in parallel, queuing effects are reduced, etc. Combine caches with lots of disks, so that the array has lots of flexibility in how it schedules I/O, and the result is even more powerful.
But what, you say, about the potential data loss when a node holding a cached block fails? Well, the bricks have very fast connections. It doesn't seem too much of a stretch to suppose that caches might be replicated (this is one of the interesting software challenges to which IBM alludes). Thus, the time to complete a write is only the time to replicate its data to another block, not the time to actually write it to disk. As long as you retain enough reserve power so that cache can be flushed to a special area on each brick's local disks in case of an external power failure, you could even claim to be ACID-compliant (some vendors do exactly this).
Block topology and failures (Score:3, Insightful)
This system is meant to have 27 cubes in a 3x3x3 cube, and when part fails, it is supposed to remain in place. Low latencies and high throughput are due to their being interconnected to the surrounding bricks.
First issue here is, that people don't like seeing things fail, and leaving them. This thing contains a "fast x86 processor", a gig of ram, (later on) six port Infiniband switches, plus all the disks. One of these failing is expensive - and getting the middle brick out would require removal of many other bricks, and probably knock out the system quite well....
It isn't really exandable either. For 27 cubes, perhaps the 3x3x3 is the best layout or topology of the blocks, but as you increase the size of the array (100 bricks or something), a cube becomes far more complex, with longer paths between cubes, longer latency, impossibility of removing a central brick. Heat would build up in the centre (yes, they are watercooled, but every part will be making heat, and not all of them connected to the heatpipe and watercooling system).
Maybe some mad buckyball style arrangement would provide the shortest average path between disks (but this would require a lot of statistical work, and depend on how the data was stored, what sort of access was required).
We could end up with huge, weirdly shaped storage arrays, like in films.
The watercooling is a step forwards, working in server rooms is getting far too loud.
Reliability may be an issue - 2.5" disks which it uses are known to be not as reliable as their larger counter parts. And there are a lot of them in this (12x27 = 324 disks), so failure is almost guaranteed within a short time.
I think this may be more of a concept thing than a final product - certainly the lego and modularity aspects need to be re-thought.
Re:Block topology and failures (Score:1)
Now, if the water cooling is internal to the unit that is a different story.
As for fan noise on the computer room floor, most of it comes from the A/C units, not the equipment.
Re:Block topology and failures (Score:2)
Water cooling is a bad idea. First off, lots of use to have this stuff years ago, but don't now because we all switched to air cooled stuff. Secondly, Water is just a bad deal with the rest of te stuff that will be in the room with the huge disk array. What happens if one of these pipes burst some night? Water everywhere. I also expect IBM to get this to be aircooled eventually. I remember a anecdote about our old ES/9000. Story goes is that we almost installed a water cooling system because at the time, that was the rage in Mainframes. Big, honking water cooled units. Now, that is not the trend although alternative cooling seems to be needed soon because the danged 1-2 u servers get hot!
Re:Block topology and failures (Score:2)
Re:Block topology and failures (Score:1)
And you'ld never be able to fit it into the server room either. :-) By the time you'd have built such a large system the original bricks would be so obsolete that they'd just be spaceheaters anyway. Better to mirror the old cube onto a new one and throw the obsolete one out.
The cubes would presumably be redundant and autoreconfiguring internally as well, so they would degrade over time until you lost all the controllers/disks/interconnects/powersupplies.
Re: (Score:1)
Re:Block topology and failures (Score:2)
Every brick is connected to the water-cooling system.
Re:Block topology and failures (Score:2)
As with any device containing air, the air will heat up. The insulation of the outside bricks and the lack of forced air cooling would not help this.
Re:Block topology and failures (Score:2)
Re:Block topology and failures (Score:2, Interesting)
Here's a quick thought on how to keep a larger structure cooler, and possibly allow maintenance in the inner layers of blocks. How about a Sierpinski sponge [sourceforge.net]?
The bigger the cube, the more perforations, and more ways to get at the inner cubes. Nearly all the cubes could be accessed since they would have an outer surface exposed. Of course, in a 3x3x3 structure you would have only 20 bricks instead of 27, but any of them could be accessed.
Re:Block topology and failures (Score:2)
How long will it last? (Score:1, Insightful)
Article didn't link to the picture (Score:1, Informative)
http://img.cmpnet.com/eet/news/02/april/icecube_b
-Jake.
They're listening to us!!! (Score:1)
Expandable storage just by adding a brick... very cool! I hope they continue with this idea in other ways as well!
Excellent idea (Score:2)
However, this does bring me back to an original idea that I had for a server room. The room will be entirely empty, with large square tiles on the floor. Each tile will have information on the hardware that is below it (server name, switches, routers, etc). And, each will have a latch of some sort. Then, you unlock the latch, and pull up, and a large storage bin below slides up on spring-loaded rails, and locks into place. Then, you service the parts that need working on (swapping tapes, changing bad hdds), and slide it back down. All of the hardware will be sub-ground-level, which will make for much easier cooling, and a lot less cluttered environment.
These Ice Cubes from IBM would make a helpful addition to this idea, except you could only have probably two or three servers to a tile, attached one on top of the other. And there would be no side-to-side connections.
Eh, it was an idea.
Water cooled? (Score:1)
Lego Bricks? (Score:1)
More like CINDER BLOCKS
Apple II (Score:1)
Hmm, didn't those old apples have NUMA?
Maybe they dumped HD (Score:1)
The ideal Slashdot story! (Score:1)
I mean, it's like it was tailor-made!
Must have been difficult choosing an icon for the story. I can just imagine the editor agonizing over the little lego, the ibm logo, the hardware nut... or maybe the Borg Gates icon just to get people to read it.
Why x86? (Score:1)
yeah, but (Score:1)
And in other news... (Score:1)
Deskstar 75GXP class action lawsuit, now this??? (Score:1)
Are they going to have a 6 week waiting period if one of the drives fails? Are they going to tell people that their drives don't fail any more than anyone else's? Are their drives going to have extraordinarily high failure rates, in some cases 50%? Are they going to tell people that they are using their drives too much if they are on for more than 8 hours a day?
Sorry, but they can't even get consumer grade hard drives to work with any semblance of reliability. Why would people trust them to make drives that are obviously going to be targeted at high-end commercial boxes?
There is currently a class action lawsuit pending against IBM for their recent HD disasters that they unleashed upon the public. Maybe people should wait and see, before jumping on the next IBM storage bandwagon.
Here's the link to the lawsuit [sheller.com], if you are interested.
IBM out of the storage game (Score:1)
It will not make it to market without funding.
Software would probably resemble Freenet (Score:2)
Magnetisim is overated (Score:1)
This will pretty much make all the obtuse magnetic data bricks and high density RDRAM obsolete! I would image that IBM knows this, but wants to make 32TB data storage systems a reality today and for now, only has magnetic disks at thier disposal.