Grid Computing and IBM 66
cozimek writes: "I just read this article from the NY Times that discusses a plan by IBM to leverage their support of the Linux platform to build grid computing. IBM has already won support of grid projects for supercomputing in England and the Netherlands, and now seems ready to take on the Internet. Of course, the article says it could be many years before we see any fruits of this bounty." This has been submitted many times, so we're posting it. But somehow I resent the fact that it's just a vaporous press release generating this hype, taking advantage of a well-known idea that many are already working on and was forecast many, many years ago.
'take on the internet' ?!?! (Score:1)
the internet is like that one fat kid in elementary school who could win in a 'vs. all' wrestling match.
Public Grid (Score:2)
Re:GRIDs? (Score:2)
I miss my old Grid. Man, that was a sexy machine. Red plasma screen, locked down tight. Nice, nice box.
I'd love to have one of those now. Wish I'd never junked my old Gridpad.
Re:GRIDs? (Score:2)
Alright... admit it... who here pines for the days of plasma screens? :)
Re:Michaels Brain is Vaporware (Score:1)
It's only the still-standing anti-trust penalties holding them back.
If you're looking for a White Knight to save you from the dreaded Microsoft, you'd better look elsewhere.
Moore's Law versus Grid Computing (Score:3)
A science fiction novel I read recently (Permutation City by Greg Egan), however, reminded me that this may eventually change, if and when Moore's Law stops working.
If compute power hits a stable plateau in 10, 20, 100 years, whatever, then the cost of compute power will also roughly become a constant number of dollars per clock cycle (or peta-clock cycle).
In that case, as Egan presents it, compute power from a global grid may indeed be the only way to get larger amounts of compute power than your local processor can give you, and therefore, as a commodity, it may go to the highest bidder at any given moment.
(Hopefully not so badly as with California's power grid bidding, but we'll see.)
P.S. the advent of nanotechnology computers, or quantum computers, or purely optical computing, etc, wouldn't dispel the above scenario, it would just delay it. It's not clear that even Vinge's Singularity would literally prevent Moore's law from going away. (I don't believe that the Singularity will do away with the laws of physics.)
Re:Public Grid (Score:2)
Who does what? (Score:3)
I'm not sure I understand -- who provides this "grid"? Are they built and maintained by IBM around the world? I don't think IBM would be thrilled to discover that Compaq is using the IBM grid to advance Compaq's bottom line. I like IBM, don't get me wrong -- but I doubt they're such humanitarians.
Is the "grid" made up of PCs on the Internet? First, most of those PCs are on dial-up connections, making things very complicated (and the PCs themselves not very useful). Second, who compensates the people who own the PCs? Is it strictly voluntary, like SETI@home? If so, how will anti-nuke activists prevent Los Alamos from running simulation calculations on their PowerMac?
I think the idea is fantastic, but I'd like a few more details..
Re:GRIDs? (Score:1)
Yes, read the article (and its references) (Score:3)
The intro is absolutely correct, which if you'd done any digging whatsoever *cough*google*cough* you would have found for yourself:
It really can't be stated much more clearly than that.
--
Re:mind games (Score:1)
Or something like that.
Re:Moore's Law versus Grid Computing (Score:1)
It seems to me that for desktop use, the current crop of processors/systems is adequate for 90% of the user base (the e.mail/Solitare/web browsers). The power users probably won't ever be satisfied - I'd expect to see a lot more work going into developing methods of reformulating the computations to best take advantage of parallel processing clusters, rather than builing UberHyperPetaFLOP single processors.
Re:Public Grid (Score:1)
-B
Re:Who does what? (Score:2)
-B
GRIDs? (Score:1)
Michaels Brain is Vaporware (Score:1)
Pure Evil (Score:1)
Read the Article! (Score:2)
Wait! (Score:1)
Re:Watch out for the grid bugs! (Score:1)
[Happosai]
Re:How can they trust the results? (Score:1)
Depends which type of RAID (Redundant Array of Independent Disks) [finitesystems.com] you opt for.
Doing something like this just decrease your disk space in half...
Wrong! See the above link for RAID 5.
------------------------
wtf? (Score:2)
A. large/complicated enough to constitute such a network: nuclear simulation, weather prediction, chess, encryption. Most of which have no little to no interest to the common user.
B. Can be distributed, Seti and encryption work because a central server can farm out sections of work to different clients. For most tasks this is not practical, especially real time problems.
C. Doesn't need a big pipe. for example a rendering farm, or maybe mp3 compression would be nice, unfortunately the data is to large to make it worth while.
-Jon
Re:How can they trust the results? (Score:1)
Some problems are intrinsically checkable. For instance, if you do a distributed factoring search, and report factors, it is easy to check if it is really a factorization of the number in question.
Other problems need redundancy. This isn't just to guard against malice, but to protect against hardware failure.
Well, now that you mention it... (Score:1)
Shhhh, don't tell anyone! I've been using my wormed version of the SETI screen saver for particle transport calculations for years.
ten thousand years ago (Score:2)
Since then MS has revealed far more oppresive vision for "grid" computing. Where did you want to go ten years ago?
Here's one vision of IBM's computing as utility (Score:1)
Re:England.... (Score:1)
Besides, everyone knows that Britain, England and Scotland are all parts of London. Whilst Wales and Northern Ireland are far too confusing to be worth mentioning.
What about the dangers? (Score:1)
I think people should leave this stuff well enough alone.
--SC
Re:Who does what? (Score:2)
vapourous hype... (Score:1)
Perhaps it should be under the `patents` section then?
Re:England.... (Score:1)
Re:Moore's Law versus Grid Computing (Score:3)
>of dollars per clock cycle (or peta-clock cycle).
IMHO, we're very close to this point, if not there already. But in a different way. Consider this an economic limit, not a technological one. We can keep shrinking chips, but it keeps getting more and more expensive to do so.
The first hint came with the sub-$1000 computer. Prior to that, a top-end PC was about $2000-$3000, with a lower priced PC about $1500-$2000. We kept buying all the power we could afford. But with the sub-$1000 computer a class of users began buying all the power they NEEDED, and let the cost ride down. More expensive PCs became the tools of gamers and technical use, and Microsoft was the only force pushing basic compute power upward.
I'd like to upgrade to a 1.5 GHz Palomino this Fall, about my normal schedule, but times are tight, so I'm probably going to pass for another year. (Maybe a Hammer, then!) And to look seriously at it, my K6-3 does just about everything I ask of it. Star Trek Elite Force runs great, RealMyst was lackluster, though.
Re:Sun is already there! (Score:2)
BBC Article (Score:4)
Re:Moore's Law versus Grid Computing (Score:1)
Are you implying that Moore's Law is dictated by the laws of physics? Moore's "law" is not a law--not in the same sense as the "laws" of physics (e.g., gravity). Moore merely predicted the exponential growth of transistor density [intel.com] in ICs. This prediction is more of a sociological obsevation--a technology industry truism--and a self-fulfulling prophecy than it is a physical law.
Microprocessors with tens of millions of transistors were no less physically possible in 1965 (according to the unchanging laws of nature) than they are today. Man simply had not developed the expertise, tools, and vision to make them.
Moore's law may cease to hold true someday because of some physical limitation (though this may depend, in part, of how you choose to define a transistor--is it a silicon FET, an organic structure, or anything which functions conceptually as a switch?). However, there's no reason it couldn't end today if we simply chose to stop developing denser ICs.
DAMM those IBM people!! (Score:1)
It's so... so... misleading!
Re:Faster than Moore's Law? (Score:2)
For those who have an IMMEDIATE need for high performance computing, parallel systems are the answer. Simply put, you can have access to high performance computing now rather than wait for a single machine to become cheap enough.
But don't forget that Moore's law made this all possible. Smaller components also made cheap, high-speed communications commonplace. This can only mean that the cost of setting up such a grid will become cheaper over time, not more expensive.
Look at AOL, for example. They provide a distributed service to millions of people. This is made possible because communications and computing power is cheaper more than it has ever been. The longer it is in existance, the more services they offer. This happens without an appreciable increase in price.
The same thing will happen with grid computing. It may be a specialty item NOW, but in the future, it will become a CHEAP commodity, not an expensive one.
Re:Who does what? (Score:2)
More Info About Grid Computing... (Score:2)
More info about the DataGrid...
MSNBC article too! (Score:2)
Even tastier, though, how many PCs in university labs are wasting cycles (or using them on SETI@home or dnet)? Wonder how likely it would be to get a client on those and use it like another big computer?
Re:At last... (Score:1)
This way I don't have to waste precious moments of my life on the irritating task of coming up with fake names and info with which to sign on to the NY Times reader's list.
(Screw them and their opt-in database. They can data-mine like everybody else.)
-Fantastic Lad; The most irritating Lad of them all!
Re:Public Grid (Score:1)
Do we need to pass measures to get a local grid?
Re:Who does what? (Score:2)
You can't hurt me with the things that you do,
I pick up dandelions and I give them to you.
Re:Who does what? (Score:1)
1) Somebody eating up a whole bunch of processing time to brute force cyptographic codes and
2) Somebody eating up a whole bunch of processing time trying desperately to frag that very last guy in quake VII?
Will the processing power be so immense that it won't fill up?
mind games (Score:1)
Futures anyone? (Score:2)
IBM's late - we've already built one (Score:2)
Oh, to answer the economic argument, unless you're doing a LOT of computing, it's cheaper to lease the time than to buy. I can give you ~30 hours/month of system time for less than you can buy _one_ equivalent machine. And my way (a) it's tax-deductible, and (b) you only pay as you go - not all up front.
Sun is already there! (Score:4)
And yep, it's free!
Everything Old is new (Score:1)
Re:Moore's Law versus Grid Computing (Score:1)
it's been more cost effective in most cases to buy your own cpu than to lease it from a grid
It seems like there are cases when this is not always true. The one that comes to mind immediately is the researcher who needs to tackle a very large problem but only needs those resources for a short time. The grid would be ideal for that.
It also seems that another reason that earlier distrubuted computing ideas didn't pan out was due to communications bottlenecks, e.g., the cost of farming out my compiles to 100 machines rather than running the compiler 100 times on one machine has a lot to do with the time spent sending the bits back and forth. If everyone on the grid (in a few years time) has a fiber connection and a guaranteed set of resources, then this problem is minimized.
WooHoo! This is gonna tie into the new Tron movie (Score:1)
You are standing in an open field west of a white house, with a boarded front door.
Vaporous, but still gives it exposure... (Score:3)
I had heard of grid computing before, but hadn't read much about it. Google turned up lots of resources this mornign - worth teh read. The article was right - the software to manage a grid will be super complex and the security implications are daunting.
BBC News article (Score:1)
There's also a BBC News article [bbc.co.uk] on this, and it has links to the Grid Forum and Globus.
Re:Who does what? (Score:2)
Will the processing power be so immense that it won't fill up?
Yes. Even the most difficult of tasks won't use up *all* the bandwidth. And I'm sure the system will have some type of safe guards against extreme usage such as attempts to harm it, etc. We're talking about 500-1000 MHz * thousands, and lots of memory too.
Re:Who does what? (Score:3)
Think Internet. Right now, we're paying for bandwidth, because the Internet is largely an information-only medium. However, in the future, we will also be able to have a certain amount of processing power, shared by everyone, used by everyone. IBM is just providing the structure (and at first the systems for the demo) to access mass computational resources. Soon, you will be able to access network wide applications which are processed on many machines across the network in a distributed way.
Right now we have an enormous processing surplus. Most machines sit unused for hours. Check your load averages if you don't believe me. Even a personal desktop used 8+ hours a day will barely break a few percent. Now imagine if we had some infrastructure, which is what IBM is aiming to do, to harness and unite all this power for general use? We would have an enormous amount of processing power available.
Is the "grid" made up of PCs on the Internet? First, most of those PCs are on dial-up connections, making things very complicated (and the PCs themselves not very useful). Second, who compensates the people who own the PCs? Is it strictly voluntary, like SETI@home? If so, how will anti-nuke activists prevent Los Alamos from running simulation calculations on their PowerMac?
Bandwidth will come in time. Even so, imagine having all of AOL's dialup connections available for processing. 56k isn't that much, but imagine millions of connections at once. As soon as we get lots of bandwidth and always-on connections wide-spread, this will be much easier. It's an upgrade path too. We can still start now and as people get faster connections and faster machines, the overall system power will increase.
As far as compensation, this is a public thing. We all use each other's resources, and we all contribute to the available processing resources. The sum of the parts of something are greater than one part alone, working alone. Similar to how Gnutella users each contribute and take, and why it works so well. Just translate the information into processing power. You can take as much or as little as you want, most people falling somewhere in between (this is how it always is and is a regular pattern).
I'm sure there are going to be leeches. But many people will want to share because they realize how the system works. Distributed systems like Gnutella do work (albeit a few leeches here and there), and this is proof that a processing system will also work.
Re:Can someone tell me (Score:1)
Re:Moore's Law versus Grid Computing (Score:1)
(Let me just mention also that the so-called "Moore's Law" isn't really a law, but just an observation for the present times and technology.)
Re:Who does what? (Score:1)
--
Re:Who does what? (Score:1)
Here's an idea that I've been tossing around. Maybe it will be feasible with a grid installed. What about paying for internet access with clock cycles? I could certainly use perpetual 'free' net access more than I could use a supercomputer on my desk. I wouldn't know what to do with it.
Re:England.... (Score:1)
How can they trust the results? (Score:1)
What's to prevent one disgruntled employee at one of the facilities from screwing up the results. I've heard that SETI@home does it by giving the same work unit to two different users and verify the results.
Doing something like this just decrease the "Grid's" speed in half...
At last... (Score:1)
Way to be principle'd Mikey (Score:1)
Honestly, if you felt strongly about it, don't post it. Have some balls, for cryin' out loud. You're just as bad as the Karma Whores. Anything for attention.
Carl G. Jung
--
Re:Public Grid (Score:1)
Re:Who does what? (Score:2)
Re:Who does what? (Score:1)