Want to read Slashdot from your mobile device? Point it at m.slashdot.org and keep reading!

 


Forgot your password?
Close
typodupeerror
×
Hardware

Can You Imagine a Beowulf Cluster of These? 71

Posted by michael from the okay,-it's-a-bad-joke dept.
Hell O'World writes: "Scientific American has a story on the history of Beowulf Clusters. It's written by the guys who built the Stone SouperComputer at the Oak Ridge National Laboratory." Nice example of how old hardware can be put to use to make new breakthroughs. Nothing radically new, but hey, it's 4AM Saturday morning, what do you expect. :)
This discussion has been archived. No new comments can be posted.

Can You Imagine a Beowulf Cluster of These? More

Can You Imagine a Beowulf Cluster of These?

Comments Filter:

  • Re:s/beowulfcluster/cluster (Score:1)

    by Anonymous Coward
    For the moleth time?

  • Render speed (Score:1)

    by Anonymous Coward
    The graphics card does not work while you're rendering. Only OpenGL/DX operations.
    Just a few plugins for some platforms use hardware acceleration because it's very difficult to do this.
    Memory bandwidth, its quantity and the processor are the main bottlenecks.
    Render farms are made of raw power servers, probably with no graphics card attached.
    Hope it helps :D

  • I like the incremental upgrades (Score:4)

    by Anonymous Coward on Saturday July 14, 2001 @12:08AM (#85787)
    The incremental upgrades that they do are pretty slick. The StoneSouper is a heterogeneous cluster. Each hour the machines do a speed analysis on themselves to track their performance, then when new equipment comes in, they know which nodes to replace. Makes sense because at some point in time the electricity used by the slower nodes becomes very costly in relation to the amount of work contributed to the cluster as a whole. It is real slick, and as they point out, the cluster is always improving. It becomes better and better over time, unlike some conventional supercomputers which slowly lose their value over time.
  • That would make really cool mp3 server. Definatelly.
  • I can understand someone posting as AC with some hot information and/or opinion. But not one making stupid replies.
  • I work for a company that writes middleware for clusters and I get to work on them every day of the week.

    I just wouldn't use ethernet to connect such a large machine. TCP/IP for message passing is by far not the best choice for making a collective of machines talk to each other. Also PVM is not the only choice anymore. Try MPI.

    http://www-unix.mcs.anl.gov/mpi/
  • where can I find a copy of the November, 1950 issue of Scientific American, cover story: the WORLDS FIRST PERSONAL COMPUTER (Berkeley's Simon)?? (And no, I can't imagine a cluster of those).

    Overrated/Offtopic/Inciteful/Flamebait (-4)
  • Don't you mean a 20 inch endoscopy?

    --
  • Hello, you just repeated the joke that was the article title. Who modded this up?

  • 4 AM Saturday morning as opposed to... (Score:4)

    by Katravax ( 21568 ) on Saturday July 14, 2001 @12:13AM (#85794)
    4 AM Saturday afternoon? :)
  • Actually, I just got back from a bachelor party, where we got our soon-to-be-married friend very intoxicated indeed. A brief lesson in bad liquor:

    --Goldschlager - bad
    --Jagermeister - awful
    --Shots of half Jager, half Goldschlager - not as bad as either one alone

    Strange, isn't it.
  • No, Taco hasn't beaten anyone in weeks. But we do try to not go too long without posting anything, and most of the time there's something reasonably interesting to post. But Friday night/Saturday morning, well, those can be tough.

    Hint to people who want to have their stuff linked on slashdot: submit the story friday night, saturday or sunday. Your odds are better. :)
  • I still don't see the difference between what is described and what a well-administered UNIX computer lab on a private network should be, with PVM installed, consoles removed, and login authorized only on a single node.

    In truth, there really isn't any difference. Beowulf is the name of a concept, not a product, package, or even method. (Beowulf clusters can be based on PVM, MPI, or other message backbones, for instance - although PVM is probably the most common, there's no standard for Beowulf clusters.)

    BTW, this stuff works - I replaced a Cray with a cluster of FDDI-connected RS/6000's nearly a decade ago and today, we use Intel boxes or an IBM 390 CMOS mainframe, depending on the job to be done. (You'd never know I'm a Sun bigot from reading that last sentence...)
  • God damnit, I'm gunna get karma burned for this but... I've spammed my beowulf cluster here on here many times before. Unfortunatly my host is dead and he hosts all the files so I can't mirror it somewhere else. Some day my 13 node beowulf cluster that rendered images in povray shall arise again! The site is http://beowulf.alignment.net ... I think it'll load if you get the IP which I have no idea. To sum it up my geek friends and I built a beowulf cluster from spare parts sitting in the back of our high school storage area. 10 486's and 3 P2-200mhz Debian boxes powered PVMPov and allowed us (Me specifically since I'm the POV-Ray guy of us) to do distributed raytracing over the cluster. Now if only I could get that website up you could see all the pictures and videos we made... Argh, I'm gunna feel the karma burn.
    ----------
  • Not the best, but the cheapest and easiest. Sometimes the data getting thrown around isn't all that much to any hit TCP/IP gives you really isn't that bad.
  • If not on the other side of the globe, at least on the other side of the country! There's plenty of drunk californias your should hire!
  • ok, I'm drunk, what's the deal with that! now, you step off.
  • every single day, now I'm seriously drunk, I've moved from beer to rum and now I'm onto wine.
  • 6AM pictures of Natalie Portman
    7AM hot grits for breakfast.
  • It actually ISN'T that common. I can't remember the last time I heard someone use AM/PM with further qualification. You'll hear people say "the meeting is at 4pm tomarrow" or "I had to get up at 4 in the morning!" but you'll rarely hear "the stupid cable guy was supposed to come at 4pm this afternoon!"
  • <i>Nothing radically new...</i>

    I guess hard drives will be breaking the 1GB barrier any day now!

    C'mon slashdot, let's post some real news.

  • Ahhhh...if only I had an excuse to setup my own cluster. I guess I can speak for most geeks when I recall the first time I heard of clustering commodity, off the shelf equipment with this ROGUE operating system called Linux...it still brings a warm feeling.

    Love live the Cluster!
  • What I would like to see happen with beowulf research is for everybody to connect their clusters via the internet (the proverbial Beowulf of Beowulfs) and go for the Holy Grail - the simulation of consciousness within the human brain. Folks, we are already using clusters of computers to search for consciousness...that's what SETI@Home [berkeley.edu] is. But space is big, and very empty, and our odds of finding ET are small. Let's start a public project to search for HAL instead. Here [harvard.edu] is what we know about the brain. Here [earthlink.net] is the place to scratch the surface on how we think it generates consciousness. We are geeks, we are hackers, we joke endlessly anout Beowulfs of Beowulfs...what are we waiting for?

  • Ummmm...good point. 'Cept I never told anybody I thought it would be easy...and I would substitute the word "new" for "unrealistic" in your post...and I never claimed "it" (consciousness simulation) was being done on a small scale; SETI@Home is a large scale data reduction project, not a large scale simulation like I'm thinking about. Despite their fundamental differences, both projects have (would have) the ultimate goal of discovering another consciousness besides our own.

    Look, I'm not the Shell Answer Man here. If I knew how to build a positronic brain, I'd do it, start U.S. Robots of Asimov fame and be richer than Bill Gates in six months. (I wish). But neural nets, and simulations of neural nets, is a valid area of research that Beowulfs could contribute to. Do I think the hackers are all going to get togther and create HAL on the net? Nah. But discussion about what IS reasonable and IS feasible could lead to some project that would attempt to simulate maybe 10 seconds of consciousness (and not necessarily in real time, either!) for some specific situation - fight or flight, arousal, cognito ergo sum...whatever. I think it will involve a continuous (and again, not necessarily real time) input flow of "sensory data" that results in an UNEXPECTED RESPONSE from the system as a first cut as to what defines success.

    Slashdot is a forum of people for whom new ideas is the stock-in-trade. All it takes is one new idea - or one connection between the links listed and somebody who didn't know those links existed - to result in some incremental progress, however small. And the future is the summation of small increments like that.

    As for my nick, I originally wanted joto but I saved it for you and went with cybrpnk instead.

  • And for you young whippersnappers out there that don't remember the day Kennedy got shot and the rest of the 1960s (what a decade) here's the scoop on the Shell Answer Man [wetfeet.com], which would be a pretty good Beowulf project in and of itself....
  • Still more on the Shell Answer Man [industrycentral.net]!!!
  • this is a test post
  • what else do people use computers for?
  • Hey, slashdot moderation works!

    At least, that's the only conclusion I can draw from the fact that a /. EDITOR seems to have a karma of below 25.

    Hmm... wait a moment. Maybe moderation doesn't work. Given all the trolling, redundant stories, and flamebait produced by the editors, I don't know if they should even be posting at Score=1.
  • This cluster is relatively small: 133 nodes. At my university [www.uu.nl] they had a 250-node cluster up for a day during the lustrumcluster [lustrumcluster.uu.nl] project. They wanted to have a 365-node cluster (the number of years that the university exists), but had trouble getting enough machines. A friend of mine (who was a member of the group that built it) told me that it equaled an 99Ghz intel machine (they used 250 intel machines with procs around 400 Mhz)

    So, this cluster is relatively small :-)

    --
  • Thanks, I was just about to point that out :) "Unique" means one of a kind, so either there is something else like it (making it not unique) or there's not.

    The only "intuitive" interface is the nipple. After that, it's all learned.
  • A Beowulf cluster *requires* that only one terminal is used for login, and that the rest are just CPU's and memory with a network connection. We want to harness CPU power, and the rest (monitors, keyboards) are just excess baggage.
  • what are we waiting for?

    We are all waiting for people with nicks like cybrpnk, telling us how easy it would be to make a simulation of something nobody understands, by linking all the computers in the world together in unrealistic ways in order to achieve an ill-defined and unverifiable goal because he claims it is already being done in the small scale (without success, I might add), without explaining what would make it happen simply by adding more computers.

  • They are already doing this here [cmu.edu], here [umich.edu], and here [umich.edu], using macs and pcs and unix boxes (UNclustered) to run "Cognitive Architectures"--simulated virtual agents that (to one extent or another) behave as real people do in simple and complex virtual environments. The problems that are being addressed out there do not require as much computing power as you might think, and the research is studying complex tasks (flying airplanes, air-traffic control, learning, memory, etc.) There is little brute-force search required in the search for 'consciousness', which is what these distributed client systems (ala SETI@home and the gene folding project) do best. The largest leaps forward have been made looking at small manageable problems that don't generally require a supercomputer. If you were able to create a giant distributed model of the brain, it very likely would be equally as difficult to understand as our own brain is; and in order to build one (for spectacle's sake or something), you would need to know a lot about the details, like local connectivity patterns.

    That being said, I don't think there's any theoretical reason someone couldn't build a fairly realistic highly-complex "brain" using, say, 100,000,000 simplified neural units (I've heard of a guy in Japan who is doing such a thing), but I don't really know what it would do, or if it would teach us anything that is interesting.

  • ...the editors are actively apologizing for their stories WHILE posting them.
  • What about a Beowulf cluster of ... er, nevermind. Sorry.
  • I only read /. for the porno links.

    Read the Final Fantasy article. Yeah, yeah, I know it's Katz, just skip down to the comments.

  • Posting an article (Score:3)

    by Traxton1 ( 154182 ) <Traxton1@NOSpAM.yahoo.com> on Saturday July 14, 2001 @12:13AM (#85822)
    OK, where is it written that you must post an article at 4 AM anyway? Will CmdrTaco just beat you mercilessly if you don't? If its something you realize you have to apologize for, try just not posting it. This article I don't particularly mind, but just for future reference. Thanks.
  • It only makes me wonder even more when I'm going to put mine together. OOOOHHH!!! I can't stand just reading about them! I want my OWN!!!!! Although, it is kinda cool that SciAm did an article like this. I don't think I've ever seen them do an article pertaining to Linux, much less Beowulf clusters.

    ------------------

  • What would you do with a cluster? Seriously.

    I hear this A LOT. There are even ISPs in my area that advertise their clusters. I honestly can't think of a reason why the -average- geek (and by definition, most of us geek -are- average) would need a cluster in his home, especially with PCs with CPU clockspeeds in the GHz range. Perhaps an MP3 machine in the living room and a nice fileserver tucked away in the wiring closet, but no need for a cluster.

    That's not to say clusters aren't of use.... they're wonderful cheap solutions for certain supercomputing tasks and are awesome for most forms of rendering. BUT... that doesn't mean every one of us needs an 8-node cluster to render the 3D images we make in Blender about four times a year. Nor is a cluster a magic fairy wand that can turn a pile of older, slower PCs into one magical, fast, new PC. It's not that easy. There is no free lunch. Programming for parallel processing is no simple task and adapting an existing project for a cluster can be extremely painful work at best. I'll leave "distributed GNOME" to someone else.

  • Just what is a real cluster? I've looked through all "Beowulf" documentation I could find...

    I don't belive there is a *proper* published, accepted usage of the term, "Beowulf". And you're correct, it is interesting how the kids are just now discovering distributed computation.

    It may also be worth noting that "Beowulf", when used in a converstation, is often followed by "Schweeet", and is mostly said by l33d d00d wannabes in their prepubescent years. (Or by buzzword kings of any age).
  • What is more important for a render farm, the processor or the graphics card? Because when you distribute something for rendering across the nodes, would it be handled by the processors of the node or the GPU on the graphics card?

    CPU and Memory bandwidth, by far. You don't even need a graphics card on cluster nodes, as the graphics will never be used. Rendering is purely a CPU operation and thus is slow, but results in a far better image than your graphics card could ever dream of producing. The best your graphics card can do is lower-quality real-time previews. The better the graphics card, the better quality of the real-time imagery. A Quadro2 Pro, FireGL4, or Wildcat II can produce some mighty nice real-time images when modeling and previewing your 3D graphics, but are nowhere near as nice as the final rendered product. There really is no way to put your graphics card to use as a "coprocessor" in the rendering process, either, as rendering software and your graphics card differ greatly in the way they produce their images. Think of your Geforce 3 as "quick, lossy, and cheap" and a render sever (or cluster) as "slow, lossless/beautiful, and expensive".
  • But what about those $1000+ graphics cards from 3dlabs? How do those help render scenes?

    See my previous comment. The expensive graphics cards only produce better quality real-time previews. They don't (and can't) assist in rendering, which is a totally differnet process that uses a different technique to handle reflections, refractions, shadows, etc.

    The same applies to even a $$$ Millions SiliconGraphics Onyx2 or Onyx3000 "Reality Monster" (1 - 16 graphics pipelines, 2 - 512 CPUs, 64 MB - 1024 GB RAM, taking up 1 - 24 *racks* of space). This beast is a single machine and can drive up to 128 independent (different view/angle) monitors or projectors (8 displays x 16 pipelines) and can handle 9 GB of gfx ram (4 GB texture ram + 5 GB of framebuffer). Yet... even this beast can only use its CPUs for photorealistic raytracing rendering. The InfiniteReality3 graphics pipes can only be used for real-time graphics (simulations, flythrus, low-quality previews of animations and movies, etc). When it comes to the final high quality rendering, only the CPUs are put to use.
  • If I were an ISP, I'd have one for the reliability and make damn sure I advertised it.

    A high availability cluster is just that, a "high availablility cluster". I was refering to computational "Beowulf-style" clusters. There is an ISP in my area that brags about their 24 node computational cluster. I can't imagine what they could possibly be using it for, other than maybe datamining their logfiles to figure out trends in their customers' surfing habits.

    Getting back to high availability, I totally agree. Anyone with a mission critical server setup really outta have a hot spare / mirror of each machine ready to take over should the first one fail. Or better yet (if the application can handle it) use a load balanced system to allow machines to be added and removed on the fly.

    There is a *major* difference between "pure" computational and high availability clusters, though each can borrow aspects from the other. Simply setting up a beowulf-style cluster will not automatically solve every problem with availability and scaling. I don't know how many times I've seen people asking "how do I install Apache, Sendmail, and mySQL on my beowulf cluster". It's not that easy. Beowulf is not a magic fairy wand that turns a stack of PCs into one supercomputer.

  • Scary (Score:3)

    by green pizza ( 159161 ) on Saturday July 14, 2001 @01:08AM (#85829) Homepage
    What truly scares me is how folks like this are lusting over something they could never even utilize. I could *maybe* understand someone's desire for a Cray (and even that's a stretch), given the company's interesting history (and even more interesting founder, Seymour Cray). But a cluster of PCs?? What's so great about having racks upon racks filled with x86 systems sitting in your den that will recieve little or no use? And really, what's so great about a Cray in your own home? What are you going to run on either? Distributed TTYGNOME? And no, you're not going to be able to recompile the Linux kernel in two seconds with -any- cluster. You're better off builing a nice desktop PC and a companion server. Lust over the 100 GHz PC that you'll be running in just 8 years.

  • s/beowulfcluster/cluster (Score:4)

    by green pizza ( 159161 ) on Saturday July 14, 2001 @12:33AM (#85830) Homepage
    For the 6.022x10^23rd time, not all clusters are "Beowulf Clusters".
  • No, but had you read the article you'd discover that the clusters it talks about are beowulf clusters.

    The subtitle: ..."connect ordinary PCs so they can work together"...
    Later on: "Since them, the name [beowulf] has been widely adopted to refer to any low-cost cluster of widely available PCs".


  • I didn't see any mention of the best Beowulf clutstering project of Macs, so to "Think Different": Project Appleseed [ucla.edu], put together by the physics department at UCLA. They've accomplished phenomenal speeds, etc.; mostly, it's just as possible on Macs as it is on anything else.

    In fact, they have even developed a drag-n-drop interface [daugerresearch.com] for setting up Beowulf jobs.
  • Even better is the moderation: 4, Redundant. No kidding!
  • I didn't think anyone still listened to the Beatles...

  • rum to wine is not a good switch... *L*

    Imagine is my favourite from John Lennon

  • *whispers* a little known secret about beer... if you stay single, the last cold beer is always yours ;o)

  • it's 6pm Saturday you American freaks! (Score:3)

    by Technodummy ( 204943 ) on Saturday July 14, 2001 @12:08AM (#85837)
    *hehe* c'mon... catch up... we're going out drinking...

  • a Beowulf Cluster of suggestions to /. for future articles?
    - "First Posts!" has been mentioned already.
    - Natalie Portman has been mentioned already.

    So that leaves us with:
    - Hot Grits and their influence on the liberal mindset, by JonKatz
    - Microsoft sucks!, by Hemos
    - Penis birds: extinct, or merely migrating somewhere else?, submitted by the goatse.cx guy (rejected)

    Uhh... let's leave it at that, for now.
    Tongue-tied and twisted, just an earth-bound misfit, I
  • Never utilize? I'd love a cluster for use in 3D rendering, now with my PIII-667 it's soooooo slow rendering PAL resolution (720x576) video... with raytracing and effects, one frame can take an hour to render.

    With a cluster of only PII-350's, say about 5-10 machines, it would be hell of a lot faster :)

    Imagine a cluster of 50 PIII-1000 machines (drool)!
  • Not only ROGUE but also VIRAL.
  • Dutch custom: Start drinking beer when "the five is in the clock" (i.e. quarter to five).

    Dutch students custom: Refering to whatever time as "five to..." (f.i. five to three to nine = 8:52 AM). This way you can get your beer anytime.

  • High availability.

    Not that most of us need more availability hardware than a UPS, that is the biggest low-end use for clusters. If you have a computing need that can't go down, cluster it. With a UPS and a back up generator, nothing short of an earthquake is going to shut you down. One, maybe even two nodes might go down, but 8 or 16 won't, and they can pick up the slack without missing a beat. If I were an ISP, I'd have one for the reliability and make damn sure I advertised it.


    "You know, the golf course is the only place he isn't handicapped."

  • And 95 of every 100 SUVs never go off road. There is nowhere this side of a racetrack to properly enjoy a Ferrari. Of the millions of guns, how many (other than cops') have actually been needed? Clusters are truly amazing computers that ordinary geeks can have. What more reason do you need?


    "You know, the golf course is the only place he isn't handicapped."


  • COMPUTING CLUSTER at the American Museum of Natural History in New York City contains 560 Pentium III microprocessors.
  • I only watch pornography for the articles.

    I only read /. for the porno links.

    ___
  • I saw this story and immediately thought of slashdot and how funny it would be to submit a story like this. But I stopped at the thought.
  • Just what is a real cluster? I've looked through all "Beowulf" documentation I could find, and I still don't see the difference between what is described and what a well-administered UNIX computer lab on a private network should be, with PVM installed, consoles removed, and login authorized only on a single node.

    Am I missing something?

  • Which is why I keep beer in the fridge--somewhere, it's Happy Hour. Cheers! :D
  • Beowolf cluster articles and posts???

    Screw 3...
  • Hey, Hell, thanks, that was a nice article. Although the Beowulf cluster has become pretty commonplace, I don't think I've actually seen a history of clusters before.
  • When computers get together to make decisions, they form a Beowulf cluster. When humans get together to make decisions, they form a comittee. Need I say more?

  • Surprised? (Score:3)

    by JBowz15 ( 451573 ) on Saturday July 14, 2001 @12:04AM (#85852)
    4 A.M., Saturday - Article on the history of Beowulf clusters.

    Now, let's look into the future....
    5 A.M., Saturday - Article on the history of First Posts.

    Who know knows what 6 A.M. will hold?
  • A 20 page biography of the goatse.cx guy at 6 AM.
    ---
  • ...or should it be called a Beowulf cluster cluster?
  • Have any of you read the Beowulf poem? That poem rawks. I know many a-kid who didn't like reading at all until he/she picked up our senior English Literature book. I liked it so much, I rented the book from the Library. If you've not read the poem, I'd suggest reading it. Good stuff.

Slashdot Top Deals

I have hardly ever known a mathematician who was capable of reasoning. -- Plato

Close