Stories
Slash Boxes
Comments

News for nerds, stuff that matters

Sm@rtReseller and good Linux Press

Posted by Hemos on Fri Jan 29, 1999 10:33 AM
from the you-best-respect-me dept.
David E. Smith writes "The five millionth ZDNet publication, Sm@rtReseller, has a neat Linux article. Basically, given the same hardware, they ran three different Linux distributions and Windows NT and benchmarked them. Guess who won. "
This discussion has been archived. No new comments can be posted.
Display Options Threshold:
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • by Pasc (59) on Friday January 29 1999, @12:50PM (#2028145)
    Steven,

    Please don't take these anti-ZD criticisms personally. We've dealt with FUD from Jesse Berst and the likes for years. S@R, as you point out, has been very fair when doing reviews of Linux (with a few exceptions.) Unfortunately, the bulk of ZD articles comparing Linux and NT have been slightly to extremely FUD-filled. Thanks for proving that journalistic integrity still exists at ZD.

    --
    Pasc

  • by KMSelf (361) <kmself@ix.netcom.com> on Friday January 29 1999, @12:07PM (#2028146) Homepage
    It would also be interesting to see performance figures for the tested systems (as well as OS/2, and Novell) where custom tuning has been applied to the systems and applications -- runtime options in the case of IIS, compilation options and runtime options in the case of Samba and Apache.

    The value of OSS is the code. Use it!

  • hmmmm.. (Score:1)

    by drwiii (434) on Friday January 29 1999, @11:35AM (#2028147)
    Of course, you do know that Microsoft is paying for all this good press [zdnet.com], right?

    (Microsoft's) Maritz told Judge Jackson that a flurry of new applications and new vendors supporting Linux meant that relatively unsophisticated consumers would soon be using the operating system. As a result, he said, Microsoft would have to work diligently to keep pace with the market.

    Microsoft produced a half-dozen magazine and newspaper articles to support its contention.

  • It'd be interesting to see how much of that performance lead is due to the fact that Linux is faster than NT, and how much of it is due to the fact that Apache is faster than IIS.

    Perhaps they should try some tests with NT using the win32 version of Apache.
  • SB16 PnP (Score:1)

    by Frandsen (816) on Saturday January 30 1999, @12:10AM (#2028149)
    I have seen NT do the bluescreen thing with a SB16 PnP.. had to rely on the repair disk.. my kingdom for a CLI in such a situation....
  • No kidding (Score:1)

    by heroine (1220) on Friday January 29 1999, @03:02PM (#2028150) Homepage
    And Linux 2.0 was a dog compared to Linux 2.2 in terms of speed. My personal Linux box is the fastest web server in all of central Florida even though the suits will never ever hire a non-Windows user here.
  • by Rick Franchuk (1324) on Saturday January 30 1999, @06:16AM (#2028151) Journal
    It'd be nice to do an apples to apples comparison when delivering dynamic content via CGI/PHP/ASP/Whatever, but there are too many variables to account for to give a clear picture of how well a server might respond.

    Probably the best you could hope for is a very very minimal one-liner 'hello world!' program executed in the various different platforms to check how well the web server speeds through the calling process... 'best' here wouldn't describe very accurate results of course, just the best you could hope for. ;)

    When it comes right down to it, nothing beats full scale implementation and use in the target environment... and if you REALLY want to have that comparitive execution thing going, get the same developer to create multiple versions of your program, run them all in parallel on equivalent hardware, and measure away. The numbers won't be terribly accurate, but for the price of multiply redundant programs you can have the luxury of choosing which one feels the best.

    The samba printing test would be interesting. I've run SMB in corporate environments and have had very little complaint, but it'd be nice to see how well it'd work under a heavy-duty printer workload (Say, running a linux box as a rasterizer/spooler pushing 2400dpi 11x17 lino pages in a newspaper or printhouse somewhere). Anyone in the printing industry willing to fess up to a linux rasterizer box in the closet? ;)

    --
    rickf@transpect.SPAM-B-GONE.net (remove the SPAM-B-GONE bit)

  • Apache performance (Score:1)

    by Matts (1628) on Friday January 29 1999, @11:05AM (#2028152) Homepage
    Can anyone explain the different Apache performance figures? I'm running Apache 1.3.3 at work for a project, and we'd like to get the best possible performance out of it. Hopefully someone will reply with "Just recompile with -02 and pentium settings" ???
    --
  • WebBench (Score:1)

    by Matts (1628) on Friday January 29 1999, @12:47PM (#2028153) Homepage
    WebBench is freely available to download from www.zdbop.com. It contains static and dynamic content tests.
    --
  • by lefty (1872) on Friday January 29 1999, @01:59PM (#2028154) Homepage
    So how does Linux *really* stack up against the Evil Empire's wanna-be-server VMS ripoff.


    "The answer: Linux with Apache beats NT 4.0 with IIS, hands down. SuSE, the least effective Linux, is 16 percent faster than IIS, and Caldera, the leader, is 50 percent faster."


    Laugh with me [zdnet.com], unless of course you're a M$ FUDster, then we'll be laughing at YOU!


    Now, how about those file server stats [zdnet.com]. ZD sums it up by saying "...Linux kicks NT's butt."


    Now, I'd like to see some other alternative OSs put against Linux. Maybe BSD?


    Anyway, it's great that this has finally come out. We all knew Linux was superior, even the M$ marketdroids. It's been a long time in the coming. Ironic, we have ZDNet to thank =].

  • by timur (2029) on Friday January 29 1999, @11:10AM (#2028155)
    Back in 1996, Infoworld compared OS/2 Warp Server with NT. They found that OS/2 was faster on one CPU than NT was on 4.

    Performance comparisons against NT always give the same result. What I would really like to see is an OEM offer two different systems for the same task, one running Linux and the other NT. Let them say that these two systems are comparable in the number of clients they can serve. And let them show that the Linux-based server is cheaper and uses older hardware. Now THAT will get people's attention.

    Unfortunately, although major OEM's are beginning to offer Linux as pre-loads for servers, I have yet to see any of them PROMOTE Linux over NT. After all, a person can buy a cheaper system if he uses Linux - and that means that OEM's can't charge a premium for top-of-the-line hardware.


    --
    Timur "too sexy for my code" Tabi, timur@tabi.org, http://www.tabi.org
  • by sheldon (2322) on Friday January 29 1999, @11:02AM (#2028156)
    I'd be particularly curious to see the same tests run on a tuned environment.

    Say a Proliant 6500, Quad processor, 512 Meg RAM, 100 gigs on RAID-5, etc...

    That's going to be a fairly standard corporate server, and it'd be curious to see the results with say 500 client computers.

    Unfortunately only a few places are going to have the hardware to do such benchmarking. I understand that Compaq has such a lab available.

    Also I don't believe there was mention of what kind of netbench test that was, it must have just been static content? What about dynamic content from asp or php or cgi or whatever?

    I'd also be curious how one might try to benchmark Samba as a print server. Most companies don't just install servers for file sharing, but also for printer sharing...

  • by way_out (2820) on Saturday January 30 1999, @10:56PM (#2028157)
    This is funny. According to law in about all civilised nations it's illegal to have an agreement that itself breaks the law. Checking your own *purchased* machine against another is something no company can forbid.

    Just imagine a car factory forbidding the owner to bechmark it against another car.

    Nobody would buy it
  • This is Great! (Score:1)

    by mdxi (3387) on Friday January 29 1999, @11:04AM (#2028158) Homepage
    This article totally kicked my ass...I can't believe it's on ZDNet of all places! I printed out all the graphs because I'm afraid this article will disappear overnight :)

    I liked the linux-to-linux-to-linux comparisons but really wished more infor had been given as to WHY some distros perform better at certain tasks. I assume it's build differences, but I'd like to know what tricks you can use to speed up a certain program at compile-time.

    Still, this rocks! Print out the graphs and show them to your boss!

    --
  • Almost unfair... (Score:1)

    by warmcat (3545) on Friday January 29 1999, @12:50PM (#2028159)
    If the GUI - X or Windows - is idle, then it doesn't suck any CPU to speak of.
  • by Passacaglia (3824) on Friday January 29 1999, @12:41PM (#2028160)
    Yes, it's always apples and oranges. Linux wasn't running a GUI, which accounts at least partly for its better performance. But, it was speaking to WinXX clients in their native language with their filesystem, while NT (as far as I know) won't do NFS. Once I heard John Blair speak and he claimed that Linux was not the best platform for Samba. All in all, I think the upshot is not that Linux is so good (pardon; it is so good) but that NT is so bad, like the comparison mentioned above with OS/2 points out. Netware doesn't do SMB, but I understand that it has the most efficient fileserver protocol, better than SMB or NFS.

    NT so often comes out last in performance compared to _anything_ else. It is difficult to understand why folks defend it, even here on /.
  • Almost unfair... (Score:1)

    by vendull (4435) on Friday January 29 1999, @06:37PM (#2028161)
    Actually, the memory used by X will be migrated to disk (swapped out) if is idle long enough, and the other processes can make use of the RAM it occupies. So really, the only thing it will end up using is some disk space...
  • No graphs? (Score:1)

    by David E. Smith (4570) on Friday January 29 1999, @01:12PM (#2028162) Homepage
    If nothing else, the graphs were in the print edition of the article. (Let's hear it for free subscriptions. :) The graphs, and there's only two of them, basically show this:

    For Windows file serving, NT peaks at 8 clients and lags behind after that. Caldera peaks at 8, but much higher than NT (about 30 Mbits/sec vs. NT's 22 or so). Red Hat is basically a shadow to the Caldera line until 30 or so clients, where it is a little bit ahead. SuSE peaks at 12 or so. At the end of the graph, with 32 clients, NT has long since bottomed out at about 10 Mb/s while all three Linux distro's are still going strong in the 20-25 range.

    For Web serving, all the lines stay pretty much level across the graph. At 32 clients, Caldera is still handling 70+ requests a second, Red Hat about 60, SuSE about 50, and NT about 45.

    As others have said, Linux would have been even better if it had been tuned somewhat. (It'd be interesting to see how the NT box works when properly tuned also, just to make it a fairer fight.)

  • Sm@rtReseller is only about a year old; the current print issue, where I found the hardcopy of the same article, says "Volume 2 Issue 2." It has some interesting articles, all slanted towards biz of course. (The same issue has an article on how to configure cron, and a columnist ranting about Windows 98. Maybe there is hope for at least a small part of the soulless monolith known as ZD after all...)
  • by Vermeer (4832) on Saturday January 30 1999, @10:36AM (#2028164) Homepage
    Why would you want to go to the server room to
    do things with your server? You can have your own
    GUI on your own PC with Netscape... to administrate Samba remotely, a possibility now standard included.

    So, no need to run X on the server. Just Apache,
    which one probably would do anyway. Or an X-server on your PC. There's many ways to do a thing. But bolting a GUI to a server OS is *really* crazy.
  • Absolutely! (Score:1)

    by edgy (5399) on Friday January 29 1999, @01:55PM (#2028165)
    That's what I did!

    And I got the contract! 100 client samba server to go, on hardware that is so much more than would ever be necessary.

  • No Subject Given (Score:1)

    by Drew M. (5831) on Friday January 29 1999, @02:10PM (#2028166) Homepage
    This article makes me happy :)

    Finally, a published article truly telling the world how much Linux kicks NT's butt. Too bad they didn't tell how many times NT crashed to the gound during the tests. I bet it was more than a few.

    [drew@s196-237 drew]$ queso 127.0.0.1
    127.0.0.1:80 * Linux 2.0.35 to 2.0.9999 :)
    [drew@s196-237 drew]$
  • by A nonymous Coward (7548) on Friday January 29 1999, @11:02AM (#2028167)
    Follow the related links to find the graphs.

    I was amazed at the lack of FUD, the lack on install nonsense, and the generally very down to earth tone of the entire article. Did ZD just start up this Sm@rt Reseller, or just buy it? Maybe they haven't had a chance yet to destroy it. I've seen it around for a few months, which may mean ZD stuff hasn't come out of the print pipeline yet.

    --
  • No graphs? (Score:1)

    by Signal 11 (7608) on Friday January 29 1999, @10:53AM (#2028168)


    So much for credibility. Go ZDNet. :/



    --
  • by malx (7723) on Saturday January 30 1999, @01:57AM (#2028169)
    This article is important not because it shows
    Linux beating NT but because it compares competing
    OSS. For ZD and other commercial magazines to
    survive they must have competing products to review. If they are ever going to support OSS
    they too need a way to make money off it. Comparing different OSS products (Redhat versus Caldera, Sendmail versus Exim, or even Apache built with GCC versus Apache built with PGCC) is the way ZD can profit from OSS.
    And guess what, if they benchmark properly they'd actually be doing something useful.


  • by Midnight Coder (8953) on Saturday January 30 1999, @02:34AM (#2028170)
    My company recently purchased a suite of new Dell machines. NT BSOD when attempting to boot and install using the CD-ROM drive.

    Linux (RH 5.2) works fine.
  • by Axe (11122) on Friday January 29 1999, @08:09PM (#2028171)
    Yeah, it was on the same PII machine (2.0.36 , glibc, vs NT4.0 SP4 with fixes and runtime from VC6.0) JDK 1.1.7a and 1.2 under NT (with JIT) vs 1.1.7a under Linux.
  • Oh please. Check out my track record--it's on the Web and in the magazine databases. I was running Unix and dissing Microsoft--when they deserve it which they usually do--for years. Check out, the Sm@rt Reseller masthead, see who's working with me in techno? A lady named Esther Schindler, better known to some of you as the OS/2 Goddess. S@R technology department calls 'em the way they see 'em. Always has, always will.

    Steven, Senior Technology Editor, S@R
  • It's a typo (Score:1)

    by sjvn (11568) <sjvn&vna1,com> on Friday January 29 1999, @11:49AM (#2028173) Homepage
    The NT disk space number should be 1 Gigabyte and it will be Real Soon Now. And before anyone mentions that you can run it on less--or Linux either for that matter--they were all set up as network file/Web servers.

    Steven, Senior Technology Editor, S@R
  • by sjvn (11568) <sjvn&vna1,com> on Friday January 29 1999, @05:56PM (#2028174) Homepage
    Nah, it's rhino hide, I was just snorting and kicking at the bugs. ;-)

    Steven
  • by Wag the Dog (12835) on Saturday January 30 1999, @05:41AM (#2028175)
    I was just reading the NT EULA yesterday and they specifically forbid benchmarking their products without prior written approval of Microsoft. I wonder if it was obtained for these tests...
  • Not Enough Clients (Score:1)

    by raistlinne (13725) <lansdoct.cs@alfred@edu> on Friday January 29 1999, @02:16PM (#2028176) Homepage
    It also depends on what cpu they compiled it for. Redhat compiles with no cpu optimization, i.e. no -i486, -mpentium, etc. I think that that was what a new dist called somethin glike Stampede was partially about, compiling everything without debugging symbols and for pentiums. Those CPU optimizations can significantly affect performance. That being said, I don't know what cpu optimizations each dist uses. Also, it's not a given that everyone optimizes with -O, -O1, -O2, -O3, etc.
  • by raistlinne (13725) <lansdoct.cs@alfred@edu> on Friday January 29 1999, @02:19PM (#2028177) Homepage
    I don't know what NT does on SMP, but Linux 2.0.x uses BFL, big grained SMP, which is a big disadvantage. 2.2, by contrast, should really look nice on SMP systems, especially bigger ones. Of course, 2.2 dists aren't going to be out for a few months, so that will take a while. It will be fun to see, though, especially given Apache's multi-process architecture.
  • by cmoss (14324) on Friday January 29 1999, @01:17PM (#2028178)
    On the one hand you can be sure that MS is looking for articles that support their contention that they are not a monopoly.

    On the other hand they don't want to add any legitimacy to any real competition.

    I don't think this article would do their case any good. How can you explain the ability to charge $800+ for a file server that is outperformed (2.5x) by a $50 linux distribution!

    MS is in a position where they want to portray Linux as immature potential future competitor. To do this they don't need any articles that actually include facts. They want articles that talk about how great it is if you are a Unix genius but otherwise it's impossible to install.

    CM
  • by kevinT (14723) on Saturday January 30 1999, @04:58AM (#2028179)
    There was a table showing which version of Apache for each distribution. They apparently used the distribution's straight without any recompiles or anything. A couple of the versions were 1.30 and one was 1.31. (See the link on how they stack up).
  • by phred (14852) on Saturday January 30 1999, @02:36PM (#2028180)
    Duly noted.

    :)

    --------
  • Almost unfair... (Score:1)

    by JamesHenstridge (14875) <(ua.di.hsemaj) (ta) (semaj)> on Friday January 29 1999, @03:44PM (#2028181) Homepage
    Or more likely just VM (if the other tasks are more active).
  • Hardware support (Score:1)

    by Mad Hatter (16140) on Friday January 29 1999, @10:59AM (#2028182) Homepage

    Quoting article:
    "Where Linux does fall behind, however, is driver support and hardware discovery. Although Linux hardware support is improving, you must check each version's supported hardware list to be certain that all of your customers' components will function properly."

    The same is true of NT, I saw a video card installed in an NT system thet caused a bluescreen every time you booted. Not only that, it hosed the install and required a complete reinstall, every time. The installer later found out thet NT did not support the card. Unfortunately I do not remember what video card it was.


    "Trouble is, just because it's obvious doesn't mean it's true"

  • not really unfair (Score:1)

    by Mad Hatter (16140) on Friday January 29 1999, @11:41AM (#2028183) Homepage
    It's a feature of the OS that allows you to tune it to what you are doing. Besides, even if you did run X as long as you had nothing that required X updates running I doubt it would really make that much of a difference (though I could be completely wrong here).

    "Trouble is, just because it's obvious doesn't mean it's true"

  • Sm@rt Reseller has been fairly decent for a long time. They had a biased pro-Microsoft opinion article a while back about the Microsoft vs DOJ trial, and when I pointed it out, and wrote a rebuttal it took only a few hours before I got a really excited mail from the editor that wanted to print it... :) And I wasn't very nice to the guy who wrote the original article.

    In the few cases where I've seen FUD filled articles there, it has been opinion pieces, clearly marked as such, and they have been quick to include articles representing the opposing view.

    Imagine, actual journalism from a ZD publication :-)

  • 53 replies beneath your current threshold.