Please create an account to participate in the Slashdot moderation system

 



Forgot your password?
typodupeerror
×
Facebook

Facebook's Corona: When Hadoop MapReduce Wasn't Enough 42

Nerval's Lobster writes "Facebook's engineers face a considerable challenge when it comes to managing the tidal wave of data flowing through the company's infrastructure. Its data warehouse, which handles over half a petabyte of information each day, has expanded some 2500x in the past four years — and that growth isn't going to end anytime soon. Until early 2011, those engineers relied on a MapReduce implementation from Apache Hadoop as the foundation of Facebook's data infrastructure. Still, despite Hadoop MapReduce's ability to handle large datasets, Facebook's scheduling framework (in which a large number of task trackers that handle duties assigned by a job tracker) began to reach its limits. So Facebook's engineers went to the whiteboard and designed a new scheduling framework named Corona." Facebook is continuing development on Corona, but they've also open-sourced the version they currently use.
Operating Systems

Slackware 14.0 Arrives 183

First time accepted submitter SgtKeeling writes "After 5 release candidates, a new version of Slackware has been released. From the website: 'Yes, it is that time again! After well over a year of planning, development, and testing, the Slackware Linux Project is proud to announce the latest stable release of the longest running distribution of the Linux operating system, Slackware version 14.0! We are sure you'll enjoy the many improvements. We've done our best to bring the latest technology to Slackware while still maintaining the stability and security that you have come to expect. Slackware is well known for its simplicity and the fact that we try to bring software to you in the condition that the authors intended. We will be setting up BitTorrent downloads for the official ISO images. Stay tuned to http://slackware.com/ for the latest updates.'"

Comment Yes (Score 4, Informative) 293

If you are working as a consultant, then the biggest advantage of incorporating will be in tax savings.

In Canada (Ontario specifically) there is a break-even point around $42k/yr income, where the personal income tax and corporate income tax (and accountant fees, etc.) you pay will be approximately equal. Above $42k/yr income, the corporate tax will become less and less compared to personal tax. This is due to the fact that the corporate tax rate is fixed at 16.5% (until $500k or $1M annual income... I can't recall) while personal tax rates have brackets that increase as you make more money.

To take an example from my past, the last year before I incorporated I made roughly $86,000 and paid about $22,000 in personal income taxes. The accountant that helped me incorporate did some calculating, and if I were incorporated, the corp would have had to pay only about $13,000-14,000 in taxes.

There are some costs associated with running a corporation. There are the initial costs of setting it up, usually between $2000-4000 for lawyers and accountants. Then annually, you will probably have an accountant prepare your corporate taxes, which will cost around $750-2000 depending on who does it and how organized your paperwork is. These are extra hassles that some people find unpalatable, and it is a bit of extra administrative work on your part, but altogether, it saves you thousands and is very much worth it. (Unless you have some kind of ADHD and psychologically cannot deal with paperwork.)

Another tax saving tool available in Canada is that you can make $50k/yr in dividend income, tax free. Therefore, if you and your significant other are both part owners in your newly formed corp, then you can essentially have a combined household (personal) income of $100k/yr, tax free because your corp will pay out dividends to its owners, rather than salary (which is all taxable). You will probably not make exactly $100k/yr tax free (but it will still be around $95k or $98k) because in order to take advantage of various tax credits you have to show some personal income. How this is works is that, whenever you need money from your corp, you just withdraw it. At the end of your fiscal year, you and your accountant will figure out how to label those withdrawals, be it dividends, salary, whatever, to maximize the tax savings. That is how I have been doing it in Canada, anyway, and your accountant will be more familiar with how this stuff works in your area.

The best thing you can do (aside from asking the experts on Slashdot, of course) is to go see an accountant who deals with corporate stuff. Explain to him or her what you are thinking about doing and outline your current situation. Using your 2011 net income as an example, they can then draw up a spreadsheet for you, showing what would be your taxes and other numbers if you had been incorporated in 2011. This will let you know with little uncertainty what is your best course of action.

There are other benefits that come with having a corporation, your corp can purchase the equipment (e.g. laptops, mobile devices for testing, etc.) that you will use to do the service that the corporation sells. This can be recorded as an expense of the corp, which reduces the corporate taxes. In contrast if you bought equipment personally, it would not affect your tax situation at all. This is nice if you like toys, and would like some extra reasons to rationalize their purchase.

In summary, if you plan to make more than $42k (*) this year from your moon-lighting activities, just get it done already.

* $42k, or whatever is the break-even number for the tax system you live in.

Earth

US Seismologist Testifies Against Scientists In Quake-Prediction Case 189

ananyo writes with this snippet from Nature (for which this earlier Nature article is also background): "'The courthouse in L'Aquila, Italy, yesterday hosted a highly anticipated hearing in the trial of six seismologists and one government official indicted for manslaughter over their reassurances to the public ahead of a deadly earthquake in 2009. .... During the hearing, the former head of the Italian Department of Civil Protection turned from key witness into defendant, and a seismologist from California criticized Italy's top earthquake experts.' Lalliana Mualchin, former chief seismologist for the Department of Transportation in California, criticized the Italian analysis, which he says was based on a poor model. If the court agrees with Mualchin, the defendants could face up to 12 years in jail."

Comment Re:Government Contract in Search of a Problem? (Score 1) 329

Wrong, "toqué" is an adjective. It is never used, anywhere, to refer to the hat, which is a noun. You'll never find a Frenchman who says "toqué". If someone does write "toqué" or "tuke" when they mean "toque" then they belong to the same group that misuses quotes and hyphens (a.k.a. illiterates of questionable moral standing).

Toque is the correct spelling.

Earth

Sahara Solar To Power Half the World By 2050 363

eldavojohn writes "A Japanese/Algerian effort called The Sahara Solar Breeder Project employs a simple concept revolving around the pure silica in the sand of the Sahara Desert. The silica can be used to build vast solar arrays which will then provide the power and means to build more solar arrays in a classic breeder model. They would then use DC powerlines utilizing high temperature superconductors. The lead of the project points out that silica is the second most abundant resource in the Earth's crust. The project's lofty goals to harness the Sahara's energy has a few requirements — including 100 million yen annually — but also the worldwide cooperation of many nations and the training of the scientists and engineers to create and man these desert plants. The once deadly wasteland of the Sahara now looks like a land rich in an important resource: sunlight."
Censorship

German Photog Wants to Shoot Buildings Excluded From Street View 327

crf00 writes with this report excerpted from Blogoscoped: "'Spiegel reports that German photographer and IT consultant Jens Best wants to personally take snapshots of all those (German) buildings which people asked Google Street View to remove. He then wants to add those photos to Picasa, including GPS coordinates, and in turn re-connect them with Google Maps. Jens believes that for the internet 'we must apply the same rules as we do in the real world. Our right to take panoramic snapshots, for instance, or to take photographs in public spaces, both base laws which determine that one may photograph those things that are visible from public streets and places.' Jens says that for his belief in the right of photographing in public places, as last resort he's even willing to go to jail. Spiegel says Jens already found over 200 people who want to help out in this project and look for removed locations in Google Street View, as there's no official list of such places published by Google."
Software

How Can I Make Testing Software More Stimulating? 396

An anonymous reader writes "I like writing software. In fact, I revel in it. However, one thing has always kept me back from being able to write the best software I possibly can: testing. I consider testing to be the absolute bane of my existence. It is so boring and un-stimulating that I usually skip it entirely, pass the testing off to someone else, or even worse, if I absolutely have to test, I do a very poor job at it. I know I'm not that lazy, as I can spend hours on end writing software, but there's something about testing that makes my mind constantly want to wander off and think about something else. Does anyone have any tips on how I can make non-automated testing a little bit more stimulating so I can at least begin to form a habit of doing so?"
Data Storage

Preserving Memories of a Loved One? 527

An anonymous reader writes "My wife is dying of metastatic (stage 4) cancer. Statistically she has between one and two years left. I have pre-teen daughters. I'm looking for innovative ideas on how to preserve memories of their mother and my wife so that years down the road we don't forget the things we all tend to forget about a person as time passes. I have copious photos and am taking as much HD video as I can without being a jerk, so images and sounds are taken care of (and backed up securely). I'm keeping a private blog of simple daily events that help me remember the things in between the hospitalizations and treatments. In this digital age what other avenues are there for preserving memories? Non-digital suggestions would be welcome, too."
Classic Games (Games)

How Death Rally Got Ported 89

An anonymous reader writes "Last year, I got the opportunity to port Remedy Entertainment's Death Rally to modern platforms off its original MS-DOS sources. I wrote an article about the porting process for Game Developer magazine, and now I've posted the text of the article for general consumption. 'The source software platform was DOS, Watcom C, and some Dos4GW-style DOS extender. The extender basically meant you could use more than 640k of memory, and would not need any weird code for data larger than 64k. The game displayed in VESA 640x480 and MCGA 320x200 graphics modes, all with 8-bit palettes; there was no true color anywhere. There were also some per-frame palette change tricks that emulators have trouble with. The source code was mostly pure C with a couple dozen inline assembly functions. There were a few missing subsystems, specifically audio and networking, which would have to be replaced completely anyway, as well as one file for which the source code was lost and only a compiled object was available.'"

Comment Re:Kazkek (Score 0, Flamebait) 337

Listen, you Labview fan boy, I am not smoking crack. (Although I will admit it: Labview makes me wish I was a toothless meth addict, hitting rock bottom, giving blowjobs to married, middle-aged closeted gay men in a movie theater for drug money.)

I spent more than 10 minutes learning that crap. More than a few weeks in fact. I got to know some Labview tech support "engineers" by name. The problem, I later realized, was that I knew exactly what I wanted the hardware to do, except I had to jump through all kinds of Labview hoops to get there. In C or C++, I could have had the majority of the hard parts done in a few days, and then polish up the details. Not so in Labview.

Ever try to force yourself to do something the hard way, when you know there is a much easier way to do it? Ever try to pee sitting down when you're a few pints in, and you really have to go? That's what working with Labview is like -- it will block your peehole until you are calmly sitting on the toilet like a good boy. If you are a girl it will make you pee standing up through one of those cardboard funnels.

Let's look at what you'd have to spend to get a hardware and software package that lets you look at signals at 10MHz.

Here is the "Buy Labview" (a.k.a. get raped in the ass with a cactus branch) web page:

http://www.ni.com/labview/buy/

I could go with Labview Base or Labview Full, but since I want to deploy stuff to customers' machines without forcing them to buy Labview, I'm going to go with Labview Professional for US$4299, although I should probably go for NI Developer Suite for US$4699 because it's the "best value."

Next, I want to sample at 10MHz or greater. In 5 minutes of searching, these are the only products that I could find, that will let me do that. Note that these both have a maximum rate of 10MHz; there don't seem to be NI products that can go higher.

  • PXI-6115 for US$4199, or if we go with the "NI recommended" version, US$5249
  • PCI-6115 which is just the PCI bus version of the PXI-6115, for US$3799, or US$4849 for the "NI recommended" version

If you go with the PCI version, you will need a PC with some pretty good horsepower to handle the 10MHz data stream. This may add an extra $1000 or $2000 to your total price.

If you go with the PXI version, then bend over and grab your ankles again, for into your bleeding rectum NI shall happily insert a well-lubricated PXI chassis of your choice, for an additional few thousands of $$$.

Add in all taxes and other costs (shipping, and oh yeah, $600 cables, anybody??) and it's pretty damn near $10k if not well above. Just for the privilege of writing multi-colored spaghetti code in order to make your measurements.

In conclusion, it is better to just get a real 60MHz digital scope for a few grand. Labview treats intelligent humans like dogs.

Comment Re:Kazkek (Score 5, Informative) 337

By all means, buy National Instruments hardware. It is fantastic. I have deployed it on a number of production systems that run for days and days and days without a glitch.

As for Labview, stay the fuck away from that steaming pile of dogshit. It is a great way to waste lots of time and give up your sanity (and possibly your anal virginity) unless you feel like fucking around at your lab bench and drag-n-dropping some blinky lights and text boxes to impress your PHB. Oh yeah, and it's also great if you enjoy having fresh-out-of-college, inexperienced National Instruments tech support fuckwads (i.e. never having done any actual work with data acquisition or signal processing in their lives) repeatedly tell you, "OMG, change the way you think! You're so wrapped up in the text-based language tunnel vision! LOL!" whenever you get frustrated because Labview actually slows you down and doesn't help you get your results.

Oh yeah, I almost forgot, it will also cost you an arm and a leg. A hardware and software (i.e. Labview) package will let you look at signals in the 10MHz range and above will probably run you at least $10-15k.

In my day to day work, I prefer to remain in the "text-based language tunnel vision." That is, I prefer to use a well-designed C or C++ API to write programs that actually work in a predictable and reliable manner. (The NI-DAQmx API is actually very powerful and easy to use.) That way, I don't have to scroll around in a blinding maze of brightly colored connector lines and boxes and stuff, just because some National Instruments fucktard decided that "text-based languages" are just too, like, texty and complicated and not very much fun, yay! Yuck.

Education

Google Engineer Decries Complexity of Java, C++ 878

snydeq writes "Google distinguished engineer Rob Pike ripped the use of Java and C++ during his keynote at OSCON, saying that these 'industrial programming languages' are way too complex and not adequately suited for today's computing environments. 'I think these languages are too hard to use, too subtle, too intricate. They're far too verbose and their subtlety, intricacy and verbosity seem to be increasing over time. They're oversold, and used far too broadly,' Pike said. 'How do we have stuff like this [get to be] the standard way of computing that is taught in schools and is used in industry? [This sort of programming] is very bureaucratic. Every step must be justified to the compiler.' Pike also spoke out against the performance of interpreted languages and dynamic typing."
Graphics

Tattoos For the Math and Science Geek? 1186

An anonymous reader writes "I've been thinking of getting a sleeve of math and science tattoos for quite a while now. With the money saved up, the only question remaining is, what equations/ideas should I get? I know for certain that I'm going to include some of Maxwell's equations, and definitely Ohm's Law. So, if you were going to put a tribute to the great math and science minds on your body forever, which ones would you choose?"

Slashdot Top Deals

One way to make your old car run better is to look up the price of a new model.

Working...