Become a fan of Slashdot on Facebook


Forgot your password?
DEAL: For $25 - Add A Second Phone Number To Your Smartphone for life! Use promo code SLASHDOT25. Also, Slashdot's Facebook page has a chat bot now. Message it for stories and more. Check out the new SourceForge HTML5 internet speed test! ×

Apache Hadoop Has Failed Us, Tech Experts Say ( 108

It was the first widely-adopted open source distributed computing platform. But some geeks running it are telling Datanami that Hadoop "is great if you're a data scientist who knows how to code in MapReduce or Pig...but as you go higher up the stack, the abstraction layers have mostly failed to deliver on the promise of enabling business analysts to get at the data." Slashdot reader atcclears shares their report: "I can't find a happy Hadoop customer. It's sort of as simple as that," says Bob Muglia, CEO of Snowflake Computing, which develops and runs a cloud-based relational data warehouse offering. "It's very clear to me, technologically, that it's not the technology base the world will be built on going forward"... [T]hanks to better mousetraps like S3 (for storage) and Spark (for processing), Hadoop will be relegated to niche and legacy statuses going forward, Muglia says. "The number of customers who have actually successfully tamed Hadoop is probably less than 20 and it might be less than 10..."

One of the companies that supposedly tamed Hadoop is Facebook...but according to Bobby Johnson, who helped run Facebook's Hadoop cluster before co-founding behavioral analytics company Interana, the fact that Hadoop is still around is a "historical glitch. That may be a little strong," Johnson says. "But there's a bunch of things that people have been trying to do with it for a long time that it's just not well suited for." Hadoop's strengths lie in serving as a cheap storage repository and for processing ETL batch workloads, Johnson says. But it's ill-suited for running interactive, user-facing applications... "After years of banging our heads against it at Facebook, it was never great at it," he says. "It's really hard to dig into and actually get real answers from... You really have to understand how this thing works to get what you want."

Johnson recommends Apache Kafka instead for big data applications, arguing "there's a pipe of data and anything that wants to do something useful with it can tap into that thing. That feels like a better unifying principal..." And the creator of Kafka -- who ran Hadoop clusters at LinkedIn -- calls Hadoop "just a very complicated stack to build on."

Comment Telephone Game: Racist Edition (Score 3, Interesting) 191

Reuters version -- "applicants who have ever been present in territory controlled by the Islamic State" * (link)
Verge version -- "applicants who have ever visited ISIS-controlled territory" (link)
Parent version -- "applications from people who like to hang out with ISIS" (above)

* Comprised in the majority of citizens who were victims, prisoners, kidnapped, abused, forced slaves and wives, i.e., any brown-skinned refugees.

Comment Uber Isn't Even Profitable (Score 4, Informative) 200

"It's hard to find much of a precedent for Uber's losses. Webvan and—two now-defunct phantoms of the original dot-com boom—lost just over $1 billion combined in their short lifetimes. Inc. is famous for losing money while increasing its market value, but its biggest loss ever totaled $1.4 billion in 2000. Uber exceeded that number in 2015 and is on pace to do it again this year [2016]."


Comment Re:Interviews need training, too (Score 1) 1001

Likewise: One of my last interviews in my gaming career, an interviewer (producer) asked me to convert a string of ASCII digits to an integer value. I did happen to remember the algorithm directly from my machine architecture class (which I feel is quite memorable). Didn't believe me when I said it's actually more efficient to walk in the forwards direction through the string and multiply by 10 at each step (he maintained you had to search to the end of the string for the lowest place-value, the walk back right-to-left). I even walked through an example to show him correct result and total operations -- still didn't believe me. No job offer, left the industry.

Comment Re:BS detector went off and is overheating (Score 1) 309

Well... "it has no other interpretation" is a bit strong. Capital Pi is of course used as the multiple product symbol (like capital sigma for sums).

More on-topic, lower case pi can get used for different purposes in mathematics. The one I'm most familiar with is the population proportion in statistical work.

More: Greek letters used in mathematics, et. al. (pi).

Comment Re:Hang on - let me put on my shocked face... (Score 2) 197

Sure, e.g., here are the first few 5-score comments from the Slashdot thread "How President Trump Could Destroy Net Neutrality" on Nov-10, 2016:

"Trump can't do squat..."

"Reality is, for Trump business ventures Net Neutrality is a huge plus and as such it would be really dumb to cripple his and his families future business interests."

"This is through-and-through FUD. To best of my knowledge Trump is rather anti-media, and all big players that would benefit from NN repeal are also happen to be media."

Etc., etc.

Comment Re:Do you just need the right teacher? (Score 2) 229

A major problem is that practically no teachers in U.S. elementary schools actually understand math (and so they teach the emergency fall-back of remember this nonsense). Education majors in the U.S. have perennially had the lowest qualifications of anyone entering college, and the highest rating for math dislike/anxiety. They're effectively self-selected for lack of mathematical understanding. I talked to a guy who used to run a middle school, and he said that he had no hope or even desire of getting math experts into the system, because they couldn't possibly be good with young kids.

There was an excellent article by Patricia Clark Kenschaft in the Notices of AMS (2005), on how she observed this functioning at both poor and wealthy schools, and concluded that most people who got math in elementary school must have some outside/home resource to make that happen. (Link)

Comment Re:This Is What Happens When You Ignore The People (Score 1) 502

Just to begin the breakdown of fake news here: elected politicians actually do deliver on the majority of their promises (66.7% of such promises in the U.S.). That 83% of Americans believe otherwise is simply one of their many mass delusions.

Comment Non-Discoverable Interfaces (Score 5, Insightful) 489

For me, the #1 modern UI sin, which wasn't included in the list here -- Non-discoverable interfaces. Interfaces based on some "gesture" which is never explained, and for which one cannot find an explanation (unless you already know the gesture to get there, if it exists). Pinch-zoom, hover in a magic corner, drag from edge, press screen for short vs. long time, invisible menu bars, etc., etc. In the 1984-2010 era I could follow the words in the menus and discover new features in any piece of software (and so could anyone, assuming they weren't illiterate). The last few years have brought my first experiences with software that I just couldn't begin to figure out how to do anything with.

Comment Anti-War Credentials (Score 4, Insightful) 745

"Hillary was openly hostile with Russia, and while I doubt it would have reached the point of increased risk of nuclear war, Russia still has real nukes, so you never know. Trump on the other hand is, if anything, too friendly with Russia."

Consider very recent history. George W. Bush ran his whole campaign in 2000 on a "compassionate conservative" platform, including that we needed to put America first, not being involved in foreign adventures, stop telling other countries what to do, etc. But he was a dimwitted cowboy wannabe who had no capacity for a real commitment or follow-through to that. He surrounded himself with belligerent neocons like Cheney and Rumsfeld and gave them incredible power. He spent the summer of 2001 saber-rattling at China which turned out not to be the actual brewing threat. Then we did suffer an actual attack on 9/11 and bam, within 24 hours he's freaked out and flipped to the exact opposite; global alliances, regime change, and a philosophy of first-strike invasions if needed around the globe. Before his term was done he'd started two separate intercontinental wars -- one having entirely nothing to do with the attack on us -- which have proved to be the longest in American history, and still not done after almost two decades now.

That is the proven historical result of a fundamentally dumb, belligerent, yahoo, volatile commander-in-chief. It's easy to predict; this is the standard reaction of a chaotic, short-attention-span bully. Sometime in a quiet space ask yourself this: Is Trump truly more or less volatile than George W. Bush?

Comment Lost Money Owning a Casino (Score 1) 406

"Nevada casinos post fifth straight fiscal year net loss" --

"Las Vegas casinos are losing big in China" --

"Pay No Attention to Money-Losing Casinos. Let’s Build More Casinos" --

Slashdot Top Deals

Time to take stock. Go home with some office supplies.