Follow Slashdot blog updates by subscribing to our blog RSS feed

 



Forgot your password?
typodupeerror
DEAL: For $25 - Add A Second Phone Number To Your Smartphone for life! Use promo code SLASHDOT25. Also, Slashdot's Facebook page has a chat bot now. Message it for stories and more. Check out the new SourceForge HTML5 internet speed test! ×
Cloud

Apache Hadoop Has Failed Us, Tech Experts Say (datanami.com) 73

It was the first widely-adopted open source distributed computing platform. But some geeks running it are telling Datanami that Hadoop "is great if you're a data scientist who knows how to code in MapReduce or Pig...but as you go higher up the stack, the abstraction layers have mostly failed to deliver on the promise of enabling business analysts to get at the data." Slashdot reader atcclears shares their report: "I can't find a happy Hadoop customer. It's sort of as simple as that," says Bob Muglia, CEO of Snowflake Computing, which develops and runs a cloud-based relational data warehouse offering. "It's very clear to me, technologically, that it's not the technology base the world will be built on going forward"... [T]hanks to better mousetraps like S3 (for storage) and Spark (for processing), Hadoop will be relegated to niche and legacy statuses going forward, Muglia says. "The number of customers who have actually successfully tamed Hadoop is probably less than 20 and it might be less than 10..."

One of the companies that supposedly tamed Hadoop is Facebook...but according to Bobby Johnson, who helped run Facebook's Hadoop cluster before co-founding behavioral analytics company Interana, the fact that Hadoop is still around is a "historical glitch. That may be a little strong," Johnson says. "But there's a bunch of things that people have been trying to do with it for a long time that it's just not well suited for." Hadoop's strengths lie in serving as a cheap storage repository and for processing ETL batch workloads, Johnson says. But it's ill-suited for running interactive, user-facing applications... "After years of banging our heads against it at Facebook, it was never great at it," he says. "It's really hard to dig into and actually get real answers from... You really have to understand how this thing works to get what you want."

Johnson recommends Apache Kafka instead for big data applications, arguing "there's a pipe of data and anything that wants to do something useful with it can tap into that thing. That feels like a better unifying principal..." And the creator of Kafka -- who ran Hadoop clusters at LinkedIn -- calls Hadoop "just a very complicated stack to build on."

Comment Re:Fait Acompli? (Score 1) 206

If you wanted to really restore the consumer-manufacturer balance the first thing you should do is create a "Digital Sales Act" that basically says if it walks, talks and quacks like a duck it's a duck. Once you start invalidating most shrinkwrap and clickwrap licenses then you can start talking consumer rights.

Microsoft is showing us what that future looks like, though, and it involves ads in your apps whether you paid for them or not. And if you don't own the software, then guess what? You're going to lose any and all rights to modify it. In fact, it might even become a crime to block those advertisements.

Then there's just one small step away to force everyone to use these adware/spyware systems: declare that only approved operating systems will be permitted to connect to the internet for "security" reasons. At first that will include numerous Linux and *BSD distributions, but it's easy enough to manufacture a crisis or simply pass legislation with no basis in reality and plug that hole later.

Comment Re:Note to self (Score 1) 206

But if printers were designed to be maintainable, with modular heads that could be snapped out and replaced, this wouldn't be a problem....

They used to be available. I'm blanking on the PN... but one of my housemates used to have a tabloid-format HP deskjet which had ink cartridges which snapped into a head cartridge which snapped into a carrier. It had a little bit of banding so it wasn't exactly spectacular, but it did have a separately replaceable head. You could buy a fully-loaded head package, the head alone, a full ink package, or any ink tank alone.

Comment Re:Note to self (Score 1) 206

What printer company sells me a printer and OFFERS me cartridges instead of doing the printer equivalent of a dealer doing his "first one is free" pitch?

Unless things have changed recently, that's Canon. They not only have long been the easiest to refill, but actually are known for working well with third party ink. Continuous inking systems are not very expensive either, and make it trivial to dump in as much third-party ink as you like.

I don't print color, though, so I have an old HP laser, a LJ2300DN with some DIMM upgrades and an additional tray. It has toner cart DRM, but I have a stick-on PCB which you attach with double-sided tape to make a home-refilled toner cart work again. The fix was two bucks. Ethernet, Duplex, feeds 500 sheets before it needs attention. There's even a 500 sheet tray for it which improves that by half again, but I ordered one and they sent me a 250 tray instead so I got that for free and called it good.

Comment Re:If I had my way... (Score 2) 206

Laws got made because of that, and now auto companies must allow those manufactures to make parts right away.

That is a great benefit, but the fight there is not yet over. What's needed now is to make illegal any agreements that the suppliers who actually make these parts won't be able to sell them to consumers directly right away. It's not until that happens that it really becomes affordable to maintain a vehicle, and so there's a period in between the end of the warranty and the time when the suppliers start selling their parts into the non-dealer channels where it's prohibitively expensive to maintain vehicles.

Comment Re:Note to self (Score 1) 206

Well, they are an IBM company.

Yes. I used to work for the MIS department of the Health and Human Services agency at Emeline St. in Santa Cruz, back in the day when it was all PS/2s on star-wired token ring, and we had HPLJ2s and HPLJ3s, and whatever printer was their contemporary from Lexmark. And the Lexmark printers even then caused ten times more problems.

Comment Re:Fait Acompli? (Score 4, Interesting) 206

Nobody should be surprised by this kind of shit any more; the only surprise is that there seems to be no sign of the bloody revolution that usually follows such ongoing abuse by the rich and powerful.

A revolution never come with a warning
A revolution never sends you an omen
A revolution just arrived like the morning
Ring the alarm we come to wake up the snoring

Slashdot Top Deals

Computer Science is the only discipline in which we view adding a new wing to a building as being maintenance -- Jim Horning

Working...