Follow Slashdot stories on Twitter

 



Forgot your password?
typodupeerror
×

Comment Re:Use databases! (Score 1) 235

Actually, these 85k rows represent only a day's worth of data from a single satellite instrument. We often operate on data sets tens of millions of rows large, and the general performance trend is nearly the same.
About scaling: as far as I understand, PyTables' main bottleneck is raw disk I/O. I think that applying a couple of primitive tricks like using memcached and a large amount of RAM will tip the scales in its favor even further, but that needs to be verified.

Comment Re:Use databases! (Score 4, Interesting) 235

Hello, I'm a space research guy.
I've recently made a comparison of MySQL 5.0, Oracle 10i and HDF5 file based data storage for our space data. The results are amusing (the linked page contains charts and explanations; pay attention to the conclusive chart, it is the most informative one). In short (for those who don't want to look at the charts): using relational databases for pretty common scientific tasks sucks badly performance-wise.

Disclaimer: while I'm positively not a guru DBA and thus admit that both of the databases tested could be configured and optimized better, but the thing is that I am not supposed to. Neither is the OP. While we may do lots of programming work to accomplish our scientific tasks, being a qualified DBA is a completely separate challenge - an unwanted one, as well.

So far, PyTables/HDF5 FTW. Which brings us back to the OP's question about organizing these files...

Comment Citation needed (Score 4, Insightful) 757

I did follow the TFA to the origin of the story (MyDroidWorld forum), and I still don't see any code, captured data or even a photo of the said eFuse chip inside the DroidX. I understand that the original poster appears to be a reputable hacker, but come on, what kind of real reporting is this? Can anyone else verify these claims? More information needed, thank you very much whoever posts it, because if true, this is an outrage.

Comment Re:Moderate yourself (Score 4, Insightful) 256

You can't have a lot of kids knowing how to program tomorrow if you don't spark their interest with such a tool today. And IMO this will be great not only for attracting and educating future software engineers, but also to tap into the pool of active talented kids who are not going to be software engineers, ever. The kids who will be nuclear physicists, radio geeks, astronomy fans, journalists will also acquire basic programming abilities without distracting from their main specialty to learn a programming language or two, dive into a complex SDK and constantly work to keep these skills up to date.
In short, I think that App Inventor is pretty awesome.

Comment Re:I might have to sway back and get an iphone.. (Score 5, Interesting) 256

I don't think I understand you correctly: nobody forces you to install those millions of fart-apps! If they find their audience among the teens, why not? Do you really notice that the whole web is literally overwhelmed by pages of similar (i.e. non-existent) quality?
The problem is not that Android Market will be flooded by low-quality apps. The problem is that Android Market has pretty rudimentary app search and filtering capabilities to reduce signal to noise ratio. Sorry for the irony, but Google must build a decent search engine for Android apps.

Comment Re:How is this different (Score 1) 155

Yes, but this crap is reported on Slashdot, which is advertised to deliver news for nerds, not plumbers! Hell, this guy didn't even try to upload his exploit to the official extension repository because, as he claims, he "didn't want to exploit the vulnerability and harm end users".
Remember when Google pulled a vulnerability exploit proof of concept app from the Android Market, and purged it from end-user phones? That was a security research project. And this is just an A-grade crap.

Comment Re:i don't know about radio, but i find (Score 1) 298

I can confirm that; a friend of my recently defended her PhD thesis describing the growth and development peculiarities of Brassica Chinensis when exposed to different combinations of LED lighting - blue, red, and both.
Her research is a part of a big Russian space project; she works on problems of farming edible plants in spacecraft (with all the problems arising from that). Pretty awesome, if you ask me. An earlier paper of hers on the same subject can be found at Springerlink.

Comment It began earlier (Score 5, Informative) 237

In case anyone got interested, the 1958 test was called Operation Argus.
By the way, despite what TFA says, there are two electron radiation belts, not just two of them at all; there's also a proton one. Wikipedia considers it to be a part of the inner radiation belt, but the accepted terminology says otherwise to the best of my knowledge.

Comment Re:Where's the Issue? (Score 2, Interesting) 198

That's the way the law is written. The problem is not that Google intercepted it, the problem is that Google saved their unencrypted transmissions to their hard drive while not being authorized to do so.
I condemn groups like Privacy International for using Google's screwup as a cheap PR resource to promote themselves. You want to claim that it was intentional, prove it in the court! Where's the libel law when you need it?

Comment Privacy Advocacy Theater (Score 5, Insightful) 198

There is little to add.
...
I want to focus on a related problem that I’ll call privacy advocacy theater. This is a problem that my friends and colleagues are guilty of, and I’m sure I’m guilty of it at times, too. Privacy Advocacy Theater is the act of extreme criticism for an accidental data breach rather than a systemic privacy design flaw. Example: if you’re up in arms over the Google Street View privacy “fiasco” of the last few days, you’re guilty of Privacy Advocacy Theater. (If you’re generally worried about Google Street View, that’s a different problem, there are real concerns there, but I’m only talking about the collection of wifi network payload data Google performed by mistake.)
I’m looking at you, EU Privacy folks, who are investigating Google over accidental data collection. Where is your investigation of Opera, which provides Opera Mini, billed as “smarter web browsing”, smarter in the sense that it relays all data, including secure connections to your bank, through Opera’s servers? We should be much more concerned about designs that inherently create privacy risk. Oh sure, it’s easy political points to harp on accidental breaches for weeks, but it doesn’t help privacy much.
I also have to be harsh with people I respect deeply, like Kim Cameron who says that Google broke two of his very nicely crafted Laws of Identity. Come on, Kim, this was accidental data collection by code that the Google Street View folks didn’t even realize was running. (I’m giving them the benefit of the doubt. If they are lying, that’s a different problem, but no one’s claiming they’re lying, as far as I know.) The Laws of Identity apply predominantly to the systems that individuals choose to use to manage their data. If anyone is breaking the Laws of Identity, it’s the wifi access points that don’t actively nudge users towards encrypting their wifi network.
Another group I deeply admire and respect is EPIC. Here, they are also guilty of Privacy Advocacy Theater: they’re asking for an investigation into Google’s accidental wifi data collection. Now, I’m not a lawyer, and I certainly wouldn’t dare argue the law with Marc Rotenberg. But using common sense here, shouldn’t intent have something to do with this? Google did not intend to collect this data, didn’t even know they had it, and didn’t make any use of it. Shouldn’t we, instead of investigating them, help them define a process, maybe with third-party auditing from folks at EPIC, that helps them catalog what data they’re collecting, what data they’re using, etc? At the very least, can we stop the press releases that make no distinction between intentional and unintentional data collection?
I’m getting worked up about this Privacy Advocacy Theater because, in the end, I believe it hurts privacy. Google is spending large amounts of time and money on this issue which is, as I’ve described previously, an inevitability in computer systems: accidental breaches happen all the time. We should be mostly commending them for revealing this flaw, and working with them to continue regular disclosure so that, with public oversight, these mistakes are discovered and addressed. Google has zero interest in making these mistakes. Slapping them on the wrist and having them feel some pain may be appropriate, but too much pain and too much focus on this non-issue is akin to a full-on criminal trial for driving 10 miles per hour over the speed limit: everyone’s doing it. Just fine them and move on. Then spend your time going after the folks who, by design, are endangering millions of users’ privacy.
There are plenty of real, systemic privacy issues: Facebook’s data sharing and privacy controls, Opera Mini’s design (tens of millions of users relaying all of their data to Opera, by design), Google’s intentional data retention practices, web-based ad networks, We have enough real issues to deal with, who needs the advocacy theater?

Comment Re:What about Google? (Score 1) 487

Even according to RMS, AdSense and Google search cannot be considered proprietary in the same sense as e.g. Photoshop since they are not distributed (JavaScript notwithstanding). Google runs them on their servers, not you. And it is popular knowledge that Google started based on Linux, MySQL, Apache and many other open-source projects. Without them, there would be no Google, at least not in the past decade.

Slashdot Top Deals

Living on Earth may be expensive, but it includes an annual free trip around the Sun.

Working...