I used to do "big data" and "cloud" computing when it was called clusters.
Did you run one process with multiple threads across all of those machines, or was threading less of an issue once you started thinking about distributed computing?
I can say this with a certainty: Anything other than a compiled language with low level facilities is a pure waste of time and money.
Isn't that what Numba does? Compiling Python code using LLVM and being able to understand numpy data structures? I'm still not sure I understand what threading has to do with this. The OP said threading was an issue, but threading doesn't
While with Java you at least get some safety for big projects
Safety? Job security?
Both languages suffer from the global interpreter lock defect and will require a rewrite in the next 5-10 years if the languages have any chance of surviving in the servers.
You don't really understand big data, if you think it needs to run on ONE computer.
This is only a problem if you think threading is the solution to scaling CPU computations across hundreds of computers. If you generalized your code to run on hundreds of computers, there is no reason you can't run a process per core for your multicore machines.
You have no idea what he's talking about? It was pretty clear: factions within the US government wants these tools to datamine all the ISP data they have been snarfing up so they can spy on everyone in the world. Saying that you believe otherwise is a pretty extreme view
He has no idea why there is ranting about open source code that everyone in the world can use for any purposes. Did you rant about git being open source? I'm betting the gov't can use that to manage code related to data mining. Do you rant about postgres or any of the databases used by the US gov't? Would postgres suddenly become evil because the gov't threw some money their way?
Yeah the govt needs better systems to manage the huge databases and dossiers they are building on everybody with their warrentless wiretaps and reading everybody's emails. Anybody who helps with this project is pretty damn naive if they don't think it will also be used for this.
Isn't this true of all useful open source projects?
I love the concept of getting authentication onto a separate server/service/system. It's crazy that anyone can run "select * from users" and get a whole sites credential listing with a simple SQL injection.
However, how did you come to suggest Kerberos as the Authentication system. There are many others, all it seems with downsides of being overly complex:
-OpenID, OAuth, Radius, CHAP, TACACS+, LDAP, etc.
bq. the music has to be 100% original as covers are 'illegal'.
That's only if the performer hasn't licensed the cover on their own. They guy from One Man Star Wars
The DMCA doesn't restrict speech. Your contract with your ISP that you enter in gives the ISP the right to take it down. You've waived your right by signing your contract (in the same that NDAs work). The gov't is not forcing the ISP to take it down, so there is no free speech issue here.
Scientists will study your brain to learn more about your distant cousin, Man.