Am I understanding correctly that you have reimplemented threads on an application level, instead of the OS level? So your application's threads (fibers, whatever) can be pre-empted by the OS, because the OS doesn't care about your scheduler when it's handling its own processes?
This is absolutely correct. And, if you check, this is what any system that wants to be able to manage tens of thousands of threads does (not necessarily with the exact same techniques). Including all major databases, all large scale virtual machines, etc. Recent versions of MacOS X even provide system libraries to simplify the implementation of such user-level threading (under the name of Grand Central Dispatch).
Am I also understanding correctly that there's no priority system for your threading implementation?
Actually, there is one. It is just not exported to userland yet.
Ah, I think I finally understand your point. It is about compatibility, not about paradigm, is it?
If so, you may be happy to learn that the low-level layers of Opa can already access other databases. The feature is not accessible at high-level yet because we are going to make a number of breaking changes before long, but eventually, we do intend to give access to most mainstream databases. Would this solve your problem?
But that is not the point. The point is that this is a problem that *every* non-trivial web application needs to face. The point is that we faced it and we beat it, so that Opa developers do not need to. Should a new browser version arise and cause new incompatibilities, *we* will be the ones doing the heavy debugging until we can produce a new version of the compiler and runtime that lets developers forget about the incompatibilities.
So yes, these brittle bases made our work difficult (and interesting
Caveat I'm part of the Opa team. Well, worse than that, I am the architect-in-chief.
The problem is that you've just created a monolithic application that ties one single database to one single front-end. What happens when you want to swap out databases?[...] It's just another language that corporate developers not only need to learn, but need to sell to management [...] But as it is, it's an interesting idea, nothing more - I'd never let it in my development shop, and even if I did, the architectural committee would hang me out to dry.
I can understand the issue. Would this calm your concerns if I told you that
- on the Opa git, there is an Opa version for Windows – it's not quite ready for prime-time, but it's there;
- Opa is designed to be able to link with other server-side technologies – for the moment, OCaml and C, other technologies will arrive in time;
- at low-level, the Opa database can access other, mainstream, database – the feature is not quite exported at high-level yet, because we are not quite satisfied with it yet, but in time, it will;
- and of course, there is always the option of modularizing your code through the use of web services, which is a nice way of allowing [hot]swapping of components.
Of course, what do I know about compilation? I only have a PhD on the topic and 9 years of professional experience.
- analyze statically the whole code and determine what goes on the client and what goes on the server (I tend to believe that this is not feasible with a dynamic language, but of course, feel free to prove me wrong);
- inject Ajax entry points on the server (no real problem there);
- inject Comet re-entry points on the server (requires a server-side language that supports either CPS or tens of thousands of lightweight non-blocking threads – theoretically possible with custom implementation of the languages).
That's without security or distribution, without database, without a syntax for css or html, but it looks somewhat possible for some languages, with considerable effort. Say, if you attempt to do this, don't hesitate to ping me, it might be interesting.
How is using Pepper different than ActiveX with Internet Explorer?
One word: sandbox.
Is there any reason that a language like Java, C#, C++, Python, Perl or Ruby, or with the appropriate framework and compiler couldn't do the same thing that Opa is aiming to do?
Frameworks definitely would not suffice. Reaching the level of features of Opa, even without security, requires quite complex static analysis that strictly eliminates Python, Perl or Ruby, and in practice, even C++. Now, it might just be possible with Java or C#, with non-trivial changes to the language and compiler.
Unsurprisingly, we agree.
Caveat I am part of the Opa team. Well, worse than that, I am the architect-in-chief.