If you look at various vehicles, the smaller it is, the more direct the control is, and there are good reasons for that:
In a small vehicle, there are a lot of feedbacks (vibration, inertial forces, sound) that help the driver control it, in fact it adds a lot of information above just vision and makes fine control possible.
If the vehicle is very small, there is also a direct influence on body position on the handling...This trend of "the smaller your vehicle is, the more direct the controls should be" is evident if you consider those few examples:
skateboard/rollers/ski/snowboard/...: direct control through your feets, huge influence of whole body, more like a different way of running than a vehicle : simulations sucks and are completely useless for mastering those sports
bicycle/motorcyle: direct control without multiplication of steering angle through handle bar, body position very important, need good balance, simulation very poor and almost useless for learning to drive.
quad: like a small car, but input is still direct and body position quite important. Balnaces skilss are not as vital as for 2-wheeled vehicles. Simulation stil not very usefull....
car: direct input with fixed demultiplication, body position mostly not relevant but still a lot of direct feedback. Simulation usefull, but not really for racedrivng or getting used to heavy traffic/different road conditions.
slow moving 4-wheeled vehicles, trucks: body position unimportant, few direct feedback (but still some),: Simulation quite usefull, except for traffic
planes, trains: body position unimportant, few direct feedback besides inertial forces (and approximating those with angling simulation cabins work good for large planes), no direct interraction with other vehicles. simualtion very usefull, you can really learn to pilot this way, because it is in a way a much more abstract and, yes, simpler control (hence the auto-pilot...)
Given that, extending stick driving to trucks may be feasible (but still, they are on the same roads as car)...
For car, it looks like a really really bad idea.
For motorcycles, it is simply suicide....