Thanks for the Scala reference.
In general, we need virtual instruments like the Vienna Instrument to allow us more freedom to "misbehave" creatively. I used to own a couple of Akai S3000 samplers, with limited ram and no possibility of anything like the VSL Legato Tool. Of course I don't want to go back to that. But with an Akai, once I got the samples into the machine, I figure I had far more easy possibilities to mis-use the samples than I do now. Pitching samples up or down by eight octaves, creating extravagant pitch wheel glissandos, filtering, reversing and generally manhandling the audio was easy and fun. Now it feels as if we're being forced into obedience, forced into correctness by the interface.
I don't think what I want would take a terrifying amount of work to implement. Loads of free VST soft synths have these sorts of thing as standard.