Well, that's it, really. Just watched the video; that's exactly what I'm after, thank you so much for posting. I imagine even if an app like that somehow never made it into production, I could pay a programmer to make one for less than the cost of a MIDI-theremin.
I think you're on the right track with a background app that would be left open. Something with a very simple interface like:
Left hand enable? Yes/No
Left hand X-axis enable? Yes/No. Controller? Insert CC number here.
Left hand Y-axis enable? Yes/No. Controller? Insert CC number here.
Left hand Z-axis enable? Yes/No. Controller? Insert CC number here.
Right hand enable? Yes/No
Right hand X-axis enable? Yes/No. Controller? Insert CC number here.
Right hand Y-axis enable? Yes/No. Controller? Insert CC number here.
Right hand Z-axis enable? Yes/No. Controller? Insert CC number here.
That way you could control up to six parameters independently, but also pull everything right back for simplicity. So you could do a full conducting job controlling tempo, velocity, volume, expression, perhaps reverb level etc. Or you could switch everything off except one axis for one hand, for careful velocity crossfade input. Or just one axis for each hand for a virtual theremin performance.
If you set up Vienna Instruments so that all woodwinds have one CC# for velocity crossfade, all brass have a second and all strings have a third, and do the same for volume, you could (in theory, it might take some practice) conduct and shape the sound of an orchestra in real time. Or not have volume, and instead have one for woodwinds, one for brass, one for strings, one for percussion, one for voices, and one for keyboards. Or do it one section at a time, splitting woodwinds up into flutes, oboes, clarinets, bassoons etc.
I think that with a basic interface like that, a simple little app (which from what I've seen would take only a few hours to code/program) could become a very powerful tool.
Pyre
AMD Ryzen 7 3700X 8-Core Processor, 3.59 Ghz
64 GB RAM
1 TB hard drive for audio, 4 TB hard drive for libraries, 1x 256 GB SSD for OS
Audient iD14 4-in 2-out USB interface
Korg Triton Extreme-76 master keyboard, M-Audio MidAir-25 lap keyboard.
Windows 10 Pro, Cubase 10.5 Pro
VSL Symphonic Cube (Full library), Vienna Choir (standard library), Vienna Solo Voices (standard library), Vienna Imperial, Konzerthaus Organ, and download instruments Recorders, Harpsichord, Basset Horn and Contrabass Clarinet.
Vienna Instruments Pro 2.5.18635 and Vienna Ensemble Pro 5.4.16181
Vienna Suite, Vienna MIR and room packs 1-5
Sibelius 7 and Komplete 8
All 64-bit.