Vienna Symphonic Library Forum
Forum Statistics

182,258 users have contributed to 42,215 threads and 254,736 posts.

In the past 24 hours, we have 2 new thread(s), 23 new post(s) and 44 new user(s).

  1. Home
  2. Sample Libraries
  3. Vienna Instruments Libraries
  4. Using the Wii to play VSL in real time

  • Using the Wii to play VSL in real time

    P
    P
    last edited
    last edited
    Working quite independently and without knowledge of Jay Bacal's awesome rendition, I made my own performance of Beethoven's Op. 59, No. 3, finale in early January. I use the Nintendo Wii controller to play my rendition after spending god-knows-how-many hours putting it all together "offline."

    I'm still refining how I set up the Wii controller to affect tempo, loudness, sample selection, etc. (which is why I made this experiment to begin with). So, this one particular run-through is not necessarily what I'd consider my "best shot" at the piece. It's easy enough, though to just play it again and do something different. And, it's quite fun, too!


    Video of Op. 59, No. 3 Finale
  • G
    G
    WOW! It sounds awesome! I thought it was a real quartet playing. Sorry for my ignorance but what the the hell are you doing with that remote or controller in your hand? Whatever it is seems very effective.
  • P
    P
    Thanks, Guy.

    I'm just using the controller to speed up and slow down. I'm feeding "speed" data to a tempo fader in Logic 8. In one spot I also use the size of my gesture to switch to the HARSH string articulations.

    In other music, I also use the controller to modify various other MIDI controller data, but here I was only focusing on speed.
  • G
    G
    Paul-So you were doing this live?
  • P
    P
    Yes, exactly. It's not just "air conducting!"
  • G
    G
    Why do you feel it's better with this, and what's the price and name of this controller? Air conducting, 1st time I hear that ; )
  • B
    B

     Hi Paul,

    Magnificant job on the Beethoven!  Your mock-up is absolutely impeccable!  On a side note, I've been very impressed with you Fauxharmonic website, what a wonderful idea!  Anyway, since watching your video I've viewed the other videos you have with wii conducting on your youtube profile.  I must say you have put together some really excellent demonstrations, personally I think the Strauss and the Beethoven 7th Symphony (2nd mvt.) videos seem to show you having more impact on the performance than the Op. 59, No. 3 video.  Though I can hear you are effecting the tempo of the string quartet, it looks more like "air conducting" than the other videos (perhaps its because the piece has so much motor-rhythm).  I say that because I've done some live pieces for electronic sounds and wii (using the same OSCulator program I'm sure you use, but with KYMA instead of straight midi) and some aspects of the wii controller are tricky to control when combined with too many others controls, and can appear to an audience as having no effect, when it actually is doing something.

    I was curious, what aspects of the wii do you assign to tempo, dynamics (vel-x-fade), and matrix selection.  Example:  Accel-X or Accel Y for tempo, and perhaps Pitch for dynamics (vel-x-fade), and Roll or Yaw for matrix selection?  Just curious about those details, if you wish to share, if not I understand [;)] .....trade secrets! [:)]  It does seem like you've found some very successful settings.

    Again, wonderful job!  I love it....watching your videos put a big smile on face! [:D]

    Brian 
  • B
    B
    last edited
    last edited

    @Guy said:

    Why do you feel it's better with this, and what's the price and name of this controller? Air conducting, 1st time I hear that ; )
     

    Guy,

    You need a Nintendo Wii Remote Controller

    http://www.nintendo.com/wii/what/controllers 

    AND

    You need the software interface called OSCulator

    http://www.osculator.net/wiki/

    The controller connects to your computer with bluetooth. 
  • G
    G
    Thanks Brian. Looks interesting.
  • B
    B

    I've been thinking about how someone should invent such a thing for conducting samples - little did I know we've already had the technology for a couple years and Nintendo made it possible! 
  • M
    M

    Paul,

    This is a brilliant idea. Not only for conducting classes, where a direct "control" over the music is possible (instead of using a CD), but also just as a tempo controller for rubato. Very natural. I'm sure this could be taken even further on... maybe some institutions would be interested in that, considering its low cost and effectiveness. At least, I am. Thanks for sharing that with us!

  • P
    P

    Hm... also viewed the baton test video partially - do you actually exaggerate at some point where one could believe it would be completely random conductor thoughts? Interesting idea though to connect various parameters to one controller...

  • P
    P
    last edited
    last edited

    @PolarBear said:

    Hm... also viewed the baton test video partially - do you actually exaggerate at some point where one could believe it would be completely random conductor thoughts? Interesting idea though to connect various parameters to one controller...



    I don't really understand your question. Sorry.

    BTW, regarding "connecting various parameters to one controller" ... well, it's really multiple controllers on one device. In other words, three axes of motion can be mapped to three different controllers. Also, the various buttons on the controller can be mapped not only to MIDI notes (for VI keyswitching, for example), but also can be mapped to commands controlling the host software, such as "stop" and "rewind" and "play." On top of this, the various sensitivities can all be adjusted (indeed, must be adjusted) according to the demands of a particular piece of music, and conducting style. This is all done with off-the-shelf software and hardware (Wii, OSCulator, Logic and VI).

    I now use this setup in real-world commercial projects. For instance, I just finished a CD for a soloist in which he is accompanied in real-time in the recording studio. You can see some of that on the video on the Fauxharmonic home page. I can't tell you how amazing it is to have the ENTIRE orchestral setup (computer, VSL, etc, etc.) all hidden away from the soloist ... and all we have to do is simply play the music.

    Unfortunately, of course, I can't use any frozen tracks. So, I'm always dangerously close to getting the dreaded pops and clicks associated with pushing disc, RAM and processors to their limits. But, having used VSL since 2003, I am confident we will continue to see swift increases in computing power. So, it's now just a matter of money and/or time (wait, time = money, so I guess just "money") before real-time performance without using VI "optimized" tracks or frozen audio tracks -- and having a full orchestra on hand -- will be the standard work-horse of my studio. (Anyone could do this now, given enough money, and I would be happy to help set it up, if you like.)

    In November I'll be conducting a performance of the 2007 adagio contest winning piece, live in concert at Barge Music in NYC. And after that, it's the Beethoven symphonies! So, the dream of the digital orchestra becoming an actual musical instrument, as opposed to only a non-real-time studio production tool, is being realized!
  • P
    P
    Brian,

    Yes, I use the OSCulator program. But I don't have much need for KYMA, so I just use the MIDI part of OSCulator. (Plus, one has to pay $$ for KYMA.)

    To tell the truth, I have forgotten what's mapped to what (I'm out of town now, but I'll review it and send you a note when I get back). Also, in Logic itself the signals from OSCulator are also run through various transformers, and then those are also run through VI instances where different cutoff points are set up to delineate different triggers. And, those parameters, controlled by, say, controller-1, have different response curves drawn into the VI interface so it's not always a linear scale being followed. Using key commands sent to Logic (via the Wii), I can also switch to different sets of all of these things in real time as the piece is playing. But, if I do that, I get royally confused, so I try to avoid having to do that.

    In general, the more I can work out in advance (e.g., in terms of balance, articulation choice, etc.) the better ... leaving only a few parameters to be controlled in real time. The most important things to have control over are tempo, loudness and starting and stopping (e.g., fermatas). Zillions of other things "could" be controlled also, but having to keep track of them and even understand what's happening only gets in the way of playing music. So, I avoid complexity there. Feel free to contact me privately if you want more details.
  • C
    C
    last edited
    last edited

    As 'real' orchestra and chamber music musician I have to ask you:

    for what reason are you doing this?

    Investing months or even years for something that NEVER will sound like a real musician.

    It is spectacularly indeed, but in my opinion only for a circus show.

    I just read an online article at www.spiegel.de

    about your project, and I can't agree with it,it even made me smile.

    But thats maybe because playing Cello is my profession and I studied it for many many years and now I earn good money with it, and somebody like you tries to replace our performing art with a computer?

    Or is it just for fun, then I excuse myself for my recent words.

    VSL is an outstanding product and a breathtaking composing and production tool, thats for sure, I use it for my compositions and I love it, I even recorded samples for them, but there will never be a product (either from VSL or another company ) that can replace a real musician to 100%,like there will never be a robot with real human feelings, and I think we all are very happy about that!

    anyway, have fun and good luck with your project!

    christof

  • C
    C

    No,of course VSL is not putting up a circus show, I believe that Herb's vision was to create a great orchestra tool to approach  to a real orchestra, not to replace a real orchestra or real musicians(He even is a musician as well).

    I just wanted to know if Paul has the intention to replace us real musicians.

    In this case he will never be able to do this.

    But maybe he doesn't want to simulate the real thing.

    I am just curious.

    It's like the robot with real human emotions, never ever! 

    No hard feelings either;-)

    christof 
  • B
    B

    Hi Christof,

    I'm certainly not responding to your post to speak on behalf of Paul H. Smith, but I do want to mention something about the Wii Remote in regards to what you said, because you use VSL and think its an outstanding tool.  I agree with you!  However, as we all know VSL does not work all on its own.  In addition to VSL you need a computer, audio output, speakers (or at least headphones), a sequencer (if you want to hear more parts than you can play yourself), and I think most people use some sort of midi keyboard.  I like to call these things as a whole the INTERFACE.  The interface between you (the human) and the vibrations in the air that hit your ears.  Your instrument is an interface, language is an interface, some might even argue that our body is an interface.  I think its fair to say, the more understanding, control, and sensitivity a person develops with an interface the more likely we are to call that person talented.  Even if the results they produce on that interface may appear displeasing to or may not be understood by some, the fact remains that they can produce and replicate those results many times over when others on the same interface can not.  It still means that particular person is talented.  I'm getting a little off track here, but the point is that humans want desperately to be expressive and want other people to feel that expression.

    However, there is always an interface between those two boundaries, and it has to be reckoned with if communication/expression is going to take place. Now we've all accepted the computer/digital interfaces between our musical desires and the results coming out of the speakers.  Some of us are better than others at that interface, because they've discovered how to translate their expressiveness through the interface.  Most of the time this has to be learned though hours of experimentation and practice.  However, there are some things the body (because its an interface that is closer connected to the brain) is just naturally more expressive at than our digital interfaces.  As a musician I'm sure you can relate to that!  I believe conducting is one of those things.

    I don't know about you, but if I could conduct in my tempo maps rather than draw them in by hand, I would jump at the opportunity because I know I can be more expressive with my body in that way, than by drawing with my mouse on the computer.   I think the Wii Remote has the potential to let more of the humanness into our digital music worlds because it relies on body motion.  Notice I say potential, but I think Paul H. Smith is seeing that potential and doing some really good experiments to make our sampled music more expressive.  So I don't look at it as trying to replace real musicians, but the Wii is just further developments in human digital interfaces.  Lots of great stuff!  Ok I'll stop now as I think I've gone on probably a little to much.  [:D]

    Brian 
  • D
    D

    I think that the advantages or disadvantages of using the Wii to control tempo is dependant on what sequencer you use. With Logic it is probably very useful. With Cubase, not really.

    DG
  • H
    H

    Basically everything that can be done with a Wii controller can be also done by moving faders on a control surface. Technically spoken.

    But artistically it makes a difference if you have something really "in your hand", especially with audio feedback and playing in realtime. After a while you come into a musicians' mode instead of a programmers' mode. If you combine different parameters with different axes then you begin to link certain sounds to certain "gestures". Which is definetely something very different than drawing cc parameters with a mouse. This is the point for me where it begins to really be like playing an instrument.

    I use Wii control, graphic tablet, data glove. And yes, the result can be emotional, why shouldn't it.
  • H
    H

    I should add that of course for me it still is more easy to control six or seven parameters in realtime on a real instrument than on a virtual, and also it has more options soundwise (I am a professional violinist). But I do not see that it will "never be like the real thing". Virtual instruments will probably be even more expressive than physical instruments somedays ... if we players can handle them.