MIDI to OSC | Shapekeys (Blendshapes)

[marcus-universe]

Hi everyone 😉✌

I'm working on my own VRChat Piano Avatar.
I created for every note on the piano a shape key (Blendshape) that presses the note down.

I also received over Touch Designer Midi signals to OSC on Port 9000. The Signals provide a Midi Name (ADDRESS) that starts with /ch1n and after that with the corresponding number for the Midi Key. Every signal provides a Float value between 0 - 1 (depending on how hard I press a key on the piano).

Here a Spreadsheet for orientation 😉👍

In Unity, I created an Avatar Parameter Expression to Test the Key ch1n73 (C#) 😏

Now my question is, How I can change a shape key with the parameter values? 🤔
Blendshapes have values between 0 to 100. This means I need to multiply it by 100. I found a doc for manipulating Shapekeys with C#.
https://docs.unity3d.com/Manual/BlendShapes.html
But how do I get the values from the OSC parameters? 🤔

[EIA485]

if i were you id remap each note to a bool, this can easily be done in td. while this would not take velocity into effect implementing that would be fairly complicated. in order to turn those bools into the shapekeys moving you want to use the fx layer animator on your avatar. for each key make a down animation then have a layer in the animator go between entry, down and exit with the condition being that note's bool. if you need a more detailed explanation lmk.

[marcus-universe]

in order to send bools from td use a math chop to clamp the midi vel to 0-1 instead of 0-127 then set the osc out chop to int.

Ok we have the Ints from 0-1. Now I making all the animation. :)

[marcus-universe]

@EIA485 Where I have to add the condition and is it later possible to press multiple notes at the same time or do i need a blendtree? 😅

[EIA485]

you to it on the transition, im realizing you need to make a dummy default state for each layer. it is possible to press multiple notes, just make a layer for each one. remember to set all the layer's weights to 1.
also, remember to all all the notes as bool parameters both to the animater in the parameters tab and in the vrc parameters object.
figure i should leave the unity docs here for reference

[marcus-universe]

@EIA485 A small update: I get it to work and it works fine. Thanks for the help :)

For everyone else: I figured out that VRChat has an OscCore Package that makes many things easier in C#. I guess this will be easier than making 88 Animation for On and Off. Instead of 176 Animation, it's possible to just route the shape keys to bools and multiply them by 10. Here is the doc on how to manipulate shape keys in C#

[EIA485]

the only issue with this is that you cant have your own scripts on avatars, how ever you can use editor scripts to generate the animations and animators for you.