Philip Rosedale wrote:
Good conversation, overall confirms the direction we've been thinking. OK, so I put up a new page in the wiki which is a project page for the specific work we're thinking of doing next:https://wiki.secondlife.com/wiki/Gesture_RecognitionWe have an intern starting at beginning of June who will work on this project. It would be fabulous if someone here wants to do a patch for Snowglobe that does the viewer side of this (see doc), which is to listen for local network packets and trigger gestures and set lookAt based on the contents of those packets. That would allow us to have the intern focus totally on the recognition/analysis app, and would also allow folks in the community who want to play with other hardware or analysis algorithms to do so.Summary: hopefully this summer we can update Snowglobe to make your avatar nod, shake its head, and look around in response to what a commodity webcam can see.
OK, this is very helpful information. It clears up the confusion around whether you were looking to trigger high-level gestures (or other action) versus translating user motion into avatar movements. It turns out that you want to do both. :-) That raises some interesting questions about how these two input streams will interact with each other, but the viewer already contains a rich avatar animation layering mechanism so it should be straightforward to find a good priority for the animation part. The look-at system has a similar priority system and a suitable priority will need to be chosen for this part as well. And of course we'll need two new saved settings so that a user can enable/disable each part independently.
In order to get my head around the project I created the attached diagram showing the design space in which we're working. I think it will be important in these discussions to always be clear which data paths we're talking about at any particular time.
-Melinda
<<inline: gestures.png>>
_______________________________________________ Policies and (un)subscribe information available here: http://wiki.secondlife.com/wiki/SLDev Please read the policies before posting to keep unmoderated posting privileges
