I spent a little time yesterday morning and got the hand interacting the way I want, I actually surprised myself when I managed to script my first gesture, and it works awesome! I can grab things/let them go and the hand animates perfectly. I finally got around to making a quick demo movie of it.
In this Augmented Reality demo you can use the leap motion interface to pickup and move furniture in an augmented environment. This prototype showcases AR image tracking, the use of a LEAP Motion controller, the integration of an articulated 3D hand model, a custom made gesture, and complex AR interactions using an augmented hand, as well as animation to accompany hand gestures.
Next step - Let's make this an Oculus Demo and find a way to make it mobile!