Day 2


Sam's Demo

To start today, as per Holger's request I captured an admittedly very amateur screen cast of Sam's Demo. I wasn't quite sure how to best show the different functions of the program. After a few failures this was the best I could come up with:



Will have to add video capturing skills to the list of things that will (hopefully) improve throughout the duration of this student ship.

I'm not sure how to get four hands up and going currently.

Creating a trial leap hands project

Today I decided to start by attempting to create a basic program that could render two hands as an attempt to get my head around the software a little bit. 

I first downloaded a bunch of stuff:
  • Leap Orion (The SDK for leap)
  • Leap Core Assets (Package with basic functionality)
  • Leap Graphic Renderer (Aims to create a system that allows you to to treat a collection of objects as a group)
I followed a set up tutorial found here:

Which helped me get a head mounted primitive program running however I haven't quite worked out how to change the materials of the hands/anything to do with picking up objects yet. It's quite simply just a representation of hands using the leap camera.



Next I'm trying to work on picking up a basic object (a box in this case) however I need to work out the height because when I put the headset on I'm too high to reach the boxes. In Sam's demo the plane is  lower and the boxes are "floating" at a better hand height. I've played around with it a bit and have a temporary not so good fix where the boxes are floating in mid air but I can interact with it sort of so that's a start.

Leap specific definitions

Thought I'd write a couple of key component definitions to remind myself later:

Hand Pool: Manages representation of the hands in a scene. Basically hand can have multiple game objects associated with it for different specific tasks. 

Leap Service Provider: This is the connection point between the Leap Motion service 


Space Shooter

Am still not feeling very confident with Unity so am going to start on another tutorial project to get a little bit more practice. 








Comments

  1. HolgerNovember 21, 2017 at 4:54 PM

    Very good. Good progress.
    When trying and playing with the application try to interact with it in a meaningful way, i.e. really try to intentionally grab a box and move it etc., This will become more important when we move to multi-arm interactions.
    The next big milestone would be to build an application from scratch with the same functionality and extending it to four arms with the purpose of you becoming an "expert" in all this. Tht will probably require some more Unity tutorials etc.,
    Keep it up!

    ReplyDelete

Post a Comment

Popular posts from this blog

Texturing Hands

Image
Texturing the 3D Hands The purpose of texturing the box was so that eventually I could move on to texturing realistic hands.  The first issue I had was that Leap Motion export their prefabs in the ASCII format of .fbx (i'm guessing because it's human readable?) and Blender doesn't allow importing of ASCII file so I had to convert to a Binary file using an external application.  After importing it into Blender I realized there was something called Armature which I hadn't heard of before and as I started reading I figured it would help to look a little bit into how animation works so I could understand the Leap Motion documentation a little bit better. Leap Motion uses something called Skeletal Animation for their hand prefabs. When using this method we split the character object (in this case hands) into two parts, the skin/mesh and the interconnected bones/rig. The bones are connected in a hierarchy so that when you move for example the tip of the fin...
Read more

5th of Dec Update

Image
Haven't updated in a while because I haven't really made any major achievements, everything has been very gradual in growing my understanding with the Leap API as well as how Sam's demo actually works. I've been focusing the last few days on how Leap works, from how to access any leap data within a script to detecting hands using the HandModels[] from the current Frame. I had a slight play around with the concept of four hands simply by duplicating the LeapController and HandModels twice over and position them in a way as to replicate four hands. Movement is that where both the left hand controls both hands on the left side and vice versa with the right. This was a good way to visualise the task and see the gaps in why this technique wouldn't work. My current challenge is to replicate the mirroring from Sam's demo. Now that I understand the code better I can see that the way that Sam has implemented it is no longer possible with the new Orion API. He mir...
Read more