Using Head Gestures in PC Games

Software Download: torbensko.com/software/head_tracking

Using a piece of head tracking software, several head based techniques are developed for interacting with first person PC games. These techniques include zooming, spinning, ironsighting and the window effect (commonly known as the Johnny Lee effect).

For more information see: http://torbensko.com/projects/phd

Created by Torben Sko, The Australian National University. Achieved using software from Seeing Machines and The Valve Corporation.

Duration : 0:3:0


Technorati Tags: , , , , , , , , , , , , , , , , , , , , ,

25 Comments

  1. mrjimmyos
    Posted July 9, 2009 at 5:39 pm | Permalink

    1.28 lol
    1.28 lol

  2. VietnamG
    Posted July 9, 2009 at 5:39 pm | Permalink

    This is bananas, i …
    This is bananas, i need to try it out…

  3. mrbitbot
    Posted July 9, 2009 at 5:39 pm | Permalink

    Good work you’ve …
    Good work you’ve done here, but how will my neck feel after a 3+ hour gaming session?

  4. dalisson55
    Posted July 9, 2009 at 5:39 pm | Permalink

    would be good if we …
    would be good if we could use do the gestures on America arms that you do without voice comands to avoid detection. You know the tactics in the game like lifting your hand to give order to your team mates stop.

  5. dalisson55
    Posted July 9, 2009 at 5:39 pm | Permalink

    Amazing.
    Amazing.

  6. Fleshreap
    Posted July 9, 2009 at 5:39 pm | Permalink

    Pretty great. I can …
    Pretty great. I can see a bright future for you =)

    Essentially what trackIR/freetrack does except without using leds. I hope this gets integrated into as many games as possible.

  7. CvanderStam
    Posted July 9, 2009 at 5:39 pm | Permalink

    If you’re looking …
    If you’re looking to replace controls you should look at Camspace. Just google it.

  8. AngelFleshBlue
    Posted July 9, 2009 at 5:39 pm | Permalink

    That was great, I’m …
    That was great, I’m just wondering how long it will take till microsoft come knocking at your door offering you a job..

    great work, hope you get a first with this project..

  9. odds87
    Posted July 9, 2009 at 5:39 pm | Permalink

    Don’t get me wrong, …
    Don’t get me wrong, it’s superb what you’ve done, but from a gamer’s perspective I can’t see the value compared to conventional input methods — particularly due to the somewhat unnatural neck movements required!

  10. SL33PYbe
    Posted July 9, 2009 at 5:39 pm | Permalink

    I’m afraid I’ll …
    I’m afraid I’ll pull a neck muscle in the heat of the action

  11. bobmar360
    Posted July 9, 2009 at 5:39 pm | Permalink

    @ TomQue -

    I’m …
    @ TomQue -

    I’m in agreement with what you are saying, but, if a ‘activate’ key/button was present then accident movement would be eliminated, i have the feeling that although in theory these could work very well in games, it could also ruin experiences if not implemented creativley, for instance in a Call of Duty game there would be far too much going on for it too work, but in a House of the Dead game it would absolutely ROCK!!!!!

  12. TomQuo
    Posted July 9, 2009 at 5:39 pm | Permalink

    If subtle movements …
    If subtle movements are enough to trigger action in-game, wouldn’t you have to be completely still, and might accidentally trigger what you don’t want to?

  13. freaqie
    Posted July 9, 2009 at 5:39 pm | Permalink

    amazing work!
    amazing work!

  14. torbensko
    Posted July 9, 2009 at 5:39 pm | Permalink

    I’m looking at …
    I’m looking at augmenting control, rather than replacing it. I don’t want to get rid of the mouse and keyboard, but rather look at what else you could be doing simultaneously. I’m increasing the bandwidth between the user and the computer basically.

  15. torbensko
    Posted July 9, 2009 at 5:39 pm | Permalink

    The movements are …
    The movements are exaggerated for the sake of demonstration. You can actually get away with very subtle head movements.

  16. dasheriff001
    Posted July 9, 2009 at 5:39 pm | Permalink

    I can picture my …
    I can picture my neck becoming very sore.

  17. Goofhead3D
    Posted July 9, 2009 at 5:39 pm | Permalink

    HOLY CRAP! This is …
    HOLY CRAP! This is cool!

    I used to work with Source, nice work! The Source SDK aint easy, so congrats on this sweet level of implementation!

    Those guys from Project Nathal should totally hire you!

  18. International0IDIOT
    Posted July 9, 2009 at 5:39 pm | Permalink

    Is this just for …
    Is this just for like this 1 program OR is it so you can keymap the controls with your head movments?

  19. Ludzix
    Posted July 9, 2009 at 5:39 pm | Permalink

    AT 1:00 HIS FACE IS …
    AT 1:00 HIS FACE IS LOOPING RUN

  20. Burkaz0id
    Posted July 9, 2009 at 5:39 pm | Permalink

    Very impressive …
    Very impressive stuff - FaceAPI looks extremely accurate, must give it a go sometime. Nice work :)

  21. Lexus7Productions
    Posted July 9, 2009 at 5:39 pm | Permalink

    You’d get a sore …
    You’d get a sore neck very fast flicking your head left and right to turn a character. But the speed of facial recognition and rotation is very interesting and does present some fantastic options.
    Interaction in games with npc’s by shaking or nodding your head, recognising what your looking at on the screen and so fourth would add extra levels of interaction. I’d like to know if it could work with the video glasses like e-star so you could look round by turning your head and still see the image

  22. originalkangarootoo
    Posted July 9, 2009 at 5:39 pm | Permalink

    I thought some of …
    I thought some of the techniques demonstrated could work perfectly well in a game, and most of them didn’t involve jerking movements. The iron sighting and corner peek moves look like they would work intuitively and without any particular strain. Not so sure about the zoom mechanic. Regardless, if a game took this technology and implemented it in a way that required jerky head movements, that would cimply be a badly designed game and not a fault with the tech.

  23. odds87
    Posted July 9, 2009 at 5:39 pm | Permalink

    Conceptually sound …
    Conceptually sound but in pratical terms I can’t see it myself.

    Jerking my neck foward and to the side doesn’t sound too appealing compared to a single key press on a keyboard that I’m already using for the vast majority of commands.

  24. therobexperience
    Posted July 9, 2009 at 5:39 pm | Permalink

    This gets the prize …
    This gets the prize for the least imaginative thing I’ve read here. And these are /youtube/ comments.

  25. torbensko
    Posted July 9, 2009 at 5:39 pm | Permalink

    If that’s the case, …
    If that’s the case, you’ll love my next video. I’ll be putting it out in the very near future.

Post a Comment

Your email is never published nor shared. Required fields are marked *

*
*