Video Gaming is About to Get More Real: Three Innovations You Need to Know

By Lori Cameron
Published 08/30/2017
Share this on:

boxing video game

With profits topping $91 billion worldwide last year, the gaming industry is about to turn an unprecedented corner in immersive, realistic video game play.

Researchers are studying the latest innovations in user interface technologies to see what features provide the most satisfying user experience. The May/June 2017 issue of IEEE Computer Graphics and Applications discusses a study (login may be required for full text) with 50 participants (38 males and 12 females), of varying ages and expertise, playing a variety of popular games including Hustle Kings, Pain, The Fight, and Tumble.

Read video gaming research here (login may be required for full text)

So pick up your console and see how their findings conclude that combining three significant features provides the most immersive and engaging gameplay: stereoscopic 3D visuals, head tracking, and hand-gesture interfaces.

Stereoscopic 3D Visuals

Hustle Kings, Sony PlayStation 3
Hustle Kings, Sony PlayStation 3

Stereoscopic 3D visuals have been around a while but have only recently been used in video games. Since most video games are created in a 3D game engine, all you need is a stereoscopic driver, such as Nvidia 3D Vision or Tridef Ignition, to make it work. The research study compared how well players did with and without the 3D visuals.

“We found that when participants interacted with only a single object at a time with a more or less static background environment (such as aiming a cue ball or putting blocks on a table in 3D space) significant performance benefits occurred for the stereoscopic 3D viewing condition over the 2D display,” wrote Arun Kulshreshth of the University of Louisiana at Lafayette, and Kevin Pfeil and Joseph J. LaViola of the University of Central Florida.

Head Tracking

Microsoft Flight
Microsoft Flight

Head tracking in a virtual reality headset can create a heightened sense of reality. Players actually feel immersed in the environment. In the study, gameplay satisfaction was measured in players who used head tracking and those who didn’t.

“Our user study found that head tracking offered significant performance advantages, but only for expert gamers playing Arma II (better survival time) and Wings of Prey (better time and more enemies shot). Both Arma II and Wings of Prey are shooting games, and in both games head tracking helps players find enemies around their current position,” said Kulshreshth, Pfeil, and LaViola.

Hand-Gesture Interfaces

 Hand-gesture-based menu techniques: hand-n-hold menu with vertical layout
Hand-gesture-based menu techniques: a hand-n-hold menu with vertical layout.

Hand-gesture interfaces allow players to control menus in a variety of unique ways:

  1. Hand-n-hold: In this technique, users control a cursor by moving a hand in the air.
  2. Thumbs up: A user holds a fist in front of the input then moves the fist horizontally, vertically, or radially in a virtual plane to highlight an item, and then give a thumbs-up gesture to confirm the selection.
  3.  Finger count: All the menu items are numbered, and the user has to extend a corresponding number of fingers to select a given item.
  4. 3D marking: In this technique, the user performs a series of simple gestures instead of a compound stroke. To select an item, the user positions a fist in the center of the menu and moves it toward the desired item and then gives a thumbs-up gesture to finalize the selection.

The innovations signal a leap forward toward immersive, realistic gaming.

Soon, it will not be uncommon to see gamers wearing headsets, whipping their heads around, and alternately poking and punching the air—amusing to us and a heckavu lot of fun for them.

The increased physicality and realism these new features bring to gaming will plunge players deep into another world where they can face off against zombies, monsters, enemy soldiers, and athletes or explore places they’ve never been.

It’s about to get real.


Related research on video gaming and design in the Computer Society Digital Library

Login may be required for full text.




About Lori Cameron

Lori Cameron is a Senior Writer for the IEEE Computer Society and currently writes regular features for Computer magazine, Computing Edge, and the Computing Now and Magazine Roundup websites. Contact her at Follow her on LinkedIn.