Heuristic Evaluation (Jonas)

As of the time of writing, the software prototype already offered much of the core functionality. I am able to start the game by entering the screen, select a difficulty and optionally see a description of what’s going on.
During the game, a horizontal bar at the bottom of the screen displays all system state information needed by the players: Color of players and their associated scores. Each player has an easy to distingush color. Each player should know his color, since the full camera image including colored player outlines was shown during difficulty seleciton.
It is somewhat difficult to get startet with this game, since game times might not appear where they are expected to be (like, left player on left side, right player on right side.)
All colors used in the game seem to be consistent to some degree. Players always get the same colors (blue, orange), success is indicated with green, failure is indicated with red. Tiles have a colored background, the color indicates to which player the tile belongs. Overal, the presented graphics are clean and kept basic.
Users may choose higher difficulty levels when they play again. Doing so will not show the introduction again, since those users already seem to either know whats going on or want a tough challenge.
Users are required to remember all games before the actual game starts. This could be bad, since some users may decide to quit playing while the introduction is still shown. On the other hand, showing the introduction during gameplay will severely interupt the game, leaving tiles out of sync with the players bodies. Not showing an introduction at all is no option either.
The introduction itself gives minimalistic explanations for the games. Those explanations might not be enough to actually understand the game.

List of changes

The user feedback brought us some good ideas not only how to improve our prototype but also already some useful functions which we will implement in our software in the next steps.

List of changes we made to our design subsequent to the user test

  • every frame has a symbol of interactive part of body
  • score in the middle (it´s a cooperative mode)
  • clock, which shows time elapsed

Summary of the observations and user feedback

After finishing the first version of our prototype we showed them to some of our flatmates to test the reactions and get some recommendation of refining the functions and design of our game.

In the following we´ll give you an overview on the encountered problems and suggestions they gave us.

Encountered problems:

  • User need some intuitive introduction to the game
  • movements/gestures sometimes not clearly understandable

Suggestions:

  • Put the games on full screen mode (at least at the beginning) in order to get a good/intuitive interaction setting
  • Animation graphics and introduction before starting the game
  • Putting a countdown between testing/training phase and start of game
  • before starting the game, the user should at least one time succesfully complete a game in the training phase
  • to get the game more attractive, various games should be offered
  • since more and more games are offered over time, it would be useful to show the particular games subsequently; so the user can get familiar with the different modes
  • There should also exist a “skip” button to skip the introduction/training part
  • if the system recognizes inattentiveness of the user, a visual warning-cue can pop up
  • coloured frames (players) should change from time to time
  • on the mental arithmetic game:
  1. 3 x 3 Matrix with hand as cursor
  2. affirmation with a simple forward motion of hand or
  3. through timer which activates a field after certain time without moving the hand from one field (disadvantage –> user has to wait to confirm)

 

Photos of the paper prototype prior to user testing

1. Starting screen: detect bypassing people and animate them to interact through kicking the football

DSCF1076

2. Change from starting screen to several game frames

start

3. Two player game with first task description

first task

4. After description, the actual interactive game frame appears

DSCF1079

5. Further tasks (description) come after a while

further tasks

6. Again, after the description the actual interactive game follows

second task interaction frame

7. Further tasks appear – here also some cognitive demanding tasks

DSCF1082 all frames all frames - changed

Interview – Questions

We used a semistructured interview guideline to combine the most flexible and standardized way of getting useful answers.

These were the questions (in german):

Vorstellung

  • Kurzweiliges Unterhaltungsangebot, nicht die konkrete Anwendung vorstellen
  • Öffentlicher Raum
  • Wartezeitüberbrückung, bzw. Abwechslung im Alltag

Standard-Fragen

  • Wie alt bist du? (Männlich/Weiblich?)
  • Was machst du beruflich?

Wartezeit

  • Wie häufig bist du in einer Situation in der du auf etwas warten musst?
  • Was machst du in solchen Situationen?
  • Wie findest du diese Wartezeit-Aktivitäten?
  • Folgefrage: Hast du Ideen, wie/was man verändern könnte?

Fittness

  • Treibst du Sport? Wenn Ja, Welchen?
  • Wie regelmäßig machst du das?
  • Würdest du dich als fit bzw. gut in Form bezeichnen?

Technik und Spiele

  • Was machst du so in deiner Freizeit?
  • Welche Technik/Unterhaltungselektronik besitzt du?
  • Weiteres:
  • Folgefrage: Wie viel Zeit verwendest du dafür?
  • Spielst du in deiner Freizeit
  • Was spielst du?
  • Spiele welchen Typs spielst du gerne?
  • Spielst du lieber gegeneinander oder miteinander?
  • Spielst du manchmal Geschicklichkeitsspiele?
  • Welche?
  • Wie häufig?
  • Stell dir einen Rummel/Freizeitparkt/Weihnachtsmarkt vor, bei dem Unterhaltungsangebote (Spielautomaten, Entenschießen, Dosen-Werfen, …) angeboten werden und du siehst jemanden spielen – wie findest du das?
  • Hast du in der Vergangenheit solche Angebote angenommen? Welche?
  • Wenn in der Öffentlichkeit (Bahnhof, Kaufhaus, Flughafen, Shopping-Meile, Fußgängerzone) kostenlose Unterhaltungselektronik/-angebote (Spielautomaten, Spielekonsolen, Torwand-Schießen) angeboten würden und du siehst jemanden spielen – wie fändest du das?
  • Hast du in der Vergangenheit solche Angebote angenommen? Welche?
  • Würdest du das Angebot annehmen/es ausprobieren?

Spielen und Wartezeit

  • Wie findest du Spielen als Zeitvertreib?
  • Würdest du Spiele spielen, um Wartezeit zu überbrücken? Wie oft? Ist das abhängig von der Länge der Wartezeit