VHToolkit : Release Test Checklist

For each installer
  • Launch all
  • Check whether intro plays
  • Ask a few questions by microphone, check whether
    • ASR results are reasonably close
    • Characters answer each question
    • Lip synching is reasonable
    • Characters are gesturing
    • Spoken dialogue matches subtitles reasonably well
  • Ask a few questions in the text box and check answer
  • Ask 'text to speech' in text box and check whether TTS response is given
  • Bring up C menu and test
    • Prerecorded audio test sentences
    • TTS test sentences

For one installer

  • Check Ogre
    • intro
    • ASR interaction
    • gestures
    • lip synching
  • Check Unity Launcher parameters
    • non-intro
    • windowed
  • Check if sbmonitor works
  • Check if Perception Components works
    • Launch all
    • Set up cam
    • Toggle with Y the VH behavior; mirroring head, gazing in same direction
  • Check if Rapoort Components works
  • Remove \AppData\Roaming\NPCEditor before launching.  Then launch all components and test Q&A.

Template Checklist

Toolkit

General

By:

Checklist

  • All modules launch from just the Run All button in the Launcher
  • Intro looks good
  • ASR results are reasonable
  • Characters answer each question (both Brad and Rachel)
  • Lip syncing is reasonable
  • Characters are gesturing
  • Spoken dialogue matches subtitles
  • Questions through text box entry are answered
  • When asking 'text to speech' in text box, a TTS response is given
  • Debug menu prerecorded audio test sentences work
  • Debug menu TTS test sentences work

Issues:

Unity

By:

Checklist

  • When 'intro' selected in Launcher, intro plays
  • When 'nointro' selected in Launcher, intro does not play
  • Full-screen / windows options from Launcher work

Issues:

Ogre

By:

Checklist

  • When 'intro' selected in Launcher, intro plays
  • When 'nointro' selected in Launcher, intro does not play
  • Full-screen / windows options from Launcher work
  • ASR results are reasonable
  • Characters answer each question
  • Lip syncing is reasonable
  • Characters are gesturing

Issues:

SBMonitor

By:

Checklist

  • Starts correctly
  • Can connect to Unity
  • Shows Brad and Rachel characters

Issues:

MultiSense

By:

Checklist

  • Both MultiSense and Perception App load
  • Output window shows head and facial tracking
  • Mirroring works correctly (Y key)
  • Follow gaze works correctly (Y key)

Issues:

VHBuilder

By:

Checklist

  • VHBuilder launches all other modules 
  • New TTS line preview works for all characters
  • New pre-recorded line preview works for all characters with FaceFX
  • New pre-recorded line preview works for all characters with in-house lip sync (HOW TO TEST, SINCE IT'S AN AUTOMATED BACK-UP OPTION?)
  • New Q/A pair works when asked from Unity
  • Animation preview works
  • New NVBG rule works
  • Color customization works
  • Facial sliders work

Issues:

Character Customizer

By:

Checklist

  • CC launches all other modules
  • New TTS line preview works
  • New pre-recorded line preview works
  • Toggle NVB works
  • Toggle subtitles works
  • Different cameras work
  • Gaze at camera toggle works
  • Record movie works (play from disk)

Issues:

Rapport

By:

Checklist

  • All modules load
  • Brad nods with general user movement

Issues:

 

Installers

(These all contain the general checklist, so if that changes above, update below as well)

Main

By:

  • Launcher runs correctly from installer
  • Intro looks good
  • ASR results are reasonable
  • Characters answer each question
  • Lip syncing is reasonable
  • Characters are gesturing
  • Spoken dialogue matches subtitles
  • Questions through text box entry are answered
  • When asking 'text to speech' in text box, a TTS response is given
  • Debug menu prerecorded audio test sentences work
  • Debug menu TTS test sentences work

Issues:

Binary-Only

By:

  • Launcher runs correctly from installer
  • Intro looks good
  • ASR results are reasonable
  • Characters answer each question
  • Lip syncing is reasonable
  • Characters are gesturing
  • Spoken dialogue matches subtitles
  • Questions through text box entry are answered
  • When asking 'text to speech' in text box, a TTS response is given
  • Debug menu prerecorded audio test sentences work
  • Debug menu TTS test sentences work

Issues:

GPR

By: 

  • Launcher runs correctly from installer
  • Intro looks good
  • ASR results are reasonable
  • Characters answer each question
  • Lip syncing is reasonable
  • Characters are gesturing
  • Spoken dialogue matches subtitles
  • Questions through text box entry are answered
  • When asking 'text to speech' in text box, a TTS response is given
  • Debug menu prerecorded audio test sentences work
  • Debug menu TTS test sentences work

Issues:

GPR Lite

By:

  • Launcher runs correctly from installer
  • Intro looks good
  • ASR results are reasonable
  • Characters answer each question
  • Lip syncing is reasonable
  • Characters are gesturing
  • Spoken dialogue matches subtitles
  • Questions through text box entry are answered
  • When asking 'text to speech' in text box, a TTS response is given
  • Debug menu prerecorded audio test sentences work
  • Debug menu TTS test sentences work

Issues: