Swan-VR05-Tutorial

Human-Centered Fidelity Metrics for Virtual Environment SimulationsThree Numbers from Standard Experimental Design and Analysis: α, power, effect magnitudeVR 2005 TutorialJ. Edward Swan II, Mississippi State UniversityOutline• Introduction and Motivation• Alpha ( α ):– The Logic of Hypothesis Testing– Interpreting α; accepting and rejecting H0– VR and AR examples• Power: – Power and hypothesis testing– Ways to use power– VR and AR examples• Effect Magnitude:– The Logic of ANOVA2 2– Calculating η and ω– VR and AR examples2Why Human Subject (HS) Experiments?• VR and AR hardware / software more mature• Focus of field:– Implementing technology → using technology• Increasingly running HS experiments:– How do humans perceive, manipulate, cognate with VR, AR-mediated information?– Measure utility of VR / AR for applications• HS experiments at VR:VR year papers % sketches % posters %2003 10 / 29 35% 5 / 14 36%2004 9 / 26 35% 5 / 23 22%2005 13 / 29 45% 1 / 8 13% 8 / 15 53%3Logical Deduction vs. Empiricism• Logical Deduction– Analytic solutions in closed form– Amenable to proof techniques– Much of computer science fits here– Examples: • Computability (what can be calculated?)• Complexity theory (how efficient is this algorithm?)• Empirical Inquiry– Answers questions that cannot be proved analytically– Much of science falls into this area– Antithetical to mathematics, computer science4Where is Empiricism Used?• Humans are very ...