HTW Berlin Fachbereich 4 Internationaler Studiengang Internationale Medieninformatik (Bachelor) WT2: Usability Winter Term 2017/18

This exercise will take both blocks today. You shoud be doing two test persons in each block.

You will present your findings to the entire class and submit your report by Dec 18, 2017. All groups must be present for the presentation. Each group will then report verbally on the results that they had. You have about 20 15 minutes for the presentation. All persons should be involved in the presentation. You may use slides or handouts if you wish. I can have handouts printed if I have them by the previous Thursday.

1. Conduct the test according to your preparations! For each round, one person from another group will be the test person. Give them the persona so that they know who they will be playing. The other three in the testing team take turns being the test facilitator and the test scribes. Take extensive notes during the test, don't forget to debrief the test person on how they found the text during the last few minutes. .
   
2. Compile and analyse your data:
   • Compile and summarise data, for example: Mean, median, range, and standard deviation of completion times.
   • Percentage of users performing successfully.
   • Bar chart of preference scores. etc.
   • Identify errors and difficulties which arose.
   • Diagnose the source of each error.
   • Prioritise problems by their severity or criticality
     
3. Prepare your final report with the following sections:
• Title Page
• Description of Test Environment
  • Hardware, software version, test room, dates when tests were performed.
• Executive Summary
  • Concise summary of major findings, no more than a few pages.
• Description of Test
  • Updated test plan, method, training, and tasks.
• Test Person Data
  • Tabular summary of age, occupation, experience.
• Results
  • Tabular and graphical summaries of times taken, number of errors made, questionnaire responses, etc.
  • Discussion and analysis, amusing quotations.
• List of Positive Findings
• List of Recommendations List of problems discovered, in descending order of severity, and recommended improvements. For each recommendation:
  • diagnose why the problem occurred
  • illustrate it with a screen shot
  • rate its severity (0...4 scale)
  • indicate exactly how many test users experienced the problem
  • include a reference to timestamp(s) on the video tape
  • possibly include an appropriate user quotation
  • describe your suggested improvements
• Appendices (raw data and tables).
  • Background questionnaires, consent forms, orientation script, data collection forms, transcripts, etc.

Whew! What a lot of work! But I bet that you found a wealth of information and have now prepared it in a useful form. We will send your reports to the persons responsible for the web pages and see if we get any reactions, if you want to.

Some rights reserved. CC-BY-SA 2017 Debora Weber-Wulff (weberwu@htw-berlin.de)