GetFit
2019/2022

Research (Phase 2)

User Evaluation

The team implemented a user evaluation to see how satisfied the users are with the app’s interface an ff the app is more efficient than the user’s current method of planning a workout. We interviewed eight participants with each session including surveys, questionnaires, and a usability test of the GetFit prototype. In the usability test portion there were two tasks; create a workout plan how the participant normally would and create a workout plan with the GetFit app. Below is the evaluation sessions outline.

​

Intro (5 mins)

• Go through introductions 

• Debrief on the experiment and timeline

• Evaluator goes through consent form

• Test subject fills out demographic questionnaire 

Trial 1 (15 mins)

• Training - Explain the workout scenario 

• Evaluator starts audio recording 

• Plan a workout using pen, paper, or phone

• Observe and tell subject to start think-aloud method

• Give participant evaluation questionnaire

Break  (5 mins)

Trial 2

• Task 1 (15 mins)

  • Training - Explain interface and workout scenario

  • Evaluator starts screen recording on the phone

  • Setup account with a phone using our prototype

  • Observe and tell subject to start think-aloud method

• Task 2 (15 mins)

  • Training - Explain interface and workout scenario

  • Evaluator starts screen recording on the phone

  • Plan workout with a phone using our prototype

  • Observe and tell subject to start think-aloud method

• Give participant evaluation questionnaire

​​

Results

Efficiency - Task Completion Time (Minutes)

We measured the efficiency of the two tasks in minutes. By comparing the mean times in task one (11.27 mins) for each section to the same section in task two (9.523 mins), the setup time was faster without the GetFit App; however, the Reminder, Plan phases, and total time was much faster with the GetFit App.

 

Efficiency - Task Completion Rate (Pass/Fail)

The next metric we collected was the completion rate. This was a pass/fail metric based on whether users finished each task. There were no outright failures planning a workout without the GetFit app in task 1. In task 2, there were two participants who failed to complete the task, resulting in a 75% completion rate. This was due to technical issues in the prototype links mentioned earlier.

​

Qualitative Data - Accuracy

Common Errors

Task 1 - Without GetFit App.

• Participants made wild guesses on a

       number of reps and sets.

• Participants chose workouts that did not

       target the correct muscle groups.

• Participants couldn’t identify tips on how

       to perform the workouts correctly.

​

User Satisfaction 

Satisfaction Survey (Task Comparison)

For User Satisfaction, we administered questionnaires after each task with the same 5 questions on a 5 point Likert scale. The below visualization shows the number of users that responded with each answer. The bottom two questions have the scale legend reversed, indicating that a “disagree” response is preferred. Each scale shows an improvement for the second condition, particularly in the bottom question, where users indicated strongly that they did not need to learn as much to complete the task while using the app, compared to the task without the app.