Just Like Me: Online Training Helpers More Effective When They Resemble Students

Opposites don’t always attract. A study from North Carolina State University shows that participants are happier – and perform better – when the electronic helpers used in online training programs resemble the participants themselves.

“It is important that the people who design online training programs understand that one size does not fit all,” says Dr. Lori Foster Thompson, an associate professor of psychology at NC State and co-author of the study. “Efforts to program helper agents that may be tailored to individuals can yield very positive results for the people taking the training.”

Online training programs are becoming increasingly common, and are used for everything from developing work skills in employees to teaching children basic math skills. Many of these programs utilize electronic training agents, or “helpers,” to give feedback to users and help them through the coursework. But the usefulness of these helpers can vary, or even be annoying. Remember Clippy, the animated paper clip, from Microsoft?

NC State researchers set out to determine what characteristics make a training helper more effective. “We know from existing research on human interaction that we like people who are like us,” Foster Thompson says. “We wanted to see whether that held true for these training agents.”

The researchers evaluated the superficial similarities between 257 study participants and helper agents in an online training course, and assessed each participant’s communication style and their similarity to the helper’s communication style. Superficial similarities included the gender and race of the participant. Assessment of each participant’s communication style was determined by asking participants how they would give feedback to others in various situations – such as helping someone with classwork. Researchers also asked participants how similar they felt the helper’s communication style was to their own style.

The researchers found that people reported being more engaged and focused on their training when the helper was portrayed by an image that matched both their race and gender. Furthermore, the researchers found that participants liked the helper more – and learned more from the program – when the helper’s communication style matched their own in regard to a very specific aspect of giving feedback.

Essentially, when giving feedback, some people give individual performance evaluations by comparing the individual to the group (e.g., you are in the top 10 percent), while others compare an individual’s performance only against that individual’s previous record (e.g., you did much better this time). Study participants performed much better when the helper’s feedback style matched their own in this regard.

The study also showed that perception could be more important than reality in participant performance. “We found that people liked the helper more, were more engaged and viewed the program more favorably when they perceived the helper agent as having a feedback style similar to their own – regardless of whether that was actually true,” Foster Thompson says.

The paper, “Similarity Effects in Online Training: Effects with Computerized Trainer Agents,” was co-authored by Foster Thompson and Dr. Tara Behrend, an assistant professor at George Washington University who worked on the study while a Ph.D. student at NC State. The paper is forthcoming from the journal Computers in Human Behavior.

NC State’s Department of Psychology is part of the university’s College of Humanities and Social Sciences.

-shipman-

Note to editors: The study abstract follows.

“Similarity Effects in Online Training: Effects with Computerized Trainer Agents”

Authors: Tara S. Behrend, The George Washington University; Lori Foster Thompson, North Carolina State University

Published: Forthcoming, Computers in Human Behavior

Abstract: In this study, trainees worked with computerized trainer agents that were either similar to them or different regarding appearance or feedback-giving style. Similarity was assessed objectively, based on appearance and feedback style matching, and subjectively, based on participants’ self-reported perceptions of similarity. Appearance similarity had few effects. Objective feedback similarity led to higher scores on a declarative knowledge test and higher liking for the trainer. Subjective feedback similarity was related to reactions, engagement, and liking for the trainer. Overall, results indicated that subjective similarity is more important in predicting training outcomes than objective similarity, and that surface-level similarity is less important than deep-level similarity. These results shed new light on the dynamics between e-learners and trainer agents, and inform the design of agent-based training.