A Feasibility Study of the Kasi Learning System to Support Independent Use of STEM Diagrams by Students With Visual Impairments

Introduction: Visual model comprehension and application are important for success in science, technology, engineering, and mathematics (STEM) courses. As educational materials shift to primarily digital content with dynamic interactive visuals, students with visual impairments are at risk for being disadvantaged, since few interactives are born accessible. To fill this gap of accessible digital STEM learning tools, we designed and tested the Kasi Learning System. Kasi uses tactile manipulatives and computer vision with audio-based augmented reality algorithms to provide a multisensory experience of an interactive digital image. Methods: Ten high school students who are visually impaired (ie, blind or have low vision) participated in an underpowered random control study to evaluate the feasibility and usability of Kasi by completing an active learning lesson. The control group was instructed by a human, whereas the Kasi group was instructed by a computer. Follow-up interviews with both students and their instructors provided further insight. Results: Comparing the experiences of the two groups suggests that Kasi is an effective instructor for completing the activity. Comparison of students who chose to use braille versus large-print pieces revealed that braille users found the system to be easier to use. Discussion: All students efficiently identified the pieces. Regarding the audio, students who do not typically use a screen reader repeated the prompts more frequently and took longer to adapt to the system. Those in the Kasi group demonstrated increased engagement as shown by the increase in submitted answers. Overall, Kasi users’ performance improved significantly during the lesson. Implications for Practitioners: Kasi is most readily adapted and used by those who do not rely on vision. However, students with low vision may benefit from using a tool like Kasi earlier in their schooling to strengthen their auditory and tactile skills. Kasi appears to have the potential to provide students independence in studying STEM diagrams.