Note-Taker device promises to help students overcome visual impairments

David Hayden with the Note-Taker device

Hayden with the Note-Taker device

Millions of students will someday be less hindered by their visual impairments if a recent Arizona State University graduate and three current ASU students realize their ambitions.

David Hayden, Michael J. Astrauskas, Qian Yan and Shashank Srinivas are developers of the Note-Taker prototype. It’s a portable, custom-designed camera connected to a pen-and-multitouch tablet personal computer.

The Note-Taker camera can tilt up and down, sweep side to side, and zoom in on a target.

The tablet computer provides a split-screen display. One half of the screen has a window that shows live video from the camera, while the other half has a window used for handwriting or typing notes.

The device is designed to help students with low vision follow classroom instruction and take notes as easily as fully-sighted students.

The split-screen interface enables students with visual impairments to glance back and forth between the live video view of the classroom presentation and their notes. The video window allows the user to aim and zoom the camera by using simple dragging, tapping or pinching motions within the video window.

Calling themselves Team Note-Taker, the four developers of the device won the first prize in the software design category of the Microsoft Imagine Cup U.S. Finals last spring. Then in July they took second place in the same category of the Imagine Cup World Finals, the premier international student technology competition.

Team Note-Taker at the Microsoft Imagine Cup World Finals, photo courtesy of Microsoft

Team Note-Taker at the Microsoft Imagine Cup World Finals, photo courtesy of Microsoft

Those achievements are only a warm-up exercise, the team members say.

Now they will concentrate on the ultimate purpose of their endeavor:  to develop next-generation Note-Taker prototypes and see the device developed into a viable commercial product that can be made available to students with visual impairments.

“It’s not a manufacturable product right now, but I think the team can improve the design to the point where the Note-Taker could be manufactured affordably and marketed,” says John Black, an ASU research scientist and Team Note-Taker’s mentor.

Astrauskas is working toward an undergraduate degree in electrical engineering, and Srinivas toward a graduate degree in computer science, in ASU’s Ira A. Fulton Schools of Engineering. Yan is seeking a master’s degree in The Design School in ASU’s Herberger Institute for Design and the Arts. Hayden, the initial inventor of the Note-Taker who created the device to help him overcome his own visual impairment, has earned an undergraduate degree in computer science in the Fulton Schools of Engineering, as well as a math degree through the ASU’s College of Liberal Arts and Sciences. He spent the summer in an internship with Google, and will begin studies this fall toward a doctorate in computer science at the Massachusetts Institute of Technology.

Their first-place prize in the Imagine Cup U.S. Finals earned a $25,000 grant from Microsoft Corporation for the Center for Cognitive Ubiquitous Computing (CUbiC )—the laboratory in ASU’s School of Computing, Informatics, and Decision Systems Engineering where much of the work on the Note-Taker has been done.

CUbiC focuses on the design of technologies and devices to assist people with perceptual or cognitive disabilities.