The new era of technology aiming to build a device which help blind people to see through their smartphone or tablet. Specialists in computer vision and machine learning based at the University of Lincoln, UK, founded by a Google Faculty Research Award, are aiming to embed a smart vision system in mobile devices to help people with sight problems navigate unfamiliar indoor environments.
“This project will build on our previous research to create an interface that can be used to help people with visual impairments,” said Project lead Dr. Nicola Bellotto, an expert on machine perception and human-centred robotics from Lincoln’s School of Computer Science.
The ongoing team plan, to use colour and depth sensor technology inside new smartphones and tablets to enable 3D mapping and localisation, navigation and object recognition is working smoothly. The team will then develop the best interface to relay that to users – whether that is vibrations, sounds or the spoken word.
“There are also existing smartphone apps that are able to, for example, recognise an object or speak text to describe places. But the sensors embedded in the device are still not fully exploited.
The research team, which includes Dr Oscar Martinez Mozos, a specialist in machine learning and quality of life technologies, and Dr Grzegorz Cielniak, who works in mobile robotics and machine perception, aim to develop a system that will recognise visual clues in the environment.
This data would be detected through the device camera and used to identify the type of room as the user moves around the space.
A key aspect of the system will be its capacity to adapt to individual users’ experiences, modifying the guidance it provides as the machine ‘learns’ from its landscape and from the human interaction.
It will become boon for the world “If people were able to use technology embedded in devices such as smartphones, it would not require them to wear extra equipment which could make them feel self-conscious.”
“We aim to create a system with ‘human-in-the-loop’ that provides good localisation relevant to visually impaired users and, most importantly, that understands how people observe and recognise particular features of their environment,” said Bellotto.