LoVi App: Android Application-based Image Classification for Low Vision

LoVi App: Android Application-based Image Classification for Low Vision

convolutional neural network; deep learning; image classification; low vision; smartphone

In Indonesia, many people with visual impairments are drawingpublic attention to their rights as fellow humans. One of the limitations that individuals with low vision face is their ability to recognize objects and navigate their surroundings due to difficulties in visual perception. In this modern era, deep learning technologies, especially in image classification, can help people with low vision overcome these challenges. In this paper, we discuss a deep learning system that optimizes image classification on users' smartphones to enhance visual support for individuals with low vision.We present an Android-based app, LoVi, designed to assist users with low vision.Powered by core systems within Sherpa models (TrotoarNet, IndoorNet, and CurrencyNet), LoVi has three modes: outdoor, indoor, and currency. The LoVi application provides over 80% accuracy for navigation on sidewalks, indoor object recognition, and currency identification. TrotoarNet aids in sidewalk navigation, IndoorNet assists with indoor object identification, and CurrencyNet recognizes Rupiah banknotes.Additionally, low-vision users can receive voice feedback for further accessibility.

Mitra Sofiyati, Fandi Azam Wiranata, Wervyan Shalanannda*, Eueung Mulyana, Isa Anshori &Ardianto Satriawan

https://journals.itb.ac.id/index.php/jictra/article/view/22132/6770

Institut Teknologi Bandung

2024

Fajar Bagus W

PDF

English

Text