Ingredients Identification Through Label Scanning Using PaddleOCR and ChatGPT for Information Retrieval

Ingredients Identification Through Label Scanning Using PaddleOCR and ChatGPT for Information Retrieval

food identification, optical character recognition, PaddleOCR, information retrieval, ChatGPT

Human health depends on choosing food ingredients that align with dietary needs and avoid allergens. However, consumers often encounter unfamiliar ingredients that require additional information. Traditionally, they search online by typing in the ingredient's name which can be time-consuming and may not yield relevant results. Therefore, a system to identify and display ingredient information is necessary. This studyproposesa new system that identifies ingredients by scanning the composition label on packaging using PaddleOCR and retrieving information through ChatGPT on a smartphone. The process begins with capturing an image of the composition label.ThenPaddleOCR is employed to extract text from the scanned label, enabling identification of the listed ingredients. Subsequently, ChatGPT retrieves detailed information about the desired ingredients and displays it, allowing users to easily understand the ingredients. The system's effectiveness in text recognition is assessed using the character error rate (CER). The results show robustperformance by achieving an average CER of 0.14, with flat packaging reaching an impressive CER of 0.05. Additionally, the system's usability was assessed through pilot testing which received significant positive user feedbackachieving a 4.37 satisfaction level on the Likert scale, particularly regarding the clarity and relevance of the ingredient information provided

Ahmad Wahyu Rosyadi1*, Siti Ma’shumah2, Muhammad Qomaruz Zaman3, Moh.Rizki Fajar

https://jurnal.iaii.or.id/index.php/RESTI/article/view/6119/992

Department of Informatics Engineering, Faculty of Engineering, Universitas Qomaruddin, Gresik, Indonesia

27-12-2024

FAJAR BAGUS W

PDF

ENGLISH

TEXT