Utilization of Convolutional Neural Network Method in Customer Identification Based on Facial Images

Abstract

Artificial intelligence-based facial recognition technology, especially using the Convolutional Neural Network (CNN) method, is increasingly widespread in various business applications, such as customer data management. This technology allows the system to recognize and identify individuals automatically through facial images, so it is very potential to be applied in customer management. This study aims to implement CNN technology in automatically identifying old customers in a case study in JAVApace Studio. CNN method for facial recognition, optimizing the accuracy of old customer identification, designing CNN system integration in computer vision-based applications, and measuring CNN performance in real-time facial identification.

The research method was carried out using a quantitative approach through data collection stages in the form of 875 customer facial images taken in JAVapace Studio, data preprocessing (cropping, resizing, and data augmentation), dataset division for training, validation, and testing. The CNN model used is the ResNet-50 architecture with fine-tuning techniques and freezing layers to improve training efficiency. Model performance evaluation uses a confusion matrix with accuracy, recall, and precision metrics. The results show that the CNN-based facial recognition system achieved 95.7% accuracy in distinguishing existing customers from the test data used. The recall rate was 94.5%, while the precision rate reached 96.2%. The discussion of the results also indicates that the fine-tuning approach is effective in optimizing model performance with an inference time suitable for real-time implementation needs. This study confirms that the implementation of CNN with ResNet-50 architecture is effectively able to recognize the faces of old customers with high levels of accuracy, recall, and precision, making it the right solution in managing customer data automatically and efficiently.