Herbal Plant Image Classification using Transfer Learning and Fine-Tuning Deep Learning Model

Authors

  • Fatimah Khalid Multimedia Department, Faculty of Computer Science & Information Technology, University of Putra Malaysia, Lebuh Universiti, 43400 Serdang, Selangor, Malaysia
  • Amirul Azuani Romle Faculty of Data Science & Information Technology, Inti International University, Persiaran Perdana BBN Putra Nilai, 71800 Nilai, Negeri Sembilan, Malaysia

DOI:

https://doi.org/10.37934/araset.34.3.1625

Keywords:

Herbal plant, ResNet-50, Transfer Learning, Fine Tuning, Deep Learning, Image Classification

Abstract

Herbal plants are highly significant to the local community in Malaysia, as the country's fertile land is rich in diverse species that are widely used for various purposes, including traditional medicine, culinary, aromatherapy, and even in the cosmetic industries. This situation demands numerous applications and activities, including plant species identification, medicinal plant research, agriculture research, and environmental monitoring, which makes image classification of herbal plants a substantial task. However, this task is complicated by the complex nature of the plants, particularly includes plants variations in appearance, close similarities between species, and limited availability of labeled data and images.  Motivated to mitigate the issues, this paper investigated the use of transfer learning and fine- tuning the deep learning neural network to classify different herbal plant species. Transfer learning is an algorithm that learns to recognize image features in one domain and having the capability to generalize the learnt knowledge to a new domain with a smaller dataset. Additionally, fine-tuning can be used to further improve the performance of the model on the new task with less training time and fewer training data. The authors performed experiments on ResNet-50 which been previously trained with ImageNet dataset. The experiments were carried out on a subset of the MYLPherbs-1 dataset, which consisted of two local perennial herbs plant species. Different hyperparameters were used across the various experiment settings, and the authors observed the behavior and relationships of the distinct models, datasets, and hyperparameters toward the classification task's accuracy. The authors also employed two different transfer learning approaches: (i) using pre-trained models as feature extractors with different classifiers, (ii) fine-tuning the pre-trained model. Based on the results and discussion, fine-tuning the ResNet-50 model on the MYLPherb-1 dataset demonstrated the best overall performance.

Downloads

Download data is not yet available.

Author Biographies

Fatimah Khalid, Multimedia Department, Faculty of Computer Science & Information Technology, University of Putra Malaysia, Lebuh Universiti, 43400 Serdang, Selangor, Malaysia

fatimahk@upm.edu.my

Amirul Azuani Romle, Faculty of Data Science & Information Technology, Inti International University, Persiaran Perdana BBN Putra Nilai, 71800 Nilai, Negeri Sembilan, Malaysia

aazuani.romle@newinti.edu.my

Downloads

Published

2023-12-16

How to Cite

Fatimah Khalid, & Amirul Azuani Romle. (2023). Herbal Plant Image Classification using Transfer Learning and Fine-Tuning Deep Learning Model. Journal of Advanced Research in Applied Sciences and Engineering Technology, 35(1), 16–25. https://doi.org/10.37934/araset.34.3.1625

Issue

Section

Articles