Count Aware Transfer Classifiers for Rare Crop Disease Recognition with Scarce Images

Authors

  • Quentin Renard Faculty of Medicine, Dentistry and Health Sciences, University of Melbourne, Melbourne, Australia
  • Naomi Bailey Faculty of Medicine, Dentistry and Health Sciences, University of Melbourne, Melbourne, Australia
  • Omar Haddad Faculty of Medicine, Dentistry and Health Sciences, University of Melbourne, Melbourne, Australia

DOI:

https://doi.org/10.66421/int.j.datasci.intell.syst40

Keywords:

Crop Disease Detection, Transfer Learning, Long-Tailed Recognition, Image Classification, Precision Agriculture

Abstract

The reliable identification of crop diseases through automated image classification is a cornerstone of modern precision agriculture, promising to mitigate yield losses and enhance global food security. However, the distribution of crop disease image data is inherently long-tailed in real-world scenarios. While common diseases benefit from abundant training samples, rare and emerging diseases suffer from severe data scarcity, leading to highly imbalanced datasets. Traditional deep learning models, particularly those relying on standard empirical risk minimization, frequently exhibit a bias toward majority classes, resulting in catastrophic misclassification of rare anomalies. To address this critical bottleneck, this paper proposes and comprehensively evaluates a count-aware transfer classifier designed specifically for rare crop disease image labels. By integrating explicit class-frequency statistics directly into the classifier adaptation phase during transfer learning from large-scale pre-trained vision models, the proposed framework structurally compensates for data deficiency in the tail classes. The methodology adjusts the decision boundaries by imposing larger margins for rare classes, guided by the inverse or logarithmic frequency of the training instances. Extensive analysis across diverse agricultural datasets demonstrates that this count-aware mechanism significantly improves the recognition accuracy of few-shot disease categories without heavily compromising the performance on well-represented classes. The findings underscore the efficacy of decoupled representation learning and classifier training, presenting a scalable and robust solution for deploying automated diagnostic systems in heterogeneous agricultural environments where early detection of rare pathogens is vital.

References

1. Yao, Zhengtao, et al. "Task-agnostic federated learning." arXiv preprint arXiv:2406.17235 (2024).

2. Luo, H., Li, Q., Zhou, H., Sun, W., Li, W., Liu, Z., ... & Ding, L. (2025). Weak Single Phase-to-Ground Fault Time Detection with Learnable-Parameter-Driven DSP-Enhanced Transformer. IEEE Transactions on Smart Grid.

3. Roh, S. B., Oh, S. K., Pedrycz, W., Wang, Z., Fu, Z., & Seo, K. (2022). Design of iterative fuzzy radial basis function neural networks based on iterative weighted fuzzy c-means clustering and weighted LSE estimation. IEEE Transactions on Fuzzy Systems, 30(10), 4273-4285.

4. Chu, Y. B., Li, J., Jia, P., Cui, J., Zhang, R., Kang, X., Lv, M., & Zhang, S. (2021). Irf1- and Egr1-activated transcription plays a key role in macrophage polarization: A multiomics sequencing study with partial validation. International immunopharmacology, 99, 108072. https://doi.org/10.1016/j.intimp.2021.108072

5. Yang, Y., Hu, H., Mao, Y., Zhang, J., Wu, C., Jiang, Y., ... & Zhang, C. (2026). OPRIDE: Offline Preference-based Reinforcement Learning via In-Dataset Exploration. arXiv preprint arXiv:2604.02349.

6. Kingma, D. P., & Ba, J. (2015). Adam: A method for stochastic optimization. In Proceedings of ICLR.

7. Wu, Beiliang, et al. "IndexNet: Timestamp and Variable-Aware Modeling for Time Series Forecasting." arXiv preprint arXiv:2509.23813 (2025).

8. Ma, Y., Qu, D., & Wang, Y. (2026). Tracking evolving communities in fake news cascades using temporal graphs. Scientific Reports.(https://www.nature.com/articles/s41598-026-35175-4)

9. Chen, L., Ge, L., Jiang, X., Li, H., & Haardt, M. (2025). Slim is better: Transform-based tensor robust principal component analysis. IEEE Transactions on Signal Processing.

10. Ma, Y., Qu, D., & Pyrozhenko, M. (2026). Bio-RegNet: A Meta-Homeostatic Bayesian Neural Network Framework Integrating Treg-Inspired Immunoregulation and Autophagic Optimization for Adaptive Community Detection and Stable Intelligence. Biomimetics, 11(1), 48.

11. Gu, C., Zhang, W., Huang, Z., Kou, J., Liu, Z., Zhao, C., Liu, C., Zhang, L., Lin, W., Wang, Z., Deng, J., Xie, Y., Huang, G., Zhang, C., Lu, X., Wang, C., Zhang, Z., Yuan, H., Duan, X., & Fang, Y. (2024). LENS: Layers of evaluation of hallucination in GenAI systems. In 2024 7th International Conference on Universal Village (UV) (pp. 1–85). IEEE. https://doi.org/10.1109/UV63228.2024.11189150

12. Yao, C., Zhan, Q., Cao, Z., Lin, Y., Li, D., Shao, Y., ... & Dong, Z. (2025). Generative ai for simulating real world dynamics applications and challenges.

13. Wang, Z., Oh, S. K., Wang, Z., Fu, Z., Pedrycz, W., & Yoon, J. H. (2023). Design of progressive fuzzy polynomial neural networks through gated recurrent unit structure and correlation/probabilistic selection strategies. Fuzzy Sets and Systems, 470, 108656.

14. Xu, X., Tu, W., & Yang, Y. (2023). CASE-Net: Integrating local and non-local attention operations for speech enhancement. Speech Communication, 148, 31-39.

15. Luo, T., Li, Q., Jiang, M., & Hou, C. (2025). Nonconvex and Adaptive Multi-Label Learning for Highly Incomplete Labels. Knowledge-Based Systems, 114784.

16. Ma, Y., Qu, D., & Wang, Y. (2025, October). Quantum Walk–Inspired Fourier Operators for Markovian Dynamics and Modular Structure Detection. In 2025 6th International Conference on Machine Learning and Computer Application (ICMLCA) (pp. 360-363). IEEE.

17. Wang, Z., Kim, E. H., Oh, S. K., Pedrycz, W., Fu, Z., & Yoon, J. H. (2024). Reinforced fuzzy-rule-based neural networks realized through streamlined feature selection strategy and fuzzy clustering with distance variation. IEEE Transactions on Fuzzy Systems, 32(10), 5674-5686.

18. Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society: Series B, 39(1), 1–38.

19. Huang, H., Zhang, J., Zhang, J., Wu, Q., & Xu, C. (2021, May). Ptn: A poisson transfer network for semi-supervised few-shot learning. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 35, No. 2, pp. 1602-1609).

20. Qu, D., & Ma, Y. (2025). Magnet-bn: markov-guided Bayesian neural networks for calibrated long-horizon sequence forecasting and community tracking. Mathematics, 13(17), 2740.

21. Wang, J. (2023, July). A multi-task learning and transfer learning-based model for crop leaf disease identification. In 2023 3rd International Symposium on Computer Technology and Information Science (ISCTIS) (pp. 348-355). IEEE.

22. Zhu, Y., Duan, H., Wang, Z., Kim, E. H., Fu, Z., & Pedrycz, W. (2025). BPFNN: Bayesian Probabilistic Fuzzy Neural Networks for Uncertainty-Aware Clustering and Probabilistic Fuzzy Reasoning. IEEE Transactions on Cybernetics.

23. Ma, Y., Qu, D., & Wang, Y. (2026). Dynamic community detection using class preserving time series generation with Fourier Markov diffusion. Scientific Reports.(https://doi.org/10.1038/s41598-026-37699-1)

24. Zhu, Y., Duan, H., Wang, Z., Kim, E. H., Fu, Z., & Pedrycz, W. (2025). Robust Classification via Interval Type-2 Fuzzy C-Means and Gradient Boosting. IEEE Transactions on Fuzzy Systems, 33(9), 3103-3117.

25. Xu, Yuanchao, et al. "Reskoopnet: Learning koopman representations for complex dynamics with spectral residuals." arXiv preprint arXiv:2501.00701 (2025).

26. Jin, X., Diao, L., Xiao, Q., Hu, Y., Zhang, Z., Liu, Y., & Gu, H. (2025). CCAD: Compressed Global Feature Conditioned Anomaly Detection. arXiv preprint arXiv:2512.21459.

27. Shor, P. W. (1997). Polynomial-time algorithms for prime factorization and discrete logarithms on a quantum computer. SIAM Journal on Computing, 26(5), 1484–1509.

28. Guo, C., Xiao, Z., Liu, Z., & Peng, S. (2020). Rg conditional diagnosability: a novel generalized measure of system-level diagnosis. Theoretical Computer Science, 814, 19-27.

29. Xu, Y., Shao, K., Ishikawa, I., Hashimoto, Y., Logothetis, N., & Shen, Z. (2025). A data-driven framework for Koopman semigroup estimation in stochastic dynamical systems. Chaos: An Interdisciplinary Journal of Nonlinear Science, 35(10).

30. Yang, C., Wang, Z., Oh, S. K., Pedrycz, W., & Yang, B. (2022). Ensemble fuzzy radial basis function neural networks architecture driven with the aid of multi-optimization through clustering techniques and polynomial-based learning. Fuzzy sets and systems, 438, 62-83.

31. Lijun, X., Yehui, Z., Yue, S., Fanglei, Z., Honghua, J., & Guangming, W. (2022). Research on the current situation of continuously variable transmission and electric drive technology. Journal of Chinese Agricultural Mechanization, 43(7), 81.

32. Zhang, J., Shi, Y., Ma, Y., Xu, L., Yu, J., & Wang, J. (2023, June). Ikol: Inverse kinematics optimization layer for 3d human pose and shape estimation via gauss-newton differentiation. In Proceedings of the AAAI conference on artificial intelligence (Vol. 37, No. 3, pp. 3454-3462).

33. Huang, H., Li, M., Gao, Z., Zhou, X., Huang, X., & Sun, X. (2026). FLUIDSPLAT: Reconstructing Physical Fields from Sparse Sensors via Gaussian Primitives. arXiv preprint arXiv:2605.18866.

34. Fowler, A. G., Mariantoni, M., Martinis, J. M., & Cleland, A. N. (2012). Surface codes: Towards practical large-scale quantum computation. Physical Review A, 86(3), 032324.

35. Chen, L., Ge, L., Jiang, X., & Li, H. (2025). Boosting RPCA by Prior Subspace. IEEE Transactions on Signal Processing.

Downloads

Published

2026-06-10