Improving Invisible Food Texture Detection by using Adaptive Extremal Region Detector in Food Recognition
Mohd Norhisham Razali, Noridayu Manshor, Norwati Mustapha, Razali Yaakob, Alfian Abdul Halin, Mohammad Noorazlan Shah Zainudin Faculty of Computer Science and Information Technology Universiti Putra Malaysia, Serdang 43300, Malaysia, Universiti Teknikal Malaysia, Melaka, 76100 Malaysia
Abstract: The advancement of mobile technology with reasonable cost has indulge the mobile phone users to photograph and share their foods in social media. Since that, food recognition has become emerging research area in image processing and machine learning. Food recognition provides an automatic identification of the types of foods from an image. Further analysis of food images can be carried out to approximate the calories and nutrients that can be used for health-care purposes as well as the other application domains. The interest region-based detector by using Maximally Stable Extremal Region (MSER) provides distinctive interest points by representing the arbitrary shape of foods in parallelogram especially the food images with strong mixture of ingredients. However, the classification performance on food categories with less diverse texture food images by using MSER are obviously was not up to par with the rest of food categories that have more noticeable texture.
The respective food objects were suffered from low volume extremal regions (ER) detection that were associated with the condition of food images that have visually texture-less objects, low contrast and brightness as well as small image pixel dimensions. Therefore, this paper proposed an adaptive interest regions detection by using MSER (aMSER) that provide an automatic MSER parameter configuration to increase the density of interest points on the targeted food images. The features
are described by using Speeded-up Robust Feature Transform (SURF) and encoded by using Bag of Features (BoF) model. The classification is performed by using Linear Support Vector Machine and yield 84.20% classification rate on UEC100-Food dataset with competitive volume of ER and extraction time efficiency.
Keywords: Food Recognition, MSER, Local Feature Improving Invisible Food Texture Detection by using Adaptive Extremal Region Detector in Food Recognition
References:[1] Coulston, A. M., Boushey, C. j., Ferruzzi, M. G., “Nutrition in the Prevention and Treatment of Disease,†in Nutrition in the Prevention and Treatment of Disease, 3rd ed., Academic Press, 2013, p 5–30.
[2] Ragusa, F., Tomaselli, V., Furnari, A., Battiato, S., Farinella, G. M. (2016). “Food vs Non-Food Classification,†in 2nd International Workshop on Multimedia Assisted Dietary Management, 2016, 77–81.
[3] Ege, T., Yanai, K. (2017). “Image-Based Food Calorie Estimation Using Knowledge on Food Categories, Ingredients and Cooking Directions,†Proc. Themat. Work. ACM Multimed. 2017, 367—375, 2017.
[4] Giovany, S., Putra, A., Hariawan, A. S., Wulandhari, L. A. (2017). “Machine Learning and SIFT Approach for Indonesian Food Image,†Procedia Comput. Sci., 116, 612–620, 2017.
[5] Farinella, G. M., Allegra, D., Moltisanti, M., Stanco, F., Battiato, S. (2016). “Retrieval and classification of food images,†Comput. Biol. Med., 77, 23–39, 2016.
[6] Razali, M. N., Manshor, N. (2018). “Object Detection Framework for Multiclass Food Object Localization and Classification,†Adv. Sci. Lett., 24, 4, 1357–1361, 2018.
[7] Norhisham, M., Manshor, N., Halin, V., Mustapha, N. (2017). “Analysis of SURF and SIFT Representations to Recognize Food Objects,†J. Telecommun. Electron. Comput. Eng., 9, 2, 81–88, 2017.
[8] Kong, F., He, H., Raynor, H. A.,Tan, J. (2015). “DietCam: Multi-view regular shape food recognition with a camera phone,†Pervasive Mob. Comput., 19 (C), 108–121, 2015.
[9] Kagaya, H., Aizawa, K. (2015). “Highly Accurate Food/Non-Food Image Classification Based on a Deep Convolutional Neural Network,†in International Conference on Image Analysis and Processing, 2015, 9281, 350–357.
[10] Zhu, F., Bosch, M., Khanna, N., Boushey, C. J., Delp, E. J. (2015). “Multiple Hypotheses Image Segmentation and Classification With Application to Dietary Assessment, IEEE J. Biomed. Heal. Informatics, 19 (1), 377–388, 2015.
[11] Zong, Z., Nguyen, D. T., Ogunbona, P., Li, W. (2010). “On the combination of local texture and global structure for food classification,†Proc. - 2010 IEEE Int. Symp. Multimedia, ISM 2010, 204–211, 2010.
[12] Razali, M. N., Manshor, N., Halin, A. A., Yaakob, R., Mustapha, N. (2017). “Food Category Recognition using SURF and MSER Local Feature Representation,†in International Visual Informatics Conference, 2017, 212–223.
[13] Lee, M. H., Park, I. K. (2017). “Performance evaluation of local descriptors for maximally stable extremal regions,†J. Vis. Commun. Image Represent., 47, 62–72, 2017.
[14] Krig, S. (2014). “Local Feature Design Concepts, Classification, and Learning,†Comput. Vis. Metrics, 131–189.
[15] Anthimopoulos, M. M., Gianola, L., Scarnato, L., Diem, P., Mougiakakou, S. G. (2014). “A Food Recognition System for Diabetic Patients Based on an Optimized Bag-of-Features Model,†IEEE J. Biomed. Heal. Informatics, 18 (4), 1261–1271, 2014.
[16] Ma, P., Seeland, M., Rzanny, M., Alaqraa, N., Wa, J. (2017). “Plant species classification using flower images — A comparative study of local feature representations,†PLoS One, 1–30, 2017.
[17] Zhang, X., Yang, Y.-H., Han, Z., Wang, H., Gao, C. (2013). “Object Class Detection: A Survey,†ACM Comput. Surv., vol. on epilepsy. Commission on Epidemiology 46, (1), 1–46, 2013.
[18] Joutou, T., Yanai, K. (2009). “A food image recognition system with Multiple Kernel Learning,†in 2009 16th IEEE International Conference on Image Processing (ICIP), 2009, 285–288.
[19] Hoashi, H., Joutou, T., Yanai, K. (2010). “Image Recognition of 85 Food Categories by Feature Fusion,†in IEEE International Symposium on Multimedia.
[20] Yu, J., Qin, Z., Wan, T., Zhang, X. (2013). “Feature integration analysis of bag-of-features model for image retrieval,†Neurocomputing, 120, p 355–364.
[21] Nowak, E., Jurie, F., Triggs, B. (2006). “Sampling strategies for bag-of-features image classification,†in 9th European Conference on Computer Vision, 2006, 3954 LNCS, 490–503.
[22] Salahat, E., Qasaimeh, M. (2017). “Recent Advances in Features Extraction and Description Algorithms : A Comprehensive Survey,†in IEEE International Conference on Industrial Technology (ICIT), 2017.
[23] Matas, J., Chum, O., Urban, M., Pajdla, T. (2002). “Robust Wide Baseline Stereo from,†Br. Mach. Vis. Conf., p. 384–393.
[24] Takeishi, N., Tanimoto, A., Yairi, T., Tsuda, Y., Terui, F., Ogawa, N., Mimasu, Y. (2015). “Evaluation of Interest-region Detectors and Descriptors for Automatic Landmark Tracking on Asteroids,†Trans. Jpn. Soc. Aeronaut. Space Sci., 58 (1), 45–53, 2015.
[25] Krig, S. (2014). “Interest Point Detector and Feature Descriptor Survey,†in Computer Vision Metrics, no. 1, Apress, Berkeley, CA, 2014, 217–282.
[26] Jabeen, S., Mehmood, Z., Mahmood, T., Saba, T., Rehman, A., Mahmood, M. T. (2018). “An effective content-based image retrieval technique for image visuals representation based on the bag-of-visual-words model,†PLoS One, 1–24, 2018.
[27] Yanai, K., Kawano, Y. (2015). “Food Image Recognition Using Deep Convolutional Network with Pre-Training and Fine- Tuning,†in IEEE International Conference on Multimedia & Expo Workshops (ICMEW), 2015.
[28] Ziomek, A., Oszust, M. (2016). “Evaluation of Interest Point Detectors in Presence of Noise,†Int. J. Intell. Syst. Appl., 8 (3), 26-33, 2016.
[29] Ionescu, B., Benois-Pineau, J., Piatrik, T., Quenot, G. (2014). “Fusion in Computer Vision,†Adv. Comput. Vis. Pattern Recognit., p. 272.
[30] Kawano, Y., Yanai, K. (2015). “FoodCam: A real-time food recognition system on a smartphone,†Multimed. Tools Appl., 74 (14), 5263–5287.
[31] Pooja, H., Madival, P. S. A. (2016). “Food Recognition and Calorie Extraction using Bag-of- SURF and Spatial Pyramid Matching Methods,†Int. J. Comput. Sci. Mob. Comput., 5 (5), 387–393.
Author Rights 
