Intelligent Baby Behavior Monitoring using Embedded Vision in IoT for Smart Healthcare Centers

Sung Wook Baik

Intelligent Media Laboratory, Digital Contents Research Institute, Sejong University, Seoul 143-147, Republic of Korea
a. [email protected] , b. [email protected] , c. [email protected],  d. [email protected]
*Corresponding author

Mainstream Internet of Things (IoT) techniques for smart homes focus on appliances and surveillance in smart cities. Most of the researchers utilize vision sensors in IoT environment targeting only adult users for various applications such as abnormal activity recognition. This paper introduces a new paradigm in vision sensor IoT technologies by analyzing the behavior of baby through an intelligent multimodal system. Traditional wearable sensors such as heartbeat if attached to any body part of the baby make him uncomfortable and also some babies are paranoid toward sensors. Our vision based baby monitoring framework employs one of the process improvement techniques known as control charts to analyze the baby behavior. We construct control chart in a specific interval for real-time frames generated by Raspberry Pi (RPi) with attached vision sensor. Baby motion is represented through points on control chart, if it exceeds upper control limit (UCL) or falls from lower control limits (LCL), it indicates abnormal behavior of the baby. Whenever such a behavior is encountered, a signal is transmitted to the interconnected devices in IoT as an alert to baby care takers in smart health care centers. Our proposed framework is adaptable, a single RPi can be used to monitor a baby in home or a network of RPi’s for an IoT in a children nursery for multiple babies monitoring. Performance evaluation on our own created dataset indicates the better accuracy and efficiency of our proposed framework.

IoT, Smart Health Care, Nurseries Monitoring, Smart Hospitals, Image Processing, Resource Constrained Devices, Control Charts

Tanveer Hussain; Khan Muhammad; Salman Khan; Amin Ullah; Mi Young Lee; Sung Wook Baik (2019). Intelligent Baby Behavior Monitoring using Embedded Vision in IoT for Smart Healthcare Centers. Journal of Artificial Intelligence and Systems, 1, 110–124. https://doi.org/10.33969/AIS.2019.11007.

[1] S. Khan, K. Muhammad, S. Mumtaz, S. W. Baik, and V. H. C. de Albuquerque, "Energy-efficient deep CNN for smoke detection in foggy IoT environment," IEEE Internet of Things Journal, 2019.
[2] T. Hussain, K. Muhammad, J. Del Ser, S. W. Baik, and V. H. C. de Albuquerque, "Intelligent Embedded Vision for Summarization of Multi-View Videos in IIoT," IEEE Transactions on Industrial Informatics, 2019.
[3] A. Sun, W. Gong, R. Shea, and J. Liu, "A Castle of Glass: Leaky IoT Appliances in Modern Smart Homes," IEEE Wireless Communications, vol. 25, pp. 32-37, 2018.
[4] M. Mohammadi, A. Al-Fuqaha, M. Guizani, and J. Oh, "Semisupervised Deep Reinforcement Learning in Support of IoT and Smart City Services," IEEE Internet of Things Journal, vol. 5, pp. 624-635, 2018.
[5] M. Sajjad, M. Nasir, F. U. M. Ullah, K. Muhammad, A. K. Sangaiah, and S. W. Baik, "Raspberry Pi assisted facial expression recognition framework for smart security in law-enforcement services," Information Sciences, vol. 479, pp. 416-431, 2019.
[6] K. Muhammad, T. Hussain, and S. W. Baik, "Efficient CNN based summarization of surveillance videos for resource-constrained devices," Pattern Recognition Letters, 2018.
[7] M. W. Condry and C. B. Nelson, "Using Smart Edge IoT Devices for Safer, Rapid Response With Industry IoT Control Operations," Proceedings of the IEEE, vol. 104, pp. 938-946, 2016.
[8] K. Muhammad, R. Hamza, J. Ahmad, J. Lloret, H. Wang, and S. W. Baik, "Secure Surveillance Framework for IoT Systems Using Probabilistic Image Encryption," IEEE Transactions on Industrial Informatics, vol. 14, pp. 3679-3689, 2018.
[9] T. Hussain, K. Muhammad, A. Ullah, Z. Cao, S. W. Baik, and V. H. C. de Albuquerque, "Cloud-assisted multi-view video summarization using CNN and bi-directional LSTM," IEEE Transactions on Industrial Informatics, 2019.
[10] P. H. F. N. Sousa, N. M. M.; Almeida, J. S.; Rebouças Filho, P. P. and Albuquerque, V. H. C, "Intelligent Incipient Fault Detection in Wind Turbines based on Industrial IoT Environment," Journal of Artificial Intelligence and Systems, pp. 1-19, 2019.
[11] C. Taramasco, T. Rodenas, F. Martinez, P. Fuentes, R. Munoz, R. Olivares, et al., "A novel monitoring system for fall detection in older people," IEEE Access, vol. 6, pp. 43563-43574, 2018.
[12] C. Taramasco, T. Rodenas, F. Martinez, P. Fuentes, R. Munoz, R. Olivares, et al., "A novel low-cost sensor prototype for nocturia monitoring in older people," IEEE Access, vol. 6, pp. 52500-52509, 2018.
[13] S. Brangui, M. El Kihal, and Y. Salih-Alj, "An enhanced noise cancelling system for a comprehensive monitoring and control of baby environments," in Electrical and Information Technologies (ICEIT), 2015 International Conference on, 2015, pp. 404-409.
[14] M. P. Joshi and D. C. Mehetre, "IoT Based Smart Cradle System with an Android App for Baby Monitoring," in 2017 International Conference on Computing, Communication, Control and Automation (ICCUBEA), 2017, pp. 1-4.
[15] A. F. Symon, N. Hassan, H. Rashid, I. U. Ahmed, and S. T. Reza, "Design and development of a smart baby monitoring system based on Raspberry Pi and Pi camera," in Advances in Electrical Engineering (ICAEE), 2017 4th International Conference on, 2017, pp. 117-122.
[16] R. Palaskar, S. Pandey, A. Telang, A. Wagh, and R. Kagalkar, "An Automatic Monitoring and Swing the Baby Cradle for Infant Care," International Journal of Advanced Research in Computer and Communication Engineering, vol. 4, pp. 187-189, 2015.
[17] M. Koli, P. Ladge, B. Prasad, R. Boria, and P. N. J. Balur, "Intelligent Baby Incubator," in 2018 Second International Conference on Electronics, Communication and Aerospace Technology (ICECA), 2018, pp. 1036-1042.
[18] C. Pan, W. Zhao, S. Deng, W. Wei, Y. Zhang, and Y. Xu, "The Methods of Realizing Baby Crying Recognition and Intelligent Monitoring Based on DNN-GMM-HMM," in 2018 2nd IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC), 2018, pp. 352-356.
[19] Z. Zivkovic, "Improved adaptive Gaussian mixture model for background subtraction," in Pattern Recognition, 2004. ICPR 2004. Proceedings of the 17th International Conference on, 2004, pp. 28-31.
[20] Z. Zivkovic and F. Van Der Heijden, "Efficient adaptive density estimation per image pixel for the task of background subtraction," Pattern recognition letters, vol. 27, pp. 773-780, 2006.
[21] A. Ullah, K. Muhammad, J. Del Ser, S. W. Baik, and V. Albuquerque, "Activity recognition using temporal optical flow convolutional features and multi-layer LSTM," IEEE Transactions on Industrial Electronics, 2018.