1. Home
  2. Issues
  3. Volume 29, Issue 2 (2018)
  4. Crowd Abnormal Behaviour Identification ...

Informatica


Crowd Abnormal Behaviour Identification Based on Integral Optical Flow in Video Surveillance Systems
Volume 29, Issue 2 (2018), pp. 211–232
Pub. online: 1 January 2018      Type: Research Article      Open accessOpen Access
Received
1 June 2017
Accepted
1 March 2018
Published
1 January 2018

Abstract

Basic motion structures of crowd aggregation and crowd dispersion are defined and a novel method for identifying these crowd behaviours is proposed. Based on integral optical flow, background and foreground are separated and intensive motion region is obtained. Crowd motion is analysed at pixel-level statistically for each frame to obtain quantity of pixels moving toward or away from each position and their comprehensive motion at each position. Regional motion indicators are computed and regional motion maps are formed to describe motions at region-level. Crowd behaviours are identified by threshold segmentation of regional motion maps.

References

 
Andrade, E.L., Blunsden, S., Fisher, R.B. (2006). Modelling crowd scenes for event detection. In: Proceedings of 18th International Conference on Pattern Recognition, Vol. 01. IEEE Computer Society, Washington, DC, pp. 175–178.
 
Ali, S., Shah, M. (2007). A Lagrangian particle dynamics approach for crowd flow segmentation and stability analysis. In: Proceedings of IEEE Computer Vision and Pattern Recognition, Vol. 00. IEEE Computer Society, Washington, DC, pp. 1–6.
 
Allain, P., Courty, N., Corpetti, T. (2012). AGORASET: a dataset for crowd video analysis. In: Proceedings of 1st ICPR International Workshop on Pattern Recognition and Crowd Analysis, pp. 1–6.
 
Chen, C., Shao, Y. (2014). Anomalous crowd behavior detection and localization in video surveillance. In: Proceedings of IEEE International Conference on Control Science and Systems Engineering. IEEE, New York, pp. 190–194.
 
Chen, C.X., Ye, S.P., Chen, H.F., Nedzvedz, O., Ablameyko, S. (2017). Integral optical flow and its applications for dynamic object monitoring in video. Journal of Applied Spectroscopy, 84(1), 120–128.
 
Cheriyadat, A.M., Radke, R.J. (2008). Detecting dominant motions in dense crowds. IEEE Journal of Selected Topics in Signal Processing, 2(4), 568–581.
 
Cheung, E., Wong, T.K., Bera, A., Wang, X., Manocha, D. (2016). Generating labeled videos for simulation-based crowd behavior learning. In: Proceedings of Computer Vision ECCV 2016 Workshops, Lecture Notes in Computer Science, Vol. 9914. Springer, Berlin, pp. 709–727.
 
Courty, N., Allain, P., Creusot, C., Corpetti, T. (2014). Using the AGORASET dataset: assessing for the quality of crowd video analysis methods. Pattern Recognition Letters, 44(8), 161–170.
 
Farnebäck, G. (2003). Two-frame motion estimation based on polynomial expansion. In: Proceedings of Scandinavian Conference on Image Analysis, Vol. 2749. Springer, Berlin, pp. 363–370.
 
Horn, B.K., Schunck, B.G. (1981). Determining optical flow. Artificial Intelligence, 17(1–3), 185–203.
 
Hu, M., Ali, S., Shah, M. (2008). Learning motion patterns in crowded scenes using motion flow field. In: Proceedings of 19th International Conference on Pattern Recognition. IEEE, New York, pp. 1–5.
 
Hu, X., Zheng, H., Wang, W., Li, X. (2013). A novel approach for crowd video monitoring of subway platforms. Optik, 124(22), 5301–5306.
 
Junior, J.C.S.J., Musse, S.R., Jung, C.R. (2010). Crowd analysis using computer vision techniques. IEEE Signal Processing Magazine, 27(5), 66–77.
 
Kustikova, V.D., Gergel, V.P. (2016). Vehicle video detection and tracking quality analysis. Pattern Recognition and Image Analysis, 26(1), 155–160.
 
Li, T., Chang, H., Wang, M., Ni, B., Hong, R., Yan, S. (2015). Crowded scene analysis: a survey. IEEE Transactions on Circuits and Systems for Video Technology, 25(3), 367–386.
 
Lucas, B.D., Kanade, T. (1981). An iterative image registration technique with an application to stereo vision. In: Proceedings of the 7th International Joint Conference on Artificial Intelligence, Vol. 2. ACM, New York, pp. 674–679.
 
Mehran, R., Oyama, A., Shah, M. (2009). Abnormal crowd behavior detection using social force model. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. IEEE Computer Society, Washington, DC, pp. 935–942.
 
Ravanbakhsh, M., Nabi, M., Mousavi, H., Sangineto, E., Sebe, N. (2017). Plug-and-play cnn for crowd motion analysis: an application in abnormal event detection. arXiv preprint at https://arxiv.org/abs/1610.00307v1.
 
Shao, J., Loy, C.C., Kang, K., Wang, X. (2016). Slicing convolutional neural network for crowd video understanding. In: Proceedings of 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society, Washington, DC, pp. 5620–5628.
 
Shao, J., Loy, C.C., Kang, K., Wang, X. (2017). Crowded scene understanding by deeply learned volumetric slices. IEEE Transactions on Circuits and Systems for Video Technology, 27(3), 613–623.
 
Sjarif, N.N.A., Shamsuddin, S.M., Hashim, S.Z. (2012). Detection of abnormal behaviors in crowd scene: a review. International Journal of Advances in Soft Computing and Its Applications, 4(1), 1–33.
 
Solmaz, B., Moore, B.E., Shah, M. (2012). Identifying behaviors in crowd scenes using stability analysis for dynamical systems. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(10), 2064–2070.
 
Tao, M., Bai, J., Kohli, P., Paris, S. (2012). Simple flow: a non-iterative, sublinear optical flow algorithm. Computer Graphics Forum, 31(2), 345–353.
 
Wang, Q., Ma, Q., Luo, C.H., Liu, H.Y., Zhang, C.L. (2016). Hybrid histogram of oriented optical flow for abnormal behavior detection in crowd scenes. International Journal of Pattern Recognition and Artificial Intelligence, 30(2), 210–224.
 
Yogameena, B., Nagananthini, C. (2017). Computer vision based crowd disaster avoidance system: a survey. International Journal of Disaster Risk Reduction, 22, 95–129.
 
Zhang, W., Hou, Y., Wang, S. (2016). Event recognition of crowd video using corner optical flow and convolutional neural network. In: Procceedings of Eighth International Conference on Digital Image Processing (ICDIP 2016), Vol. 10033. SPIE, Bellingham, pp. 332–335.
 
Zhao, Z., Li, H., Zhao, R., Wang, X. (2016). Rossing-line crowd counting with two-phase deep neural networks. In: Proceedings of Computer Vision – ECCV 2016, Lecture Notes in Computer Science, Vol. 9912. Springer, Cham, pp. 712–726.

Biographies

Chen Huafeng
eric.hf.chen@hotmail.com

H. Chen was born in 1982. He is a lecturer of Zhejiang Shuren University. Graduated from Zhejiang University in 2003. In 2009 he got his PhD in the field of earth exploration and information technology at the Institute of Space Information & Technique, Zhejiang University. His scientific interests include remote sensing image processing, GIS application, image and video processing, multi-agent system. He has published more than 10 academic articles.

Nedzvedz Olga

O. Nedzvedz is a senior lecturer of Department of Medical and Biological Physics of Belarusian Medical University. Her area of scientific interests includes analysis of medical images, mathematical simulation of medical processes, biophysics and biophysical education. She is an author of more than 25 publications in the fields of medical informatics, biophysics and pedagogy.

Ye Shiping

Sh. Ye was born in 1967. He is a professor and vice president of Zhejiang Shuren University. Graduated from Zhejiang University in 1988. In 2009 he got his master’s degree in computer science and technology from Zhejiang University. His scientific interests include application of computer graphics and image, GIS. He has published more than 40 academic articles. Four research projects he has taken part in have been awarded second prize of Zhejiang Provincial Scientific and Technological Achievement. Two teaching research programs he has presided over have been awarded first prize and second prize of Zhejiang Provincial Teaching Achievement, respectively.

Ablameyko Sergey

S. Ablameyko was born in 1956, DipMath in 1978, PhD in 1984, DSc in 1990, prof. in 1992. Rector (president) of Belarusian State University from 2008 to 2017. His scientific interests are: image analysis, pattern recognition, digital geometry, knowledge based systems, geographical information systems, medical imaging. He has more than 400 publications. He is in editorial board of Pattern Recognition Letters, Pattern Recognition and Image Analysis and many other international and national journals. He is editor-in-chief of two national journals. He is a senior member of IEEE, Fellow of IAPR, Fellow of Belarusian Engineering Academy, Academician of National Academy of Sciences of Belarus, Academician of the European Academy, and others. He was a first vice-president of International Association for Pattern Recognition IAPR (2006–2008), President of Belarusian Association for image analysis and recognition. He is a deputy chairman of Belarusian Space Committee, chairman of BSU Academic Council of awarding of PhD and DSc degrees. For his activity he was awarded by State Prize of Belarus (highest national scientific award) in 2002, Belarusian Medal of F. Skoryna, Russian Award of Friendship and many other awards.


Full article Related articles Cited by PDF XML
Full article Related articles Cited by PDF XML

Copyright
© 2018 Vilnius University
Open access article under the CC BY license.

Keywords
crowd behaviour integral optical flow motion analysis segmentation

Metrics
since January 2020
2185

Article info
views

619

Full article
views

612

PDF
downloads

249

XML
downloads


Share


RSS