1. Home
  2. Issues
  3. Volume 30, Issue 1 (2019)
  4. Detecting Free Standing Conversational G ...

Informatica


Detecting Free Standing Conversational Group in Video Using Fuzzy Relations
Volume 30, Issue 1 (2019), pp. 21–32
Pub. online: 1 January 2019      Type: Research Article      Open accessOpen Access
Received
1 November 2017
Accepted
1 June 2018
Published
1 January 2019

Abstract

In Computer Vision and Pattern Recognition, surveillance-video crowded scenes have been analysed according to their structure, where the detection of distinguishable people groups is an essential step. In this paper, we are interested in detecting F-Formations (i.e. free standing conversational groups) on video, which are formed by people social relations. We proposed a new method based on fuzzy relations, where a new social representation for computing relation between individuals, fusion for search consensus in multiple frame and clustering are introduced. Finally, our proposal was tested in a real-world dataset, improving the already reported scores from literature.

References

 
Bulò, S., Pelillo, M. (2009). A game-theoretic approach to hypergraph clustering. In: Conference on Neural Information Processing Systems, pp. 1571–1579.
 
Cristani, M., Bazzani, L., Paggetti, G., Fossati, A., Tosato, D., Del Bue, A., Menegaz, G., Murino, V. (2011). Social interaction discovery by statistical analysis of f-formations. In: British Machine Vision Conference, Dundee, UK Vol. 2, pp. 1–12.
 
Gupta, M.M., Qi, J. (1991). Theory of T-norms and fuzzy inference methods. Fuzzy Sets and Systems, 40(3), 431–450.
 
Hall, E.T. (1966). The Hidden Dimension, New York.
 
Hung, H., Kröse, B. (2011). Detecting f-formations as dominant sets. In: Proceedings of the 13th International Conference on Multimodal Interfaces. ACM, pp. 231–238.
 
Kendon, A. (2010). Spacing and orientation in co-present interaction. Development of Multimodal Interfaces: Active Listening and Synchrony, 1–15.
 
Lee, H. (2001). An optimal algorithm for computing the max-min transitive closure of a fuzzy similarity matrix. Fuzzy Sets and Systems, 1, 129–136.
 
Levine, J., Moreland, R. (2004). Small Groups: Key Readings. Key Readings in Social Psychology. Taylor, Francis.
 
Li, T., Chang, H., Wang, M., Ni, B., Hong, R., Yan, S. (2015). Crowded scene analysis: a survey. Circuits and Systems for Video Technology, IEEE Transactions, 25(3), 367–386.
 
Moussaïd, M., Perozo, N., Garnier, S., Helbing, D., Theraulaz, G. (2010). The walking behaviour of pedestrian social groups and its impact on crowd dynamics. PloS One, 5(4), e10047.
 
Mukhopadhyay, P., Chaudhuri, B.B. (2015). A survey of hough transform. Pattern Recognition, 48(3), 993–1010.
 
Setti, F., Lanz, O., Ferrario, R., Murino, V., Cristani, M. (2013). Multi-scale f-formation discovery for group detection. In: International Conference on Image Processing. IEEE, pp. 3547–3551.
 
Somasundaram, K., Baras, J. (2009). Achieving symmetric Pareto Nash equilibria using biased replicator dynamics. In: IEEE Conference on Decision and Control, pp. 7000–7005.
 
Takagi, T., Sugeno, M. (1985). Fuzzy identification of systems and its applications to modeling and control. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 15(1), 116–132.
 
Tamura, S., Higuchi, S., Tanaka, K. (1971). Pattern classification based on fuzzy relations. IEEE Transactions on Systems, Man, and Cybernetics, 1, 61–66.
 
Vascon, S., Mequanint, E.Z., Cristani, M., Hung, H., Pelillo, M., Murino, V. (2014). A game-theoretic probabilistic approach for detecting conversational groups. In: Asian Conference on Computer Vision, pp. 658–675.
 
Vascon, S., Mequanint, E.Z., Cristani, M., Hung, H., Pelillo, M., Murino, V. (2016). Detecting conversational groups in images and sequences: a robust game-theoretic approach. Computer Vision and Image Understanding, 143, 11–24.
 
Vinciarelli, A., Pantic, M., Bourlard, H. (2009). Social signal processing: Survey of an emerging domain. Image and Vision Computing, 27(12), 1743–1759.
 
Zadeh, L. (1965). Fuzzy sets. Information and Control, 8, 338–353.
 
Zadeh, L.A. (1971). Similarity relations and fuzzy orderings. Information Sciences, 3(2), 177–200.
 
Zhang, L., Hung, H. (2016). Beyond f-formations: determining social involvement in free standing conversing groups from static images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1086–1095.
 
Zhang, H.P., Beé, A., Florin, E.L., Swinney, H.L. (2010). Collective motion and density fluctuations in bacterial colonies. Proceedings of the National Academy of Sciences, 107(31), 13626–13630.

Biographies

Ferrera-Cedeño Elvis
elchago8787@gmail.com

E. Ferrera-Cedeño obtained a BEng on computational science from University of Informatics Sciences, Cuba, in 2011. Currently, he is a research fellow in the Pattern Recognition Department at CENATAV, where he is a PhD student. His research interests include: social groups detection in video scene, crowded scene analysis, video-surveillance.

Acosta-Mendoza Niusvel

N. Acosta-Mendoza obtained a BEng on computational science from University of Informatics Sciences, Cuba, in 2007. In July 2013 he received the MSc degree in computer science at INAOE, Mexico. He completed his PhD degree in computational sciences at INAOE in February 2018. Currently, he is a research fellow in the Data Mining Department at CENATAV, Cuba. His research interests include: knowledge discovery and data mining in graph-based content, machine learning.

Gago-Alonso Andrés

A. Gago-Alonso obtained a Bsc in computer science from Havana University, Havana, Cuba, in 2004. He holds the MSc degree in mathematics from the same university in 2007. He completed his PhD degree in computational sciences at INAOE in January 2010. Currently, he is an associate researcher in the Data Mining Department at CENATAV, Cuba. His research interests include: knowledge discovery, data mining in graph-based content.

García-Reyes Edel

E. García-Reyes obtained a Bsc in computer science from Havana University, Havana, Cuba, in 1986. He received the PhD degree in technical sciences at the Technical Military Institute José Martí of Havana, in 1997. Currently, he is an associate researcher in the Pattern Recognition Department at CENATAV, Cuba. His research interests include: digital image processing of remote sensing data, biometric, video-surveillance.


Full article Related articles Cited by PDF XML
Full article Related articles Cited by PDF XML

Copyright
© 2019 Vilnius University
Open access article under the CC BY license.

Keywords
F-formation detection group detection crowded scene surveillance-video fuzzy relations

Metrics
since January 2020
1087

Article info
views

577

Full article
views

589

PDF
downloads

250

XML
downloads


Share


RSS