Scalable Overlapping Community Detection in Internet-Scale Networks

Proceedings of the Workshop of Information Technology and Systems, Auckland 2014

15 Pages Posted: 13 Dec 2016

See all articles by Junming Yin

Junming Yin

University of Arizona

Qirong Ho

Agency for Science, Technology and Research

Eric Xing

Carnegie Mellon University

Date Written: 2014

Abstract

The rapid growth of the Internet, particularly the explosion of social media, has led to unprecedented increases in the volume of network data worldwide. Already, the Yahoo Web Graph collected in 2002 contains in excess of one billion URLs, the Facebook social network recently exceeded one billion users, and numerous other social networks or online communities easily claim memberships in the millions of users. One fundamental task towards understanding the structural and functional properties of large-scale networks is to detect its community structure, where each community consists of a group of (relatively) densely interconnected nodes. Recently, there has been growing interest in overlapping community detection due to the evidence of significant community overlaps found in large-scale real networks with ground-truth communities (Yang and Leskovec 2012). Not surprisingly, for example, it is generally accepted that actors in a social network tend to belong to multiple social groups (such as family, colleagues, and friends), depending on whom they are interacting with.

The discovered communities can be explored and utilized in a number of important applications such as identifying fraudulent actions in telecommunication networks (Pinheiro 2012), studying dynamics of viral marketing (Leskovec et al. 2007), and identifying target groups in consumer networks (Hill et al. 2006). However, only a few algorithms have been successfully applied to large networks in excess of hundreds of millions of nodes — and to the best of our knowledge, none of them are based on a statistical framework.

Suggested Citation

Yin, Junming and Ho, Qirong and Xing, Eric, Scalable Overlapping Community Detection in Internet-Scale Networks (2014). Proceedings of the Workshop of Information Technology and Systems, Auckland 2014. Available at SSRN: https://ssrn.com/abstract=2883859

Junming Yin (Contact Author)

University of Arizona ( email )

Department of History
Tucson, AZ 85721
United States

Qirong Ho

Agency for Science, Technology and Research ( email )

1 Fusionopolis Way
#16-16 Connexis
Singapore, 138632
Singapore

Eric Xing

Carnegie Mellon University ( email )

Pittsburgh, PA 15213-3890
United States

Register to save articles to
your library

Register

Paper statistics

Downloads
28
Abstract Views
295
PlumX Metrics