Mining connected global and local dense subgraphs for bigdata

• Published in: International journal of modern physics. C, Computational physics, physical computation Vol. 27; no. 7; p. 1650072
• Main Authors: Wu, Bo, Shen, Haiying
• Format: Journal Article
• Language: English
• Published: Singapore World Scientific Publishing Company 01.07.2016; World Scientific Publishing Co. Pte., Ltd
• Subjects: Algorithms; Data analysis; Data management; Domains; Graphs; complex network; natural graph; Densest subgraph
• ISSN: 0129-1831; 1793-6586
• DOI: 10.1142/S0129183116500728

The problem of discovering connected dense subgraphs of natural graphs is important in data analysis. Discovering dense subgraphs that do not contain denser subgraphs or are not contained in denser subgraphs (called significant dense subgraphs) is also critical for wide-ranging applications. In spite of many works on discovering dense subgraphs, there are no algorithms that can guarantee the connectivity of the returned subgraphs or discover significant dense subgraphs. Hence, in this paper, we define two subgraph discovery problems to discover connected and significant dense subgraphs, propose polynomial-time algorithms and theoretically prove their validity. We also propose an algorithm to further improve the time and space efficiency of our basic algorithm for discovering significant dense subgraphs in big data by taking advantage of the unique features of large natural graphs. In the experiments, we use massive natural graphs to evaluate our algorithms in comparison with previous algorithms. The experimental results show the effectiveness of our algorithms for the two problems and their efficiency. This work is also the first that reveals the physical significance of significant dense subgraphs in natural graphs from different domains.