skip to main content
10.1145/3394486.3403077acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article

Laplacian Change Point Detection for Dynamic Graphs

Published: 20 August 2020 Publication History

Abstract

Dynamic and temporal graphs are rich data structures that are used to model complex relationships between entities over time. In particular, anomaly detection in temporal graphs is crucial for many real world applications such as intrusion identification in network systems, detection of ecosystem disturbances and detection of epidemic outbreaks. In this paper, we focus on change point detection in dynamic graphs and address two main challenges associated with this problem: I) how to compare graph snapshots across time, II) how to capture temporal dependencies. To solve the above challenges, we propose Laplacian Anomaly Detection (LAD) which uses the spectrum of the Laplacian matrix of the graph structure at each snapshot to obtain low dimensional embeddings. LAD explicitly models short term and long term dependencies by applying two sliding windows. In synthetic experiments, LAD outperforms the state-of-the-art method. We also evaluate our method on three real dynamic networks: UCI message network, US senate co-sponsorship network and Canadian bill voting network. In all three datasets, we demonstrate that our method can more effectively identify anomalous time points according to significant real world events.

Supplementary Material

MP4 File (3394486.3403077.mp4)
Dynamic graphs are rich data structures that are used to model complex relationships between entities over time. In this paper, we focus on change point detection in dynamic graphs and address two main challenges associated with this problem: I) how to compare graph snapshots across time, II) how to capture temporal dependencies. To solve the above challenges, we propose Laplacian Anomaly Detection (LAD) which uses the spectrum of the Laplacian matrix of the graph structure at each snapshot to obtain low dimensional embeddings. LAD explicitly models short term and long term dependencies by applying two sliding windows. In synthetic experiments, LAD outperforms the state-of-the-art method. We also evaluate our method on three real dynamic networks: UCI message network, US senate co-sponsorship network and Canadian bill voting network. In all three datasets, we demonstrate that our method can more effectively identify anomalous time points according to significant real world events.

References

[1]
Michal Aharon, Michael Elad, and Alfred Bruckstein. 2006. K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation. IEEE Transactions on signal processing, Vol. 54, 11 (2006), 4311--4322.
[2]
Leman Akoglu and Christos Faloutsos. 2010. Event detection in time series of mobile communication graphs. In Army science conference, Vol. 1.
[3]
N Benjamin Erichson, Steven L Brunton, and J Nathan Kutz. 2017. Compressed singular value decomposition for image and video processing. In Proceedings of the IEEE International Conference on Computer Vision Workshops. 1880--1888.
[4]
Michael W Berry. 1992. Large-scale sparse singular value computations. The International Journal of Supercomputing Applications, Vol. 6, 1 (1992), 13--49.
[5]
Phillip Bonacich. 1987. Power and centrality: A family of measures. American journal of sociology, Vol. 92, 5 (1987), 1170--1182.
[6]
Markus M Breunig, Hans-Peter Kriegel, Raymond T Ng, and Jörg Sander. 2000. LOF: identifying density-based local outliers. In Proceedings of the 2000 ACM SIGMOD international conference on Management of data. 93--104.
[7]
Rasmus Bro. 1997. PARAFAC. Tutorial and applications. Chemometrics and intelligent laboratory systems, Vol. 38, 2 (1997), 149--171.
[8]
Anna D Broido and Aaron Clauset. 2019. Scale-free networks are rare. Nature communications, Vol. 10, 1 (2019), 1017.
[9]
Zhengzhang Chen, William Hendrix, and Nagiza F Samatova. 2012. Community-based anomaly detection in evolutionary networks. Journal of Intelligent Information Systems, Vol. 39, 1 (2012), 59--85.
[10]
Fan RK Chung and Fan Chung Graham. 1997. Spectral graph theory. Number 92. American Mathematical Soc.
[11]
Our Commons. [n.d.]. In the House. https://www.ourcommons.ca/en Retrieved February 9, 2020 from
[12]
Richard S Conley. 2011. Legislative Activity in the Canadian House of Commons: Does Majority or Minority Government Matter? American Review of Canadian Studies, Vol. 41, 4 (2011), 422--437.
[13]
William Cross. 2016. The Importance of Local Party Activity in Understanding Canadian Politics: Winning from the Ground Up in the 2015 Federal Election: Presidential Address to the Canadian Political Science Association Calgary, 31 May 2016. Canadian Journal of Political Science/Revue canadienne de science politique, Vol. 49, 4 (2016), 601--620.
[14]
Dhivya Eswaran, Christos Faloutsos, Sudipto Guha, and Nina Mishra. 2018. Spotlight: Detecting anomalies in streaming graphs. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 1378--1386.
[15]
James H Fowler. 2006. Legislative cosponsorship networks in the US House and Senate. Social Networks, Vol. 28, 4 (2006), 454--465.
[16]
Mostafa Reisi Gahrooei and Kamran Paynabar. 2018. Change detection in a dynamic stream of attributed networks. Journal of Quality Technology, Vol. 50, 4 (2018), 418--430.
[17]
Christopher Garner and Natalia Letki. 2005. Party structure and backbench dissent in the Canadian and British Parliaments. Canadian Journal of Political Science/Revue canadienne de science politique, Vol. 38, 2 (2005), 463--482.
[18]
K-I Goh, Byungnam Kahng, and Doochul Kim. 2001. Universal behavior of load distribution in scale-free networks. Physical review letters, Vol. 87, 27 (2001), 278701.
[19]
Gene H Golub and Christian Reinsch. 1971. Singular value decomposition and least squares solutions. In Linear Algebra. Springer, 134--151.
[20]
Lars Hagen and Andrew B Kahng. 1992. New spectral methods for ratio cut partitioning and clustering. IEEE transactions on computer-aided design of integrated circuits and systems, Vol. 11, 9 (1992), 1074--1085.
[21]
Nathan Halko, Per-Gunnar Martinsson, and Joel A Tropp. 2011. Finding structure with randomness: Probabilistic algorithms for constructing approximate matrix decompositions. SIAM review, Vol. 53, 2 (2011), 217--288.
[22]
Richard A Harshman et al. 1970. Foundations of the PARAFAC procedure: Models and conditions for an" explanatory" multimodal factor analysis. (1970).
[23]
Paul W Holland, Kathryn Blackmond Laskey, and Samuel Leinhardt. 1983. Stochastic blockmodels: First steps. Social networks, Vol. 5, 2 (1983), 109--137.
[24]
Tsuyoshi Idé and Hisashi Kashima. 2004. Eigenspace-based anomaly detection in computer systems. In Proceedings of the tenth ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 440--449.
[25]
Tamara G Kolda and Brett W Bader. 2009. Tensor decompositions and applications. SIAM review, Vol. 51, 3 (2009), 455--500.
[26]
Jean Kossaifi, Yannis Panagakis, Anima Anandkumar, and Maja Pantic. 2019. Tensorly: Tensor learning in python. The Journal of Machine Learning Research, Vol. 20, 1 (2019), 925--930.
[27]
Danai Koutra, Evangelos E Papalexakis, and Christos Faloutsos. 2012. Tensorsplat: Spotting latent anomalies in time. In 2012 16th Panhellenic Conference on Informatics. IEEE, 144--149.
[28]
Danai Koutra, Neil Shah, Joshua T Vogelstein, Brian Gallagher, and Christos Faloutsos. 2016. Deltacon: Principled massive-graph similarity function with attribution. ACM Transactions on Knowledge Discovery from Data (TKDD), Vol. 10, 3 (2016), 1--43.
[29]
Xiaolei Li, Zhenhui Li, Jiawei Han, and Jae-Gil Lee. 2009. Temporal outlier detection in vehicle traffic data. In 2009 IEEE 25th International Conference on Data Engineering. IEEE, 1319--1322.
[30]
Emmett Macfarlane. 2019. The Renewed Canadian Senate: Organizational Challenges and Relations with the Government .Institute for Research on Public Policy.
[31]
Alex Marland. 2013. What is a political brand?: Justin Trudeau and the theory of political branding. In annual meeting of the Canadian Communication Association and the Canadian Political Science Association, University of Victoria, British Columbia, June, Vol. 6.
[32]
Benjamin A Miller, Nicholas Arcolano, Michelle S Beard, Jeremy Kepner, Matthew C Schmidt, Nadya T Bliss, and Patrick J Wolfe. 2012. A scalable signal processing architecture for massive graph analysis. In 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 5329--5332.
[33]
Lawrence Page, Sergey Brin, Rajeev Motwani, and Terry Winograd. 1999. The pagerank citation ranking: Bringing order to the web. Technical Report. Stanford InfoLab.
[34]
Pietro Panzarasa, Tore Opsahl, and Kathleen M Carley. 2009. Patterns and dynamics of users' behavior and interaction: Network analysis of an online community. Journal of the American Society for Information Science and Technology, Vol. 60, 5 (2009), 911--932.
[35]
F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research, Vol. 12 (2011), 2825--2830.
[36]
Leto Peel and Aaron Clauset. 2015. Detecting change points in the large-scale structure of evolving networks. In Twenty-Ninth AAAI Conference on Artificial Intelligence .
[37]
Stephen Ranshous, Shitian Shen, Danai Koutra, Steve Harenberg, Christos Faloutsos, and Nagiza F Samatova. 2015. Anomaly detection in dynamic networks: a survey. Wiley Interdisciplinary Reviews: Computational Statistics, Vol. 7, 3 (2015), 223--247.
[38]
Awwal Mohammed Rufai, Gholamreza Anbarjafari, and Hasan Demirel. 2014. Lossy image compression using singular value decomposition and wavelet difference reduction. Digital signal processing, Vol. 24 (2014), 117--123.
[39]
Neil Shah, Danai Koutra, Tianmin Zou, Brian Gallagher, and Christos Faloutsos. 2015. Timecrunch: Interpretable dynamic graph summarization. In Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 1055--1064.
[40]
Jianbo Shi and Jitendra Malik. 2000. Normalized cuts and image segmentation. IEEE Transactions on pattern analysis and machine intelligence, Vol. 22, 8 (2000), 888--905.
[41]
Brian Thompson and Tina Eliassi-Rad. 2009. Dapa-v10: Discovery and analysis of patterns and anomalies in volatile time-evolving networks. Technical Report. Lawrence Livermore National Lab.(LLNL), Livermore, CA (United States).
[42]
Pauli Virtanen, Ralf Gommers, Travis E. Oliphant, Matt Haberland, Tyler Reddy, David Cournapeau, Evgeni Burovski, Pearu Peterson, Warren Weckesser, Jonathan Bright, Stéfan J. van der Walt, Matthew Brett, Joshua Wilson, K. Jarrod Millman, Nikolay Mayorov, Andrew R. J. Nelson, Eric Jones, Robert Kern, Eric Larson, CJ Carey, .Ilhan Polat, Yu Feng, Eric W. Moore, Jake Vand erPlas, Denis Laxalde, Josef Perktold, Robert Cimrman, Ian Henriksen, E. A. Quintero, Charles R Harris, Anne M. Archibald, Antônio H. Ribeiro, Fabian Pedregosa, Paul van Mulbregt, and SciPy 1. 0 Contributors. 2020. SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python. Nature Methods (2020). https://doi.org/10.1038/s41592-019-0686--2
[43]
Ulrike Von Luxburg. 2007. A tutorial on spectral clustering. Statistics and computing, Vol. 17, 4 (2007), 395--416.
[44]
Yu Wang, Aniket Chakrabarti, David Sivakoff, and Srinivasan Parthasarathy. 2017. Fast change point detection on dynamic social networks. arXiv preprint arXiv:1705.07325 (2017).
[45]
Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. 2018. How powerful are graph neural networks? arXiv preprint arXiv:1810.00826 (2018).
[46]
Rose Yu, Huida Qiu, Zhen Wen, ChingYung Lin, and Yan Liu. 2016. A survey on social media anomaly detection. ACM SIGKDD Explorations Newsletter, Vol. 18, 1 (2016), 1--14.
[47]
Wenchao Yu, Wei Cheng, Charu C Aggarwal, Kai Zhang, Haifeng Chen, and Wei Wang. 2018. Netwalk: A flexible deep embedding approach for anomaly detection in dynamic networks. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM, 2672--2681.
[48]
Sina Zamani, Tejaswi Nanjundaswamy, and Kenneth Rose. 2017. Frequency domain singular value decomposition for efficient spatial audio coding. In 2017 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA). IEEE, 126--130.
[49]
Xiao-Dong Zhang. 2011. The Laplacian eigenvalues of graphs: a survey. arXiv preprint arXiv:1111.2897 (2011).
[50]
Li Zheng, Zhenpeng Li, Jian Li, Zhao Li, and Jun Gao. 2019. Addgraph: anomaly detection in dynamic graph using attention-based temporal GCN. In Proceedings of the 28th International Joint Conference on Artificial Intelligence. AAAI Press, 4419--4425.
[51]
Eric R Ziegel. 2001. Standard probability and statistics tables and formulae. Technometrics, Vol. 43, 2 (2001), 249.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
KDD '20: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining
August 2020
3664 pages
ISBN:9781450379984
DOI:10.1145/3394486
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 August 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. anomaly detection
  2. change point detection
  3. dynamic graphs
  4. spectral methods

Qualifiers

  • Research-article

Funding Sources

  • Canadian Institute for Advanced Research (CIFAR AI chair program)

Conference

KDD '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,133 of 8,635 submissions, 13%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)151
  • Downloads (Last 6 weeks)10
Reflects downloads up to 16 Oct 2024

Other Metrics

Citations

Cited By

View all

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media