Comparing SVD and word2vec for analysis of malware forum posts
Pages 1080 - 1086
Abstract
Many corpora of intelligence interest are so large that it is impractical to read them entirely. Analysts need tools that will focus attention on significant structures and particular documents. Here we exploit singular value decomposition and word2vec as tools for this purpose, and compare them with one another in a real-world application -- a malware forum from the dark web.
References
[1]
S. C. Deerwester, S. T. Dumais, T. K. Landauer, G. W. Furnas, and R. A. Harshman. Indexing by latent semantic analysis. Journal of the American Society of Information Science, 41(6):391--407, 1990.
[2]
Yoav Goldberg and Omer Levy. word2vec explained: Deriving mikolov et al.'s negative-sampling word-embedding method. arXiv preprint arXiv:1402.3722, 2014.
[3]
C.E. Lamb and D.B. Skillicorn. Extending textual models of deception to interrogation settings. Linguistic Evidence In Security, Law And Intelligence (LESLI), 1(1):13--40, December 2013.
[4]
T. Mikolov. Word2vec software. https://code.google.com/archive/p/word2vec/. Accessed: 2017-04-28.
[5]
Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781, 2013.
[6]
Tomas Mikolov, Quoc V Le, and Ilya Sutskever. Exploiting similarities among languages for machine translation. arXiv preprint arXiv:1309.4168, 2013.
[7]
Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems, pages 3111--3119, 2013.
[8]
Preslav Nakov, Alan Ritter, Sara Rosenthal, Fabrizio Sebastiani, and Veselin Stoyanov. Semeval-2016 task 4: Sentiment analysis in twitter. Proceedings of SemEval, pages 1--18, 2016.
[9]
Radim Řehůřek and Petr Sojka. Software Framework for Topic Modelling with Large Corpora. In Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks, pages 45--50, Valletta, Malta, May 2010. ELRA. http://is.muni.cz/publication/884893/en.
[10]
Aliaksei Severyn and Alessandro Moschitti. Twitter sentiment analysis with deep convolutional neural networks. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 959--962. ACM, 2015.
[11]
D.B. Skillicorn. Empirical assessment of al Qaeda, ISIS, and Taliban propaganda. In IEEE International Conference on Intelligence and Security Informatics, pages 61--66, Baltimore, 2015.
[12]
D.B. Skillicorn and E. Reid. Language use in the jihadist magazines Inspire and Azan. Security Informatics, 3(9), September 2014.
[13]
Duyu Tang, Furu Wei, Nan Yang, Ming Zhou, Ting Liu, and Bing Qin. Learning sentiment-specific word embedding for twitter sentiment classification. In ACL (1), pages 1555--1565, 2014.
[14]
L. van der Maaten and G. Hinton. Visualizing data using t-SNE. Journal of Machine Learning Research, 9:2579--2605, 2008.
[15]
Dongwen Zhang, Hua Xu, Zengcai Su, and Yunfeng Xu. Chinese comments sentiment classification based on word2vec and svm perf. Expert Systems with Applications, 42(4):1857--1863, 2015.
[16]
Jiajun Zhang, Shujie Liu, Mu Li, Ming Zhou, Chengqing Zong, et al. Bilingually-constrained phrase embeddings for machine translation. In ACL (1), pages 111--121, 2014.
[17]
Xiang Zhang, Junbo Zhao, and Yann LeCun. Character-level convolutional networks for text classification. In Advances in neural information processing systems, pages 649--657, 2015.
- Comparing SVD and word2vec for analysis of malware forum posts
Recommendations
Word2Vec based spelling correction method of Twitter message
SAC '19: Proceedings of the 34th ACM/SIGAPP Symposium on Applied ComputingTwitter1 became popular owing to the devices like smartphones and tablets, with which short messages can be easily composed. Due to the popularity of Twitter, the volume of Twitter messages has increased rapidly. Accordingly, studies have been carried ...
Comparing SVD and SDAE for Analysis of Islamist Forum Postings
ICDMW '15: Proceedings of the 2015 IEEE International Conference on Data Mining Workshop (ICDMW)We analyze postings in the Turn to Islam forum using techniques based on singular value decomposition (SVD) and the deep learning technique of stacked denoising autoencoders (SDAE). Models based on frequent words and jihadist language intensity are used,...
Authorship Attribution of Russian Forum Posts with Different Types of N-gram Features
NLPIR '19: Proceedings of the 2019 3rd International Conference on Natural Language Processing and Information RetrievalAuthorship attribution is an important field in online security. Recently there have been numerous successful works in authorship attribution in various European languages. Character n-grams are reported to be the best choice in authorship attribution, ...
Comments
Information & Contributors
Information
Published In
July 2017
698 pages
Copyright © 2017 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 31 July 2017
Check for updates
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ASONAM '17
Sponsor:
ASONAM '17: Advances in Social Networks Analysis and Mining 2017
July 31 - August 3, 2017
Sydney, Australia
Acceptance Rates
Overall Acceptance Rate 116 of 549 submissions, 21%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 228Total Downloads
- Downloads (Last 12 months)9
- Downloads (Last 6 weeks)0
Reflects downloads up to 06 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in