skip to main content
research-article

Broad collaborative filtering with adjusted cosine similarity by fusing matrix completion

Published: 01 November 2024 Publication History

Abstract

Collaborative filtering (CF) algorithms provide personalized recommendations based on user preferences and they are widely applied in various domains including social media and video platforms. Recently, the broad learning system (BLS) has been incorporated into CF. The combination of BLS and CF produces more accurate recommendation results due to the fact it can efficiently learn the non-linear relationship between items and users. However, the BLS-based CF adopts cosine similarity to seek several nearest neighbors when constructing features. This feature construction process generally leads to the difference of user rating scales and thus affects the calculation accuracy of the nearest neighbors. Furthermore, like many other CF algorithms, the BLS-based version cannot effectively handle with the data sparsity problem. The above two issues frequently result in poor recommendation performance for the BLS-based CF. To address these problems, a broad collaborative filtering with adjusted cosine similarity (ACOS), named MC-ABCF, is proposed by fusing matrix completion (MC). The matrix completion technique is first used to complete the rating matrix in order to relieve the phenomenon of data sparsity. Subsequently, the adjusted cosine similarity is utilized to find the nearest neighbors of a given user or item. As a result, the problem of rating scales difference between different users is avoided to some extent. The BLS is finally employed to establish complex nonlinear relationships between users and items. Extensive experiments on three benchmark datasets demonstrate that the proposed MC-ABCF model can mitigate the difficulties of data sparsity and user rating scales difference to a certain extent. Taking RMSE as an example, the MC-ABCF algorithm achieved an average improvement of 8.48 % compared to the BCF model across three datasets. In addition, ablation studies have shown the application of MC or ACOS is beneficial for the recommendation performance.

Highlights

Matrix completion is used to complete the user-item rating matrix to overcome the data sparsity problem effectively.
The proposed model adopts adjusted cosine similarity to measure user/item proximity to alleviate the rating scale difference.
Ablation experiments validate that both matrix completion and adjusted cosine similarity can improve the prediction accuracy.
Extensive experiments prove that the proposed model has better recommendation accuracy and efficiency.

References

[1]
Y. Zhu, N. Zhong, Y. Xiong, Data Explosion, data nature and dataology, Brain Inf. (2009) 147–158,.
[2]
S. Raza, C. Ding, News recommender system: a review of recent progress, challenges, and opportunities, Artif. Intell. Rev. 55 (2022) 749–800,.
[3]
V.L. Gatta, V. Moscato, M. Pennone, M. Postiglione, G. Sperlí, Music recommendation via hypergraph embedding, IEEE Trans. Neural Netw. Learn Syst. 34 (10) (2023) 7887–7890,.
[4]
Z. Zhu, S. Wang, F. Wang, Z. Tu, Recommendation networks of homogeneous products on an e-commerce platform: measurement and competition effects, Expert Syst. Appl. 201 (2022),.
[5]
P. Covington, J. Adams, E. Sargin, Deep neural networks for YouTube recommendations, in: Proceedings of the 10th ACM Conference on Recommender Systems, 2016, pp. 191–198, https://doi.org/10.1145/2959100.2959190.
[6]
R. Zhan, C. Pei, Q. Su, J. Wen, X. Wang, G. Mu, D. Zheng, P. Jiang, K. Gai, Deconfounding duration bias in watch-time prediction for video recommendation, in: Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2022, pp. 4472–4481, https://doi.org/10.1145/3534678.3539092.
[7]
E. Hasan, C. Ding, A. Cuzzocrea, Multi-criteria rating and review based recommendation model, in: 2022 IEEE International Conference on Big Data, 2022, pp. 5494–5503, https://doi.org/10.1109/bigdata55660.2022.10020741.
[8]
Z. Chen, S. Gai, D. Wang, Deep tensor factorization for multi-criteria recommender systems, in: 2019 IEEE International Conference on Big Data, 2019, pp. 1046–1051, https://doi.org/10.1109/bigdata47090.2019.9005677.
[9]
D. Liu, Y. Wang, C. Luo, J. Ma, An improved autoencoder for recommendation to alleviate the vanishing gradient problem, Knowl. Based Syst. 263 (2023),.
[10]
N. Nassar, A. Jafar, Y. Rahhal, Multi-criteria collaborative filtering recommender by fusing deep neural network and matrix factorization, J. Big Data 7 (2020) 34,.
[11]
Z. Deng, L. Huang, C. Wang, J. Lai, P.S. Yu, DeepCF: A unified framework of representation learning and matching function learning in recommender system, in: Proceedings of the AAAI Conference on Artificial Intelligence, 2019, pp. 61–68, https://doi.org/10.1609/aaai.v33i01.330161.
[12]
J. Chen, H. Zhang, X. He, L. Nie, W. Liu, T. Chua, Attentive collaborative filtering, in: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2017, pp. 335–344, https://doi.org/10.1145/3077136.3080797.
[13]
X. He, X. Du, X. Wang, F. Tian, J. Tang, T. Chua, Outer product-based neural collaborative filtering, in: Proceedings of the 27th International Joint Conference on Artificial Intelligence, 2018, pp. 2227–2233, https://doi.org/10.24963/ijcai.2018/308.
[14]
Y. Zhu, X. Wu, J. Qiang, Y. Yuan, Y. Li, Representation learning with collaborative autoencoder for personalized recommendation, Expert Syst. Appl. 186 (2021),.
[15]
X. Wang, X. He, M. Wang, F. Feng, T. Chua, Neural graph collaborative filtering, in: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2019, pp. 165–174, https://doi.org/10.1145/3331184.3331267.
[16]
H. Khojamli, J. Razmara, Survey of similarity functions on neighborhood-based collaborative filtering, Expert Syst. Appl. 185 (2021),.
[17]
H. Koohi, K. Kiani, User based collaborative filtering using fuzzy c-means, Measurement 91 (2016) 134–139,.
[18]
S. Manochandar, M. Punniyamoorthy, A new user similarity measure in a new prediction model for collaborative filtering, Appl. Intell. 51 (1) (2021) 586–615,.
[19]
W. Yue, Z. Wang, W. Liu, B. Tian, S. Lauria, X. Liu, An optimally weighted user- and item-based collaborative filtering approach to predicting baseline data for Friedreich’s ataxia patients, Neurocomputing 419 (2021) 287–294,.
[20]
J. Guo, J. Deng, X. Ran, Y. Wang, H. Jin, An efficient and accurate recommendation strategy using degree classification criteria for item-based collaborative filtering, Expert Syst. Appl. 164 (2021),.
[21]
F. Xue, X. He, X. Wang, J. Xu, K. Liu, R. Hong, Deep item-based collaborative filtering for top-N recommendation, ACM Trans. Inf. Syst. 37 (3) (2019) 1–25,.
[22]
B. Sarwar, G. Karypis, J. Konstan, J. Riedl, Item-based collaborative filtering recommendation algorithms, in: Proceedings of the 10th International Conference on World Wide Web, 2001, pp. 285–295, https://doi.org/10.1145/371920.372071.
[23]
L. Hu, L. Cao, J. Cao, Z. Gu, G. Xu, D. Yang, Learning informative priors from heterogeneous domains to improve recommendation in cold-start user domains, ACM Trans. Inf. Syst. 35 (2) (2016) 1–37,.
[24]
Y. Koren, Factorization meets the neighborhood, in: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2008, pp. 426–434, https://doi.org/10.1145/1401890.1401944.
[25]
Y. Koren, R. Bell, C. Volinsky, Matrix factorization techniques for recommender systems, Computer 42 (8) (2009) 30–37,.
[26]
H. Zhang, I. Ganchev, N. Nikolov, Z. Ji, M. O’Droma, FeatureMF: An item feature enriched matrix factorization model for item recommendation, IEEE Access 9 (2021) 65266–65276,.
[27]
R. Salakhutdinov, A. Mnih, Probabilistic matrix factorization, in: Proceedings of the 20th International Conference on Neural Information Processing Systems, 2007, pp. 1257–1264, https://dl.acm.org/doi/https://doi.org/10.5555/2981562.2981720.
[28]
Y. LeCun, Y. Bengio, G. Hinton, Deep learning, Nature 521 (2015) 436–444,.
[29]
G. Menghani, Efficient deep learning: A survey on making deep learning models smaller, faster, and better, ACM Comput. Surv. 55 (12) (2023) 1–37,.
[30]
R. Ranjbarzadeh, S.J. Ghoushchi, N.T. Sarshar, E.B. Tirkolaee, S.S. Ali, T.K.M. Bendechache, ME-CCNN: Multi-encoded images and a cascade convolutional neural network for breast tumor segmentation and recognition, Artif. Intell. Rev. 56 (2023) 10099–10136,.
[31]
L. Feng, H. Wei, Q. Guo, Z. Lin, B. An, Embedding-augmented generalized matrix factorization for recommendation with implicit feedback, IEEE Intell. Syst. 36 (6) (2021) 32–41,.
[32]
S. Zhong, L. Huang, C. Wang, J. Lai, P.S. Yu, An Autoencoder framework with attention mechanism for cross-domain recommendation, IEEE Trans. Cybern. 52 (6) (2022) 5229–5241,.
[33]
R.V.D. Berg, T.N. Kipf, M. Welling, Graph convolutional matrix completion, 2017 arXiv preprint arXiv:1706.02263, https://doi.org/10.48550/arXiv.1706.02263.
[34]
H. Guo, R. Tang, Y. Ye, Z. Li, X. He, DeepFM: A factorization-machine based neural network for CTR prediction, in: Proceedings of the 26th International Joint Conference on Artificial Intelligence, 2017, pp. 1725–1731, https://doi.org/10.24963/ijcai.2017/239.
[35]
M. Chen, T. Ma, X. Zhou, COCNN: Co-occurrence CNN for recommendation, Expert Syst. Appl. 195 (2022),.
[36]
Q. Li, X. Zheng, X. Wu, Neural collaborative autoencoder, 2017, arXiv preprint arXiv:1712.09043, https://doi.org/10.48550/arXiv.1712.09043.
[37]
X. He, K. Deng, X. Wang, Y. Li, Y. Zhang, M. Wang, LightGCN: Simplifying and powering graph convolution network for recommendation, in: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2020, pp. 639–648, https://doi.org/10.1145/3397271.3401063.
[38]
H. Xue, X. Dai, J. Zhang, S. Huang, J. Chen, Deep matrix factorization models for recommender systems, in: Proceedings of the 26th International Joint Conference on Artificial Intelligence, 2017, pp. 3203–3209, https://doi.org/10.24963/ijcai.2017/447.
[39]
X. He, L. Liao, H. Zhang, L. Nie, X. Hu, T. Chua, Neural collaborative filtering, in: Proceedings of the 26th international conference on world wide web, 2017, pp. 173–182, https://doi.org/10.1145/3038912.3052569.
[40]
C. Wang, W. Xi, L. Huang, Y. Zheng, Z. Hu, J. Lai, A BP neural network based recommender framework with attention mechanism, IEEE Trans. Knowl. Data Eng. 34 (7) (2020) 3029–3043,.
[41]
W. Xi, L. Huang, C. Wang, Y. Zheng, J. Lai, BPAM: Recommendation based on BP neural network with attention mechanism, in: Proceedings of the 28th International Joint Conference on Artificial Intelligence, 2019, pp. 3905–3911, https://doi.org/10.24963/ijcai.2019/542.
[42]
L. Su, L. Xiong, J. Yang, Multi-attn BLS: Multi-head attention mechanism with broad learning system for chaotic time series prediction, Appl. Soft Comput. 132 (2023),.
[43]
M. Xu, M. Han, C.L.P. Chen, T. Qiu, Recurrent broad learning systems for time series prediction, IEEE Trans. Cybern. 50 (4) (2020) 1405–1417,.
[44]
L. Huang, C. Guan, Z. Huang, Y. Gao, Y. Kuang, C. Wang, C.L.P. Chen, Broad Recommender System: An Efficient Nonlinear Collaborative Filtering Approach, 2022, arXiv preprint arXiv:2204.11602, https://doi.org/10.48550/arXiv.2204.11602.
[45]
C.L.P. Chen, Z. Liu, Broad learning system: An effective and efficient incremental learning system without the need for deep architecture, IEEE Trans. Neural Netw. Learn Syst. 29 (1) (2018) 10–24,.
[46]
J. Breese, D. Heckerman, C. Kadie, Empirical analysis of predictive algorithms for collaborative filtering, in: Proceedings of the 14th conference on Uncertainty in artificial intelligence, 1998, https://doi.org/10.48550/arXiv.1301.7363.
[47]
G. Adomavicius, A. Tuzhilin, Toward the next generation of Recommender Systems: A survey of the state-of-the-art and possible extensions, IEEE Trans. Knowl. Data Eng. 17 (6) (2005) 734–749,.
[48]
J. Zhu, J. Zhang, L. He, Q. Wu, B. Zhou, C. Zhang, P.S. Yu, Broad learning based multi-source collaborative recommendation, in: Proceedings of the 2017 ACM on Conference on Information and Knowledge Management, 2017, pp. 1409–1418, https://doi.org/10.1145/3132847.3132976.
[49]
H. Ahn, A new similarity measure for collaborative filtering to alleviate the new user cold-starting problem, Inf. Sci. 178 (1) (2008) 37–51,.
[50]
K. Xie, X. Ning, X. Wang, D. Xie, J. Cao, G. Xie, J. Wen, Recover corrupted data in sensor networks: A matrix completion solution, IEEE Trans. Mob. Comput. 16 (5) (2017) 1434–1448,.
[51]
E. Candes, Y. Plan, Matrix completion with noise, Proc. IEEE 98 (6) (2010) 925–936,.
[52]
M. Zhang, Y. Chen, Inductive matrix completion based on graph neural networks, 2019, arXiv preprint arXiv:1904.12058, https://doi.org/10.48550/arXiv.1904.12058.
[53]
J. Fan, J. Cheng, Matrix completion by deep matrix factorization, Neural Netw. 98 (2018) 34–41,.
[54]
J. Fan, Dynamic nonlinear matrix completion for time-varying data imputation, (in:) Proc. AAAI Conf. Artif. Intell. (2022) 6587–6596,.
[55]
M. Davenport, J. Romberg, An overview of low-rank matrix recovery from incomplete observations, IEEE J. Sel. Top. Signal Process. 10 (4) (2016) 608–622,.
[56]
L. Nguyen, J. Kim, B. Shim, Low-rank matrix completion: A contemporary survey, IEEE Access 7 (2019) 94215–94237,.
[57]
Z. Lin, M. Chen, Y. Ma, The augmented lagrange multiplier method for exact recovery of corrupted low-rank matrices, 2010, arXiv preprint arXiv:1009.5055, https://doi.org/10.48550/arXiv.1009.5055.
[58]
J. Cai, E. Candès, Z. Shen, A singular value thresholding algorithm for matrix completion, SIAM J. Optim. 20 (4) (2010) 1956–1982,.
[59]
A.E. Hoerl, R.W. Kennard, Ridge regression: Biased estimation for nonorthogonal problems, Technometrics 42 (1) (2000) 80–86,.
[60]
M. Masana, X. Liu, B. Twardowski, M. Menta, A.D. Bagdanov, J.V.D. Weijer, Class-incremental learning: Survey and performance evaluation on Image Classification, IEEE Trans. Pattern Anal. Mach. Intell. 45 (5) (2022) 5513–5533,.
[61]
A. Entezami, H. Sarmadi, B. Behkamal, Long-term health monitoring of concrete and steel bridges under large and missing data by unsupervised meta learning, Eng. Struct. 279 (2023),.
[62]
F. Chu, G. Wang, J. Wang, C.L.P. Chen, X. Wang, Learning broad learning system with controllable sparsity through L0 regularization, Appl. Soft Comput. 136 (2023),.
[63]
L. Liu, L. Cai, T. Xie, Y. Wang, Self-paced broad learning system, IEEE Trans. Cybern. 53 (6) (2022) 4029–4042,.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Applied Soft Computing
Applied Soft Computing  Volume 165, Issue C
Nov 2024
1386 pages

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 November 2024

Author Tags

  1. Recommendation system
  2. Collaborative filtering
  3. Adjusted cosine similarity
  4. Matrix completion
  5. Broad learning system
  6. K-nearest neighbors
  7. Data sparsity

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 09 Feb 2025

Other Metrics

Citations

View Options

View options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media