skip to main content
10.1145/3664647.3680615acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article
Open access

Mitigating Sample Selection Bias with Robust Domain Adaption in Multimedia Recommendation

Published: 28 October 2024 Publication History

Abstract

Industrial multimedia recommendation systems extensively utilize cascade architectures to deliver personalized content for users, generally consisting of multiple stages like retrieval and ranking. However, retrieval models have long suffered from Sample Selection Bias (SSB) due to the distribution discrepancy between the exposed items used for model training and the candidates (almost unexposed) during inference, affecting recommendation performance. Traditional methods utilize retrieval candidates as augmented training data, indiscriminately treating unexposed data as negative samples, which leads to inaccuracies and noise. Some efforts rely on unbiased datasets, while they are costly to collect and insufficient for industrial models. In this paper, we propose a debiasing framework named DAMCAR, which introduces Domain Adaptation to mitigate SSB in Multimedia CAscade Recommendation systems. Firstly, we sample hard-to-distinguish samples from unexposed data to serve as the target domain, optimizing data quality and resource utilization. Secondly, adversarial domain adaptation is employed to generate pseudo-labels for each sample. To enhance robustness, we utilize Exponential Moving Average (EMA) to create a teacher model that supervises the generation of pseudo-labels via self-distillation. Finally, we obtain a retrieval model that maintains stable performance during inference through a hybrid training mechanism. We conduct offline experiments on two real-world datasets and deploy our approach in the retrieval model of a multimedia video recommendation system for online A/B testing. Comprehensive experimental results demonstrate the effectiveness of DAMCAR in practical applications.

References

[1]
Stephen Bonner and Flavian Vasile. 2018. Causal embeddings for recommendation. In ACM Conference on Recommender Systems (RecSys). 104--112.
[2]
Tianwei Cao, Qianqian Xu, Zhiyong Yang, and Qingming Huang. [n.,d.]. Mitigating Confounding Bias in Practical Recommender Systems With Partially Inaccessible Exposure Status. In IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI). 957--974.
[3]
Yu Cao, Meng Fang, Baosheng Yu, and Joey Tianyi Zhou. 2020. Unsupervised domain adaptation on reading comprehension. In AAAI Conference on Artificial Intelligence (AAAI). 7480--7487.
[4]
Yue Cao, Xiaojiang Zhou, Jiaqi Feng, Peihao Huang, Yao Xiao, Dayao Chen, and Sheng Chen. 2022. Sampling is all you need on modeling long-term user behaviors for CTR prediction. In ACM International Conference on Information and Knowledge Management (CIKM). 2974--2983.
[5]
Wenhao Chai, Zhongyu Jiang, Jenq-Neng Hwang, and Gaoang Wang. 2023. Global adaptation meets local generalization: Unsupervised domain adaptation for 3d human pose estimation. In International Conference on Computer Vision (ICCV). 14655--14665.
[6]
Chaochao Chen, Ziqi Liu, Peilin Zhao, Jun Zhou, and Xiaolong Li. 2018. Privacy preserving point-of-interest recommendation using decentralized matrix factorization. In AAAI Conference on Artificial Intelligence (AAAI). 257--264.
[7]
Haoran Chen, Xintong Han, Zuxuan Wu, and Yu-Gang Jiang. 2023. Multi-prompt alignment for multi-source unsupervised domain adaptation. In Conference on Neural Information Processing Systems (NeurIPS). 74127--74139.
[8]
Jiawei Chen, Hande Dong, Yang Qiu, Xiangnan He, Xin Xin, Liang Chen, Guli Lin, and Keping Yang. 2021. AutoDebias: Learning to debias for recommendation. In International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 21--30.
[9]
Jiawei Chen, Hande Dong, Xiang Wang, Fuli Feng, Meng Wang, and Xiangnan He. 2023. Bias and debias in recommender system: A survey and future directions. In ACM Transactions on Information Systems (TOIS). 1--39.
[10]
Ruey-Cheng Chen, Luke Gallagher, Roi Blanco, and J Shane Culpepper. 2017. Efficient cost-aware cascade ranking in multi-stage retrieval. In International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 445--454.
[11]
T. Chen and C. Guestrin. 2016. Xgboost: A scalable tree boosting system. In ACM SIGKDD Conference on Knowledge Discovery and Data Mining (SIGKDD). 785--794.
[12]
Paul Covington, Jay Adams, and Emre Sargin. 2016. Deep neural networks for youtube recommendations. In ACM Conference on Recommender Systems (RecSys). 191--198.
[13]
Andrea Dal Pozzolo, Olivier Caelen, Reid A Johnson, and Gianluca Bontempi. 2015. Calibrating probability with undersampling for unbalanced classification. In IEEE Symposium Series on Computational Intelligence (SSCI). IEEE, 159--166.
[14]
Pieter-Tjerk De Boer, Dirk P Kroese, Shie Mannor, and Reuven Y Rubinstein. 2005. A tutorial on the cross-entropy method. In Annals of Operations Research. 19--67.
[15]
Sihao Ding, Fuli Feng, Xiangnan He, Jinqiu Jin, Wenjie Wang, Yong Liao, and Yongdong Zhang. 2022. Interpolative distillation for unifying biased and debiased recommendation. In International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 40--49.
[16]
John Duchi, Elad Hazan, and Yoram Singer. 2011. Adaptive subgradient methods for online learning and stochastic optimization. In Journal of Machine Learning Research (JMLR). 1--39.
[17]
Miao Fan, Jiacheng Guo, Shuai Zhu, Shuo Miao, Mingming Sun, and Ping Li. 2019. MOBIUS: towards the next generation of query-ad matching in baidu's sponsored search. In ACM SIGKDD Conference on Knowledge Discovery and Data Mining (SIGKDD). 2509--2517.
[18]
Hongliang Fei, Jingyuan Zhang, Xingxuan Zhou, Junhao Zhao, Xinyang Qi, and Ping Li. 2021. GemNN: gating-enhanced multi-task neural networks with feature interaction learning for CTR prediction. In International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 2166--2171.
[19]
Luke Gallagher, Ruey-Cheng Chen, Roi Blanco, and J Shane Culpepper. 2019. Joint optimization of cascade ranking models. In ACM International Conference on Web Search and Data Mining (WSDM). 15--23.
[20]
Yaroslav Ganin and Victor Lempitsky. 2015. Unsupervised domain adaptation by backpropagation. In International Conference on Machine Learning (ICML). PMLR, 1180--1189.
[21]
Chengqian Gao, Ke Xu, Kuangqi Zhou, Lanqing Li, Xueqian Wang, Bo Yuan, and Peilin Zhao. 2022. Value penalized q-learning for recommender systems. In International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 2008--2012.
[22]
Jingyue Gao, Shuguang Han, Han Zhu, Siran Yang, Yuning Jiang, Jian Xu, and Bo Zheng. 2023. Rec4Ad: A Free Lunch to Mitigate Sample Selection Bias for Ads CTR Prediction in Taobao. In ACM International Conference on Information and Knowledge Management (CIKM). 4574--4580.
[23]
Xavier Glorot, Antoine Bordes, and Yoshua Bengio. 2011. Deep sparse rectifier neural networks. In International Conference on Artificial Intelligence and Statistics (AISTATS). 315--323.
[24]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Conference on Neural Information Processing Systems (NeurIPS). 1--9.
[25]
Huifeng Guo, Ruiming Tang, Yunming Ye, Zhenguo Li, and Xiuqiang He. 2017. DeepFM: a factorization-machine based neural network for CTR prediction. In arXiv preprint arXiv:1703.04247. 1--8.
[26]
Jun Han and Claudio Moraga. 1995. The influence of the sigmoid function parameters on the speed of backpropagation learning. In International Conference on Artificial Neural Networks (ICANN). 195--201.
[27]
Peng Han, Shuo Shang, Aixin Sun, Peilin Zhao, Kai Zheng, and Xiangliang Zhang. 2021. Point-of-interest recommendation with global and local context. In IEEE Transactions on Knowledge and Data Engineering (TKDE). 5484--5495.
[28]
Xiangnan He, Yang Zhang, Fuli Feng, Chonggang Song, Lingling Yi, Guohui Ling, and Yongdong Zhang. 2023. Addressing confounding feature issue for causal recommendation. In ACM Transactions on Information Systems (TOIS). 1--23.
[29]
Steven CH Hoi, Doyen Sahoo, Jing Lu, and Peilin Zhao. 2021. Online learning: A comprehensive survey. In Neurocomputing. 249--289.
[30]
Jiri Hron, Karl Krauth, Michael Jordan, and Niki Kilbertus. 2021. On component interactions in two-stage recommender systems. In Conference on Neural Information Processing Systems (NeurIPS). 2744--2757.
[31]
Jiaxing Huang, Dayan Guan, Aoran Xiao, Shijian Lu, and Ling Shao. 2022. Category contrast for unsupervised domain adaptation in visual tasks. In IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR). 1203--1214.
[32]
Jui-Ting Huang, Ashish Sharma, Shuying Sun, Li Xia, David Zhang, Philip Pronin, Janani Padmanabhan, Giuseppe Ottaviano, and Linjun Yang. 2020. Embedding-based retrieval in facebook search. In ACM SIGKDD Conference on Knowledge Discovery and Data Mining (SIGKDD). 2553--2561.
[33]
Po-Sen Huang, Xiaodong He, Jianfeng Gao, Li Deng, Alex Acero, and Larry Heck. 2013. Learning deep structured semantic models for web search using clickthrough data. In ACM International Conference on Information and Knowledge Management (CIKM). 2333--2338.
[34]
Chen Hui, Shaohui Liu, Wuzhen Shi, Feng Jiang, and Debin Zhao. 2022. Spatio-temporal context based adaptive camcorder recording watermarking. In ACM Transactions on Multimedia Computing, Communications and Applications (TOMM). 1--25.
[35]
Chen Hui, Shengping Zhang, Wenxue Cui, Shaohui Liu, Feng Jiang, and Debin Zhao. 2023. Rate-adaptive neural network for image compressive sensing. In IEEE Transactions on Multimedia (TMM). 2515--2530.
[36]
Gert Jacobusse and Cor Veenman. 2016. On selection bias with imbalanced classes. In Discovery Science (DS). 325--340.
[37]
Guolin Ke, Qi Meng, Thomas Finley, Taifeng Wang, Wei Chen, Weidong Ma, Qiwei Ye, and Tie-Yan Liu. 2017. Lightgbm: A highly efficient gradient boosting decision tree. In Conference on Neural Information Processing Systems (NeurIPS). 1--9.
[38]
Qian Li, Xiangmeng Wang, Zhichao Wang, and Guandong Xu. 2023. Be causal: De-biasing social network confounding in recommendation. In ACM Transactions on Knowledge Discovery from Data (TKDD). 1--23.
[39]
Xiangyang Li, Bo Chen, HuiFeng Guo, Jingjie Li, Chenxu Zhu, Xiang Long, Sujian Li, Yichao Wang, Wei Guo, Longxia Mao, et al. 2022. Inttower: the next generation of two-tower model for pre-ranking system. In ACM International Conference on Information and Knowledge Management (CIKM). 3292--3301.
[40]
Xiang Li, Xiaojiang Zhou, Yao Xiao, Peihao Huang, Dayao Chen, Sheng Chen, and Yunsen Xian. 2022. AutoFAS: Automatic Feature and Architecture Selection for Pre-Ranking System. In ACM SIGKDD Conference on Knowledge Discovery and Data Mining (SIGKDD). 3241--3249.
[41]
Xiao Lin, Wenpeng Zhang, Min Zhang, Wenwu Zhu, Jian Pei, Peilin Zhao, and Junzhou Huang. 2018. Online compact convexified factorization machine. In International World Wide Web Conference (WWW). 1633--1642.
[42]
Chenghao Liu, Teng Zhang, Peilin Zhao, Jun Zhou, and Jianling Sun. 2017. Locally Linear Factorization Machines. In International Joint Conference on Artificial Intelligence (IJCAI). 2294--2300.
[43]
Dugang Liu, Pengxiang Cheng, Zhenhua Dong, Xiuqiang He, Weike Pan, and Zhong Ming. 2020. A general knowledge distillation framework for counterfactual recommendation via uniform data. In International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 831--840.
[44]
Dugang Liu, Pengxiang Cheng, Zinan Lin, Jinwei Luo, Zhenhua Dong, Xiuqiang He, Weike Pan, and Zhong Ming. 2022. KDCRec: Knowledge distillation for counterfactual recommendation via uniform data. In IEEE Transactions on Knowledge and Data Engineering (TKDE). 8143--8156.
[45]
Dugang Liu, Pengxiang Cheng, Zinan Lin, Xiaolian Zhang, Zhenhua Dong, Rui Zhang, Xiuqiang He, Weike Pan, and Zhong Ming. 2023. Bounding system-induced biases in recommender systems with a randomized dataset. In ACM Transactions on Information Systems (TOIS). 1--26.
[46]
Dugang Liu, Yang Qiao, Xing Tang, Liang Chen, Xiuqiang He, and Zhong Ming. 2023. Prior-Guided Accuracy-Bias Tradeoff Learning for CTR Prediction in Multimedia Recommendation. In ACM International Conference on Multimedia (MM). 995--1003.
[47]
David C Liu, Stephanie Rogers, Raymond Shiau, Dmitry Kislyuk, Kevin C Ma, Zhigang Zhong, Jenny Liu, and Yushi Jing. 2017. Related pins at pinterest: The evolution of a real-world recommender system. In International World Wide Web Conference (WWW) Companion. 583--592.
[48]
Shichen Liu, Fei Xiao, Wenwu Ou, and Luo Si. 2017. Cascade ranking for operational e-commerce search. In ACM SIGKDD Conference on Knowledge Discovery and Data Mining (SIGKDD). 1557--1565.
[49]
Tie-Yan Liu. 2011. Learning to Rank for Information Retrieval.
[50]
Erxue Min, Yu Rong, Tingyang Xu, Yatao Bian, Da Luo, Kangyi Lin, Junzhou Huang, Sophia Ananiadou, and Peilin Zhao. 2022. Neighbour interaction based click-through rate prediction via graph-masked transformer. In International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 353--362.
[51]
Zongshen Mu, Yueting Zhuang, Jie Tan, Jun Xiao, and Siliang Tang. 2022. Learning hybrid behavior patterns for multimedia recommendation. In ACM International Conference on Multimedia (MM). 376--384.
[52]
Poojan Oza, Vishwanath A Sindagi, Vibashan Vishnukumar Sharmini, and Vishal M Patel. 2023. Unsupervised domain adaptation of object detectors: A survey. In IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI). 1--24.
[53]
Sinno Jialin Pan and Qiang Yang. 2009. A survey on transfer learning. In IEEE Transactions on Knowledge and Data Engineering (TKDE). 1345--1359.
[54]
Qi Pi, Weijie Bian, Guorui Zhou, Xiaoqiang Zhu, and Kun Gai. 2019. Practice on long sequential user behavior modeling for click-through rate prediction. In ACM SIGKDD Conference on Knowledge Discovery and Data Mining (SIGKDD). 2671--2679.
[55]
Qi Pi, Guorui Zhou, Yujing Zhang, Zhe Wang, Lejian Ren, Ying Fan, Xiaoqiang Zhu, and Kun Gai. 2020. Search-based user interest modeling with lifelong sequential behavior data for click-through rate prediction. In ACM International Conference on Information and Knowledge Management (CIKM). 2685--2692.
[56]
Jiarui Qin, Weinan Zhang, Rong Su, Zhirong Liu, Weiwen Liu, Ruiming Tang, Xiuqiang He, and Yong Yu. 2021. Retrieval & interaction machine for tabular data prediction. In ACM SIGKDD Conference on Knowledge Discovery and Data Mining (SIGKDD). 1379--1389.
[57]
Jiarui Qin, Weinan Zhang, Rong Su, Zhirong Liu, Weiwen Liu, Ruiming Tang, Xiuqiang He, and Yong Yu. 2021. Retrieval & interaction machine for tabular data prediction. In ACM SIGKDD Conference on Knowledge Discovery and Data Mining (SIGKDD). 1379--1389.
[58]
Jiarui Qin, Weinan Zhang, Xin Wu, Jiarui Jin, Yuchen Fang, and Yong Yu. 2020. User behavior retrieval for click-through rate prediction. In International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 2347--2356.
[59]
Jiarui Qin, Jiachen Zhu, Bo Chen, Zhirong Liu, Weiwen Liu, Ruiming Tang, Rui Zhang, Yong Yu, and Weinan Zhang. 2022. Rankflow: Joint optimization of multi-stage cascade ranking systems as flows. In International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 814--824.
[60]
Steffen Rendle, Zeno Gantner, Christoph Freudenthaler, and Lars Schmidt-Thieme. 2011. Fast context-aware recommendations with factorization machines. In International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 635--644.
[61]
Weichen Shen. 2017. DeepCTR: Easy-to-use,Modular and Extendible package of deep-learning based CTR models. https://github.com/shenweichen/deepctr.
[62]
Hongzu Su, Yifei Zhang, Xuejiao Yang, Hua Hua, Shuangyang Wang, and Jingjing Li. 2022. Cross-domain recommendation via adversarial adaptation. In ACM International Conference on Information and Knowledge Management (CIKM). 1808--1817.
[63]
Jiaxi Tang and Ke Wang. 2018. Ranking distillation: Learning compact ranking models with high performance for recommender system. In ACM SIGKDD Conference on Knowledge Discovery and Data Mining (SIGKDD). 2289--2298.
[64]
Jinpeng Wang, Ziyun Zeng, Yunxiao Wang, Yuting Wang, Xingyu Lu, Tianxiang Li, Jun Yuan, Rui Zhang, Hai-Tao Zheng, and Shu-Tao Xia. 2023. Missrec: Pre-training and transferring multi-modal interest-aware sequence representation for recommendation. In ACM International Conference on Multimedia (MM). 6548--6557.
[65]
Lidan Wang, Jimmy Lin, and Donald Metzler. 2011. A cascade ranking model for efficient ranked retrieval. In International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 105--114.
[66]
Ruoxi Wang, Bin Fu, Gang Fu, and Mingliang Wang. 2017. Deep & cross network for ad click predictions. In Proceedings of the ADKDD (ADKDD). 1--7.
[67]
Yuan Wang, Peifeng Yin, Zhiqiang Tao, Hari Venkatesan, Jin Lai, Yi Fang, and PJ Xiao. 2023. An empirical study of selection bias in pinterest ads retrieval. In ACM SIGKDD Conference on Knowledge Discovery and Data Mining (SIGKDD). 5174--5183.
[68]
Zitai Wang, Qianqian Xu, Zhiyong Yang, Xiaochun Cao, and Qingming Huang. 2021. Implicit feedbacks are not always favorable: Iterative relabeled one-class collaborative filtering against noisy interactions. In ACM International Conference on Multimedia (MM). 3070--3078.
[69]
Wei Wei, Chao Huang, Lianghao Xia, and Chuxu Zhang. 2023. Multi-modal self-supervised learning for recommendation. In International World Wide Web Conference (WWW). 790--800.
[70]
Yinwei Wei, Xiang Wang, Liqiang Nie, Xiangnan He, and Tat-Seng Chua. 2020. Graph-refined convolutional network for multimedia recommendation with implicit feedback. In ACM International Conference on Multimedia (MM). 3541--3549.
[71]
Zhixiang Xu, Matt Kusner, Kilian Weinberger, and Minmin Chen. 2013. Cost-sensitive tree of classifiers. In International Conference on Machine Learning (ICML). 133--141.
[72]
Yuguang Yan, Hanrui Wu, Yuzhong Ye, Chaoyang Bi, Min Lu, Dapeng Liu, Qingyao Wu, and Michael K Ng. 2021. Transferable feature selection for unsupervised domain adaptation. In IEEE Transactions on Knowledge and Data Engineering (TKDE). 5536--5551.
[73]
Ji Yang, Xinyang Yi, Derek Zhiyuan Cheng, Lichan Hong, Yang Li, Simon Xiaoming Wang, Taibai Xu, and Ed H Chi. 2020. Mixed negative sampling for learning two-tower neural networks in recommendations. In International World Wide Web Conference (WWW). 441--447.
[74]
Zixuan Yi, Xi Wang, Iadh Ounis, and Craig Macdonald. 2022. Multi-modal graph contrastive learning for micro-video recommendation. In International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR). 1807--1811.
[75]
Bowen Yuan, Jui-Yang Hsia, Meng-Yuan Yang, Hong Zhu, Chih-Yao Chang, Zhenhua Dong, and Chih-Jen Lin. 2019. Improving ad click prediction by considering non-displayed events. In ACM International Conference on Information and Knowledge Management (CIKM). 329--338.
[76]
Jinghao Zhang, Yanqiao Zhu, Qiang Liu, Shu Wu, Shuhui Wang, and Liang Wang. 2021. Mining latent structures for multimedia recommendation. In ACM International Conference on Multimedia (MM). 3872--3880.
[77]
Guorui Zhou, Na Mou, Ying Fan, Qi Pi, Weijie Bian, Chang Zhou, Xiaoqiang Zhu, and Kun Gai. 2019. Deep interest evolution network for click-through rate prediction. In AAAI Conference on Artificial Intelligence (AAAI). 5941--5948.
[78]
Guorui Zhou, Xiaoqiang Zhu, Chenru Song, Ying Fan, Han Zhu, Xiao Ma, Yanghui Yan, Junqi Jin, Han Li, and Kun Gai. 2018. Deep interest network for click-through rate prediction. In ACM SIGKDD Conference on Knowledge Discovery and Data Mining (SIGKDD). 1059--1068.
[79]
Han Zhu, Xiang Li, Pengye Zhang, Guozheng Li, Jie He, Han Li, and Kun Gai. 2018. Learning tree-based deep model for recommender systems. In ACM SIGKDD Conference on Knowledge Discovery and Data Mining (SIGKDD). 1079--1088.

Index Terms

  1. Mitigating Sample Selection Bias with Robust Domain Adaption in Multimedia Recommendation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    MM '24: Proceedings of the 32nd ACM International Conference on Multimedia
    October 2024
    11719 pages
    ISBN:9798400706868
    DOI:10.1145/3664647
    This work is licensed under a Creative Commons Attribution International 4.0 License.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 28 October 2024

    Check for updates

    Author Tags

    1. cascade systems
    2. debiasing
    3. multimedia recommendation

    Qualifiers

    • Research-article

    Conference

    MM '24
    Sponsor:
    MM '24: The 32nd ACM International Conference on Multimedia
    October 28 - November 1, 2024
    Melbourne VIC, Australia

    Acceptance Rates

    MM '24 Paper Acceptance Rate 1,150 of 4,385 submissions, 26%;
    Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 141
      Total Downloads
    • Downloads (Last 12 months)141
    • Downloads (Last 6 weeks)68
    Reflects downloads up to 17 Jan 2025

    Other Metrics

    Citations

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media