research-article

Weakly Supervised Entity Alignment with Positional Inspiration

Authors:

Hao YangAuthors Info & Claims

WSDM '23: Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining

Pages 814 - 822

https://doi.org/10.1145/3539597.3570394

Published: 27 February 2023 Publication History

Abstract

The current success of entity alignment (EA) is still mainly based on large-scale labeled anchor links. However, the refined annotation of anchor links still consumes a lot of manpower and material resources. As a result, an increasing number of works based on active learning, few-shot learning, or other deep network learning techniques have been developed to address the performance bottleneck caused by a lack of labeled data. These works focus either on the strategy of choosing more informative labeled data or on the strategy of model training, while it remains opaque why existing popular EA models (e.g., GNN-based models) fail the EA task with limited labeled data. To overcome this issue, this paper analyzes the problem of weakly supervised EA from the perspective of model design and proposes a novel weakly supervised learning framework, Position Enhanced Entity Alignment (PEEA). Besides absorbing structural and relational information, PEEA aims to increase the connections between far-away entities and labeled ones by incorporating positional information into the representation learning with a Position Attention Layer (PAL). To fully utilize the limited anchor links, we further introduce a novel position encoding method that considers both anchor links and relational information from a global view. The proposed position encoding will be fed into PEEA as additional entity features. Extensive experiments on public datasets demonstrate the effectiveness of PEEA.

Supplementary Material

MP4 File (WSDM23-fp0195.mp4)

Presentation video

Download
164.84 MB

References

[1]

Max Berrendorf, Evgeniy Faerman, and Volker Tresp. 2021. Active Learning for Entity Alignment. In Proc. of ECIR.

Digital Library

[2]

Muhao Chen, Weijia Shi, Ben Zhou, and Dan Roth. 2021. Cross-lingual Entity Alignment with Incidental Supervision. In Proc. of EACL.

[3]

Muhao Chen, Yingtao Tian, Kai-Wei Chang, Steven Skiena, and Carlo Zaniolo. 2018. Co-training Embeddings of Knowledge Graphs and Entity Descriptions for Cross-lingual Entity Alignment. In Proc. of IJCAI.

[4]

Muhao Chen, Yingtao Tian, Mohan Yang, and Carlo Zaniolo. 2016. Multilingual knowledge graph embeddings for cross-lingual knowledge alignment. arXiv preprint arXiv:1611.03954.

[5]

Hejie Cui, Zijie Lu, Pan Li, and Carl Yang. 2021. On Positional and Structural Node Features for Graph Neural Networks on Non-attributed Graphs. CoRR (2021).

[6]

Marco Cuturi. 2013. Sinkhorn Distances: Lightspeed Computation of Optimal Transport. In Proc. of NeurIPS.

[7]

Vijay Prakash Dwivedi and Xavier Bresson. 2020. A Generalization of Transformer Networks to Graphs. CoRR (2020).

[8]

Vijay Prakash Dwivedi, Chaitanya K. Joshi, Thomas Laurent, Yoshua Bengio, and Xavier Bresson. 2020. Benchmarking Graph Neural Networks. CoRR (2020).

[9]

Vijay Prakash Dwivedi, Anh Tuan Luu, Thomas Laurent, Yoshua Bengio, and Xavier Bresson. 2021. Graph Neural Networks with Learnable Structural and Positional Representations. CoRR (2021).

[10]

Lingbing Guo, Zequn Sun, and Wei Hu. 2019. Learning to Exploit Long-term Relational Dependencies in Knowledge Graphs. In ICML 2019.

[11]

Qingyu Guo, Fuzhen Zhuang, Chuan Qin, Hengshu Zhu, Xing Xie, Hui Xiong, and Qing He. 2022. A Survey on Knowledge Graph-Based Recommender Systems. IEEE Trans. Knowl. Data Eng. (2022).

[12]

Guillaume Lample, Alexis Conneau, Marc'Aurelio Ranzato, Ludovic Denoyer, and Hervé Jé gou. 2018. Word translation without parallel data. In Proc. of ICLR.

[13]

Chengjiang Li, Yixin Cao, Lei Hou, Jiaxin Shi, Juanzi Li, and Tat-Seng Chua. 2019. Semi-supervised Entity Alignment via Joint Knowledge Embedding Model and Cross-graph Model. In Proc. of EMNLP.

[14]

Bing Liu, Harrisen Scells, Guido Zuccon, Wen Hua, and Genghong Zhao. 2021b. ActiveEA: Active Learning for Neural Entity Alignment. In Proc. of EMNLP.

[15]

Fangyu Liu, Muhao Chen, Dan Roth, and Nigel Collier. 2021a. Visual Pivoting for (Unsupervised) Entity Alignment. In Proc. of AAAI.

[16]

Zhiyuan Liu, Yixin Cao, Liangming Pan, Juanzi Li, and Tat-Seng Chua. 2020. Exploring and Evaluating Attributes, Values, and Structures for Entity Alignment. In Proc. of EMNLP.

[17]

Xin Mao, Wenting Wang, Yuanbin Wu, and Man Lan. 2021a. Are Negative Samples Necessary in Entity Alignment?: An Approach with High Performance, Scalability and Robustness. In Proc. of CIKM.

Digital Library

[18]

Xin Mao, Wenting Wang, Yuanbin Wu, and Man Lan. 2021b. Boosting the Speed of Entity Alignment 10 texttimes: Dual Attention Matching Network with Normalized Hard Sample Mining. In Proc. of WWW.

Digital Library

[19]

Xin Mao, Wenting Wang, Huimin Xu, Man Lan, and Yuanbin Wu. 2020a. MRAEA: an efficient and robust entity alignment approach for cross-lingual knowledge graph. In WSDM 2020.

Digital Library

[20]

Xin Mao, Wenting Wang, Huimin Xu, Yuanbin Wu, and Man Lan. 2020b. Relational reflection entity alignment. In CIKM 2020.

Digital Library

[21]

Shichao Pei, Lu Yu, Robert Hoehndorf, and Xiangliang Zhang. 2019. Semi-Supervised Entity Alignment via Knowledge Graph Embedding with Awareness of Degree Difference. In Proc. of WWW.

Digital Library

[22]

Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. DeepWalk: online learning of social representations. In Proc. of KDD.

Digital Library

[23]

Balasubramaniam Srinivasan and Bruno Ribeiro. 2020. On the Equivalence between Positional Node Embeddings and Structural Graph Representations. In Proc. of ICLR.

[24]

Zequn Sun, Wei Hu, and Chengkai Li. 2017. Cross-lingual entity alignment via joint attribute-preserving embedding. In ISWC 2017.

Digital Library

[25]

Zequn Sun, Jiacheng Huang, Wei Hu, Muhao Chen, Lingbing Guo, and Yuzhong Qu. 2019. TransEdge: Translating Relation-Contextualized Embeddings for Knowledge Graphs. In ISWC 2019.

[26]

Zequn Sun, Chengming Wang, Wei Hu, Muhao Chen, Jian Dai, Wei Zhang, and Yuzhong Qu. 2020a. Knowledge Graph Alignment Network with Gated Multi-Hop Neighborhood Aggregation. In Proc. of AAAI.

[27]

Zequn Sun, Qingheng Zhang, Wei Hu, Chengming Wang, Muhao Chen, Farahnaz Akrami, and Chengkai Li. 2020b. A Benchmarking Study of Embedding-based Entity Alignment for Knowledge Graphs. Proceedings of the VLDB Endowment (2020).

Digital Library

[28]

Anil Surisetty, Deepak Chaurasiya, Nitish Kumar, Alok Singh, Gaurav Dhama, Aakarash Malhotra, Ankur Arora, and Vikrant Dey. 2022. RePS: Relation, Position and Structure aware Entity Alignment. (2022).

[29]

Wei Tang, Jingyu Wang, Qi Qi, Haifeng Sun, Shimin Tao, and Hao Yang. 2021. Deep graph alignment network. Neurocomputing, Vol. 465 (2021), 289--300.

Digital Library

[30]

Hanghang Tong, Christos Faloutsos, and Jia-Yu Pan. 2006. Fast Random Walk with Restart and Its Applications.

[31]

Bayu Distiawan Trisedya, Jianzhong Qi, and Rui Zhang. 2019. Entity alignment between knowledge graphs using attribute embeddings. In Proc. of AAAI.

Digital Library

[32]

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Proc. of NeurIPS.

[33]

Zhichun Wang, Qingsong Lv, Xiaohan Lan, and Yu Zhang. 2018. Cross-lingual Knowledge Graph Alignment via Graph Convolutional Networks. In EMNLP 2019.

[34]

Yuting Wu, Xiao Liu, Yansong Feng, Zheng Wang, and Dongyan Zhao. 2020. Neighborhood Matching Network for Entity Alignment. In ACL 2020.

[35]

Yuejia Xiang, Ziheng Zhang, Jiaoyan Chen, Xi Chen, Zhenxi Lin, and Yefeng Zheng. 2021. OntoEA: Ontology-guided Entity Alignment via Joint Knowledge Graph Embedding. arXiv preprint arXiv:2105.07689.

[36]

Chengjin Xu, Fenglong Su, and Jens Lehmann. 2021. Time-aware Graph Neural Networks for Entity Alignment between Temporal Knowledge Graphs. In EMNLP 2021.

[37]

Jun Xu, Haifeng Wang, Zhengyu Niu, Hua Wu, and Wanxiang Che. 2020. Knowledge Graph Grounded Goal Planning for Open-Domain Conversation Generation. In Proc. of AAAI.

[38]

Hsiu-Wei Yang, Yanyan Zou, Peng Shi, Wei Lu, Jimmy Lin, and Xu Sun. 2019. Aligning Cross-Lingual Entities with Multi-Aspect Information. In EMNLP 2019.

[39]

Jiaxuan You, Rex Ying, and Jure Leskovec. 2019. Position-aware Graph Neural Networks. In Proc. of ICML.

[40]

Seongjun Yun, Minbyul Jeong, Raehyun Kim, Jaewoo Kang, and Hyunwoo J. Kim. 2019. Graph Transformer Networks. CoRR (2019).

[41]

Weixin Zeng, Xiang Zhao, Jiuyang Tang, and Changjun Fan. 2021. Reinforced Active Entity Alignment. In Proc. of CIKM.

Digital Library

[42]

Weixin Zeng, Xiang Zhao, Wei Wang, Jiuyang Tang, and Zhen Tan. 2020. Degree-Aware Alignment for Entities in Tail. In Proc. of SIGIR.

Digital Library

[43]

Qing Zhan and Hang Yin. 2018. A Loan Application Fraud Detection Method Based on Knowledge Graph and Neural Network. In Proceedings of the 2nd International Conference on Innovation in Artificial Intelligence.

Digital Library

[44]

Si Zhang, Hanghang Tong, Long Jin, Yinglong Xia, and Yunsong Guo. 2021. Balancing Consistency and Disparity in Network Alignment. In Proc. of KDD.

Digital Library

[45]

Hao Zhu, Ruobing Xie, Zhiyuan Liu, and Maosong Sun. 2017. Iterative Entity Alignment via Joint Knowledge Embeddings. In Proc. of IJCAI.

[46]

Yao Zhu, Hongzhi Liu, Zhonghai Wu, and Yingpeng Du. 2021. Relation-Aware Neighborhood Matching Model for Entity Alignment. In Proc. of AAAI.

Cited By

Zeng KJin HLv XZhu FHou LZhang YPang FQi YLiu DLi JFeng L(2024)XLORE 3: A Large-Scale Multilingual Knowledge Graph from Heterogeneous Wiki Knowledge ResourcesACM Transactions on Information Systems10.1145/366052142:6(1-47)Online publication date: 19-Aug-2024
https://dl.acm.org/doi/10.1145/3660521
Tang WWang YGurrin CKongkachandra RSchoeffmann KDang-Nguyen DRossetto LSatoh SZhou L(2024)Multi-modal Entity Alignment via Position-enhanced Multi-label PropagationProceedings of the 2024 International Conference on Multimedia Retrieval10.1145/3652583.3658085(366-375)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3652583.3658085
Xu BLu YSu BYan X(2024)Position-Aware Active Learning for Multi-Modal Entity AlignmentICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP48485.2024.10447624(8215-8219)Online publication date: 14-Apr-2024
https://doi.org/10.1109/ICASSP48485.2024.10447624
Show More Cited By

Index Terms

Weakly Supervised Entity Alignment with Positional Inspiration
1. Information systems
  1. Information systems applications
    1. Data mining

Recommendations

SelfKG: Self-Supervised Entity Alignment in Knowledge Graphs
WWW '22: Proceedings of the ACM Web Conference 2022

Entity alignment, aiming to identify equivalent entities across different knowledge graphs (KGs), is a fundamental problem for constructing Web-scale KGs. Over the course of its development, the label supervision has been considered necessary for ...
Efficient Path Prediction for Semi-Supervised and Weakly Supervised Hierarchical Text Classification
WWW '19: The World Wide Web Conference

Hierarchical text classification has many real-world applications. However, labeling a large number of documents is costly. In practice, we can use semi-supervised learning or weakly supervised learning (e.g., dataless classification) to reduce the ...
Weakly supervised label distribution learning based on transductive matrix completion with sample correlations
Highlights
- The matrix completion is firstly applied to weakly supervised LDL problems.
- ...
Abstract
Label distribution learning (LDL) is one of the paradigms for dealing with label ambiguity, and it can learn the relative importance of each label to a particular instance. Most of the existing LDL approaches require strong supervision ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WSDM '23: Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining

February 2023

1345 pages

ISBN:9781450394079

DOI:10.1145/3539597

General Chairs:
Tat-Seng Chua
National University of Singapore
,
Hady Lauw
Singapore Management University
,
Program Chairs:
Luo Si
Salesforce
,
Evimaria Terzi
Boston University
,
Panayiotis Tsaparas
University of Ioannina

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 February 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Natural Science Foundation of China
Ministry of Education and China Mobile Joint Fund
China Postdoctoral Science Foundation

Conference

WSDM '23

Sponsor:

WSDM '23: The Sixteenth ACM International Conference on Web Search and Data Mining

February 27 - March 3, 2023

Singapore, Singapore

Acceptance Rates

Overall Acceptance Rate 498 of 2,863 submissions, 17%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
497
Total Downloads

Downloads (Last 12 months)194
Downloads (Last 6 weeks)29

Reflects downloads up to 22 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zeng KJin HLv XZhu FHou LZhang YPang FQi YLiu DLi JFeng L(2024)XLORE 3: A Large-Scale Multilingual Knowledge Graph from Heterogeneous Wiki Knowledge ResourcesACM Transactions on Information Systems10.1145/366052142:6(1-47)Online publication date: 19-Aug-2024
https://dl.acm.org/doi/10.1145/3660521
Tang WWang YGurrin CKongkachandra RSchoeffmann KDang-Nguyen DRossetto LSatoh SZhou L(2024)Multi-modal Entity Alignment via Position-enhanced Multi-label PropagationProceedings of the 2024 International Conference on Multimedia Retrieval10.1145/3652583.3658085(366-375)Online publication date: 30-May-2024
https://dl.acm.org/doi/10.1145/3652583.3658085
Xu BLu YSu BYan X(2024)Position-Aware Active Learning for Multi-Modal Entity AlignmentICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP48485.2024.10447624(8215-8219)Online publication date: 14-Apr-2024
https://doi.org/10.1109/ICASSP48485.2024.10447624
Lu CXu XZhang B(2024)Modification and completion of geological structure knowledge graph based on pattern matchingScientific Reports10.1038/s41598-024-60618-114:1Online publication date: 29-Apr-2024
https://doi.org/10.1038/s41598-024-60618-1
Liang YCai WYang MJiang Y(2024)An unsupervised multi-view contrastive learning framework with attention-based reranking strategy for entity alignmentNeural Networks10.1016/j.neunet.2024.106583179(106583)Online publication date: Nov-2024
https://doi.org/10.1016/j.neunet.2024.106583
Yan ZPeng RWu H(2024)Similarity propagation based semi-supervised entity alignmentEngineering Applications of Artificial Intelligence10.1016/j.engappai.2023.107787130:COnline publication date: 2-Jul-2024
https://dl.acm.org/doi/10.1016/j.engappai.2023.107787
Zhang YZhu XHu X(2024)Entity alignment in noisy knowledge graphApplied Intelligence10.1007/s10489-024-06131-455:2Online publication date: 23-Dec-2024
https://doi.org/10.1007/s10489-024-06131-4
Tang WSun HWang JQi QWang JYang HTao SChen HDuh WHuang HKato MMothe JPoblete B(2023)Multi-order Matched Neighborhood Consistent Graph Alignment in a Union Vector SpaceProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591735(963-972)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3539618.3591735
Qian YPan L(2023)Variety-aware GAN and online learning augmented self-training model for knowledge graph entity alignmentInformation Processing and Management: an International Journal10.1016/j.ipm.2023.10347260:5Online publication date: 1-Sep-2023
https://dl.acm.org/doi/10.1016/j.ipm.2023.103472
Xiao MChen TWang ZLong JHuang JYang L(2023)Parameter-Lite Adapter for Dynamic Entity AlignmentPRICAI 2023: Trends in Artificial Intelligence10.1007/978-981-99-7019-3_36(389-400)Online publication date: 15-Nov-2023
https://dl.acm.org/doi/10.1007/978-981-99-7019-3_36

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents