Deep learning for entity matching: A design space exploration
Proceedings of the 2018 international conference on management of data, 2018•dl.acm.org
Entity matching (EM) finds data instances that refer to the same real-world entity. In this
paper we examine applying deep learning (DL) to EM, to understand DL's benefits and
limitations. We review many DL solutions that have been developed for related matching
tasks in text processing (eg, entity linking, textual entailment, etc.). We categorize these
solutions and define a space of DL solutions for EM, as embodied by four solutions with
varying representational power: SIF, RNN, Attention, and Hybrid. Next, we investigate the …
paper we examine applying deep learning (DL) to EM, to understand DL's benefits and
limitations. We review many DL solutions that have been developed for related matching
tasks in text processing (eg, entity linking, textual entailment, etc.). We categorize these
solutions and define a space of DL solutions for EM, as embodied by four solutions with
varying representational power: SIF, RNN, Attention, and Hybrid. Next, we investigate the …
Entity matching (EM) finds data instances that refer to the same real-world entity. In this paper we examine applying deep learning (DL) to EM, to understand DL's benefits and limitations. We review many DL solutions that have been developed for related matching tasks in text processing (e.g., entity linking, textual entailment, etc.). We categorize these solutions and define a space of DL solutions for EM, as embodied by four solutions with varying representational power: SIF, RNN, Attention, and Hybrid. Next, we investigate the types of EM problems for which DL can be helpful. We consider three such problem types, which match structured data instances, textual instances, and dirty instances, respectively. We empirically compare the above four DL solutions with Magellan, a state-of-the-art learning-based EM solution. The results show that DL does not outperform current solutions on structured EM, but it can significantly outperform them on textual and dirty EM. For practitioners, this suggests that they should seriously consider using DL for textual and dirty EM problems. Finally, we analyze DL's performance and discuss future research directions.
ACM Digital Library