Learning Context-based Embeddings for Knowledge Graph Completion

Ali, M., Berrendorf, M., Hoyt, C.T., Vermue, L., Sharifzadeh, S., Tresp, V., & Lehmann, J. (2021). PyKEEN 1.0- A python library for training and evaluating knowledge graph embeddings. Journal of Machine Learning Research, 22, 1–6. AliM. BerrendorfM. HoytC.T. VermueL. SharifzadehS. TrespV. LehmannJ. 2021 PyKEEN 1.0- A python library for training and evaluating knowledge graph embeddings Journal of Machine Learning Research 22 1 6 Search in Google Scholar

Antoine, B., Nicolas, U., Alberto, G.D., Weston, J & Yakhnenko, O. (2013). Translating embeddings for modeling multirelational data. Proceedings of Advances in Neural Information Processing Systems (NIPS), 2787–2795. AntoineB. NicolasU. AlbertoG.D. WestonJ YakhnenkoO. 2013 Translating embeddings for modeling multirelational data Proceedings of Advances in Neural Information Processing Systems (NIPS) 2787 2795 Search in Google Scholar

Chang, K.W., Yih, W.T., Yang, B.S., & Meek, C. (2014). Typed tensor decomposition of knowledge bases for relation extraction. Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 1568–1579. ChangK.W. YihW.T. YangB.S. MeekC. 2014 Typed tensor decomposition of knowledge bases for relation extraction Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP) 1568 1579 10.3115/v1/D14-1165 Search in Google Scholar

Das, R, Dhuliawala, S., Zaheer, M., Vilnis, L., Durugkar, I., Krishnamurthy, A., Smola, A., & McCallum, A. (2018). Go for a walk and arrive at the answer: Reasoning over paths in knowledge bases using reinforcement learning. Proceedings of 6th International Conference on Learning Representations (ICLR). DasR DhuliawalaS. ZaheerM. VilnisL. DurugkarI. KrishnamurthyA. SmolaA. McCallumA. 2018 Go for a walk and arrive at the answer: Reasoning over paths in knowledge bases using reinforcement learning Proceedings of 6th International Conference on Learning Representations (ICLR) Search in Google Scholar

Dettmers, T., Minervini, P., Stenetorp, P., & Riedel, S. (2018). Convolutional 2D knowledge graph embeddings. Proceedings of 32nd AAAI Conference on Artificial Intelligence, 1811–1818. DettmersT. MinerviniP. StenetorpP. RiedelS. 2018 Convolutional 2D knowledge graph embeddings Proceedings of 32nd AAAI Conference on Artificial Intelligence 1811 1818 10.1609/aaai.v32i1.11573 Search in Google Scholar

Devlin, J., Chang, M.W., Lee, K., & Toutanova, K. (2019). Bert: Pre-training of deep bidirectional transformers for language understanding. Proceedings of 57th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT), 4171–4186. DevlinJ. ChangM.W. LeeK. ToutanovaK. 2019 Bert: Pre-training of deep bidirectional transformers for language understanding Proceedings of 57th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) 4171 4186 Search in Google Scholar

Ding, B.Y., Wang, Q., Wang, B., & Guo, L. (2018). Improving knowledge graph embedding using simple constraints, Proceedings of 56th Annual Meeting of the Association for Computational Linguistics (ACL), 110–121. DingB.Y. WangQ. WangB. GuoL. 2018 Improving knowledge graph embedding using simple constraints Proceedings of 56th Annual Meeting of the Association for Computational Linguistics (ACL) 110 121 10.18653/v1/P18-1011 Search in Google Scholar

Dong, X., Gabrilovich, E., Geremy, H., Horn, W., Lao, N., Murphy, K., Strohmann, T., Sun, S.H., & Zhang, W. (2014). Knowledge vault: A web-scale approach to probabilistic knowledge fusion. Proceedings of 20th ACM SIGKDD conference on Knowledge Discovery and Data Mining (KDD), 601–610. DongX. GabrilovichE. GeremyH. HornW. LaoN. MurphyK. StrohmannT. SunS.H. ZhangW. 2014 Knowledge vault: A web-scale approach to probabilistic knowledge fusion Proceedings of 20th ACM SIGKDD conference on Knowledge Discovery and Data Mining (KDD) 601 610 10.1145/2623330.2623623 Search in Google Scholar

Galarraga, L.A., Teflioudi, C., Hose, K., & Suchanek, F.M. (2015). Fast rule mining in ontological knowledge bases with AMIE+. VLDB Journal, 24(6), 707–730. GalarragaL.A. TeflioudiC. HoseK. SuchanekF.M. 2015 Fast rule mining in ontological knowledge bases with AMIE+ VLDB Journal 24 6 707 730 10.1007/s00778-015-0394-1 Search in Google Scholar

Gjergji, K., Fabian, M.S., Georgiana, I., Maya, R. & Gerhard, W. (2018). Naga: Searching and ranking knowledge. Proceedings of 24th IEEE International Conference on Data Engineering (ICDE), 953–962. GjergjiK. FabianM.S. GeorgianaI. MayaR. GerhardW. 2018 Naga: Searching and ranking knowledge Proceedings of 24th IEEE International Conference on Data Engineering (ICDE) 953 962 Search in Google Scholar

Guillaume, B., Sameer, S., & Theo, T. (2015). On approximate reasoning capabilities of low-rank vector spaces. Proceedings of AAAI Spring Syposium on Knowledge Representation and Reasoning (KRR): Integrating Symbolic and Neural Approaches, 6–9. GuillaumeB. SameerS. TheoT. 2015 On approximate reasoning capabilities of low-rank vector spaces Proceedings of AAAI Spring Syposium on Knowledge Representation and Reasoning (KRR): Integrating Symbolic and Neural Approaches 6 9 Search in Google Scholar

Guo, S., Wang, Q., Wang, L.H., Wang, B., & Guo, L. (2018). Knowledge graph embedding with iterative guidance from soft rules. Proceedings of 32th AAAI Conference on Artificial Intelligence, 4816–4823. GuoS. WangQ. WangL.H. WangB. GuoL. 2018 Knowledge graph embedding with iterative guidance from soft rules Proceedings of 32th AAAI Conference on Artificial Intelligence 4816 4823 10.1609/aaai.v32i1.11918 Search in Google Scholar

Guo, L.B., Sun, Z.Q., & Hu, W. (2019). Learning to exploit long-term relational dependencies in knowledge graphs. Proceedings of 36th International Conference on Machine Learning (ICML), 2505–2514. GuoL.B. SunZ.Q. HuW. 2019 Learning to exploit long-term relational dependencies in knowledge graphs Proceedings of 36th International Conference on Machine Learning (ICML) 2505 2514 Search in Google Scholar

Hao, Y.C., Zhang, Y.Z., Liu, K., He, S.Z, Liu, Z.Y., Wu, H., & Zhao, J. (2017). An end-to-end model for question answering over knowledge base with cross-attention combining global knowledge. Proceedings of 55th Annual Meeting of the Association for Computational Linguistics (ACL), 221–231. HaoY.C. ZhangY.Z. LiuK. HeS.Z LiuZ.Y. WuH. ZhaoJ. 2017 An end-to-end model for question answering over knowledge base with cross-attention combining global knowledge Proceedings of 55th Annual Meeting of the Association for Computational Linguistics (ACL) 221 231 10.18653/v1/P17-1021 Search in Google Scholar

Ji, G.L., He, S.Z., & Xu, L. (2015). Knowledge graph embedding via dynamic mapping matrix, Proceedings of 53rd Annual Meeting of the Association for Computational Linguistics and 7th International Joint Conference on Natural Language Processing, 687–696. JiG.L. HeS.Z. XuL. 2015 Knowledge graph embedding via dynamic mapping matrix Proceedings of 53rd Annual Meeting of the Association for Computational Linguistics and 7th International Joint Conference on Natural Language Processing 687 696 10.3115/v1/P15-1067 Search in Google Scholar

Ji, G.L., Liu, K., He S.Z., & Zhao, J. (2017). Distant supervision for relation extraction with sentence-level attention and entity descriptions. Proceedings of 31st AAAI Conference on Artificial Intelligence, 3060–3066. JiG.L. LiuK. HeS.Z. ZhaoJ. 2017 Distant supervision for relation extraction with sentence-level attention and entity descriptions Proceedings of 31st AAAI Conference on Artificial Intelligence 3060 3066 10.1609/aaai.v31i1.10953 Search in Google Scholar

Ji, G.L., Liu, K., He, S.Z., & Zhao, J. (2016). Knowledge graph completion with adaptive sparse transfer matrix. Proceedings of 30th Conference on Artificial Intelligence, 985–991. JiG.L. LiuK. HeS.Z. ZhaoJ. 2016 Knowledge graph completion with adaptive sparse transfer matrix Proceedings of 30th Conference on Artificial Intelligence 985 991 10.1609/aaai.v30i1.10089 Search in Google Scholar

Kok, S., & Domingos, P. (2007). Statistical predicate invention. Proceedings of the 24th International Conference on Machine Learning (ICML), 433–440. KokS. DomingosP. 2007 Statistical predicate invention Proceedings of the 24th International Conference on Machine Learning (ICML) 433 440 10.1145/1273496.1273551 Search in Google Scholar

Li, H., Y. Liu, Mamoulis, N., & Rosenblum, D.S. (2019). Translation-based sequential recommendation for complex users on sparse data. IEEE Transactions on Knowledge and Data Engineering, 32(8), 1639–1651. LiH. LiuY. MamoulisN. RosenblumD.S. 2019 Translation-based sequential recommendation for complex users on sparse data IEEE Transactions on Knowledge and Data Engineering 32 8 1639 1651 10.1109/TKDE.2019.2906180 Search in Google Scholar

Lin, X.V., Socher, R., & Xiong, C.M. (2018). Multi-hop knowledge graph reasoning with reward shaping, Proceedings of 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP), 3243–3253. LinX.V. SocherR. XiongC.M. 2018 Multi-hop knowledge graph reasoning with reward shaping Proceedings of 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP) 3243 3253 10.18653/v1/D18-1362 Search in Google Scholar

Lin, Y.K., Liu, Z.Y., Luan, H.B., Sun, M.S., Rao, S.W., & Liu, S. (2015). Modeling relation paths for representation learning of knowledge bases. Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 705–714. LinY.K. LiuZ.Y. LuanH.B. SunM.S. RaoS.W. LiuS. 2015 Modeling relation paths for representation learning of knowledge bases Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP) 705 714 10.18653/v1/D15-1082 Search in Google Scholar

Liu, H.X., Wu, Y.X., & Yang, Y.M. (2017). Analogical inference for multi-relational embeddings. Proceedings of 34th International Conference on Machine Learning (ICML), 2168–2178. LiuH.X. WuY.X. YangY.M. 2017 Analogical inference for multi-relational embeddings Proceedings of 34th International Conference on Machine Learning (ICML) 2168 2178 Search in Google Scholar

Liu, W.J., Zhou, P., Zhao, Z., Wang, Z.R, Ju, Q., Deng, H.T., & Wang, P. (2020). K-BERT: Enabling language representation with knowledge graph, Proceedings of 34th AAAI Conference on Artificial Intelligence, 1112–1119. LiuW.J. ZhouP. ZhaoZ. WangZ.R JuQ. DengH.T. WangP. 2020 K-BERT: Enabling language representation with knowledge graph Proceedings of 34th AAAI Conference on Artificial Intelligence 1112 1119 10.1609/aaai.v34i03.5681 Search in Google Scholar

Liu, Y., Li, H., & Alberto, G.D. (2019). MMKG: Multi-modal knowledge graphs, European Semantic Web Conference, LNCS, 11503, 459–474. LiuY. LiH. AlbertoG.D. 2019 MMKG: Multi-modal knowledge graphs, European Semantic Web Conference LNCS 11503 459 474 10.1007/978-3-030-21348-0_30 Search in Google Scholar

Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., & Dean, J. (2013). Distributed representations of words and phrases and their compositionality. Proceedings of Advances in Neural Information Processing Systems (NIPS), 3111–3119. MikolovT. SutskeverI. ChenK. CorradoG.S. DeanJ. 2013 Distributed representations of words and phrases and their compositionality Proceedings of Advances in Neural Information Processing Systems (NIPS) 3111 3119 Search in Google Scholar

Minervini, P., Costabello, L., Munoz, E., Novacek, V., & Vandenbussche, P.Y. (2017). Regularizing knowledge graph embeddings via equivalence and inversion axioms. Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases (ECML-KDD), 668–683. MinerviniP. CostabelloL. MunozE. NovacekV. VandenbusscheP.Y. 2017 Regularizing knowledge graph embeddings via equivalence and inversion axioms Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases (ECML-KDD) 668 683 10.1007/978-3-319-71249-9_40 Search in Google Scholar

Nathani, D., Chauhan, J., Sharma, C., & Kaul, M. (2019). Learning attention-based embeddings for relation prediction in knowledge graphs. Proceedings of 57th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT), 4710–4723. NathaniD. ChauhanJ. SharmaC. KaulM. 2019 Learning attention-based embeddings for relation prediction in knowledge graphs Proceedings of 57th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) 4710 4723 10.18653/v1/P19-1466 Search in Google Scholar

Nguyen, D.Q., Nguyen, T.D., Nguyen, D.Q., & Phung, D. (2018). A novel embedding model for knowledge base completion based on convolutional neural network. Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT), 327–333. NguyenD.Q. NguyenT.D. NguyenD.Q. PhungD. 2018 A novel embedding model for knowledge base completion based on convolutional neural network Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL HLT) 327 333 10.18653/v1/N18-2053 Search in Google Scholar

Nguyen, D.Q., Vu, T., Nguyen, T.D., Nguyen, D.Q., & Phung, D. (2019). A capsule network-based embedding model for knowledge graph completion and search personalization. Proceedings of 57th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT), 2180–2189. NguyenD.Q. VuT. NguyenT.D. NguyenD.Q. PhungD. 2019 A capsule network-based embedding model for knowledge graph completion and search personalization Proceedings of 57th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT) 2180 2189 10.18653/v1/N19-1226 Search in Google Scholar

Peng, Y.H., & Zhang, J. (2020). LineaRE: Simple but Powerful Knowledge Graph Embedding for Link Prediction. Proceedings of 20th IEEE International Conference on Data Mining (ICDM), 422–431. PengY.H. ZhangJ. 2020 LineaRE: Simple but Powerful Knowledge Graph Embedding for Link Prediction Proceedings of 20th IEEE International Conference on Data Mining (ICDM) 422 431 10.1109/ICDM50108.2020.00051 Search in Google Scholar

Pu, F., Yang, B.L., Ying, J.C, You, L.Z., & Xu, C.O. (2020). A Contextualized Entity Representation for Knowledge Graph Completion. Proceedings of 13th International Conference on Knowledge Science, Engineering and Management (KSEM), 77–85. PuF. YangB.L. YingJ.C YouL.Z. XuC.O. 2020 A Contextualized Entity Representation for Knowledge Graph Completion Proceedings of 13th International Conference on Knowledge Science, Engineering and Management (KSEM) 77 85 10.1007/978-3-030-55130-8_7 Search in Google Scholar

Rocktaschel, T., & Riedel, S. (2017). End-to-end differentiable proving. Proceedings of Advances in Neural Information Processing Systems (NIPS), 3791–3803. RocktaschelT. RiedelS. 2017 End-to-end differentiable proving Proceedings of Advances in Neural Information Processing Systems (NIPS) 3791 3803 Search in Google Scholar

Schlichtkrull, M.S., Thomas, N.K., & Bloem, P. (2018). Modeling relational data with graph convolutional networks. Gangemi A. et al. (eds.) ESWC 2018, LNCS, vol. 10843, 593–607, Springer, Heidelberg. SchlichtkrullM.S. ThomasN.K. BloemP. 2018 Modeling relational data with graph convolutional networks GangemiA. (eds.) ESWC 2018, LNCS 10843 593 607 Springer Heidelberg 10.1007/978-3-319-93417-4_38 Search in Google Scholar

Seyed, M.K., & David, P. (2018). Simple embedding for link prediction in knowledge graphs. Proceedings of 32nd Conference on Advances in Neural Information Processing Systems (NIPS), 4289–4300. SeyedM.K. DavidP. 2018 Simple embedding for link prediction in knowledge graphs Proceedings of 32nd Conference on Advances in Neural Information Processing Systems (NIPS) 4289 4300 Search in Google Scholar

Socher, R., Chen, D.Q., Manning, C.D., & Andrew, Ng. (2013). Reasoning with neural tensor networks for knowledge base completion. Proceedings of Advances in Neural Information Processing Systems, 926–934. SocherR. ChenD.Q. ManningC.D. AndrewNg. 2013 Reasoning with neural tensor networks for knowledge base completion Proceedings of Advances in Neural Information Processing Systems 926 934 Search in Google Scholar

Sun, Y., Wang, S., Li, Y., Feng, S.K., Chen, X,Y., Zhang, H., Tian, X., Zhu, D.X., Tian, H., & Wu, H. (2019). ERNIE: Enhanced representation through knowledge integration. arXiv preprint arXiv:1904.09223. SunY. WangS. LiY. FengS.K. ChenX,Y. ZhangH. TianX. ZhuD.X. TianH. WuH. 2019 ERNIE: Enhanced representation through knowledge integration arXiv preprint arXiv:1904.09223. Search in Google Scholar

Sun, Z.Q., Deng, Z.H., Nie, J.Y., & Tang, J. (2019). Rotate: knowledge graph embedding by relational rotation in complex space. Proceedings of 7th International Conference on Learning Representations (ICLR). SunZ.Q. DengZ.H. NieJ.Y. TangJ. 2019 Rotate: knowledge graph embedding by relational rotation in complex space Proceedings of 7th International Conference on Learning Representations (ICLR) Search in Google Scholar

Sun, Z.Q., Vashishth, S., Sanyal, S., Talukdar, P., & Yang, Y.M. (2020). A re-evaluation of knowledge graph completion methods. Proceedings of 58th Annual Meeting of the Association for Computational Linguistics (ACL), 5516–5522. SunZ.Q. VashishthS. SanyalS. TalukdarP. YangY.M. 2020 A re-evaluation of knowledge graph completion methods Proceedings of 58th Annual Meeting of the Association for Computational Linguistics (ACL) 5516 5522 10.18653/v1/2020.acl-main.489 Search in Google Scholar

Trouillon, T., Welbl, J., Riedel, S., Gaussier, E., & Bouchard, G. (2016). Complex embeddings for simple link prediction. Proceedings of International Conference on Machine Learning (ICML), 2071–2080. TrouillonT. WelblJ. RiedelS. GaussierE. BouchardG. 2016 Complex embeddings for simple link prediction Proceedings of International Conference on Machine Learning (ICML) 2071 2080 Search in Google Scholar

Vaswani, A., Shazeer, N., Parmar, N, Uszkoreit, J, Jones, Llion J., Gomez, A.N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. Proceedings of Advances in Neural Information Processing Systems (NIPS), 5998–6008. VaswaniA. ShazeerN. ParmarN UszkoreitJ Jones LlionJ. GomezA.N. KaiserL. PolosukhinI. 2017 Attention is all you need Proceedings of Advances in Neural Information Processing Systems (NIPS) 5998 6008 Search in Google Scholar

Wang, Z., Zhang, J.W., Feng, J.L., & Chen, Z. (2014). Knowledge graph embedding by translating on hyperplanes. Proceedings of 28th AAAI Conference on Artificial Intelligence, 1112–1119. WangZ. ZhangJ.W. FengJ.L. ChenZ. 2014 Knowledge graph embedding by translating on hyperplanes Proceedings of 28th AAAI Conference on Artificial Intelligence 1112 1119 10.1609/aaai.v28i1.8870 Search in Google Scholar

Xiong, C.Y., Russell, P., & Jamie, C. (2017). Explicit semantic ranking for academic search via knowledge graph embedding. Proceedings of 26th International Conference on World Wide Web (WWW), 1271–1279. XiongC.Y. RussellP. JamieC. 2017 Explicit semantic ranking for academic search via knowledge graph embedding Proceedings of 26th International Conference on World Wide Web (WWW) 1271 1279 10.1145/3038912.3052558 Search in Google Scholar

Yang, B.S., & Tom, M. (2017). Leveraging knowledge bases in LSTMs for improving machine reading. Proceedings of 55th Annual Meeting of the Association for Computational Linguistics (ACL), 1436–1446. YangB.S. TomM. 2017 Leveraging knowledge bases in LSTMs for improving machine reading Proceedings of 55th Annual Meeting of the Association for Computational Linguistics (ACL) 1436 1446 10.18653/v1/P17-1132 Search in Google Scholar

Yang, B.S., Yih, W.T., He, X.D., Gao, J.F., & Deng, L. (2015). Embedding entities and relations for learning and inference in knowledge bases. Proceedings of the International Conference on Learning Representations (ICLR), 1–12. YangB.S. YihW.T. HeX.D. GaoJ.F. DengL. 2015 Embedding entities and relations for learning and inference in knowledge bases Proceedings of the International Conference on Learning Representations (ICLR) 1 12 Search in Google Scholar

Yang, F, Yang, Z.L., & Cohen, W.W. (2017). Differentiable learning of logical rules for knowledge base reasoning. Proceedings of Advances in Neural Information Processing Systems (NIPS), 2319–2328. YangF YangZ.L. CohenW.W. 2017 Differentiable learning of logical rules for knowledge base reasoning Proceedings of Advances in Neural Information Processing Systems (NIPS) 2319 2328 Search in Google Scholar

Zhang, N.Y., Deng, S.M., Sun Z.L., Wang, G.Y., Chen, X., Zhang, W., & Chen, H.J. (2019). Long-tail relation extraction via knowledge graph embeddings and graph convolution networks, Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (ACL), 3016–3025. ZhangN.Y. DengS.M. SunZ.L. WangG.Y. ChenX. ZhangW. ChenH.J. 2019 Long-tail relation extraction via knowledge graph embeddings and graph convolution networks Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (ACL) 3016 3025 10.18653/v1/N19-1306 Search in Google Scholar

Zhang, Z.Q., Cai, J.Y., Zhang, Y.D., & Wang, J. (2020). Learning hierarchy-aware knowledge graph embeddings for link prediction. Proceedings of 34th AAAI Conference on Artificial Intelligence, 3065–3072. ZhangZ.Q. CaiJ.Y. ZhangY.D. WangJ. 2020 Learning hierarchy-aware knowledge graph embeddings for link prediction Proceedings of 34th AAAI Conference on Artificial Intelligence 3065 3072 10.1609/aaai.v34i03.5701 Search in Google Scholar

Zhong H.P., Zhang J.W., Wang Z., Wan H., & Chen Z. (2015). Aligning knowledge and text embeddings by entity descriptions. Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 267–272. ZhongH.P. ZhangJ.W. WangZ. WanH. ChenZ. 2015 Aligning knowledge and text embeddings by entity descriptions Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP) 267 272 10.18653/v1/D15-1031 Search in Google Scholar