Namespace:    uci-datalab

PI: Padhraic Smyth
Institution: University of California, Irvine
Project description:

We are working on knowledge aware language modeling, which leverages structured knowledge (e.g., the WikiData knowledge graph) to help language model’s better model factual information. By rendering statements from the knowledge source, knowledge aware language models have the potential to improve the quality of natural language generation systems such as dialogue agents. In addition, knowledge aware language models can also be used to learn pre-trained contextualized word representations that improve performance on downstream tasks such as relation extraction, natural language inference, and word sense disambiguation.

Software: Python, CUDA, PyTorch, NVIDIA Apex, AllenNLP

Back to namespaces