Lexical choice


Lexical choice is the subtask of Natural language generation that involves choosing the content words in a generated text. Function words are usually chosen during realisation.

Examples

The simplest type of lexical choice involves mapping a domain concept to a word. For example, the concept Finger might be mapped to the word finger.
A more complex situation is when a domain concept is expressed using different words in different situations. For example, the domain concept Value-Change can be expressed in many ways
Sometimes words can communicate additional contextual information, for example
Contextual information is especially significant for vague terms such as tall. For example, a 2m tall man is tall, but a 2m tall horse is small.

Linguistic perspective

Lexical choice modules must be informed by linguistic knowledge of how the system's input data maps onto words. This is a question of semantics, but it is also influenced by syntactic factors and pragmatic factors.
Hence NLG systems need linguistic models
of how meaning is mapped to words in the target domain of the NLG system. Genre tends to be very important; for example the verb veer has a very specific meaning in weather forecasts which it does not have in general English, and a weather-forecast generator must be aware of this genre-specific meaning.
In some cases there are major differences in how different people use the same word; for example, some people use by evening to mean 6PM and others use it to mean midnight. Psycholinguists have shown that when people speak to each other, they agree on a common interpretation via lexical alignment; this is not something which NLG systems can yet do.
Ultimately, lexical choice must deal with the fundamental issue of how language relates to the non-linguistic world. For example, a system which chose colour terms such as red to describe objects in a digital image would need to know which RGB pixel values could generally be described as red; how this was influenced by visual and linguistic context; what pragmatic connotations were associated with red ; and so forth.

Algorithms and models

A number of algorithms and models have been developed for lexical choice in the research community, for example Edmonds developed a model for choosing between near-synonyms. However such algorithms and models have not been widely used in applied NLG systems; such systems have instead often used quite simple computational models, and invested development effort in linguistic analysis instead of algorithm development.