Human Speakers Help Machine Listeners To Account For Visual Asymmetries in Dialogue

Human-machine dialogue (HMD) research debates the degree to which language production in this context is egocentric or allocentric. That is, the degree to which a person might take a machine’s perspective into account. Our study aims to identify whether users produce allocentric or egocentric language within speech-based HMD when there is asymmetry in the information available to both partners. Through an adapted referential communication task, we manipulated the presence or absence of visual distractors and occlusions, similarly to previous referential tasks used in psycholinguistic research. Results show that people are sensitive to the presence of distractors and occlusions and tend to produce more informative expressions to help machine partners account for the visual asymmetries. We discuss the findings on how allocentric production in HMD is explained by how the division of labour manifests in spoken HMD. The findings further our understanding of the language production mechanisms in HMD.