A Quantitative Approach to Multimodality: An application to the creative process of Van Gogh
提出一种基于关键连接元素的定量多模态分析方法，同时分析视觉和语言数据，并应用于梵高1881-1890年间的创作过程，验证了视觉与语言对立随时间共现的有效性。
The paper proposes a quantitative approach to analyzing a “strong” form of multimodality, based on the co-emergence of a key connecting element in different modes of data. It provides a methodological template for the simultaneous analysis of visual and verbal data, which is applied to the domain of creativity. We expand the possibilities for analyzing creativity as a process by drawing on the “Janusian” tradition, using opposition as the key connecting element between the verbal and visual modes. The research context is the creative process of Vincent Van Gogh (during the period 1881–1890), as reflected in his letters and paintings. The visual analysis attests to the growing presence of contrast of complementary colors, while the textual analysis provides evidence for increasing affective, cognitive, and behavioral ambivalence. The results corroborate the validity of the method by demonstrating the co-emergence of visual and verbal opposition over time. The method can be used for purposes of exploration or validation. It has broad applications in organizational scholarship.