Cross-Cultural Multimedia Computing

Semantic and Aesthetic Modeling

The ability to communicate cultural codes in multimedia depends on their meaning and beauty, as perceived by different audiences around the globe. In this book, the ongoing research on computational modeling of visual, musical and textual contents is described in terms of identifying and mapping their semantic representations across different cultures. The underlying psychology of sense-making is quantified through analysis of aesthetics in terms of organizational and structural aspects of the contents that influence an audience’s formation of expectations for future signals, violations of these expectations, and explanations of their meaning. Complexity-accuracy tradeoffs in sound representation are further used to develop new computational methods that capture poietic and aesthetic aspects in music communication. Experimental studies are reported that try to characterize preferences for complexity in abstract, classical and traditional art and music across samples of Western and Far Eastern cultures. These experiments illustrate how aesthetics can be computed in terms of semantic and information measures, highlighting commonalities and uncovering differences in aesthetic preferences across cultures and individuals.