Textual Communication Design via Affective Semantic Annotation and Evocative Artistic Visualization

Abstract
In the interest of enriching user experience of computer-based textual content, we propose a novel text visualization approach, whose visual aspect is grounded in generative art, evocative abstract animation, and visual elements of cartography. Its technical aspect is based on text mining, textual affect recognition, and semantic annotation. Our general approach is centered on the idea that digital technologies increasingly dictate the languages in which we speak and think, and therefore we need to develop new forms of expression. In particular, we believe that these affective computer systems should be able to relate to, communicate, and evoke human emotions. In addition, we discuss how engineers, designers, and artists should be aware of the influence such technologies have as media, not as mere tools. Our study, organized as repeated measures within-subjects experiment, demonstrated that in terms of affect communication, our visualizations are comparable to two common textual emotion visualization techniques: emoticons and avatars. However, our visualizations based on abstract color, motion, and shape proved to be the best in evoking emotions.

Biography
With formal background in information technology and digital media, and informal background in animation,illustration, literature,film, and visual art, my long-term objective is to bring close together ideas from these diverse disciplines. My current professional and personal interests include data visualization, information design, human-computer interaction, and new media art and literature–in terms of research, teaching, and production. I am deeply interested in technology as a language, not as a utilitarian tool.

My projects range from Synesketch, an open-source software for textual emotion recognition and artistic generative visualization, to Bantustan, an infographic African documentary novel.

My work was recognized by international festivals and conferences such as International Digital Media and Arts Association, and scientific journals such as IEEE Transactions on Human-Machine Systems and the IEEE Transactions on Affective Computing.