Co-existence of auditory and visual data

Abstract

“Co-existence of auditory & visual data” | Summary “Co-existence of auditory & visual data” is a trial in understanding what impact sound and visual images have on a viewer combined together as a mixed medium. Thesis poses a question of how can they influence each other and how can they enhance and modify the message or entirely contradict its meaning. Main aim of this thesis is to bring awareness of permanent presence of various stimuli in the surrounding environment and constant activity of feature detectors and, finally, make people more sensitive to everyday audio-visual experience and able to consciously make use of both media and look for new solutions as visual artists. Thesis thoroughly investigates the subject of perception, describes elements of perceptual process, as well as role of senses and feature detectors – receptors in the equation. It shows how important are the factors brought to the process by the human himself, both by conscious and unconscious collecting of data and knowledge about culture codes that provide base to cognitive processes. Synesthesia is another focal point of this paper. It is a great example at how different norms of perception can be. This unique cross-sensory experience is explained in detail with description of the condition, its features and factors that make its appearance more likely as well as possibilities to acquire synesthesia by natural and artificial means. Also, describes types of the condition, focusing on types connected to sight and hearing and describing portraits of Olivier Sacks’ patients that represented different approach to the condition and finally – interesting case of artificially induced synesthetic experience, which shows how modifying one’s ability to obtain sensory data broadens possible array of perceptive experience. Last chapter focuses on presenting art of various genres inspired by synesthetic experience and bringing to attention similarities between creative processes when it comes to producing sound and visual imagery. It shows how many possible uses exist to inborn synesthesia in different fields of artistic expression and presents examples where synesthesia is merely an inspiration, not direct impulse influencing creation. Musicians and designers are a source of information when it comes to behind-the-scenes activities leading to formation of artistic piece. Especially in the era of using mostly digital tools, building blocks of both music and visual images are becoming more and more similar. Conclusions presented in the paper underline that diversity and uniqueness of human perception is a valuable source of inspiration when it comes to creative work and is an interesting topic of art itself. Awareness and understanding of perceptual processes lead to broadening possible spectrum of interpretation of data collected from the environment. Senses are important tools in withdrawing that information as well as an useful channel to pass it along to the audience. Art based on both audio and visual elements bring multi-dimensional experience, new possible interpretations but also enable direct translation between both media with use of modern tools. Thesis presents senses as an universal and unique source of cognition for human kind. It is the only way to broaden knowledge and gain experience. The more aware and open a person is to receive perceptual stimuli, the more information can be possibly acquired.