Tag: music and emotion

  • Towards a Progressive Art

    Towards a Progressive Art

    How Can You Build on Such a Quicksand?

    George Rochberg spent his life arguing for a renewal of humanist values in art. He felt the aleatoric and serial music that dominated his time was destined to fail the most basic test for inclusion in the ever-expanding legacy of culture — that musical experiences must be meaningful to people.

    George watched as many of the musicians around him turned their backs on the values of identity and meaning in their art. Without identity and memory, there could be no meaning. Without the possibility for meaning, art would fail to exist as a holistic and satisfying experience.

    For George, these elements were the very substance of life, and therefore music.

    We literally must impose an order of some kind on our affective memory if we are to see meaning in our existence. It is in the power of forming the data of our existence that we shape ourselves and the world around us; and it is out of this power, this urge to meaning through form and order, that art arises.

    — George Rochberg

    In other words, cultivating a sense of musical identity requires the listener to recall the idea in memory and recalling musical ideas requires an adherence to culturally acquired patterns and structures. If musical elements exist without an identity (what is it? and later, what was it?), they will, at best, only offer fleeting moments of disassociated sensations. In George’s mind, music like this has “foredoomed itself to extinction”. It will never have the chance to become part of heritable culture.

    The Search for Firmer Ground

    Rochberg insisted that in order to escape the quicksand of musical entropy, identity and memory must operate in two places at once: at the motivic level and formally. In both cases, he suggested that a perceivable identity must be consistently present through repetition, variation, and recall. Further, he imagined that even though they all approached music very differently, Bach, Beethoven, Brahms, Mozart, and Wagner would all have recognized and fully embraced these high-level concepts.

    In fact, there is a growing body of research that supports this.

    Starting in the 1950s Meyer, Younblood, Krahenbuehl, and Coons introduced serious studies involving the concepts of musical arousal, uncertainty, and surprise using principles borrowed from information theory. Since then, generative theories (Lerdahl, Jackendoff, and Narmour) and quantitative models (Huron, Margulis, and Farbood) of musical expectation and tension have shown that humans apply learned memory encoding to the sounds and musical patterns that we experience.

    So, in order to find meaning in musical expression, we require structure and a perceptual adherence to culturally learned schematic patterns, structures, and devices. It seems George was on to something…

    To play with entropy in art is to play with a self-consuming fire.

    — George Rochberg

    Self-perpetuating musical elements must incorporate the past, present, and suggest a possible future. Without this, music (pitch, harmony, duration, and ultimately, form) cannot convey movement or meaning. Without this, the questions so fundamental to human expression and existence suddenly have no answers. Where are we going? Have we arrived? Why have we arrived here?

    The Problem with Allegory

    While it’s clear we’ve made great strides in understanding the fundamentals of musical comprehension since the 1950s, most of this progress has yet to filter down into the lexicon of applied music. Without awareness of these discoveries, the people discussing, creating, teaching, promoting, and financing artwork remain locked in a haze of anecdotal notions when trying to assess aesthetic value, consider solutions to artistic problems, and communicate artistic ideas.

    At best, we can only come away with an allegorical sense of the issues we’re attempting to address.

    When talking and writing about the creative process, Rochberg often used intentionally vague phrases to convey concepts such as, “emerging on a new plane”, “transcendent qualities”, “cosmic consciousness”, “powerful connections”, and “growing an atmosphere”. He spoke of musical gestures in terms of their weight (gravity) and temperature. He even assigned these attributes to individual composers; Beethoven was “hot” while Debussy was “cold” etc.

    George was far from alone in defining music in largely allegorical terms. In fact, it’s quite common to hear artistic values discussed in poetic, ephemeral, mystical, or even supernatural terms. Of course metaphysical descriptions of music are useful because they convey more than the words themselves might imply. Thinking about art in this way can inspire an artist to imagine beyond the obvious solutions that present themselves and discover novel, more satisfying results.

    But it’s not without a significant downside.

    Relying on allegory when discussing the complexities of artistic expression can introduce unnecessary confusion, stunt communication, and hinder artistic progress. Ignoring (or hiding from) the tangibles surrounding the artistic process imposes an emotionally-biased and highly-subjective system of judgment that is difficult to apply in practical terms. Most importantly, it closes the door on ideas that exist outside of the internally-defined borders of acceptance, often without reason or evidence.

    German poet and critic, Hans Magnus Enzensberger saw this problem and described it nicely:

    The moment a topological structure appears as a metaphysical structure the game loses its dialectical balance, and literature turns into a means of demonstrating that the world is essentially impenetrable, that any communication is impossible. The labyrinth thus ceases to be a challenge to human intelligence and establishes itself as a facsimile of the world and of society.

    Pragmatic and Progressively Human

    Allegorical representations of musical expression have value, but the creation of art is also concerned with definable practicalities. Like Enzensberger and others, I see a balanced approach as essential to progress. As such, I am interested in (and even inspired by) the inevitable march of technological progress and the influence it is exerting on the future of art. Moreover, I find that the inclusion of an information-driven perspective offers a convincing theoretical model of our own human creative processes.

    My work in music (as composer, pianist, and researcher) has been focused on developing a practical, useful, and tangible understanding of these principles — in order to ensure the survival of music as a progressively human expression of art.

    George (and others) rejected the reduction of musical information to parameters upon which a person can operate. Perhaps more importantly, he worried about the result of imposing a strictly rational order on this data to create new art — an order that might not take into account his concerns with memory and identity.

    My claim is that many of the artistic values that we as artists hold dear are present in the discrete parameters of music. This includes memory, identity, and even an understanding of expressive qualities of musical character. Further, algorithms are no longer limited to the simplistic and prescriptive ordering of musical data. Today we can create software that is flexible, adaptive, and if trained against representative human examples, is even able to contribute meaningful expressions of art.

  • The Pleasures of Music

    The Pleasures of Music

    Much of what currently passes as interdisciplinary work in computational creativity is profoundly lacking in artistic experience and understanding. This is a pervasive and critical flaw — after all, the creative side of the equation is our primary goal, is it not?

    To help us consider a more appropriate balance, let’s briefly examine how human composers and analysts approach their work.

    Music as Data

    Our first challenge is that musicians don’t generally think of raw musical materials as data. Immediately we find a conflict between the computational and creative — how can we compute without data? The answer lies with how we collect, represent, and ultimately select musical elements for processing. The key issue we need to consider is context.

    Interpreting the musical context around individual events is what allows us to develop a meaningful picture of how groups of musical events function. Understanding these musical effects requires computational systems to make aesthetic judgments based on experience (or training in this case). I’m developing my own approaches to this set of challenges, but suffice it to say…

    Any composer that deals with musical materials as anything but a means to achieve musical effect is not likely to produce results worth exploring or repeating.

    A Composer’s View

    Composers seek combinations of musical patterns that take on an irrepressible life of their own. As someone with decades of experience attempting this, I can say that it’s an intimate and perilous journey with few external guiding references. Every step forward simultaneously removes options and presents new opportunities, and when a combination of musical events expressing strong potential finally presents itself, there are no guarantees.

    Unfortunately, this first-hand description of the compositional process isn’t very helpful when designing creative algorithms. To do that, we need ways of defining and comparing the effect of musical ideas to learn what sinks and what floats. In recent years my work as composer, pianist, and researcher has focused on developing a computation-friendly approach to this problem and I believe reasonable solutions aren’t that far off.

    What About the Analyst?

    On the other hand, analysis (whether computational or theoretical) encourages the deconstruction and justification of existing musical ideas by developing a highly-relational network of connections between events with clearly definable attributes. Strange as it may seem, some of these relationships may be carefully planned and executed by the composer, but many are not.

    Ultimately, analysis aims to reveal a tightly woven fabric of methodically cataloged connections; regardless of the composer’s design or intent, and without the natural aesthetic judgments mandated by the compositional process.

    Analysis is a necessary component of model-based computational composition. But for analysis to become directly relevant to the compositional process, it must be capable of addressing a wide range of emotional potential to provide a meaningful musical experience. In other words, it must evolve to encompass the pleasures that music provides to us.

    Pleasures of Music

    What exactly do I mean by the “pleasures” of music?

    Well, I don’t mean the types of emotional associations that attach themselves to musical textures, forms, and ideas through cultural conditioning and repetition. No. I’m speaking of an aurally perceptible, inner geometry that attaches itself to our collective nervous system and forces us to repeat and examine it for generations upon generations.

    While it may be difficult to codify them, these designs are recognizable and valued because we are human. We find a pleasure in their architecture that universally speaks to us, regardless of time and cultural distance. And they did not come to exist in a vacuum — they have been under constant development for thousands of years through the myriad generations that precede us. Lucky for us, these designs can be found throughout the musical canon.

    To create music worthy of sustained exploration and repetition, computational creativity must seek out the patterns and trends that elucidate these universal pleasures. This process begins with our attempting to understand fundamental musical aspects like memory, identity, expectation, surprise, and developing a data-driven understanding of the expressive qualities of musical character.

  • Automating Musical Descriptions: A Case Study

    Automating Musical Descriptions: A Case Study

    It’s widely accepted that music elicits similar emotional responses from culturally connected groups of human listeners. Less clear is how various aspects of musical language contribute to these effects.

    Funded by a Mellon Foundation Research Grant through Dickinson College Digital Humanities, our research into this questions leverages cognition-based machine listening algorithms and network analysis of musical descriptors to identify the connections between musical affect and language.

    (more…)