Tag: music informatics

  • Towards a Progressive Art

    Towards a Progressive Art

    How Can You Build on Such a Quicksand?

    George Rochberg spent his life arguing for a renewal of humanist values in art. He felt the aleatoric and serial music that dominated his time was destined to fail the most basic test for inclusion in the ever-expanding legacy of culture — that musical experiences must be meaningful to people.

    George watched as many of the musicians around him turned their backs on the values of identity and meaning in their art. Without identity and memory, there could be no meaning. Without the possibility for meaning, art would fail to exist as a holistic and satisfying experience.

    For George, these elements were the very substance of life, and therefore music.

    We literally must impose an order of some kind on our affective memory if we are to see meaning in our existence. It is in the power of forming the data of our existence that we shape ourselves and the world around us; and it is out of this power, this urge to meaning through form and order, that art arises.

    — George Rochberg

    In other words, cultivating a sense of musical identity requires the listener to recall the idea in memory and recalling musical ideas requires an adherence to culturally acquired patterns and structures. If musical elements exist without an identity (what is it? and later, what was it?), they will, at best, only offer fleeting moments of disassociated sensations. In George’s mind, music like this has “foredoomed itself to extinction”. It will never have the chance to become part of heritable culture.

    The Search for Firmer Ground

    Rochberg insisted that in order to escape the quicksand of musical entropy, identity and memory must operate in two places at once: at the motivic level and formally. In both cases, he suggested that a perceivable identity must be consistently present through repetition, variation, and recall. Further, he imagined that even though they all approached music very differently, Bach, Beethoven, Brahms, Mozart, and Wagner would all have recognized and fully embraced these high-level concepts.

    In fact, there is a growing body of research that supports this.

    Starting in the 1950s Meyer, Younblood, Krahenbuehl, and Coons introduced serious studies involving the concepts of musical arousal, uncertainty, and surprise using principles borrowed from information theory. Since then, generative theories (Lerdahl, Jackendoff, and Narmour) and quantitative models (Huron, Margulis, and Farbood) of musical expectation and tension have shown that humans apply learned memory encoding to the sounds and musical patterns that we experience.

    So, in order to find meaning in musical expression, we require structure and a perceptual adherence to culturally learned schematic patterns, structures, and devices. It seems George was on to something…

    To play with entropy in art is to play with a self-consuming fire.

    — George Rochberg

    Self-perpetuating musical elements must incorporate the past, present, and suggest a possible future. Without this, music (pitch, harmony, duration, and ultimately, form) cannot convey movement or meaning. Without this, the questions so fundamental to human expression and existence suddenly have no answers. Where are we going? Have we arrived? Why have we arrived here?

    The Problem with Allegory

    While it’s clear we’ve made great strides in understanding the fundamentals of musical comprehension since the 1950s, most of this progress has yet to filter down into the lexicon of applied music. Without awareness of these discoveries, the people discussing, creating, teaching, promoting, and financing artwork remain locked in a haze of anecdotal notions when trying to assess aesthetic value, consider solutions to artistic problems, and communicate artistic ideas.

    At best, we can only come away with an allegorical sense of the issues we’re attempting to address.

    When talking and writing about the creative process, Rochberg often used intentionally vague phrases to convey concepts such as, “emerging on a new plane”, “transcendent qualities”, “cosmic consciousness”, “powerful connections”, and “growing an atmosphere”. He spoke of musical gestures in terms of their weight (gravity) and temperature. He even assigned these attributes to individual composers; Beethoven was “hot” while Debussy was “cold” etc.

    George was far from alone in defining music in largely allegorical terms. In fact, it’s quite common to hear artistic values discussed in poetic, ephemeral, mystical, or even supernatural terms. Of course metaphysical descriptions of music are useful because they convey more than the words themselves might imply. Thinking about art in this way can inspire an artist to imagine beyond the obvious solutions that present themselves and discover novel, more satisfying results.

    But it’s not without a significant downside.

    Relying on allegory when discussing the complexities of artistic expression can introduce unnecessary confusion, stunt communication, and hinder artistic progress. Ignoring (or hiding from) the tangibles surrounding the artistic process imposes an emotionally-biased and highly-subjective system of judgment that is difficult to apply in practical terms. Most importantly, it closes the door on ideas that exist outside of the internally-defined borders of acceptance, often without reason or evidence.

    German poet and critic, Hans Magnus Enzensberger saw this problem and described it nicely:

    The moment a topological structure appears as a metaphysical structure the game loses its dialectical balance, and literature turns into a means of demonstrating that the world is essentially impenetrable, that any communication is impossible. The labyrinth thus ceases to be a challenge to human intelligence and establishes itself as a facsimile of the world and of society.

    Pragmatic and Progressively Human

    Allegorical representations of musical expression have value, but the creation of art is also concerned with definable practicalities. Like Enzensberger and others, I see a balanced approach as essential to progress. As such, I am interested in (and even inspired by) the inevitable march of technological progress and the influence it is exerting on the future of art. Moreover, I find that the inclusion of an information-driven perspective offers a convincing theoretical model of our own human creative processes.

    My work in music (as composer, pianist, and researcher) has been focused on developing a practical, useful, and tangible understanding of these principles — in order to ensure the survival of music as a progressively human expression of art.

    George (and others) rejected the reduction of musical information to parameters upon which a person can operate. Perhaps more importantly, he worried about the result of imposing a strictly rational order on this data to create new art — an order that might not take into account his concerns with memory and identity.

    My claim is that many of the artistic values that we as artists hold dear are present in the discrete parameters of music. This includes memory, identity, and even an understanding of expressive qualities of musical character. Further, algorithms are no longer limited to the simplistic and prescriptive ordering of musical data. Today we can create software that is flexible, adaptive, and if trained against representative human examples, is even able to contribute meaningful expressions of art.

  • Automating Musical Descriptions: A Case Study

    Automating Musical Descriptions: A Case Study

    It’s widely accepted that music elicits similar emotional responses from culturally connected groups of human listeners. Less clear is how various aspects of musical language contribute to these effects.

    Funded by a Mellon Foundation Research Grant through Dickinson College Digital Humanities, our research into this questions leverages cognition-based machine listening algorithms and network analysis of musical descriptors to identify the connections between musical affect and language.

    (more…)

  • A Study in Stylometry

    A Study in Stylometry

    JK Rowling & Robert GalbraithIn July of 2013, Patrick Juola, a computer science/mathematics researcher at Duquesne University, uncovered the fact that J.K. Rowling was writing detective novels under an assumed name. Juola used simple statistical methods (distribution-based, primarily) to analyze the length, frequency, and relative placement of words and n-grams. Results were compared against numerous writing samples and presto, Robert Galbraith was found to be J.K. Rowling.

    Incredibly, this fairly simple approach produced useful results regarding authorship (and in a very limited sense, style), and the algorithms never parsed the meaning of a single word! Let’s say that again — meaning was never addressed.

    This is encouraging news for the MIR community, where similar results are sought after by many researchers. However, as I see it, a critical difference between the approach of most MIR projects and the work of ‘forensic linguists’ like Juola is the understanding and availability of grammatical morphemes.

    The Challenges of Music as Language

    Much of current MIR research focuses on uncovering trends and correlations in data provided by raw features. This is especially true when dealing with audio, and has, in some cases, produced useful results. But features derived from DSP do not constitute aspects of musical grammar, and the limited success of so many feature-based projects supports the suggestion that we may be overlooking an important piece of the puzzle.

    Musical language is abstract in the sense that it doesn’t contain lexical morphemes — units of grammar that carry with them specific meaning(s). This freedom from restrictive definitions is arguably one of music’s most compelling features, but it also makes parsing its largely self-referential and often emergent grammar extremely challenging.

    Within musicological, theoretical, and cognitive research circles, it has been shown that fundamental principles of musical grammar, free of cultural associations, do in fact exist, especially when events are considered in context. What’s more, this built-in lexical syntax may be at least partly responsible for allowing us to differentiate between noise and musical sounds. In my view, it is here that we must direct our energies.

    Bridging the gap between raw audio features and musically meaningful morphemes is no simple task, but one that I believe is essential to opening the path to many desirable MIR tasks. As such, extracting musically relevant morphemes is a primary force behind the design and architecture of the Isomer code base.

    The Power of Multiple Representations

    In the case of audio input, Isomer separates feature data into four musical components: melody, harmony, rhythm and timbre. Crucially, it also interprets the data to begin building musical context around individual observations. But most notable is Isomer’s ability to create multiple abstracted representations from a single audio source.

    The power of implementing a series of interpreted abstractions is that audio feature data can be represented multiple times at varying depths from the original observations, providing a variety of ways to view and examine the model. For example, determining the location of perceptually important event onsets, ‘beats’, or perceptual pulse points may be more quickly and accurately calculated from Isomer’s normalized representation rather than the raw feature data. In other cases, the detection of more expansive musical elements like harmony and harmonic rhythm may benefit significantly from a more general reduction of the raw DSP data.

    From stylistic identification to model-based music composition, there are many challenges facing the MIR community that continue to remain out of reach using current approaches. In addition to offering greater flexibility as a research tool, I believe these design features of Isomer’s architecture will do much to bring us closer to a more meaningful set of data upon which to work.

  • What the Future Sounds Like

    What the Future Sounds Like

    Electronic music pioneer Peter Zinovieff sums up Isomer’s raison d’etre in a single sentence…

    https://youtu.be/8KkW8Ul7Q1I?t=25m35s

    See this fantastic documentary in its entirety here.

  • Inferring Meaning from Expectation

    Inferring Meaning from Expectation

    Of all the sublime moments in operatic literature, few surpass “Pur ti miro, pur ti godo” (I gaze at you, I possess you), the final love duet between Nero and Poppea in Monteverdi’s “L’incoronazione di Poppea”.

    This enduring masterpiece aims to represent love’s supreme power over all other forces through the unifying of the couple in unbreakable bonds of love.

    (more…)

  • Melodic Expectation: A Case Study

    Melodic Expectation: A Case Study

    Due to inherent limitations in our own perceptive and cognitive abilities, we find the anticipation and realization of unexpected events and connections (within certain parameters) extremely satisfying. We subconsciously predict moment-to-moment what’s going to happen next, and to a large degree, the fulfillment and/or denial of these predictions dictates the amount of creative enjoyment we experience.

    (more…)