Category: Discussion & Process

Discussions about the state of music composition in the 21st century and for the more technically inclined, research observations involving music informatics and related software.

  • Debussy is Overrated

    Debussy is Overrated

    or… “How Others Did It So Much Better”

    The following is a video script I prepared, but never filmed. In the end, I decided I had better things to do, but perhaps the idea is of interest?


    VIDEO: Me playing the Drowning Church

    VOICE OVER
    When I first encountered Debussy, it was here. With this piece.

    At the time, my hands weren’t yet big enough to reach the wide spreads… and strange shapes… but that’s not why I found it difficult. It was difficult because I couldn’t find a way to convincingly express anything musical.

    It was like the composer needed to convince himself that gravity didn’t apply to him – in my hands, the music couldn’t escape a suffocating heaviness… everything… just… went nowhere…

    Debussy was not for me.


    VIDEO: Greg speaks directly to the camera while music continues in the background

    Of course, Debussy’s influence then and now is undeniable. But I’m still not convinced. And 40 years later, I think I know why…


    CHANNEL SPLASH


    VIDEO: Greg speaks to camera
    TEXT OVERLAY: “Debussy Oversimplified”

    Debussy’s legacy and influence comes down to a couple of things:

    • he rejected common practice counterpoint and voice leading
    • relied on parallel harmony that broke formal conventions
    • and most important – the sound texture mattered above all else (symbolism)

    VIDEO: composer headshots of Ravel, Satie, Scriabin…

    BUT the thing is… other composers around that time were making similar choices – advancing musical language – and they were writing better music.

    VIDEO: New Location – Greg Speaks to camera

    Musical events are connected in time by our brains – this an unavoidable principle of musical language. One event next to another – implies a range of NEXT options… and if we go too far outside what was implied… the connection can be lost.

    Ignoring this is like deciding to ignore physics just so you can build a perpetual motion machine.

    Let me show you what I mean.


    VIDEO: Me playing Moons Over My Hammy
    TEXT OVERLAY: “Sweet Anticipation”

    VOICE OVER
    Let’s take the opening of one of Debussy’s most famous works – Clair de Lune.

    If at any moment…

    ANYTHING can happen…

    The connection is lost. The implication isn’t strong enough to imply a satisfying resolution.

    A sense of anticipation is never created – because just about anything… can happen… and all we can do is take it in.

    Anticipation requires that we look forward to something… and THAT depends on what we JUST heard.


    VIDEO: New Location – Greg Speaks to camera

    If you know this piece, you realize that I just started adding random bits of… whatever. If you don’t know this piece, you probably weren’t bothered.

    Now… creating a sense of suspended animation – of floating aimlessly in a hazy mist – can be done in so many wonderfully compelling ways – ways that maintain and deepen connections to the way our brains listen – and ways that still feel as “magical” as anything you can dream up…


    VIDEO: Me playing Gymnopédie No. 1
    TEXT OVERLAY: “Suspended Animation Doesn’t Exists Without Movement”

    VOICE OVER
    Here the composer sets up several expectations…

    A “looping” accompaniment of sorts…

    And a beautiful melody that has clear direction…

    Even if it takes some time to complete…

    This is Erik Satie. He wrote this in 1888 and in many ways, this is the earliest “ambient” music.

    But it creates a sense of stillness through the illusion of suspended animation. Expectations are set forth and satisfied on multiple levels and we don’t have to ignore the way our brains embrace music!


    VIDEO: Me playing Scriabin Op. 74
    TEXT OVERLAY: “To Break Rules, You Must First Know The Rules”

    VOICE OVER
    In this case, Alexander Sciabin has discarded traditional harmony in favor of symmetrical harmonic structures. He’s breakin’ the rules. (what a rebel!)

    But a sense of anticipation with a relatively limited set of options is maintained.

    And yet we’re absolutely floating in a fragrant cloud of misty goodness – gravity is intact. And the anticipation is sweet.


    VIDEO: New Location – Greg Speaks to camera

    So there it is.

    40 years after I struggled to give this music direction…

    I learned that it doesn’t have any. At least not to my ears…

    VIDEO: Me playing the Drowning Church

    VOICE OVER
    I’d like to know what you think about Debussy and my take… Leave your thoughts in the comments below. I look forward to you showing me the error of my ways!

  • What To Know Before Mixing In Dolby Atmos

    What To Know Before Mixing In Dolby Atmos

    Dolby Atmos is here and it’s tempting to route a few audio tracks into your multichannel bus and invite your family and friends for a festival of frenetic panning. But in reality, it’s tough to create an engaging and listenable experience in a multichannel environment. What do we need to know to create better immersive audio mixes?

    What’s the Frequency, Kenneth?

    When it comes to picking out where sounds originate, our ears are blisteringly fast and extremely accurate. But there are limitations. For example, lower frequencies (starting around 800 Hz and certainly below 200 Hz) are difficult to localize while frequencies over 1600 kHz are much easier to pinpoint. Also, the location of narrow band signals (like sine waves) is more difficult to perceive than those with lots of rich harmonic content. This is especially true in the frequency range of vocal intelligibility (between 500 Hz and 4 kHz).

    Takeaway #1: Higher-pitched sounds with strong transients and stochastic spectral components are more easily localized and therefore have more options in terms of physical movement. They can move further and faster with greater effect.

    Motion of the Ocean

    When sounds move through space, their dynamic and emotional impact increases, but not all 3D motion is created equal. In order to be perceived as a single, coherent movement, sounds circling a listener must take more than ~250ms to make the journey. If they move faster than that, the source will appear to oscillate and become disorienting – which, of course, could be used to creative effect…

    Takeaway #2: The physical movement of sound adds impact and energy, but a little goes a long way. Often a slow, gentle, local movement is more than enough to breathe life into your mix.

    But I Can’t Fly!

    We have an inherent tendency to connect aural events to coincidental visual acts. Everyone has experienced this watching musicians perform – the sound of an amplified guitar may be coming from amplifiers sitting at the sides of the stage but our ears and eyes make us feel as if the sound is coming directly from the guitar itself – especially when we’re watching from a distance.

    Perhaps this is the primary reason it doesn’t feel right to hear a drumset panning side to side? Even when we can’t see the source, our brains expect physical positioning to match our real world experience.

    Takeaway #3: Understand the role each and every musical element plays in the construction of your mix and use those observations for creative good.

    A Musical Vector is Born

    Timbre describes the spectral components of a single musical object or group of objects over time and, as with rhythm and harmony, the savviest composers can build meaningful connections by manipulating these relationships. Spatialization deals with the dimension of individual events, their relationship in physical space, and their relationship TO the space itself. That said, movement of sound through space is not an intrinsic quality of the sound.

    Takeaway #4: Working in Dolby Atmos offers you opportunities to craft new connections and build meaningful relationships between the places individual musical elements inhabit. Not sure where to start? Try experimenting with contrast…

    Serve Your Master

    Moving a boring sound around in space will not make it less boring. However not all musical elements are meant to be exciting on their own. (Ever play the french horn in a Sousa march?) Consider the psychological impact of the musical intent and the role elements can play together – in combination.

    Takeaway #5: Connect elements of similar intent and activity to clearly defined regions of physical space. Note that “connect” could suggest pitting elements against each other to create contrast.

    The Cocktail Effect

    When you hear a stereo recording of a dinner party, the crowd sounds like a single wash of sound. It’s nearly impossible to separate individual voices and conversations – this is the Cocktail Effect. Reducing the points of origin creates spatial masking which essentially helps us “glue” elements together a stereo mix, but elements separated in space also become separate and distinct in our perception.

    Takeaway #6: While the spatial separation can “un-glue” your mix, it also allows you to control the direction of the listener’s focus and attention, thereby opening up creative possibilities.

    Knowing the limitations of our ears can be EXACTLY the thing we need to create novel effects that engage and excite our listeners. Or it could be key to building a subtly expanded version of a well-loved stereo mix. Either way, the key to crafting effective spatial mixes is understanding those cognitive limits so you can use them to your artistic advantage.

  • 2 Channels Deep

    2 Channels Deep

    Last March I reconfigured the studio to accommodate a wide 4 channel stereo speaker setup.

    I began developing several projects for this front-facing semi-circle, but found they translated horribly when condensed to stereo. Ironically, this was a sign that they were conceived well, but I found it frustrating that they weren’t portable.

    Happily, this March brought with it several studio upgrades along with a return to stereo monitoring.

    Doepfer LMK4+

    In anticipation of future live performances, I upgraded my master controller from the Roland RD-700GX to the Doepfer LMK4+ (TP/40GH).

    Happy fingers. But by far the biggest studio upgrade involved the bits that make the air move — the speakers.

    Adam S2V

    Great googily moogily.

    When I first powered on these Adam S2Vs I couldn’t pull away for hours. They are a miracle of engineering and a revelation for any willing pair of ears.

  • Towards a Progressive Art

    Towards a Progressive Art

    How Can You Build on Such a Quicksand?

    George Rochberg spent his life arguing for a renewal of humanist values in art. He felt the aleatoric and serial music that dominated his time was destined to fail the most basic test for inclusion in the ever-expanding legacy of culture — that musical experiences must be meaningful to people.

    George watched as many of the musicians around him turned their backs on the values of identity and meaning in their art. Without identity and memory, there could be no meaning. Without the possibility for meaning, art would fail to exist as a holistic and satisfying experience.

    For George, these elements were the very substance of life, and therefore music.

    We literally must impose an order of some kind on our affective memory if we are to see meaning in our existence. It is in the power of forming the data of our existence that we shape ourselves and the world around us; and it is out of this power, this urge to meaning through form and order, that art arises.

    — George Rochberg

    In other words, cultivating a sense of musical identity requires the listener to recall the idea in memory and recalling musical ideas requires an adherence to culturally acquired patterns and structures. If musical elements exist without an identity (what is it? and later, what was it?), they will, at best, only offer fleeting moments of disassociated sensations. In George’s mind, music like this has “foredoomed itself to extinction”. It will never have the chance to become part of heritable culture.

    The Search for Firmer Ground

    Rochberg insisted that in order to escape the quicksand of musical entropy, identity and memory must operate in two places at once: at the motivic level and formally. In both cases, he suggested that a perceivable identity must be consistently present through repetition, variation, and recall. Further, he imagined that even though they all approached music very differently, Bach, Beethoven, Brahms, Mozart, and Wagner would all have recognized and fully embraced these high-level concepts.

    In fact, there is a growing body of research that supports this.

    Starting in the 1950s Meyer, Younblood, Krahenbuehl, and Coons introduced serious studies involving the concepts of musical arousal, uncertainty, and surprise using principles borrowed from information theory. Since then, generative theories (Lerdahl, Jackendoff, and Narmour) and quantitative models (Huron, Margulis, and Farbood) of musical expectation and tension have shown that humans apply learned memory encoding to the sounds and musical patterns that we experience.

    So, in order to find meaning in musical expression, we require structure and a perceptual adherence to culturally learned schematic patterns, structures, and devices. It seems George was on to something…

    To play with entropy in art is to play with a self-consuming fire.

    — George Rochberg

    Self-perpetuating musical elements must incorporate the past, present, and suggest a possible future. Without this, music (pitch, harmony, duration, and ultimately, form) cannot convey movement or meaning. Without this, the questions so fundamental to human expression and existence suddenly have no answers. Where are we going? Have we arrived? Why have we arrived here?

    The Problem with Allegory

    While it’s clear we’ve made great strides in understanding the fundamentals of musical comprehension since the 1950s, most of this progress has yet to filter down into the lexicon of applied music. Without awareness of these discoveries, the people discussing, creating, teaching, promoting, and financing artwork remain locked in a haze of anecdotal notions when trying to assess aesthetic value, consider solutions to artistic problems, and communicate artistic ideas.

    At best, we can only come away with an allegorical sense of the issues we’re attempting to address.

    When talking and writing about the creative process, Rochberg often used intentionally vague phrases to convey concepts such as, “emerging on a new plane”, “transcendent qualities”, “cosmic consciousness”, “powerful connections”, and “growing an atmosphere”. He spoke of musical gestures in terms of their weight (gravity) and temperature. He even assigned these attributes to individual composers; Beethoven was “hot” while Debussy was “cold” etc.

    George was far from alone in defining music in largely allegorical terms. In fact, it’s quite common to hear artistic values discussed in poetic, ephemeral, mystical, or even supernatural terms. Of course metaphysical descriptions of music are useful because they convey more than the words themselves might imply. Thinking about art in this way can inspire an artist to imagine beyond the obvious solutions that present themselves and discover novel, more satisfying results.

    But it’s not without a significant downside.

    Relying on allegory when discussing the complexities of artistic expression can introduce unnecessary confusion, stunt communication, and hinder artistic progress. Ignoring (or hiding from) the tangibles surrounding the artistic process imposes an emotionally-biased and highly-subjective system of judgment that is difficult to apply in practical terms. Most importantly, it closes the door on ideas that exist outside of the internally-defined borders of acceptance, often without reason or evidence.

    German poet and critic, Hans Magnus Enzensberger saw this problem and described it nicely:

    The moment a topological structure appears as a metaphysical structure the game loses its dialectical balance, and literature turns into a means of demonstrating that the world is essentially impenetrable, that any communication is impossible. The labyrinth thus ceases to be a challenge to human intelligence and establishes itself as a facsimile of the world and of society.

    Pragmatic and Progressively Human

    Allegorical representations of musical expression have value, but the creation of art is also concerned with definable practicalities. Like Enzensberger and others, I see a balanced approach as essential to progress. As such, I am interested in (and even inspired by) the inevitable march of technological progress and the influence it is exerting on the future of art. Moreover, I find that the inclusion of an information-driven perspective offers a convincing theoretical model of our own human creative processes.

    My work in music (as composer, pianist, and researcher) has been focused on developing a practical, useful, and tangible understanding of these principles — in order to ensure the survival of music as a progressively human expression of art.

    George (and others) rejected the reduction of musical information to parameters upon which a person can operate. Perhaps more importantly, he worried about the result of imposing a strictly rational order on this data to create new art — an order that might not take into account his concerns with memory and identity.

    My claim is that many of the artistic values that we as artists hold dear are present in the discrete parameters of music. This includes memory, identity, and even an understanding of expressive qualities of musical character. Further, algorithms are no longer limited to the simplistic and prescriptive ordering of musical data. Today we can create software that is flexible, adaptive, and if trained against representative human examples, is even able to contribute meaningful expressions of art.

  • The Aural Savant

    The Aural Savant

    Johannes Vermeer (1632-1675) is widely acknowledged as one of the greatest painters of the Dutch Golden Age. In particular, his uncanny ability to capture the lens-accurate effects of light and shadow in intricate and provocatively staged scenes has elevated him to the status of revolutionary master.

    There’s something very special there. Almost spiritual. And yet, we can’t quite put our finger on it.

    — Tracy Chevalier, Historical Novelist on Vermeer

    Recently, inventor Tim Jenison spent more than five years developing and testing theories around the possibility that Vermeer relied heavily on machines to produce the 36 masterworks attributed to him today. While it’s unclear how applicable Jenison’s results are to Vermeer’s actual process, the backlash from his efforts makes it clear that associating influential artwork to a partially mechanical process is a decidedly unpopular thing to do.

    Should Technology Play a Creative Role?

    Of course, art is never created in a technological vacuum. Advances in paint pigmentation, musical instrument construction, and so on, are examples of technology’s direct influence on artistic output. And yet many cry foul when they suspect a technology may be brushing up against the essence of an artwork.

    When confronted with art that acknowledges direct technological involvement in the creative process, people often say they feel deprived of an authentic artistic experience. They feel cheated in some way.

    I’ve experienced this bias from non-musicians and professional musicians, and I’m not alone. While I understand why people might draw similar battlelines in other aspects of their lives (e.g. politics and spirituality), I’m left frustrated and confused when it comes to the role of technology in art. How can the source of the artifact count for more than the artistic value of the work itself?

    Perhaps a little armchair theorizing will help me understand — or at least feel better about — the apparent state of things.

    Touchable Technologies

    clarinet-technologyCould it be that certain technologies are more readily accepted because they appear to be within the immediate control of the artists themselves? For example, while most composers would be unable to fashion a working clarinet from raw materials, it’s certain that most have worked closely with numerous clarinets and clarinetists, so as to understand the limitations and advantages of the physical mechanisms employed.

    Is a composer’s use of “clarinet technology” acceptable because we can touch it? Are clarinets welcome because they’ve been around (in one form or another) for hundreds of years? Does the mechanical nature of physical instruments and tools seem more grounded to us?

    This sounds plausible.

    Untouchable Technologies

    But if touchability is so important, why then is it acceptable to use software to design and/or implement an artistic idea?

    Most often, creators employ digital tools as a series of black boxes with very little knowledge of their internal workings. Artists using these tools can be unwittingly influenced (or even held hostage) by interfaces, opcodes, and algorithms they didn’t create.

    Computer Generated Net Art

    And yet, artists using technologies like these are rarely (if ever) seen as engaging in artistic trickery or cheating, nor do they feel these tools are outside of their control.

    Strike.

    Maybe it’s time to turn the question of artistic authenticity on its head. What can we learn by examining other examples of artistic practice that are commonly viewed as deceptive?

    The (Dis)Advantage of Influence

    Just as certain applications of technology appear to influence the assumed integrity of a given artwork, the same may be said for the amount and type of perceived influence any given work contains.

    I say “perceived” because it is often the case that deep influence between artists and composers go misappropriated or even unnoticed. In fact, the attribution of landmark innovations can be so widely mistaken that the error becomes an indelible part of the canon.

    Even so, the questions that arise are familiar…

    • When artists draw heavily from existing artwork (whatever their intent), is it a form of cheating?
    • Where should lines be drawn between artistic influence, parody and copying?
    • Is it acceptable for artists to copy (or borrow) from themselves?
    • When is artistic appropriation a creative act, and when does it devolve into plagiarism?

    This feels closely related to questions surrounding our Vermeer example such as: when does a mechanically-aided artistic process cease to be a creative act?

    Hrm…

    Maybe what upsets people isn’t the use of technology per se, but rather a perceived loss of artistic authenticity and uniqueness. Adding to the confusion, perceived signals of artistic authenticity are in a constant state of flux…

    A Modern View

    js-bach-with-shadesInterpreting evidence that Vermeer was an extremely clever engineer with a talent for theatrical staging (who happened to produce incredibly important and influential artworks) is offensive to many — at least today. I suspect the same would be true if evidence surfaced suggesting that Bach’s ingenious counterpoint was significantly made possible by an incredibly clever (but long forgotten) 17th century machine.

    It’s important to remember that these illustrations carry the full force of history behind them. A distant history whereby it’s impossible to know with certainty how any specific artwork was created. Of course, this isn’t true for new pieces created by machines. But this fact only makes it that much easier for people to dismiss machine-generated music as less worthy of repetition — especially in an time of A.I. buzzword fatigue and algorithmic intrusion into our daily lives.

    Parting Thoughts

    I recently had the opportunity to see several of Vermeer’s paintings with my own eyes. Great googily moogily. The light in these paintings are unlike anything else I’ve seen.

    I’m certainly no expert, but the illumination sure feels lens-accurate to me. And so what if it is? The paintings are so much more than the unprecedented technical execution of light and shadow. So much more…

    The truth is — I have yet to hear music produced by a machine that rises to the quality of what humans create. But don’t mistake this for pessimism. There are many worthwhile efforts underway. We’re just getting started. And unlike some, I welcome our new algorithmic overlords.

  • Allan Schindler Memorial

    Allan Schindler Memorial

    Allan Schindler, my friend, mentor, and colleague, passed away suddenly on October 8th, 2018.

    The folks at Eastman reached out to colleagues and alumni, and set up a memorial concert for Allan on November 7th in Rochester, NY. Allan’s music was the centerpiece, and many of us were asked to contribute pieces. As you can see from the concert program, the response was overwhleming.

    Before the concert there was a private service for close friends and family. It was beautiful. Truly beautiful. The love everyone shared for Allan was on full display.

    Raising a glass to Allan

    After the concert, we all raised a glass to Allan. Many of us hadn’t seen each other in 16+ years and it was important (maybe even necessary) to get together to share stories and remembrances.

    A Few Personal Reflections


    When I arrived at Eastman in 1996, I had already written a considerable amount of music for electronic media but I felt constantly thwarted. My frustration with computer-generated sound was that it simply didn’t have the expressive potential of acoustic instruments. I struggled and struggled trying to get those damn computers to sing — even if only for a brief moment.

    And then I worked with Allan. And I got to know his music. It was music from silicon chips that defied gravity. It danced and floated. And it sang.

    Like his personality, Allan’s music expressed or embodied the essential values of the greatest art: lightness, quickness, exactitude, visibility, and multiplicity.

    And to me, it sounded completely effortless. But in working with him (and around him) I learned the truth; getting computers to make musically expressive sounds is a Herculean challenge.

    Allan fought hard to make his sounds “come alive” (as he was fond of saying). He would spend weeks getting a few seconds of music to work out. And we (his students) were lucky enough to hear him wrestle those sounds into submission through his office door. Day in and day out.

    As it turns out, listening to Allan work was one of the greatest lessons he provided to his students. (Little did I know that nearly all of us felt this way…) But when I arrived at Eastman in 1996, I had just about given up. I was nearly convinced there was no way to coax music worth hearing from a computer.

    That is, until I learned from Allan’s example.

    Allan Schindler

    He loved his life. He loved his work. And he was loved by many.