Tag: human a.i. collaboration

  • The Aural Savant

    The Aural Savant

    Johannes Vermeer (1632-1675) is widely acknowledged as one of the greatest painters of the Dutch Golden Age. In particular, his uncanny ability to capture the lens-accurate effects of light and shadow in intricate and provocatively staged scenes has elevated him to the status of revolutionary master.

    There’s something very special there. Almost spiritual. And yet, we can’t quite put our finger on it.

    — Tracy Chevalier, Historical Novelist on Vermeer

    Recently, inventor Tim Jenison spent more than five years developing and testing theories around the possibility that Vermeer relied heavily on machines to produce the 36 masterworks attributed to him today. While it’s unclear how applicable Jenison’s results are to Vermeer’s actual process, the backlash from his efforts makes it clear that associating influential artwork to a partially mechanical process is a decidedly unpopular thing to do.

    Should Technology Play a Creative Role?

    Of course, art is never created in a technological vacuum. Advances in paint pigmentation, musical instrument construction, and so on, are examples of technology’s direct influence on artistic output. And yet many cry foul when they suspect a technology may be brushing up against the essence of an artwork.

    When confronted with art that acknowledges direct technological involvement in the creative process, people often say they feel deprived of an authentic artistic experience. They feel cheated in some way.

    I’ve experienced this bias from non-musicians and professional musicians, and I’m not alone. While I understand why people might draw similar battlelines in other aspects of their lives (e.g. politics and spirituality), I’m left frustrated and confused when it comes to the role of technology in art. How can the source of the artifact count for more than the artistic value of the work itself?

    Perhaps a little armchair theorizing will help me understand — or at least feel better about — the apparent state of things.

    Touchable Technologies

    clarinet-technologyCould it be that certain technologies are more readily accepted because they appear to be within the immediate control of the artists themselves? For example, while most composers would be unable to fashion a working clarinet from raw materials, it’s certain that most have worked closely with numerous clarinets and clarinetists, so as to understand the limitations and advantages of the physical mechanisms employed.

    Is a composer’s use of “clarinet technology” acceptable because we can touch it? Are clarinets welcome because they’ve been around (in one form or another) for hundreds of years? Does the mechanical nature of physical instruments and tools seem more grounded to us?

    This sounds plausible.

    Untouchable Technologies

    But if touchability is so important, why then is it acceptable to use software to design and/or implement an artistic idea?

    Most often, creators employ digital tools as a series of black boxes with very little knowledge of their internal workings. Artists using these tools can be unwittingly influenced (or even held hostage) by interfaces, opcodes, and algorithms they didn’t create.

    Computer Generated Net Art

    And yet, artists using technologies like these are rarely (if ever) seen as engaging in artistic trickery or cheating, nor do they feel these tools are outside of their control.

    Strike.

    Maybe it’s time to turn the question of artistic authenticity on its head. What can we learn by examining other examples of artistic practice that are commonly viewed as deceptive?

    The (Dis)Advantage of Influence

    Just as certain applications of technology appear to influence the assumed integrity of a given artwork, the same may be said for the amount and type of perceived influence any given work contains.

    I say “perceived” because it is often the case that deep influence between artists and composers go misappropriated or even unnoticed. In fact, the attribution of landmark innovations can be so widely mistaken that the error becomes an indelible part of the canon.

    Even so, the questions that arise are familiar…

    • When artists draw heavily from existing artwork (whatever their intent), is it a form of cheating?
    • Where should lines be drawn between artistic influence, parody and copying?
    • Is it acceptable for artists to copy (or borrow) from themselves?
    • When is artistic appropriation a creative act, and when does it devolve into plagiarism?

    This feels closely related to questions surrounding our Vermeer example such as: when does a mechanically-aided artistic process cease to be a creative act?

    Hrm…

    Maybe what upsets people isn’t the use of technology per se, but rather a perceived loss of artistic authenticity and uniqueness. Adding to the confusion, perceived signals of artistic authenticity are in a constant state of flux…

    A Modern View

    js-bach-with-shadesInterpreting evidence that Vermeer was an extremely clever engineer with a talent for theatrical staging (who happened to produce incredibly important and influential artworks) is offensive to many — at least today. I suspect the same would be true if evidence surfaced suggesting that Bach’s ingenious counterpoint was significantly made possible by an incredibly clever (but long forgotten) 17th century machine.

    It’s important to remember that these illustrations carry the full force of history behind them. A distant history whereby it’s impossible to know with certainty how any specific artwork was created. Of course, this isn’t true for new pieces created by machines. But this fact only makes it that much easier for people to dismiss machine-generated music as less worthy of repetition — especially in an time of A.I. buzzword fatigue and algorithmic intrusion into our daily lives.

    Parting Thoughts

    I recently had the opportunity to see several of Vermeer’s paintings with my own eyes. Great googily moogily. The light in these paintings are unlike anything else I’ve seen.

    I’m certainly no expert, but the illumination sure feels lens-accurate to me. And so what if it is? The paintings are so much more than the unprecedented technical execution of light and shadow. So much more…

    The truth is — I have yet to hear music produced by a machine that rises to the quality of what humans create. But don’t mistake this for pessimism. There are many worthwhile efforts underway. We’re just getting started. And unlike some, I welcome our new algorithmic overlords.

  • The Pleasures of Music

    The Pleasures of Music

    Much of what currently passes as interdisciplinary work in computational creativity is profoundly lacking in artistic experience and understanding. This is a pervasive and critical flaw — after all, the creative side of the equation is our primary goal, is it not?

    To help us consider a more appropriate balance, let’s briefly examine how human composers and analysts approach their work.

    Music as Data

    Our first challenge is that musicians don’t generally think of raw musical materials as data. Immediately we find a conflict between the computational and creative — how can we compute without data? The answer lies with how we collect, represent, and ultimately select musical elements for processing. The key issue we need to consider is context.

    Interpreting the musical context around individual events is what allows us to develop a meaningful picture of how groups of musical events function. Understanding these musical effects requires computational systems to make aesthetic judgments based on experience (or training in this case). I’m developing my own approaches to this set of challenges, but suffice it to say…

    Any composer that deals with musical materials as anything but a means to achieve musical effect is not likely to produce results worth exploring or repeating.

    A Composer’s View

    Composers seek combinations of musical patterns that take on an irrepressible life of their own. As someone with decades of experience attempting this, I can say that it’s an intimate and perilous journey with few external guiding references. Every step forward simultaneously removes options and presents new opportunities, and when a combination of musical events expressing strong potential finally presents itself, there are no guarantees.

    Unfortunately, this first-hand description of the compositional process isn’t very helpful when designing creative algorithms. To do that, we need ways of defining and comparing the effect of musical ideas to learn what sinks and what floats. In recent years my work as composer, pianist, and researcher has focused on developing a computation-friendly approach to this problem and I believe reasonable solutions aren’t that far off.

    What About the Analyst?

    On the other hand, analysis (whether computational or theoretical) encourages the deconstruction and justification of existing musical ideas by developing a highly-relational network of connections between events with clearly definable attributes. Strange as it may seem, some of these relationships may be carefully planned and executed by the composer, but many are not.

    Ultimately, analysis aims to reveal a tightly woven fabric of methodically cataloged connections; regardless of the composer’s design or intent, and without the natural aesthetic judgments mandated by the compositional process.

    Analysis is a necessary component of model-based computational composition. But for analysis to become directly relevant to the compositional process, it must be capable of addressing a wide range of emotional potential to provide a meaningful musical experience. In other words, it must evolve to encompass the pleasures that music provides to us.

    Pleasures of Music

    What exactly do I mean by the “pleasures” of music?

    Well, I don’t mean the types of emotional associations that attach themselves to musical textures, forms, and ideas through cultural conditioning and repetition. No. I’m speaking of an aurally perceptible, inner geometry that attaches itself to our collective nervous system and forces us to repeat and examine it for generations upon generations.

    While it may be difficult to codify them, these designs are recognizable and valued because we are human. We find a pleasure in their architecture that universally speaks to us, regardless of time and cultural distance. And they did not come to exist in a vacuum — they have been under constant development for thousands of years through the myriad generations that precede us. Lucky for us, these designs can be found throughout the musical canon.

    To create music worthy of sustained exploration and repetition, computational creativity must seek out the patterns and trends that elucidate these universal pleasures. This process begins with our attempting to understand fundamental musical aspects like memory, identity, expectation, surprise, and developing a data-driven understanding of the expressive qualities of musical character.

  • What the Future Sounds Like

    What the Future Sounds Like

    Electronic music pioneer Peter Zinovieff sums up Isomer’s raison d’etre in a single sentence…

    https://youtu.be/8KkW8Ul7Q1I?t=25m35s

    See this fantastic documentary in its entirety here.