AI x [Moving] Image

Humans have always made images, driven by a need to preserve memories and tell stories. Yet, with each image-making innovation – like photography and video – we are forced us to rethink how we make and use images. The emergence of AI and ML tools invites us again to re-imagine our role as both image-makers and image-consumers.

In this guide, we share our findings, resources, and community reflections from our program: AI Playground / Image.

From synthetic media in photography to auto-editing video, we'll look at how new AI and ML tools are impacting image-making. We’ll reflect on how these new tools can be misused and what we can do about it.

decroative corner decroative corner
decroative corner decroative corner

01_Introduction

1888 Advertisment for Kodak camera, source: THE GUARDIANTimeline by Fabian Mosele, see the finished interactive timeline HERE

When photography was invited in the early 1800s, it was primarily a tool for scientists to experiment with photo-sensitive materials. During this time, futurists imagined potential use cases of photography, and artists debated if photography might be considered art. Fine art societies worked to develop standards for how photographs should look.

[Photographs are useful so long as they are taken in] accordance, as far as it is possible, with the acknowledged principles of Fine Art.

Upon Photography in an Artistic View, 1853, Journal of the Photographic Society

A couple of decades later in 1888, Kodak launched a camera Kodak’s with the tagline “You press the button, we do the rest”. A century later, the button has been replaced by a cursor.

Image capture has always been important for society and people. Images help us document historic events, persuade others to join our causes, capture every and any moment of everyday life. Images have power to keep the memory of a loved one alive, evoke buried emotions, and help us tell our story.

Through the year, so many tools have revolutionized the field, from Camera Obscura to the Kodak Camera, the Polaroid Camera, and the iPhone. Now AI tools push us even further. The use of AI allows us to create memories of events that never happened – or even images of people who don’t exist.

If an image is worth a thousand words, how does AI change our stories and how we tell them?

02_ A Brief History to Image-Making Technology

📸 WIP Timeline by Fabian Mosele see the finished interactive timeline HERE

03_ Redefining Creativity

Listen to Fabian discuss how Artificial intelligence is changing our creative process, how it is connected to semiotics and what are artists currently doing with this one model – VQGAN+CLIP AI has been around for decades, but it’s only recently that it has become more accessible for artists and creatives; low-code applications and new educational resources launch every day.As a result, a new wave of digital art and artists have emerged. Generative Adversarial Networks (GANs) have launched its own distinct art style as seen in music videos by Cuco ABRA, and Magdalena Bay.

How has generative image-making tools impacted image-making? How will it affect the future of image-making? AIxD member Fabian Mosele, says:

It is making us think about our creative process in a different way – a way that is only possible because of these tools. Now is the time to dig deep and see what can be done.

FABIAN MOSELE, AI-PROMPT ENGINEER + 3D ANIMATOR , AIXD MEMBER 🤖

NOTABLE .. DEVELOPMENTS / CREATORS >>

Notable developments

  • We see AI-generated images as populating album covers and gallery spaces.

  • Filmmaker Cécile B. Evans’ piece, A Screen Test for an Adaptation of Giselle , weaves together different image media, like deep AI, 16mm, animation and VHS recordings to demonstrate how analogue and digital tools to can be used together to create moving art.

  • The Known_Ai Film Festival is the first of its kind to exclusively feature art films that have been created with AI.

  • AI is being used as a curator. In 2022, the Bucharest International Biennial of Contemporary Art will be curated by JARVIS, the first AI curator in history.

decroative corner decroative corner

BEHIND THE SCENES (CONNECTION), BY SEYHAN LEE

Take a look behind the scenes of "Connections", a film for European appliance brand Beko. Recipient of D&AD Wood Pencil (2021).

decroative corner decroative corner
decroative corner decroative corner

Take a look behind the scenes of "Connections", a film for European appliance brand Beko. Recipient of D&AD Wood Pencil (2021).

decroative corner decroative corner
decroative corner decroative corner

BORROWED LIMBS BY LISA MARLEEN MANTEL AND LAURA WAGNER

In this experimental film, the AI protagonist utilizes the human body as a sensing device to gain an embodied understanding of its environment. A result of consequent machine-human hybridization with AI as new species. The work, influenced by posthuman thinkers, was produced with several ML techniques into a coherent narrative.

decroative corner decroative corner
decroative corner decroative corner
Youtube video:

IDFA 2021 | FESTIVAL TRAILER, BY WE ARE PI

We Are Pi worked with installation artist collective Circus Family, using an AI parametric algorithm to scan the films' colour brightness and luminance, duration and location. The data was then translated into ink patterns with a specially constructed robot that released the ink patterns into a tank of water. The machine then created dynamic Rorschach Inkblots.

decroative corner decroative corner
decroative corner decroative corner

DALL·E 2022-06-29 10.18.34 | PROMPT: RENAISSANCE PAINTING OF AN ASIAN WOMAN WITH GREEN HAIR USING A VR HEADSET BY BLURBNATION

The Instagram channel @aie_aie_ai by community member Maria Than shows her trials and tribulations experimenting with DALL-E. Check out her IG account here & or read about more image-based experiments at Maria Tries to Understand.

decroative corner decroative corner
decroative corner decroative corner
Youtube video:

LESSONS FROM MY NIGHTMARES BY KIRA BURSKY

Made with Runway ML and After Effects, this surrealist short film follows the story of a girl haunted by nightmares. It is within these nightmares that the repressed parts of self can communicate with her. In the day she has a “projected self”. Only by expressing her many selves can she find peace of mind… and finally get some sleep.

decroative corner decroative corner
decroative corner decroative corner

REFLECTOR BY RNDR STUDIO

Design studio RNDR experimented with building an autonomous AI engine that arranges and edits film in continuous real time. Putting this computer program in the editor’s seat opens new doors for filmmaking.

decroative corner decroative corner
decroative corner decroative corner
Youtube video:

FICTIONING SYNTHETIC REALITY BY LENKA HAMOSOVA

Lenka Hámošová is a designer, researcher and visual artist who explores the future use of synthetic media generated by Artificial Intelligence in the context of the post-truth era. Her research is conducted primarily through artistic research and participatory workshop methods.

decroative corner decroative corner

DEEP (ML) DIVING WITH THE WHALES

AI_PLAYGROUND / IMAGE / TALK WITH WHALES FOR CLIMATE

As part of the AI Playground program, we hosted an artist talk with the Whales for Climate team in which they shared the process behind this project, from the conceptual phase and motivation to a detailed exploration of using ML and GAN for image-making. Through their project, we learned how narrative-building and visuals can help shine a light on the ongoing environmental crisis and educate about marine life.

The artists talked about the process of deciding which tech tool to use in the project. After a lot of thought, the team decided to use VQGAN+CLIP (a text-to-image model that generates images of variable size given a set of text prompts) as it was recently published and seemed like an interesting way to experiment with this new AI tool. VQGAN+CLIP is now so much more developed and refined as there was a huge leap in quality improvement in less than 6 months. This shows how rapidly this kind of technology develops.

decroative corner decroative corner
Youtube video:

decroative corner decroative corner
decroative corner decroative corner

“Imagining a whale under the water in a dreamy way”

decroative corner decroative corner

04_Proceed with Caution ⚠️

Bias

Artists are not only looking at AI to generate images, but also to address the impact of AI systems on society, the harms of algorithmic biases and its negative impact on social justice, equity, and inclusion. Many of these AI models are trained on images from across the interest, using the corresponding alt-text as its defacto image label. This leave these models vulnerable in two ways, as described below artist @kaliyuga_ai:

It is just an infinitely complex mirror held up to our society. It’s trained on images we deem worthy enough to post on the internet and the language we choose to describe them.
KALIYUNG, ARTIST, SOURCE: THE AI THAT CREATES ANY PICTURE YOU WANT, EXPLAINED, VOX

‘ImageNet Roulette’ is a project created by artist Trevor Paglen and researcher Kate Crawford in response to their concerns about the systemic biases in ImageNet (a free repository containing over 14 million images). These images were manually labelled as part of a Stanford University project to “map out the entire world of objects” and are widely used by researchers to train AI systems.

There is no easy technical ‘fix’ by shifting demographics, deleting offensive terms, or seeking equal representation by skin tone. The whole endeavor of collecting images, categorizing them, and labeling them is itself a form of politics, filled with questions about who gets to decide what images mean and what kinds of social and political work those representations perform.

— KATE CRAWFORD AND TREVOR PAGLAN , EXCAVATING AI: THE POLITICS OF TRAINING SETS FOR MACHINE LEARNING (SEPT 2019)

But because the images were labelled by humans, many of the labels are subjective and reflect the biases and politics of the individuals who created them. In their research, they racial bias, gender bias, and offensive stereotypes within the image labels, from racist slurs to misogynistic terms. Paglen and Crawford’s project went viral, leading to more than half of the 1.2 million pictures in the dataset’s ‘people’ category being erased.

Deepfakes

Deepfakes are AI-generated images or audio that replace the likeness of the original person in the image with someone else. We see deepfakes being used creatively seen in Kendrick Lamar’s music video The Heart Part 5, or when the Mona Lisa was bought to life by Samsung AI. While he European Film Market Horizon classified AI as a non-threat to creativity, it See an example of this type of deepfake below, published by Bloomberg Quicktake. also warned about its potential for misuse.

Deepfakes aren’t well-regulated, leaving people who are victims of deepfakes without the meaningful avenues of redress. Additionally, deepfakes can fuel disinformation by creating videos of famous people or politicians saying things they never said.

OWNERSHIP & COPYRIGHT

While there’s very little legal protection, there are a lot of concerns around copyright and creative ownership in regards to generative images. David O’Reilly summarizes it well in his recent Instagram post (below):

THE GOOD OLD D(AI)S: GENERATING MEMORIES THAT NEVER EXISTED

AI_PLAYGROUND / IMAGE / WORKSHOP WITH AARATI AKKAPEDDI

While photography, in essence, is captures what we see, GANs produce images that have photographic quality but are not photographic in nature. These images can fuel our creativity & imagination while also being used as tools of deception. AI Playground invited Aarti Akkapeddi to share her practice and lead a beginner’s workshop in generative image-making.

Thinking of AI, we are drawn to its potential when it comes to imagining our future. But in the creative uses of this technology, AI is as powerful to help us reminisce and create new memories and narratives of our past. In their work, interdisciplinary artist Aarati Akkapeddi does just that – using AI to work with the subjects of family, memory and childhood, the artist creates new memories and a space for reflection.

decroative corner decroative corner
Youtube video:

During this workshop, Aarati took us on an immersive and exploratory deep dive into working with AI and images. We understood how to combine AI and ML with our personal image archives and watch new memories emerge.

decroative corner decroative corner
decroative corner decroative corner

Questions such as ‘Does the machine understand the human face as an average of many faces? What does it mean to build a collage with AI? Can your photo gallery be used as a dataset? ‘ informed the development of the workshop. The very beginning of exploring AI as a creative tool is understanding the importance of datasets. Instead of struggling with “big data”, we learned how to build tiny image datasets, which led us on a journey of algorithm-based creative explorations.

decroative corner decroative corner

Memory is always an approximation rather than documentation. Through this approximation, it is fluid and subjective. Changes from generation to generation or even within one person's lifetime as you grow and your experiences influence how you remember and forget.

Aarti Akkapeddi, interdisciplinary artist

05_Tools & Resources

We agree with Lenka that public literacy of data and AI is an important part in ensuring these new and powerful tools are developed for the many and not the few. Please join us as we continue to learn tinker, and play!

Here’s a list with some of our favourite resources:

Additionally, we’re constantly curating resources & tools to help you explore how AI can augment your creative practice in our Resource Library.

The solution, for now, lies in supporting critical thinking, engaging in offline public discussion and most importantly – familiarizing oneself with the production tools of synthetic media.

06_Closing Remarks

One thing is certain: the future of imaging, photography and video will not be shaped solely by professionals working in those fields. Using the accessible tools mentioned before, anyone can experiment and create new artworks, whether they know how to code or not. As generative visuals are acknowledged as art, the border between fine arts and vernacular visual languages will become more and more blurred, making us rethink the definitions of art and visual culture.

Along these lines, there has been a rapid shift in how art is made and consumed with the emergence of technologies such as DALL-E and Midjourney. As we are able to quickly generate high-quality images from text prompts, our thinking is adapting to these new formats and our creativity is taking new forms.

For artists working in the field, these tools can become damaging to their industry on a larger scale. Some creatives have expressed their discouragement of the use of AI, considering the scenario where large corporations take advantage of the efficiency and quick turnaround of AI tools in comparison to commissioning artists. As art shouldn’t be a means to an end, we should strive to collectively build and use these tools as a way to empower creativity, instead of replacing the need for artists. Being an independent community of practice, we work to create a space for exploration, meaning that exploration consists both of joyful hands-on experiments, but also conversations and contemplating the infrastructure behind the tools we like to play with.