The rapid ascendancy of Artificial Intelligence stands as the defining cultural and technological shift of our era. For the creative industries, this evolution has been met with a mixture of profound skepticism and guarded optimism. At PRINT, our mission has always been the preservation and elevation of human-centric artistry. Consequently, when news broke of animator Connie He’s latest project, Dear Upstairs Neighbors—a film developed in collaboration with Google DeepMind to fuse traditional acrylic painting with cutting-edge machine learning—it arrived with the weight of both controversy and promise.

Could a project so deeply rooted in the analog traditions of fine art truly coexist with the algorithmic nature of AI? As Dear Upstairs Neighbors made its high-profile debut at the Tribeca Film Festival, it became clear that He hasn’t just participated in the AI conversation; she has fundamentally altered it. By eschewing the "text-to-video" shortcuts that have drawn ire from the creative community, He has utilized AI as a bespoke instrument, proving that technology, when wielded with intention, can amplify human vision rather than replace it.

Connie He Creates a New Animation Language with AI – PRINT Magazine

The Genesis of an Urban Symphony

The seeds for Dear Upstairs Neighbors were sown during the isolation of the COVID-19 pandemic. Like millions worldwide, He found herself confined to an apartment, where the mundane realities of vertical living—the rhythmic thud of a neighbor’s jumping rope, the relentless clatter of stilettos at 5:00 AM, and the incessant drone of construction—became an unintended, visceral soundtrack to her life.

"It was a little bit of therapy for myself," He reflects. What began as a personal catharsis evolved into a complex, year-and-a-half-long labor of love. The project required 27 distinct iterations, a rigorous process of polishing the narrative arc through constant feedback and refinement. While the film is devoid of dialogue, it possesses a sophisticated emotional resonance, relying on pure visual storytelling to capture the frustration, absurdity, and eventual acceptance of living in a shared, noisy environment.

Connie He Creates a New Animation Language with AI – PRINT Magazine

Chronology: From Pixar Roots to DeepMind Collaboration

Connie He’s professional pedigree—including a tenure at Pixar—provided the technical foundation necessary to navigate this experimental project. By 2023, as the capabilities of generative AI began to surface, He and her producer, Marcia, recognized a unique opportunity. Rather than watching from the sidelines, they chose to engage with the technology directly.

"Nobody really knew what AI was, what to do with it, or what it could actually achieve," He explains. "We decided the best way to figure it out was to build a project specifically to test the boundaries of these tools."

Connie He Creates a New Animation Language with AI – PRINT Magazine

The collaboration with Google DeepMind was not a standard vendor-client relationship but a deep, research-driven partnership. He brought a clear creative mandate: she wanted the film to look like a living, breathing acrylic painting. Because existing video-to-video pipelines were insufficient for her vision, she and the Google engineering team had to essentially invent the necessary workflows. This involved fine-tuning custom models—specifically leveraging LoRA (Low-Rank Adaptation) to ensure that the AI adhered strictly to her own hand-painted aesthetic rather than defaulting to generic, synthetic outputs.

Technical Methodology: Beyond the Prompt

The production of Dear Upstairs Neighbors followed a hybrid workflow that respected traditional animation hierarchies while integrating high-tech innovation:

Connie He Creates a New Animation Language with AI – PRINT Magazine
  1. Pre-Production (The Human Touch): All storyboards, character designs, and concept art were created manually by He and collaborator Yingzong Xin. This ensured the film’s "soul" remained firmly in human hands.
  2. Animation Performance: The project utilized traditional 2D and 3D animators for character performance. He emphasizes that the standard for animation quality remained high because "no amount of AI can replace the human understanding of acting and timing."
  3. The "Video-to-Video" Pipeline: Unlike text-to-video models, which generate imagery from simple prompts, He’s process involved feeding her own animation into a model trained on her physical acrylic paintings. The AI functioned as a digital brush, applying the textures and light of her physical canvases onto the movement created by her team.
  4. The Third Act Transformation: The film’s final act features a distinct, highly saturated, and fluid "painterly" sequence that pushed the AI’s capabilities to their limit, achieving a visual depth that would have been prohibitively time-consuming using traditional frame-by-frame painting.

The Role of Sound as a Narrative Anchor

Music in Dear Upstairs Neighbors serves as more than an accompaniment; it is a primary character. Scored by Yung Spielberg, the soundtrack’s high-octane energy dictated the visual pacing.

"Since nobody had done anything similar to this style, it was hard to find visual references," He notes. "But listening to the first demo from Yung, I could suddenly see the colors in my head. That inspired the entire look of the third act." This symbiotic relationship—where the audio informs the visual, and the visual informs the technical pipeline—highlights the collaborative potential of modern, tech-enabled filmmaking.

Connie He Creates a New Animation Language with AI – PRINT Magazine

Implications for the Future of Creative Work

The industry is currently grappling with a "fear versus utility" paradox. When asked if the rise of AI scared her, He admits to a feeling of initial professional challenge. "All of a sudden, you can type something and create something. What does that mean for us as artists? My motivation was to find out if we could use these tools to explore things that were previously impossible."

He points to the issue of iteration. In traditional animation, making a single change to a sequence can take weeks of work. In her new hybrid workflow, the ability to iterate allows for a higher level of creative experimentation. "These tools give artists the control they want, while allowing them to pursue styles that were previously hard to achieve," she says.

Connie He Creates a New Animation Language with AI – PRINT Magazine

The success of Dear Upstairs Neighbors suggests a potential "art renaissance" for video. For decades, the medium has been largely bifurcated between live-action and traditional computer-generated imagery. He’s work invites a third category: a painterly, expressive, and highly personalized form of digital cinema that bridges the gap between the museum and the theater.

A Legacy of Craft

Perhaps the most poignant moment of the project’s validation came from He’s parents, who are themselves lifelong, "old-school" painters.

Connie He Creates a New Animation Language with AI – PRINT Magazine

"Their minds were blown," He says. "My dad told me, ‘This is so different from my art, but you found your own voice.’" This affirmation from the previous generation of artists is critical. It underscores that while the tools of the trade may evolve—from brush and canvas to neural networks and render farms—the core pursuit remains the same: the expression of a unique human perspective.

Conclusion: The Responsible Path Forward

Connie He’s leadership of a 45-person crew, including veterans from Pixar and beyond, demonstrates that AI, when utilized as a tool rather than a replacement, requires more expertise, not less. It demands a deep understanding of art history, timing, color theory, and narrative structure.

Connie He Creates a New Animation Language with AI – PRINT Magazine

As we look toward the future of creative industries, Dear Upstairs Neighbors stands as a blueprint for responsible innovation. It is a reminder that the value of art does not lie in the method of its production, but in the vision of the artist. By anchoring AI in the tactile reality of acrylic on paper, He has ensured that the "human" remains the protagonist of her story, while the technology serves merely as a brilliant, powerful supporting character. The film is not just a triumph of animation; it is a testament to the resilience of the human creative spirit in the face of an uncertain technological future.

Leave a Reply

Your email address will not be published. Required fields are marked *