DALLE 2 & 3 character design experiments
Research of cartoon character designs within DALLE 2, experimental DALLE 2 and DALLE 3.
2022-23
AI generative models are trained on big datasets of existing content, many of which contain intellectual properties of movies and series we love and watch.
DALLE 2 is an interesting case study for character design because it creates recognizable images yet different altered versions.
Only the most famous brands achieve high iconic similarity to the original character. While DALLE knows very well how Minions, Hello Kitty or Homer Simpson look like, it becomes more blurry when it comes to Gru, Badtz-Maru or Marge Simpson. The less famous the character is, the less likely DALLE will create an exact copy.
As in the case of Squidwards, the iconicity of the character is often mixed with more squid-based figures in DALLE 2. Yoshi, on the other hand, does not share much of the original design and only keeps the generic idea of a green dinosaur-like character. However both characters gain iconicity in experimental DALLE 2.
DALLE 3 seems to have learned to be more faithful to the iconicity of known character designs, yet it’s still flexible when prompted with less known or multiple characters.
A particularly flexible prompt is Teletubbies, from which DALLE makes different colored characters with bizarre designs. This brand of characters is quite versatile, because it lets create generic colored figures, giving more space to DALLE’s interpretation.
When it comes to non-existing characters, it can bring to life somewhat similar designs from the same name. It is hard to have consistent character designs, but it often shares a certain style in the different variants. It surprisingly mirrors the vibe of the name to the character.
Character design remains more consistent though, when they share the same prompt. The moment the prompt is slightly changed, the designs can vary a lot, further distancing from the other designs.
DALLE 3 has famously been the first image model able to create proper comics. While misspellings and narrative holes are often present, they are enough coherent to create a characterizing absurd AI humor.
Using DALLE 3, it is easy to spot various characters from movie studios, Buzz Lightyear for Pixar and Iron Man for Disney. But what’s worth noticing are the characters that do not exist, the one that only lives in latent space and can somehow distill the style of a movie studio.
And to conclude, here are some Wimmelbilder full of generated characters, as it is a very reliable tool for such big scale projects.