How to animate a painted 2D character with AI without losing its design
Painted characters are the hardest kind to animate with AI. Pixel art can hide a little inconsistency inside its chunky pixels. A soft painted crab with a carefully shaded shell cannot. Redraw it eight times and you get eight slightly different crabs.
We went looking for a way to keep a painted character exactly as it was designed while it walks, attacks and gets hit. This post is what we found, and how you can use it in your own game.
Three ways we tried, and how they did
On 6 November 2026 we put three painted characters (a crab, a hound and a knight) through three routes, for walks and attacks.
- Asking an image model for a sheet of poses. It repainted the character every frame. The shell pattern drifted, the colours shifted, and the knight's tabard changed design between steps.
- A free puppet with preset bodies. It works well for blobs, snakes and fliers, but none of its preset bodies fit the crab, so the crab came out wrong.
- Filming it. We gave a video model the one picture of the character standing on a flat green background and asked for the move. Then we cut the clip into frames, keyed out the green, and found the loop.
Filming won clearly. On 13 of 13 clips the character kept its design, and its average colour drifted under 3% across the clip. It also gets something the puppet cannot: weight. A hound's ears flop, a knight's cape lags behind.
What happens to a clip after it is filmed
A video model does not know it is making a game sprite, so the clip needs work before a game can play it.
- The background goes. The picture is placed on a key colour chosen away from its own palette: green usually, magenta for a green creature. The key and the colour it spills onto the edges are pulled off.
- The loop is found. For a walk, the cut looks for a stretch of at least a third of a second with real movement inside, trims the eased start and end, and makes sure the last frame flows back into the first.
- Every frame is laid in one cell at one scale, with the feet on the same ground line, so the character never jitters up and down between clips.
- It is checked for movement. A walk has to actually move, an attack has to move more, and an idle has to move a little but not too much, so a calm stance stays calm.
That last check matters more than it sounds. In a test platformer, the enemy was a jelly puddle. Its first walk came back looking almost frozen, on both tries. The check refused it as "barely moves" instead of putting a dead slime in the game. The builder reworded the ask as "squishing and stretching, wobbling", and the next take passed.
How it looks in a real game
In that same test, the hero was a painted cartoon hound in a side-view platformer. The whole game was built in under nine minutes and passed every check. The hound's sheet came out with four clips:
- a walk, 8 frames at 9 frames a second
- an attack, 12 frames
- an idle, 8 frames at a slow 6 a second
- a hit, 12 frames
The game plays the walk while the hound moves and the idle when it stops. Nobody drew a single frame.
Facing matters in top-down games
A side-view game needs one facing, because the character just flips to walk left. A top-down game needs three: walking toward you, away from you, and side on. An isometric game needs two. Early on, we filmed only the front, and a top-down knight walked north up the screen still showing her face. Now each view asks for the facings it needs, and if a sheet is missing one, the build report says so and how to finish it.
Tips for your own painted characters
- Start from a clean, whole picture. One character, standing, nothing cut off at the edges, on a plain background. What you get back can only be as good as the picture you start from.
- Describe the move with energy words. "Walks" gives you a walk. "Bounds forward with its ears flopping" gives you a character. For an attack, ask for a strong wind-up and a snappy hit.
- Say what kind of body it is. A crab scuttles sideways, a ghost drifts, a knight strides. The more the words say how it moves, the less the model has to guess.
- Keep heavy outlines and flat backgrounds out of the character picture. The cut finds the edge of the character, and a busy background makes that harder.
Where it lives in Tyrbo
On a game's Settings tab, the 2D animation row offers Video, which films every character from its picture, and Auto, which films anything that is not pixel art or a simple blob, serpent or flier. You do not need to do anything for a painted game on Auto; it is the route the builder already takes. If one clip comes out wrong, ask for that clip again in your own words.
If you are still choosing a look, the cartoon and hand-drawn style pages show the kind of painted characters this route was built for, and our wobble study explains why the other routes exist too.
Questions people ask
Can AI animate my own character drawing?
Yes. Tyrbo can film a character from one picture with a video model and turn the clip into a sprite sheet the game plays. In our tests the character kept its design on 13 of 13 clips, with its colours drifting under 3%.
Why not just ask an image model to draw every frame?
Because it redraws the character each time, so details shift and the animation shimmers. That can suit pixel art, where frame-by-frame drawing is part of the style, but it breaks a painted character’s design.
What moves can a filmed character have?
The usual set is idle, walk, attack, hit and defeat, with a jump for side views. Other moves can be asked by name, such as a run, a fly or a special attack.
What if a clip looks wrong?
Ask for that clip again and say what was off. A clip that barely moves is refused by the check before it reaches the game, and rewording the move with more energy usually fixes it on the next take.
Make the game this guide is about.
Make your gameSign in to get the plan and its concept art. Both are free.