The Checkpoint #6 – Scene-stealing blobs and glitchy symphonies
News & articles
Latent Princess Generator – Not just for princesses, this is a new general-purpose Clip-guided latent diffusion approach from @dango233 @multimodalart which produces excellent results.
Centipede Diffusion update – I've featured this notebook a lot, but it's just so good. Latest release sees a new UI for precisely selecting where to inpaint. Definitely worth checking out.
Thin-Plate Spline Motion Model for Image Animation – Cryptic name, but can transfer motion from a video to a still image startlingly well – Colab, Github, Paper
SymphonyNet – Generate symphonic soundtracks to compliment your AI movies. Pretty cool, though the results do get more mad as they progress.
Featured notebook – BlobGAN
Instead of generating an image as a whole, BlobGAN constructs scenes from depth-arranged 'blobs' of elements. The upshot is that by moving and resizing a blob, the network moves and resizes a wardrobe in your bedroom scene, for example.
The interface for editing blobs is tricky and the ability to upload custom scenes hasn't been released yet, but it works well as a first release. This kind of feature built into something like Photoshop would be huge.
Get it
Thanks for reading!
If you have anything you’d like to be featured or want to get in touch, give me a shout on Twitter or send an email. Please also consider supporting me on Patreon so that I can spend more time creating content like this.