Video style transfer

You’ve almost certainly seen the neural style transfer technique used (or abused) around the internet this year; this is the deal where you extract the general visual style from one image (say, a famous painting) and apply it to another one (say, a photo of your sandwich) with results that are sometimes glitchy, other times jaw-dropping. (My favorite implementation is Pikazo, available for both iOS and Android.)

Manuel Ruder, Alexey Dosovitskiy, and Thomas Brox of the University of Freiburg recently introduced a new technique for video neural style transfer and released their code in a very approachable form () so I thought I’d give it a try.

Here is the great engraver Gustav Doré applied to Raiders of the Lost Ark:

And the pointillist Paul Signac:

For reference, here are the source style images: Doré (720×720), Signac (720×720)

And direct video links for closer inspection: Doré (13MB), Signac (8MB) 


Really, the main thing to do here is sign up for my email newsletter. I try to make it feel like a note from a friend, and it's very easy to unsubscribe. Plus, there are occasionally… secrets