~ajroach42.com

I'm Andrew. I write about the past and future of tech, music, media, culture, art, and activism. This is my blog.

DeOldify - Automatically colorizing videos

Posted: November 9, 2020

Whew, what a year! I bought a computer in March with the intent of using it to do some video processing and film preservation work. Then … well, this year happened. Last night, I finally finished setting it up, and I now have a great video editing rig (well, aside from the slow hdd, but we’ll deal with that next week), and I’ve started playing with some automated post-processing. Today, I’d like to show you DeOldify.

First, DeOldify is designed for still images, and it does a great job there most of the time.

Have some still images:

Before

After

Before

After

Before

Enhanced_photo (1).jpg

Enhanced_photo (5).jpg

There are better examples of the DeOldify github page, and on MyHeritage (which uses a new version of the same algorithms), but you get the idea.

I will point out that these colors are mostly Wrong. the Space Patrol uniforms should be red and green. I don’t mind this, but it might bother other folks.

It works for video. Jantic posted some GIFs of video frames with some promising results.

I decided to throw it at one of the worst videos in my collection, a low resolution, low contrast, noisy episode of Space Patrol.

The original:

The color:

Some scenes from the colorized version look great! Some of them are flickery, messy, and ugly! There are lots of adjustments I can make on the front end to clean up the video and make it easier for deoldify to do it’s work, and there are some tweaks I can do within DeOldify that might improve things too.

So far, I’m tennatively hopeful.

I’ll have more to say about the process, why I’m doing this, and what further results I’m able to achieve in subsequent posts. Look for them in the coming weeks.

Have you done any video processing with ML? I’d love to hear about it.


If you enjoyed this post, please consider signing up for my newsletter. or following me on Mastodon.