Saturday, March 7, 2020

Colorizing and upscaling video, all done with AI

Original movie:
Colorized and upscaled version:


"we expect that the frame interpolation and upscaling were done [using artificial intelligence to get] to 4K and 60fps [then used a] Neural Network to automatically colorize the footage."
 
"...the results are once again surprisingly good—as long as you don't punch in too close. The biggest disappointment is probably the colorizing, which is okay for some parts and abysmal for others.

Still, the fact that all of this was automatically, and produced such a surprisingly watchable result—creating frames, resolution, and color out of thin air—is mind-blowing in and of itself."

https://petapixel.com/2020/02/24/using-ai-to-colorize-and-upscale-a-109-year-old-video-of-new-york-city-to-4k-and-60fps/

Here's an opinion from a trained museum conservator:

... from a conservator point of view , I guess I would just say that so long as they're making a copy of the original and changing the copy and keeping the original untouched, then that is fine. 

Conservators don't like to introduce new material into an original and if they do, for example, if they do an infill and an inpainting on a painting, for example, they make it clear what is new material and what is old material, and the new material, for the most part should be removable/reversible, so that the old original material remains preserved. 





No comments:

Post a Comment

Search This Blog

Followers