This AI Tool Can Turn Regular Footage Into Almost-Perfect Slow-Mo

Share: 

A team of researchers has released a tool they call “Depth-Aware Video Frame Interpolation” or DAIN, which is capable of turning regular footage into “fragment less” slow-mo.

Photo by Markus Spiske from Pexels.

The team behind it combined scientists from Wenbo Bao of Shanghai Jiao Tong University and researchers from the University of California Merced as well as Google.

As the researchers explain in their abstract:

“Video frame interpolation aims to synthesize non-existent frames in-between the original frames. While significant advances have been made from the deep convolutional neural networks, the quality of interpolation is often reduced due to large object motion or occlusion. In this work, we propose to explicitly detect the occlusion by exploring the depth cue in frame interpolation. Specifically, we develop a depth-aware flow projection layer to synthesize intermediate flows that preferably sample closer objects than farther ones. In addition, we learn hierarchical features as the contextual information.”

In other words, their tool fills in the missing information using an array of datasets to make it natural looking.

The abstract continues:

“The proposed model then warps the input frames, depth maps, and contextual features based on the optical flow and local interpolation kernels for synthesizing the output frame. Our model is compact, efficient, and fully differentiable to optimize all the components. We conduct extensive experiments to analyze the effect of the depth-aware flow projection layer and hierarchical contextual features. Quantitative and qualitative results demonstrate that the proposed model performs favorably against state-of-the-art frame interpolation methods on a wide variety of datasets.”

You can watch a video explaining it here

And, in case you missed it, here's a recent article we posted about Microsoft's AI that detects edits in photos.

What do you think of this AI tool? Let us know your thoughts on this article in the comments section below if you like.

Don’t forget to check out our other photography news articles on Light Stalking by clicking here.

[PetaPixel]

What We Recommend to Improve Your Photography Fast

It's possible to get some pretty large improvements in your photography skills very fast be learning some fundamentals. Consider this the 80:20 rule of photography where 80% of the improvements will come from 20% of the learnable skills. Those fundamentals include camera craft, composition, understanding light and mastering post-production. Here are the premium guides we recommend.

  1. html cleaner  Easy DSLR –  Friend of Light Stalking, Ken Schultz has developed this course over several years and it still remains the single best source for mastering your camera by identifying the main things that are holding you back.
  2. Word to html  Understanding Composition – As one of the core elements of a good photograph, getting your head around composition is essential. Photzy's guide to the subject is an excellent introduction. Their follow-up on Advanced Composition is also well worth a read.
  3. Word to html  Understanding Light – Also by Photzy, the other essential part of photography is covered in this epic guide and followed up in Understanding Light, Part 2. This is fundamental stuff that every photographer should aim to master.
  4. Word to html  5 Minute Magic Lightroom Workflow – Understanding post production is one of the keys to photographs that you will be proud of. This short course by one of the best in the business will show you how an award-winning photographer does it.

About Author

Avatar

Kehl is our staff photography news writer and has over a decade of experience in online media and publishing and you can get to know him better here

Leave a Reply

Your email address will not be published. Required fields are marked *