This AI Transforms Sketches Into Landscape Photos


NVIDIA is really at the forefront of developing next-gen artificial intelligence technology. Given its huge presence in video games, among other industries, that's really no surprise.

At NVIDIA GTC 2019, the company unveiled a Microsoft Paint-like application called GauGAN that uses generative adversarial networks to transform your simple paint sketch into a realistic-looking photo.

Image via NVIDIA

There are three basic tools that users can use in order to paint, including a paint bucket, pen, and a pencil. Using these tools in coordination with presets such as snow, water, and road, GauGAN can interpret user input but doesn’t rely upon “image stamps” as TechCrunch points out – everything it generates is unique to that particular picture.

Further, GauGAN interprets the same input in a unique way each in and every time. This what TechCrunch calls “multimodal” and the result is a wealth of unique content from one program.

What NVIDIA showed off was occurring in real time and took a lot of computing power to accomplish. Even then, the results weren’t perfect but “good enough” to pass as photo realistic upon first glance.

Interestingly, NVIDIA used Flickr to train the neural network powering GauGAN. For those of you who read our article about Flickr and Creative Commons rights, you’ll know this probably raised a few eyebrows (you can read that article here to find out why).

To calm any fears, Bryan Catanzaro, NVIDIA’s VP of Applied Deep Learning Research, said that all of the images they used were used with permission.

The company hopes to have it available for their AI Playground but wasn’t specific on a timeline for that. There are no plans to commercialize the software but TechCrunch says that a public trial could happen in the future.

If you’d like to learn more about the GauGAN project, you can watch a video about it here on YouTube.

What We Recommend to Improve Your Photography Fast

It's possible to get some pretty large improvements in your photography skills very fast be learning some fundamentals. Consider this the 80:20 rule of photography where 80% of the improvements will come from 20% of the learnable skills. Those fundamentals include camera craft, composition, understanding light and mastering post-production. Here are the premium guides we recommend.

  1. html cleaner  Easy DSLR –  Friend of Light Stalking, Ken Schultz has developed this course over several years and it still remains the single best source for mastering your camera by identifying the main things that are holding you back.
  2. Word to html  Understanding Composition – As one of the core elements of a good photograph, getting your head around composition is essential. Photzy's guide to the subject is an excellent introduction. Their follow-up on Advanced Composition is also well worth a read.
  3. Word to html  Understanding Light – Also by Photzy, the other essential part of photography is covered in this epic guide and followed up in Understanding Light, Part 2. This is fundamental stuff that every photographer should aim to master.
  4. Word to html  5 Minute Magic Lightroom Workflow – Understanding post production is one of the keys to photographs that you will be proud of. This short course by one of the best in the business will show you how an award-winning photographer does it.

About Author


Kehl is our staff photography news writer and has over a decade of experience in online media and publishing and you can get to know him better here

Leave a Reply

Your email address will not be published. Required fields are marked *