Adobe’s impressive AI upscaling project makes blurry videos look HD
Adobe researchers have developed a new generative AI model called VideoGigaGAN that can upscale blurry videos at up to eight times their original resolution. Introduced in a paper published on April 18th, Adobe claims VideoGigaGAN is superior to other Video Super Resolution (VSR) methods as it can provide more fine-grained details without introducing any “AI weirdness” to the footage.
In a nutshell, Generative Adversarial Networks (GANs) are effective for upscaling still images to a higher resolution, but struggle to do the same for video without introducing flickering and other unwanted artifacts. Other upscaling methods can avoid this, but the results aren’t as sharp or detailed. VideoGigaGAN aims to provide the best of both worlds — the higher image/video quality of GAN models, with fewer flickering or distortion issues across output frames. The company has provided several examples here that show its work in full resolution.
Some of the finer details in the demo clips Adobe provided appear to be entirely artificial, such as the skin texture and creases in the below example, but the results appear impressively natural. It would be difficult to tell that generative AI was used to improve the resolution, which could extend the “what is a photo” debate to include video.
This is only a research preview, so there’s no guarantee that Adobe will make VideoGigaGAN available to consumers via Creative Cloud software like Premiere Pro. The company previously previewed a separate diffusion-based upsampling experiment, Project Res-Up, during its MAX event in October 2023, which similarly improves the quality of low-resolution GIFs and video footage. And Adobe isn’t alone in this work, as both Microsoft and Nvidia have also developed their own VSR upscaling technology.
Adobe researchers have developed a new generative AI model called VideoGigaGAN that can upscale blurry videos at up to eight times their original resolution. Introduced in a paper published on April 18th, Adobe claims VideoGigaGAN is superior to other Video Super Resolution (VSR) methods as it can provide more fine-grained…
Recent Posts
- Quordle today – hints and answers for Monday, May 6 (game #833)
- NYT Strands today — hints, answers and spangram for Monday, May 6 (game #64)
- Randy Travis gets his voice back in a new Warner AI music experiment
- Jack Dorsey says he’s no longer on Bluesky’s board
- 4 movies new to Hulu with over 90% on Rotten Tomatoes
Archives
- May 2024
- April 2024
- March 2024
- February 2024
- January 2024
- December 2023
- November 2023
- October 2023
- September 2023
- August 2023
- July 2023
- June 2023
- May 2023
- April 2023
- March 2023
- February 2023
- January 2023
- December 2022
- November 2022
- October 2022
- September 2022
- August 2022
- July 2022
- June 2022
- May 2022
- April 2022
- March 2022
- February 2022
- January 2022
- December 2021
- November 2021
- October 2021
- September 2021
- August 2021
- July 2021
- June 2021
- May 2021
- April 2021
- March 2021
- February 2021
- January 2021
- December 2020
- November 2020
- October 2020
- September 2020
- August 2020
- July 2020
- June 2020
- May 2020
- April 2020
- March 2020
- February 2020
- January 2020
- December 2019
- November 2019
- December 2011