Forgot Password
Pentax Camera Forums Home
 

Reply
Show Printable Version Search this Thread
6 Days Ago - 3 Likes   #1
Site Supporter
Site Supporter




Join Date: Aug 2013
Location: Brisbane, QLD
Photos: Gallery | Albums
Posts: 1,806
NVIDIA uses AI to remove noise and watermarks

This is well worth a read and the 1:20s to watch the video: AI Can Now Fix Your Grainy Photos by Only Looking at Grainy Photos - NVIDIA Developer News CenterNVIDIA Developer News Center


I wonder when the benefits of this research will end up in something we can access? For removing noise only is what I'm thinking, but we all know what the less than savoury types will be doing.


Tas

6 Days Ago   #2
Senior Moderator
Loyal Site Supporter
Loyal Site Supporter
BigMackCam's Avatar

Join Date: Mar 2010
Location: Durham, England
Posts: 9,089
Fascinating - thanks for posting the link!

Like you, I'd be very interested in the noise reduction aspect.

If it really works as well as the examples suggest, I can see software providers and camera companies being very interested in that technology...
6 Days Ago   #3
Site Supporter
Site Supporter
savoche's Avatar

Join Date: Jun 2011
Location: Lowlands of Norway
Posts: 10,719
One of many areas where I think machine learning will change things quite a bit in the time to come. We're just starting to see what's possible.

Thanks for the link!
6 Days Ago - 1 Like   #4
Site Supporter
Site Supporter
Dartmoor Dave's Avatar

Join Date: Aug 2012
Location: Dartmoor, UK
Photos: Albums
Posts: 1,298
Amazing technology that would be a big help for those times when you really need a clean image in lower light than your sensor can handle.

But what I really wish is that camera makers would start working on improving the quality of noise rather than just reducing the quantity. There was a time when photographers would push films like Tri-X for no other reason than that they wanted to use the resulting grain as an expressive tool, and the results could be beautiful. If only there was some way to make digital sensors give a nice moody, grainy look when pushed instead of just horrible noise. I know you can add film grain in PP if you're that way inclined, but I've never managed to get a look that I really liked from doing that.

As for being able to remove watermarks. No. Just no.

6 Days Ago - 1 Like   #5
mee
Pentaxian




Join Date: May 2010
Posts: 6,355
QuoteOriginally posted by BigMackCam Quote
Fascinating - thanks for posting the link!

Like you, I'd be very interested in the noise reduction aspect.

If it really works as well as the examples suggest, I can see software providers and camera companies being very interested in that technology...
From the source page, it requires multiple Tesla P100 on at least a desktop PC if not in a rack. That is a huge power draw (and expensive all around). So I think it is more just a means to market (and sell) their hardware... for now.


The result is still rather smeary yet interesting for such a noisy source. Perhaps this has more likelihood of being adopted in high-dollar business use than consumer products? I think so. That said as savoche says, this is just the start.


Which makes me wonder when we will no longer use photographic or video evidence as proof of something because it will become too easy to fake? We can strip complex watermarks, rebuild data in images that is missing, denoise heavily noisy images so how long before we can just replace people realistically in image and video? We're really close... really really close.


This seems cool to the photog because it means theoretically more capability in getting shots or restoring old ones. But I'm more concerned long term for society that has far greater technology than it has morality..


Think of AI/machine learning crafting believable video of politician making shady deals that never actually happened... people involved in illicit relationships that never happened. Adobe is working on this already (along with Nvidia) with the ability to swap faces of anyone on video. It is pretty incredible.
6 Days Ago - 1 Like   #6
Site Supporter
Site Supporter




Join Date: Mar 2017
Photos: Albums
Posts: 158
I had wondered if a simpler version of this is what is being done in the K-1 Mk2.
Nvidia is known for making graphics accelerator chips. Which, it turns out, are extremely good at certain kinds of AI tasks, as can be seen in the link.

Pentax has branded the new chip as an "accelerator chip" and it's doing some noise reduction so it seems to me not a bad connection to make.

As for the watermarks, someone skilled with PS can get rid of those already. Unfortunately, AI tech will make it easier. Probably no way around this particular march of technology. Ultimately I suspect we'll need to have some kind of non-visible encrypted signature or blockchain link to prove creation and ownership over images and video.
5 Days Ago - 1 Like   #7
Pentaxian
Not a Number's Avatar

Join Date: Mar 2012
Location: Venice, CA
Posts: 4,964
Does it eat stars? {snicker}
5 Days Ago - 1 Like   #8
Pentaxian




Join Date: Jun 2015
Location: South West UK
Photos: Albums
Posts: 923
QuoteOriginally posted by mee Quote
From the source page, it requires multiple Tesla P100 on at least a desktop PC if not in a rack. That is a huge power draw (and expensive all around). So I think it is more just a means to market (and sell) their hardware... for now.
Or to sell the technology to Adobe, who will run it on their servers for processing their users' images in the cloud.

5 Days Ago   #9
Senior Member
krre23's Avatar

Join Date: Apr 2015
Location: Caracas
Photos: Gallery
Posts: 224
Interesting

Thanks for sharing
5 Days Ago - 1 Like   #10
Loyal Site Supporter
Loyal Site Supporter
Mikesul's Avatar

Join Date: Sep 2009
Location: Phoenix, AZ
Posts: 4,259
This seems a long way from practical in camera implementation.
5 Days Ago - 1 Like   #11
Pentaxian




Join Date: Jun 2015
Location: South West UK
Photos: Albums
Posts: 923
QuoteOriginally posted by Mikesul Quote
This seems a long way from practical in camera implementation.
It's a long way from home computer implementation too - it needs some significant power. The best likelihood is for cloud computing...upload image, wait, download finished product...which could be in-camera using wi-fi or 4G to send and receive, but probably easiest with a cloud-enabled PP app, or an online service.
5 Days Ago   #12
Loyal Site Supporter
Loyal Site Supporter
Mikesul's Avatar

Join Date: Sep 2009
Location: Phoenix, AZ
Posts: 4,259
QuoteOriginally posted by victormeldrew Quote
It's a long way from home computer implementation too - it needs some significant power. The best likelihood is for cloud computing...upload image, wait, download finished product...which could be in-camera using wi-fi or 4G to send and receive, but probably easiest with a cloud-enabled PP app, or an online service.
I imagine some would be interested in such a service but i am unimpressed with the need.
Reply

Bookmarks
  • Submit Thread to Facebook Facebook
  • Submit Thread to Twitter Twitter
  • Submit Thread to Digg Digg
Tags - Make this thread easier to find by adding keywords to it!
developer, noise, nvidia, photography, photos, photoshop
Thread Tools Search this Thread
Search this Thread:

Advanced Search


Similar Threads
Thread Thread Starter Forum Replies Last Post
Research at NVIDIA: AI Reconstructs Photos with Realistic Results interested_observer Digital Processing, Software, and Printing 1 04-23-2018 05:21 PM
Google shows how easy it is for software to remove watermarks from photos Tas Digital Processing, Software, and Printing 20 03-14-2018 04:42 AM
Eye-Fi Pro to Nvidia Shield tablet for Photoshop Processing Rai93 Digital Processing, Software, and Printing 5 03-04-2016 03:22 AM
Can Nikon Ai and/or non Ai lenses be adapted to work on the K mount? Vantage-Point Non-Pentax Cameras: Canon, Nikon, etc. 3 07-28-2013 08:25 PM
How do you remove the dust that cannot be remove by the blower? rustynail925 Pentax DSLR Discussion 3 07-31-2010 10:39 AM



All times are GMT -7. The time now is 06:43 AM. | See also: NikonForums.com, CanonForums.com part of our network of photo forums!
  • Red (Default)
  • Green
  • Gray
  • Dark
  • Dark Yellow
  • Dark Blue
  • Old Red
  • Old Green
  • Old Gray
  • Dial-Up Style
Hello! It's great to see you back on the forum! Have you considered joining the community?
register
Creating a FREE ACCOUNT takes under a minute, removes ads, and lets you post! [Dismiss]
Top