Author Topic: TGVDenoise Example: Gamma Cygni Region  (Read 13818 times)

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
TGVDenoise Example: Gamma Cygni Region
« on: 2013 May 16 11:26:46 »
Philippe Bernhard has kindly uploaded a set of six linear images for us to test TGVDenoise out. In this first example I'm going to show how easily we can achieve a very good noise reduction when the data are excellent.

The original image is an integration of 20 light frames of the Gamma Cygni region:


The six images that Philippe has uploaded are of excellent quality, as you'll see in the next screenshots. This is the linear output of the ImageIntegration process, so we need ScreenTransferFunction (STF) in order to see the image on the screen. For newbie users, the STF tool in PixInsight applies a histogram transformation to the data that are sent to the screen, but does not change the actual image. This way we can work with linear images without stretching them. This is very important because data linearity is necessary for some essential image processing algorithms and techniques, such as color calibration, background modeling and deconvolution. There are also some tools that can be applied to both linear and nonlinear images, but perform much better with linear data.

For noise reduction of linear images, it is very important to carefully adjust STF settings, so that we can see the background, and at the same time, bright areas without saturation. Usually the automatic STF stretch is too aggressive for this purpose. The next screenshot shows the original image enlarged 4:1 with the custom STF that I've used in this example.


And without more preambles, this is the same area after TGVDenoise:


As you probably have already discovered if you have tried out this tool, the default TGVDenoise parameters have been optimized for nonlinear images. For linear images, the default parameters are way too aggressive, and usually have to be lowered by one order of magnitude or even more.

Something that will cause some surprise is the fact that I haven't used a local support in this example. This will give you a better idea of the power of TGVDenoise: For images with relatively high SNR, this tool is able to remove virtually all of the noise, preserving significant structures remarkably well without any help from external data.

Once you get some experience with the tool, finding the correct parameters becomes very easy, especially for high-quality data. It has taken me about five minutes to achieve the noise reduction that I was looking for with this image. I'll show you the result on two additional previews for comparison.

Original image:

After TGVDenoise:

Original image:

After TGVDenoise:

And as usual, some crops of special interest zoomed 3:1 (left: original image, right: after TGVDenoise).




Now this image can be printed at a size of 1 meter by 80 cm at 300 dpi without problems (about 40 x 30 inches), and navigating through it onscreen zoomed 4x is a real joy.

Thank you Philippe for allowing me to work with your nice data.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Nocturnal

  • PixInsight Jedi Council Member
  • *******
  • Posts: 2727
    • http://www.carpephoton.com
Re: TGVDenoise Example: Gamma Cygni Region
« Reply #1 on: 2013 May 16 11:34:03 »
Nice!
Best,

    Sander
---
Edge HD 1100
QHY-8 for imaging, IMG0H mono for guiding, video cameras for occulations
ASI224, QHY5L-IIc
HyperStar3
WO-M110ED+FR-III/TRF-2008
Takahashi EM-400
PIxInsight, DeepSkyStacker, PHD, Nebulosity

Offline Philippe B.

  • PixInsight Old Hand
  • ****
  • Posts: 399
    • CIEL AUSTRAL
Re: TGVDenoise Example: Gamma Cygni Region
« Reply #2 on: 2013 May 16 23:48:58 »
Hi Juan

not bad, not bad  :cheesy: :cheesy: :cheesy: :cheesy:

I tried yesterday with local support but didn't find something nice. So I come back without it.
I have worked on the importance of the couple "strength" + "edge", decrease one while increase other and I can see differences in rendition in the dark structures. but tends to get a "fuzzy" effect not really nice, whereas a completely smooth dark areas is not nice too !!!!  ???

Feel free to play with my images and post some examples (if you want, I have the rest of the serie because I gave you the less signal ones taken with S-II or O-III filter. My Ha layers are much better.

Thanks for this new function which will fill the next rainy week-end  :'(
Cheers
Philippe

 

Offline Philippe B.

  • PixInsight Old Hand
  • ****
  • Posts: 399
    • CIEL AUSTRAL
Re: TGVDenoise Example: Gamma Cygni Region
« Reply #3 on: 2013 May 17 00:49:37 »
me again

Some examples in 1:1 format

Original


Juan, with your settings, I got some "fuzzy" pattern in the darkest areas)


with 500 iterations, it is much better but smoother


with a mask (not a local support), it is less smoother and a very little noise is still there which is not bad at all


4 images Animated with 1s interval
 

Philippe

Offline Philippe B.

  • PixInsight Old Hand
  • ****
  • Posts: 399
    • CIEL AUSTRAL
Re: TGVDenoise Example: Gamma Cygni Region
« Reply #4 on: 2013 May 17 00:58:34 »
with 200% original and last one give :


Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: TGVDenoise Example: Gamma Cygni Region
« Reply #5 on: 2013 May 17 03:02:29 »
Hi Philippe,

For noise reduction of linear images, the STF is critical. In your tests, you've used a much more aggressive STF than the one I used in my example. It's not that your STF is incorrect, by no means; it's just that it reveals much more noise in low-SNR areas of the image, as a result of a stronger nonlinear stretch.

I have tried to emulate the STF you've used, and have repeated my example using it:


The image shown above represents a heavy nonlinear stretch that would require some dynamic range compression (IMO) with the HDRMultiscaleTransform tool.

On this screenshot you can also see the TGVDenoise parameters that I've used in this second example. This time I've enabled the local support, using the target image and the same midtones balance and shadows clipping point values that I have set for STF. In other words, the local support is just what you see on the screen.

Also note that I have decreased the smoothness parameter to 0.3. This has allowed me to control the degree of smoothness on low-SNR regions.

As for the number of iterations, beyond 200 iterations or so the results don't change visibly with these parameters, so the process converges quickly.

I think the results are very nice with this configuration. Here are three comparisons zoomed 2:1 without interpolation.




In my opinion, all of the nebular structures that can be seen on the denoised images over dark regions are real, in the sense that they have been recorded in your data set. The noise reduction process just makes them more visible, which is a very nice result. You can verify this visually by comparing the before and after crops.

As for mixing the original and denoised images with a mask, it's clearly an option, but I think it isn't necessary with advanced noise reduction algorithms such as MultiscaleMedianTransform and TGVDenoise. A drawback of reinserting some of the original noise in the denoised image is that it creates staircase artifacts, i.e. relatively hard transitions at the edges of low-SNR structures. Personally, I lost the need for comfort noise long time ago (that happens when you design noise reduction tools :) ), and definitely prefer smooth gradients.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Philippe B.

  • PixInsight Old Hand
  • ****
  • Posts: 399
    • CIEL AUSTRAL
Re: TGVDenoise Example: Gamma Cygni Region
« Reply #6 on: 2013 May 17 03:12:57 »
Juan, I like when you go deeper in your analysis  >:D >:D >:D >:D >:D
You see when you want !!!  :laugh: :laugh: :laugh:
I like your result too  :-*

Glad to see there can be a discussion on noise reduction technics and what is the final goal we want to achieve

For example, here, I wanted a hard result without increase the noise. So STF was very intensive, that's right !
I just got this result of the final image (reduced 50%)



« Last Edit: 2013 May 17 03:19:48 by Philippe B. »

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: TGVDenoise Example: Gamma Cygni Region
« Reply #7 on: 2013 May 17 04:07:32 »
Gorgeous image. Sorry, I couldn't resist  O:)



(disclaimer: I haven't paid attention to the stars, so the brightest ones are slightly concave)

It's nice to see how the same data can lead to different interpretations, different ways to understand the properties and limitations of the image with good analysis and processing tools, but always respecting the data. The people that paint their images (you know, brushes, pencils, 'selective sharpening' by hand and all that stuff) really don't know how much are those practices blocking their creativity.
« Last Edit: 2013 May 17 09:27:08 by Juan Conejero »
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline cs_pixinsight

  • PixInsight Addict
  • ***
  • Posts: 156
Re: TGVDenoise Example: Gamma Cygni Region
« Reply #8 on: 2013 May 21 11:21:04 »
Philippe, is there an issue with your website?  None of the images you post seem to show up, including your Avatar.  :sad:

Craig

Offline Nocturnal

  • PixInsight Jedi Council Member
  • *******
  • Posts: 2727
    • http://www.carpephoton.com
Re: TGVDenoise Example: Gamma Cygni Region
« Reply #9 on: 2013 May 21 12:01:25 »
All images on this page load fine here including Philippe's avatar.
Best,

    Sander
---
Edge HD 1100
QHY-8 for imaging, IMG0H mono for guiding, video cameras for occulations
ASI224, QHY5L-IIc
HyperStar3
WO-M110ED+FR-III/TRF-2008
Takahashi EM-400
PIxInsight, DeepSkyStacker, PHD, Nebulosity

Offline Philippe B.

  • PixInsight Old Hand
  • ****
  • Posts: 399
    • CIEL AUSTRAL
Re: TGVDenoise Example: Gamma Cygni Region
« Reply #10 on: 2013 May 21 23:50:37 »
It should work fine as right now
Maybe there was a shutdown during some minutes (it can happen sometimes)



Offline mads0100

  • PixInsight Addict
  • ***
  • Posts: 116
Re: TGVDenoise Example: Gamma Cygni Region
« Reply #11 on: 2013 June 05 18:56:21 »
So, I can use TGVDenoise to reduce noise prior to stretching the image?  Is that what you're all hinting at?

Offline Nocturnal

  • PixInsight Jedi Council Member
  • *******
  • Posts: 2727
    • http://www.carpephoton.com
Re: TGVDenoise Example: Gamma Cygni Region
« Reply #12 on: 2013 June 05 19:55:43 »
Well, by saying it works on linear images there is no hinting going on. It can't be more explicit and clear :)
Best,

    Sander
---
Edge HD 1100
QHY-8 for imaging, IMG0H mono for guiding, video cameras for occulations
ASI224, QHY5L-IIc
HyperStar3
WO-M110ED+FR-III/TRF-2008
Takahashi EM-400
PIxInsight, DeepSkyStacker, PHD, Nebulosity

Offline Philippe B.

  • PixInsight Old Hand
  • ****
  • Posts: 399
    • CIEL AUSTRAL
Re: TGVDenoise Example: Gamma Cygni Region
« Reply #13 on: 2013 June 05 23:31:12 »
TGV is the BEST denoising algorithm for LINEAR image !

What else ?