Author Topic: New script for denoising linear monochannel images  (Read 89148 times)

Offline mschuster

  • PTeam Member
  • PixInsight Jedi
  • *****
  • Posts: 1087
Re: New script for denoising linear monochannel images
« Reply #180 on: 2019 November 29 15:56:11 »
still, it sounds like the median of the LN stack was for some reason abnormally low? i understand that Mure has problems with the low median but it seemed like you were saying the low median is in itself a problem.

I now think the low median is not itself a problem. It might remain a problem if LN gave a low median result for a high median reference, as that might indicate LN is not operating as we expect it should. But I am guessing that this did not happen, probably the LN reference had a low median.

For MureDenoise, the new metadata I am proposing will provide more info on what LN actually did. That will help a lot.

Offline mschuster

  • PTeam Member
  • PixInsight Jedi
  • *****
  • Posts: 1087
Re: New script for denoising linear monochannel images
« Reply #181 on: 2019 December 15 08:31:07 »
New version MureDenoise 1.26 should appear soon as an auto update. Change log:
  • Improved undo/redo/reset support when the denoising process is aborted.
  • Added support for interpolation method Lanczos-5.
  • Improved documentation and tooltips.
IMO one of the strengths of MureDenoise is that it has little if any impact on star FWHM and eccentricity. Here is data that shows an example of this. This test project consists of 28 3nm Ha frames, 18.7 hours, from my undersampled, portable setup. The table below shows median FWHM and eccentricity for the frames, the integration, the denoised result, and the final processed image.

ImageFWHM (pixels)    Eccentricity
28 frames0.94 +/- 0.020.40 +/- 0.01
Integration    1.060.43
Denoised1.050.43
Processed1.680.47

Offline Sedat

  • Member
  • *
  • Posts: 63
  • Newbie
Re: New script for denoising linear monochannel images
« Reply #182 on: 2019 December 15 22:06:20 »
Thanks for the update Mike. I look forward to it. I have never found a noticeable FWHM increase due to MureDenoise and your data confirms that.
Sedat

Offline Sedat

  • Member
  • *
  • Posts: 63
  • Newbie
Re: New script for denoising linear monochannel images
« Reply #183 on: 2019 December 17 23:31:38 »
Hello Mike,

Is it ok to use MD on stacked images even if they are LN'ed ? I will give it a try but wanted to have your word on the subject as well.

Thanks
Sedat

Offline mschuster

  • PTeam Member
  • PixInsight Jedi
  • *****
  • Posts: 1087
Re: New script for denoising linear monochannel images
« Reply #184 on: 2019 December 18 12:48:49 »
Hello Sedat,

It is OK to try, you might be able to get an acceptable result by adjusting Variance scale. But officially LN is not supported.

Work to support LN has started, but it is not yet complete. I need Juan's help to add additional metadata and he is very busy with other higher priority tasks.

Thanks,
Mike

Offline mschuster

  • PTeam Member
  • PixInsight Jedi
  • *****
  • Posts: 1087
Re: New script for denoising linear monochannel images
« Reply #185 on: 2019 December 23 18:07:56 »
Here are examples of the denoised results produced by the new option Include gradient classifier on several of my projects.

Notes:
  • Please widen your browser window enough so that the integrated and denoised crops appear side by side, left and right.
  • All crops shown with boosted stretch.
  • The integrations range from 12 to 20 hours, the frames are 40 minute, 3nm Ha, undersampled exposures. Each pair of crops is from a different integration.
  • In the dark nebula areas, about half of the total noise is measurement noise from the detector, the other half is photon counting noise.
  • The images were denoised with Variance scale set to the default of one.
  • Safari on my Retina 5k monitor smooths the displayed images slightly, the visual differences between the crops are larger when viewed from within PixInsight.

 

 

 

 

 

Offline Sedat

  • Member
  • *
  • Posts: 63
  • Newbie
Re: New script for denoising linear monochannel images
« Reply #186 on: 2019 December 23 22:54:13 »
Looks great to me! Thanks!

Can you please broadly tell what this new parameter does actually ?
Sedat

Offline mschuster

  • PTeam Member
  • PixInsight Jedi
  • *****
  • Posts: 1087
Re: New script for denoising linear monochannel images
« Reply #187 on: 2019 December 24 17:42:21 »
Looks great to me! Thanks!

Can you please broadly tell what this new parameter does actually ?

Thank you Sedat.

The Include gradient classifier option increases denoising accuracy by incorporating additional local gradient magnitude (ie, local intensity change) information into the denoising process.

Local regions of the image at each multiresolution scale are classified by the value of the local Gradient squared magnitude estimate to local Noise variance estimate Ratio (GNR).

This classification helps the denoising process to better optimize the compromise between noise suppression and signal preservation. Generally at each scale, local regions with small GNR have improved noise suppression while local regions with large GNR have improved signal preservation.

The improved denoising accuracy comes at a cost of 50% more processing time.

Offline Sedat

  • Member
  • *
  • Posts: 63
  • Newbie
Re: New script for denoising linear monochannel images
« Reply #188 on: 2019 December 25 03:22:53 »
Thank you Mike.

The increase in processing time is a small price to pay if the result justifies the time spent and looking at your above images this looks to be the case.

What cycle-spin count are you using ? Is the default 8 enough for most of the cases ? I noticed that you increased the max count to 48 recently and thought there must be a reason for this.
Sedat

Offline mschuster

  • PTeam Member
  • PixInsight Jedi
  • *****
  • Posts: 1087
Re: New script for denoising linear monochannel images
« Reply #189 on: 2019 December 25 16:13:42 »
Thank you Mike.

The increase in processing time is a small price to pay if the result justifies the time spent and looking at your above images this looks to be the case.

What cycle-spin count are you using ? Is the default 8 enough for most of the cases ? I noticed that you increased the max count to 48 recently and thought there must be a reason for this.

On these examples I used 32. The change from 8 to 32 is measurable as a pixelwise difference, but hard to see, if at all. 48 is for testing.
« Last Edit: 2019 December 25 17:51:10 by mschuster »

Offline Sedat

  • Member
  • *
  • Posts: 63
  • Newbie
Re: New script for denoising linear monochannel images
« Reply #190 on: 2019 December 26 04:09:28 »
Noted with thanks!

Happy holidays!
Sedat

Offline niccoc1603

  • Newcomer
  • Posts: 42
Re: New script for denoising linear monochannel images
« Reply #191 on: 2020 January 07 15:02:10 »
Hi I am curious to try this script. For gain and noise input parameters should I use the detectorparameterscript that comes with the main script? Should the two flats and darks have same exposure/gain/offset? Also is the output from the script ready for the MURE even though the camera (ASI1600) has a 12bit ADC? Thank you

Offline mschuster

  • PTeam Member
  • PixInsight Jedi
  • *****
  • Posts: 1087
Re: New script for denoising linear monochannel images
« Reply #192 on: 2020 January 07 17:27:59 »
Hi I am curious to try this script. For gain and noise input parameters should I use the detectorparameterscript that comes with the main script? Should the two flats and darks have same exposure/gain/offset? Also is the output from the script ready for the MURE even though the camera (ASI1600) has a 12bit ADC? Thank you

Yes, use the detector setting script, and all frames should have the same camera settings, with exposures the same for each pair of frames. 12bit works. Some frame capture software scales up 12bit to 16bit, other software does not. Either works, but all frames should be captured the same way.

Offline niccoc1603

  • Newcomer
  • Posts: 42
Re: New script for denoising linear monochannel images
« Reply #193 on: 2020 January 07 22:43:03 »
Thank you. ZWO drivers scale up the images to 16bit. Soif I understand correctly I just input the two darks and two flats in the detector settings script and use the calculated values as input for the MURE script.
One more question, what about interpolation? I always leave it to Auto for image registration.

Offline mschuster

  • PTeam Member
  • PixInsight Jedi
  • *****
  • Posts: 1087
Re: New script for denoising linear monochannel images
« Reply #194 on: 2020 January 08 17:06:41 »
One more question, what about interpolation? I always leave it to Auto for image registration.

Auto uses Lanczos-3, assuming all frames have the same pixel resolution (the script won't work if frame resolutions differ). You can double check the method choice by running a couple of frames in StarAlignment and looking in the process log.