Author Topic: Can somebody explain these strange process console statistics?  (Read 3918 times)

Offline Geoff

  • PixInsight Padawan
  • ****
  • Posts: 908
I've been looking at the ImageIntegration statistics provided in the process console and the results seemed unreasonable (v high SNR for example).  As a sanity check, I took three identical copies of an image and ran them through ImageIntegration.  The process console indicated a reference and median noise reduction of 1.15.  The integrated image and the original image were (as expected) identical.  So how can there be a noise reduction? Also, the claimed SNR is around 600--on a 10 minute sub!?
« Last Edit: 2016 January 14 22:30:32 by Geoff »
Don't panic! (Douglas Adams)
Astrobin page at http://www.astrobin.com/users/Geoff/
Webpage (under construction) http://geoffsastro.smugmug.com/

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: Can somebody explain these strange process console statistics?
« Reply #1 on: 2016 January 15 00:21:55 »
Hi Geoff,

The SNR estimate is computed as Equation 12 in ImageIntegration documentation. Note that this is not an estimate of SNR increment, which is what you probably expected here. This SNR estimate is given for informational purposes, although it is not a robust estimate for the reasons noted in the documentation, so it must be used with great care for comparisons.

The effective noise reduction estimate (ENR) is given by Equations 40 and 41. If you have selected the same exact image three or more times in ImageIntegration, the ENR estimate should be exactly one. I have just made a test and ENR = 1.0 as expected.

If you get an ENR estimate of 1.15, then there are different input images. Can you double check this?
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Geoff

  • PixInsight Padawan
  • ****
  • Posts: 908
Re: Can somebody explain these strange process console statistics?
« Reply #2 on: 2016 January 15 01:05:00 »
Hi Juan
I have just redone the test with a different file.  There is a similar anomaly, as the attached file shows.
Don't panic! (Douglas Adams)
Astrobin page at http://www.astrobin.com/users/Geoff/
Webpage (under construction) http://geoffsastro.smugmug.com/

Offline msmythers

  • PTeam Member
  • PixInsight Jedi
  • *****
  • Posts: 1178
    • astrobin
Re: Can somebody explain these strange process console statistics?
« Reply #3 on: 2016 January 15 01:34:43 »
Geoff

I tried with one of my DSLR frames and got the expected result. Have you tried clearing and purging the cache in the ImageIntegration preferences?


Mike

Offline Geoff

  • PixInsight Padawan
  • ****
  • Posts: 908
Re: Can somebody explain these strange process console statistics?
« Reply #4 on: 2016 January 15 15:05:25 »
Hi Mike.  I presume you mean unchecking the box that says "use file cache".  Yes I have tried this.
« Last Edit: 2016 January 15 15:20:27 by Geoff »
Don't panic! (Douglas Adams)
Astrobin page at http://www.astrobin.com/users/Geoff/
Webpage (under construction) http://geoffsastro.smugmug.com/

Offline Geoff

  • PixInsight Padawan
  • ****
  • Posts: 908
Re: Can somebody explain these strange process console statistics?
« Reply #5 on: 2016 January 15 15:13:58 »


The effective noise reduction estimate (ENR) is given by Equations 40 and 41. If you have selected the same exact image three or more times in ImageIntegration, the ENR estimate should be exactly one. I have just made a test and ENR = 1.0 as expected.

If you get an ENR estimate of 1.15, then there are different input images. Can you double check this?
Thanks Juan.  There is really something weird going on here.  If I take 3 copies of an uncalibrated image, I get the expected value of 1.0000.  If the same image is calibrated and three copies integrated I get a value of 1.0002. If the same image is calibrated and registered (against my best sub) I get a value of 1.14...

This occurs on two different computers, an Asus laptop running Win 7 with the penultimate version of PixInsight and a Dell desktop running Win 10 with the latest version of PixInsight.
Geoff
Don't panic! (Douglas Adams)
Astrobin page at http://www.astrobin.com/users/Geoff/
Webpage (under construction) http://geoffsastro.smugmug.com/

Offline msmythers

  • PTeam Member
  • PixInsight Jedi
  • *****
  • Posts: 1178
    • astrobin
Re: Can somebody explain these strange process console statistics?
« Reply #6 on: 2016 January 15 15:15:09 »
Geoff

I'm referring to the preferences for the tool, the little wrench icon.

Mike

Offline Geoff

  • PixInsight Padawan
  • ****
  • Posts: 908
Re: Can somebody explain these strange process console statistics?
« Reply #7 on: 2016 January 15 15:24:08 »
Thanks Mike.  Just tried that now.  Same result
Don't panic! (Douglas Adams)
Astrobin page at http://www.astrobin.com/users/Geoff/
Webpage (under construction) http://geoffsastro.smugmug.com/

Offline Geoff

  • PixInsight Padawan
  • ****
  • Posts: 908
Re: Can somebody explain these strange process console statistics?
« Reply #8 on: 2016 January 15 16:24:08 »
Here is he link to a file showing the anomalous behaviour (on my computers)
http://endor.uv.es/files/data/public/2f9832.php
Don't panic! (Douglas Adams)
Astrobin page at http://www.astrobin.com/users/Geoff/
Webpage (under construction) http://geoffsastro.smugmug.com/

Offline Geoff

  • PixInsight Padawan
  • ****
  • Posts: 908
Re: Can somebody explain these strange process console statistics?
« Reply #9 on: 2016 January 15 16:44:58 »
It seems that at some stage during calibration and registration, a noise value has been added in the file header.  This seems to be the case with both the BatchPreprocessing script and if it is done the long way.  Maybe using the same file causes a glitch.

Here are some figures:
Noise estimate in file header 1.5190e-4.  Noise estimate in process console1.3287e-4. So the "improvement" factor is 1.5190/1.3287=1.1432, exactly as reported on the console.
Geoff
« Last Edit: 2016 January 15 23:06:09 by Geoff »
Don't panic! (Douglas Adams)
Astrobin page at http://www.astrobin.com/users/Geoff/
Webpage (under construction) http://geoffsastro.smugmug.com/