Author Topic: ImageIntegration problem  (Read 12010 times)

Offline NKV

  • PTeam Member
  • PixInsight Guru
  • ****
  • Posts: 677
ImageIntegration problem
« on: 2010 April 28 06:34:25 »
PI 1.6
Some times I got strange result of Sigma Cliping during ImageIntegration: One of image have very high rejection value. See picture.
The strange picture looked very similar to other, and Statistic tools don't report nothing strange. So I don't know how to trace the problem.   

But, everything fine if ClipLowRange is disabled. See pic in next post.

Offline NKV

  • PTeam Member
  • PixInsight Guru
  • ****
  • Posts: 677
Re: ImageIntegration problem
« Reply #1 on: 2010 April 28 06:35:22 »
The next pic.

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: ImageIntegration problem
« Reply #2 on: 2010 April 28 09:14:01 »
Hi Nikolay,

This is a known problem that happens when one or more images have very dissimilar illumination levels. Try selecting Additive + scaling normalization in the Image Integration section.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline NKV

  • PTeam Member
  • PixInsight Guru
  • ****
  • Posts: 677
Re: ImageIntegration problem
« Reply #3 on: 2010 April 28 09:28:57 »
Try selecting Additive + scaling normalization in the Image Integration section.
Juan, Generate integrated image disabled ;)

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: ImageIntegration problem
« Reply #4 on: 2010 April 28 10:47:04 »
Quote
Generate integrated image disabled

Hmm, please select Additive + scaling normalization before disabling the Generate integrated image option. If your integration works fine this way, then we have an interesting bug here.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline NKV

  • PTeam Member
  • PixInsight Guru
  • ****
  • Posts: 677
Re: ImageIntegration problem
« Reply #5 on: 2010 April 29 05:20:28 »
Hmm, please select Additive + scaling normalization before disabling the Generate integrated image option. If your integration works fine this way, then we have an interesting bug here.
Additive + scaling selected. Doesn't help. See pic.
Look NKV_Light.zip at FTP

Best regards,
Nikolay.

Offline NKV

  • PTeam Member
  • PixInsight Guru
  • ****
  • Posts: 677
Re: ImageIntegration problem
« Reply #6 on: 2010 May 01 07:32:53 »
One more bug? See pic.
300 images it is maximum for ImageIntegration ?

Best regards,
Nikolay.

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: ImageIntegration problem
« Reply #7 on: 2010 May 01 11:59:43 »
Hi Nikolay,

No, there is no specific limit as for the number of images that can be integrated with the ImageIntegration tool.

This must be a limit imposed by your operating system. ImageIntegration needs to open all input files to work. If you were using Linux, increasing the maximum number of open files is very easy (ulimit command), but for Windows, I'd need to investigate it...

Does anyone know how to increase the maximum number of open files in Windows? Does anyone know what the default limit is?
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline georg.viehoever

  • PTeam Member
  • PixInsight Jedi Master
  • ******
  • Posts: 2132
Re: ImageIntegration problem
« Reply #8 on: 2010 May 01 14:12:32 »
According to http://www.iis-aid.com/articles/iis_aid_news/increasing_mysql_open_file_limit_on_windows, it is 2048. I seem to remember that during WindowsNT times it was around 500 or so, but I am not sure.
Georg
Georg (6 inch Newton, unmodified Canon EOS40D+80D, unguided EQ5 mount)

Offline NKV

  • PTeam Member
  • PixInsight Guru
  • ****
  • Posts: 677
Re: ImageIntegration problem
« Reply #9 on: 2010 May 18 20:26:32 »
One more time about ClipLowRange.
See attached movie. Look closely at the cosmic rays. ClipLowRange doesn't work properly.

Offline Carlos Milovic

  • PTeam Member
  • PixInsight Jedi Master
  • ******
  • Posts: 2172
  • Join the dark side... we have cookies
    • http://www.astrophoto.cl
Re: ImageIntegration problem
« Reply #10 on: 2010 May 18 21:28:00 »
Aren't cosmic rays rejected by the ClipHighRange parameter?
Regards,

Carlos Milovic F.
--------------------------------
PixInsight Project Developer
http://www.pixinsight.com

Offline NKV

  • PTeam Member
  • PixInsight Guru
  • ****
  • Posts: 677
Re: ImageIntegration problem
« Reply #11 on: 2010 May 18 21:52:57 »
Aren't cosmic rays rejected by the ClipHighRange parameter?
Actually, if switch-on ClipLowRange (and don't change any other settings) Winsorized Sigma Clipping pass cosmic ray.

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: ImageIntegration problem
« Reply #12 on: 2010 May 19 00:51:31 »
Hi Nikolay,

Quote
if switch-on ClipLowRange (and don't change any other settings) Winsorized Sigma Clipping pass cosmic ray.

This is normal behavior. When you activate one or both range clipping features, in general you must also redefine your statistical pixel rejection thresholds (e.g. sigma clipping thresholds). This happens because range clipping is applied before statistical pixel rejection. When you enable clip low range and/or clip high range, the set of pixels that survive range clipping may be different for some pixel stacks, and when this happens the statistical properties of those stacks are also different.

In your example, you've found a case where a particular combination of range clipping limits and rejection thresholds is leading to significant differences in the final result. I'd like to play with this particular data set, if you don't mind, because it seems an interesting test case. A small crop covering the area in your GIF animation would be sufficient. Sorry, I am always asking you to upload images! :-[

A different question is if range clipping should be applied before or after statistical pixel rejection. It seems to me that the most logical way is to apply range clipping as an initial step, because range-clipped pixels are in general marginal data (e.g. abnormally low and abnormally high pixels, or definite outliers), and hence they shouldn't enter the statistical pixel rejection process.

Thanks for your thorough testing!
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline NKV

  • PTeam Member
  • PixInsight Guru
  • ****
  • Posts: 677
Re: ImageIntegration problem
« Reply #13 on: 2010 May 19 02:06:50 »
This is normal behavior.
I'm so stupid ... Juan, thank you for the excellent explanation.

Quote
I'd like to play with this particular data set, if you don't mind, because it seems an interesting test case.
A small crop covering the area in your GIF animation would be sufficient. Sorry, I am always asking you to upload images! :-[
Juan, of course I want and I will upload images to FTP. But I will upload full size whole set of mosaic images (16pcs of 2Kx2K). Sorry for 80Mb. :footinmouth:
I hope you can show how to align all of them to StarGen and integrate it. (via only one alignment process please)

Quote
It seems to me that the most logical way is to apply range clipping as an initial step, because range-clipped pixels are in general marginal data.
I absolutely agree with you. But maybe good idea don't accumulate statistic if pixel rejected by range-clipped. Now I see so high clipping %, so difficult to understand: settings is OK or not.

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: ImageIntegration problem
« Reply #14 on: 2010 May 19 03:11:50 »
Nikolay,

Quote
I will upload full size whole set of mosaic images (16pcs of 2Kx2K). Sorry for 80Mb.

Sorry? You're kidding? THANK YOU!  :)

Quote
I hope you can show how to align all of them to StarGen and integrate it. (via only one alignment process please)

In fact I think this can be an excellent data set to finish the series of video tutorials on StarAlignment (and to introduce StarGenerator by the way). If I find that this work can't be done in optimal conditions, be sure we'll modify the existing tools and/or create new ones, as necessary.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/