Author Topic: Drizzle generates a matrix  (Read 4510 times)

Offline Sebastiano

  • Newcomer
  • Posts: 14
Drizzle generates a matrix
« on: 2015 October 26 10:30:50 »
Hello,

I am lately experimenting a bit with DrizzleIntegration and I noticed a sort of matrix in my drizzle integration file.

Am I doing something wrong? Is there a way to avoid this matrix?

Files added: 79 x 900s subs total, 42 L + 37 RGB.

Dithering was 4 to 6 pixel wide.



« Last Edit: 2015 October 26 11:54:02 by mesone »
Takahashi FSQ-106EDX3
FLI Atlas Focuser
QSI 683 wsg-8
Astrodon E-Series Gen2 LRGB + H-alpha 5nm + O-III 5nm, 31mm unmounted
SX Lodestar X2
Paramount MyT
Geoptik Hercules 95
Lenovo X1 Carbon

Offline jkmorse

  • PixInsight Padawan
  • ****
  • Posts: 931
  • Two questions, Mitch . .
    • Jim Morse Astronomy
Re: Drizzle generates a matrix
« Reply #1 on: 2015 October 26 12:03:26 »
I have never seen this.  Are you sure this is only at the drizzle integration stage and is not in ImageIntegration as well?  Also, are you using the default 2/90 settings in Drizzle?
Really, are clear skies, low wind and no moon that much to ask for? 

New Mexico Skies Observatory
Apogee Aspen 16803
Planewave CDK17 - Paramount MEII
Planewave IFR90 - Astrodon LRGB & NB filters
SkyX - MaximDL - ACP

http://www.jimmorse-astronomy.com
http://www.astrobin.com/users/JimMorse

Offline Sebastiano

  • Newcomer
  • Posts: 14
Re: Drizzle generates a matrix
« Reply #2 on: 2015 October 26 12:39:06 »
Hello Jim,

Yes, it only happens after the DrizzleIntegration and not in the ImageIntegration. I used default drizzle settings.
« Last Edit: 2015 October 26 16:05:04 by mesone »
Takahashi FSQ-106EDX3
FLI Atlas Focuser
QSI 683 wsg-8
Astrodon E-Series Gen2 LRGB + H-alpha 5nm + O-III 5nm, 31mm unmounted
SX Lodestar X2
Paramount MyT
Geoptik Hercules 95
Lenovo X1 Carbon

Offline Sebastiano

  • Newcomer
  • Posts: 14
Re: Drizzle generates a matrix
« Reply #3 on: 2015 October 26 15:44:37 »
I have just re-aligned and averaged 22 luminance frames, then I did a Drizzle integration.

This is how the matrix appears.
Takahashi FSQ-106EDX3
FLI Atlas Focuser
QSI 683 wsg-8
Astrodon E-Series Gen2 LRGB + H-alpha 5nm + O-III 5nm, 31mm unmounted
SX Lodestar X2
Paramount MyT
Geoptik Hercules 95
Lenovo X1 Carbon

Offline Sebastiano

  • Newcomer
  • Posts: 14
Re: Drizzle generates a matrix
« Reply #4 on: 2015 October 26 17:15:03 »
I've just found this has to do with the Drop Shrink option.

In the last drizzle_weight screeshot I used a Drop Shrink value of 0.90.

When increased to 1.0 the result improves, but still it's not enough to totally remove that matrix.


Takahashi FSQ-106EDX3
FLI Atlas Focuser
QSI 683 wsg-8
Astrodon E-Series Gen2 LRGB + H-alpha 5nm + O-III 5nm, 31mm unmounted
SX Lodestar X2
Paramount MyT
Geoptik Hercules 95
Lenovo X1 Carbon

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: Drizzle generates a matrix
« Reply #5 on: 2015 October 27 03:59:07 »
Quote
Dithering was 4 to 6 pixel wide.

Apparently your dithering is too accurate. For drizzle, dithering must be performed by fractional pixels, ideally following a random pattern to ensure uniform pixel coverage. If the images are always displaced by integer pixels (or nearly), drizzle will tend to generate aliasing artifacts.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Sebastiano

  • Newcomer
  • Posts: 14
Re: Drizzle generates a matrix
« Reply #6 on: 2015 October 27 10:10:04 »
Thank you Juan for your explanation.

Could it also be the SuperBias involved into this?

Maybe such median algorithm could have caused the pattern, but it's not visible in the ImageIntegration file though.


While testing, look how weird a drizzle_weights image appeared:

Takahashi FSQ-106EDX3
FLI Atlas Focuser
QSI 683 wsg-8
Astrodon E-Series Gen2 LRGB + H-alpha 5nm + O-III 5nm, 31mm unmounted
SX Lodestar X2
Paramount MyT
Geoptik Hercules 95
Lenovo X1 Carbon

Offline vicent_peris

  • PTeam Member
  • PixInsight Padawan
  • ****
  • Posts: 988
    • http://www.astrofoto.es/
Re: Drizzle generates a matrix
« Reply #7 on: 2015 October 27 11:40:03 »
Hi,

I would load all the image set into Blink to make a visual inspection of all the image. Maybe some of them have something strange...?


V.

Offline Sebastiano

  • Newcomer
  • Posts: 14
Re: Drizzle generates a matrix
« Reply #8 on: 2015 October 27 15:16:04 »
Hello Vicent,

I did see them into Blink and apart some lightness differences between frames and dithering movements I can't see anything strange.

About the too accurate dithering, all frames have been acquired during six different nights with a portable setup, everytime positioning the rotator position manually with some arcminutes of rotation error, so I wouldn't bet it was so accurate.

Takahashi FSQ-106EDX3
FLI Atlas Focuser
QSI 683 wsg-8
Astrodon E-Series Gen2 LRGB + H-alpha 5nm + O-III 5nm, 31mm unmounted
SX Lodestar X2
Paramount MyT
Geoptik Hercules 95
Lenovo X1 Carbon

Offline vicent_peris

  • PTeam Member
  • PixInsight Padawan
  • ****
  • Posts: 988
    • http://www.astrofoto.es/
Re: Drizzle generates a matrix
« Reply #9 on: 2015 October 27 16:35:56 »
Please could you upload the data set?

V.

Offline Sebastiano

  • Newcomer
  • Posts: 14
Re: Drizzle generates a matrix
« Reply #10 on: 2015 October 27 16:41:55 »
Yes, I am going to.

It will take some time though.
Takahashi FSQ-106EDX3
FLI Atlas Focuser
QSI 683 wsg-8
Astrodon E-Series Gen2 LRGB + H-alpha 5nm + O-III 5nm, 31mm unmounted
SX Lodestar X2
Paramount MyT
Geoptik Hercules 95
Lenovo X1 Carbon

Offline whwang

  • Member
  • *
  • Posts: 62
Re: Drizzle generates a matrix
« Reply #11 on: 2015 October 27 18:43:21 »
A wild guess is that one (or few) of the images have much higher background than the other images.  If images are not normalized for background brightness, drizzle will produce something like this.  Did you turn on the "Normalization" function in the ImageIntegration tool? 

My question to Juan is whether the normalization is carried from ImageIntegration to DrizzleIntegration.  It is not obvious to me since there is not an "Enable image normalization" option in DrizzleIntegration, but there are options like "Enable pixel rejection" and "Enable image weighting" etc.

Cheers,
Wei-Hao

Offline Sebastiano

  • Newcomer
  • Posts: 14
Re: Drizzle generates a matrix
« Reply #12 on: 2015 October 27 19:24:02 »
Hello Wei-Hao,

Your guess could be right because some of the luminance frames have been acquired still under a good sky but that night the sky was brighter because of humidity and this has produced higher backgroud adu.

Normalization in ImageIntegration was set to Scale + Zero offset.

Your question is interesting, because DrizzleIntegration might have not performed that then.

Let's wait the response of Juan.
Takahashi FSQ-106EDX3
FLI Atlas Focuser
QSI 683 wsg-8
Astrodon E-Series Gen2 LRGB + H-alpha 5nm + O-III 5nm, 31mm unmounted
SX Lodestar X2
Paramount MyT
Geoptik Hercules 95
Lenovo X1 Carbon

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: Drizzle generates a matrix
« Reply #13 on: 2015 October 28 04:31:14 »
Normalization parameters are always stored in .drz files by ImageIntegration, and are always applied by DrizzleIntegration. These parameters are the statistical scale and location estimates for each input image, which are computed with the IKSS algorithm by default (see a description of this algorithm in the Image Normalization section of ImageIntegration documentation).

Note that the normalization data that drizzle uses is the output normalization of ImageIntegration, that is, the parameters used for pixel combination, not the rejection normalization parameters. The output normalization is "additive with scaling" by default. All this stuff is described in the documentation.

It's true that there are no options to disable image normalization in DrizzleIntegration, as doing so doesn't make any sense IMO. We could add an option to disable it, though, if there are good reasons.

Let us know when you have uploaded the data set, since I am also interested in this test case.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline whwang

  • Member
  • *
  • Posts: 62
Re: Drizzle generates a matrix
« Reply #14 on: 2015 October 28 11:56:29 »
Hi Juan,

Thanks for clarification.  As you said, it makes no sense not to normalize the images in drizzle.  I just wonder about this since there is no obvious indication whether the normalization is applied or not.  It's good to know that it is.  Now the problem Sebastiano encountered must be caused something else.

BTW, I posted a question in the Bayer drizzle thread.  Do you mind taking a look?

Cheers,
Wei-Hao