Author Topic: Help - What's wrong with my master light?  (Read 1999 times)

Offline andythilo

  • Newcomer
  • Posts: 18
Help - What's wrong with my master light?
« on: 2020 January 22 23:50:50 »
Hi

Been shooting for only a few months. But I'm having issues with my stacking. The light master below is from 45 x 180sec frames with 40 x flats, 40 x darks and 40 x flat darks. All frames at the same temperature and gain, flats are 4 sec as recommended for the ASI294MC Pro and taken with a flat field generator @ ADU 27000 approx.

https://1drv.ms/u/s!Ari3AWpbmLZ0gvwwSaNxwdSfJkmVJw?e=HYwv1Z

Setup is Esprit 80 with dedicated flattener, ASI 294MC Pro cooled to -20. Dew heater on both lens and guide camera.

If anyone could have a look and see what you think I'd be really grateful :). I can upload the all the individual frames if it helps.

Offline andythilo

  • Newcomer
  • Posts: 18
Re: Help - What's wrong with my master light?
« Reply #1 on: 2020 January 22 23:59:42 »
I should add that every other frame was dithered and a 2x drizzle applied in PI to help with the undersampling of the Esprit 80/ASI294 combo.

Here's a link to the individual files - https://1drv.ms/u/s!Ari3AWpbmLZ0gvwxyfTENADAlBHSOg?e=lCnmgj

Offline dld

  • PixInsight Addict
  • ***
  • Posts: 132
Re: Help - What's wrong with my master light?
« Reply #2 on: 2020 January 23 01:08:36 »
Before I start downloading an 1.7 GB rar file, could you please be more specific about the problem you are facing?

Offline andythilo

  • Newcomer
  • Posts: 18
Re: Help - What's wrong with my master light?
« Reply #3 on: 2020 January 23 03:26:02 »
Before I start downloading an 1.7 GB rar file, could you please be more specific about the problem you are facing?

Hi, basically I have a light patch on the left side, although running the light frames through ccdinspector it seems I have a tilt, probably from my rotator as I didn't have this tilt in light frames before I fitted it, also tested in ccdinspector. The other issue is background mess. Hard to explain, it's not noise, maybe high level cloud but I ran it this morning using WBPP and it used 42 out of 45.

I guess I'd just like someone to try stacking it and seeing if they know what the issue is, whether is a viewing conditions issue, user error or equipment error. Sorry I know it's rather vague :(.

Thanks

Andy

Offline bulrichl

  • PixInsight Guru
  • ****
  • Posts: 524
Re: Help - What's wrong with my master light?
« Reply #4 on: 2020 January 23 03:45:17 »
Hi Andy,

the issue is definitely caused by the flat frames. You need to capture new flat frames.

It is conspicious that the red channel is very weak compared to the other channels. These are the mean values of the CFA channels of the MasterFlat:

CFA0 (red):    3109
CFA1 (green): 37843
CFA2 (green): 37840
CFA3 (blue):  23713


I suppose that you took sky flats -- this would explain why the red channel is that weak. Speaking from my own experience with the ASI294, there is no need to take long exposed flat frames. I took my flat frames with a not dimmed flatfield box and an exposure time of 0.003 s. However, it is not clear to me whether the weakness of the red channel is the actual problem.

By the way, why did you prepare the Master Calibration files with DeepSkyStacker?

Bernd

Offline andythilo

  • Newcomer
  • Posts: 18
Re: Help - What's wrong with my master light?
« Reply #5 on: 2020 January 23 03:55:54 »
Hi
Hi Andy,

the issue is definitely caused by the flat frames. You need to capture new flat frames.

It is conspicious that the red channel is very weak compared to the other channels. These are the mean values of the CFA channels of the MasterFlat:

CFA0 (red):    3109
CFA1 (green): 37843
CFA2 (green): 37840
CFA3 (blue):  23713


I suppose that you took sky flats -- this would explain why the red channel is that weak. Speaking from my own experience with the ASI294, there is no need to take long exposed flat frames. I took my flat frames with a not dimmed flatfield box and an exposure time of 0.003 s. However, it is not clear to me whether the weakness of the red channel is the actual problem.

By the way, why did you prepare the Master Calibration files with DeepSkyStacker?

Bernd


Hi

Ignore the masters in the folders, I tried DSS and it puts them in there and I forget to delete them. I had my L-Enhance filter in for all frames. Flats were taken with a flat field generator with the voltage dropped to give me a 4sec sub, directly after the light frames. Flat darks the same but with the cap on the scope.

If you look at the stacked master light I linked, it's virtually all red, until I ABE or DBE.

I'll try not dimming the flat field generator but was told it was better for the 294 to run the subs >2 secs.

Offline bulrichl

  • PixInsight Guru
  • ****
  • Posts: 524
Re: Help - What's wrong with my master light?
« Reply #6 on: 2020 January 23 05:35:49 »
Hi Andy,

I guess you misunderstood what I wrote. Independently from the MasterFlat generated by DSS, your flat subframes (FITS format) are very weak in the red channel, and the same will be true for your MasterFlat, whether generated by DSS or by PixInsight. The very weak red channel in the MasterFlat will cause the red channel in the calibrated light frames to be shifted to high values. See the appended histograms of a flat subframe (left), uncalibrated light frame (middle) and your stacked master light (right). For better comparability, the flat frame and the uncalibrated light frame are debayered as well. Please note the strong shift of the red peak in the histograms of the the stacked master light compared to the histogram of the uncalibrated light frame.

You can easily evaluate the calibrated light frames or your stacked master light before applying DBE or ABE: simply disable 'Link RGB channels' in ScreenTransferFunction and apply an Auto Stretch to the image. Then the strong red color cast is gone.

As I wrote, I am NOT shure that the weakness of the red channel in the MasterFlat is the actual issue. So I am NOT telling you that the problem will be gone with using an undimmed flatfield box and short exposure time. However, it is absolutely clear that the flat frames at hand are causing your problem -- they are unusable. You can check that by repeating the image calibration without the MasterFlat. In this special case, a better result is to be expected. Of course I am not recommending to omit the flat frames as a solution. Bottom line is: you have to capture new flat frames.

In the last post you wrote that you used an L-enhance (dual band pass) filter. There is a thread in CloudyNights about problems with an ASI294 and similar filters:
https://www.cloudynights.com/topic/661685-word-of-warning-asi294mc-pro-and-opt-triad-and-nb/
Your problem seems to be related.

Bernd

Offline andythilo

  • Newcomer
  • Posts: 18
Re: Help - What's wrong with my master light?
« Reply #7 on: 2020 January 23 06:10:25 »
Hi Andy,

I guess you misunderstood what I wrote. Independently from the MasterFlat generated by DSS, your flat subframes (FITS format) are very weak in the red channel, and the same will be true for your MasterFlat, whether generated by DSS or by PixInsight. The very weak red channel in the MasterFlat will cause the red channel in the calibrated light frames to be shifted to high values. See the appended histograms of a flat subframe (left), uncalibrated light frame (middle) and your stacked master light (right). For better comparability, the flat frame and the uncalibrated light frame are debayered as well. Please note the strong shift of the red peak in the histograms of the the stacked master light compared to the histogram of the uncalibrated light frame.

You can easily evaluate the calibrated light frames or your stacked master light before applying DBE or ABE: simply disable 'Link RGB channels' in ScreenTransferFunction and apply an Auto Stretch to the image. Then the strong red color cast is gone.

As I wrote, I am NOT shure that the weakness of the red channel in the MasterFlat is the actual issue. So I am NOT telling you that the problem will be gone with using an undimmed flatfield box and short exposure time. However, it is absolutely clear that the flat frames at hand are causing your problem -- they are unusable. You can check that by repeating the image calibration without the MasterFlat. In this special case, a better result is to be expected. Of course I am not recommending to omit the flat frames as a solution. Bottom line is: you have to capture new flat frames.

In the last post you wrote that you used an L-enhance (dual band pass) filter. There is a thread in CloudyNights about problems with an ASI294 and similar filters:
https://www.cloudynights.com/topic/661685-word-of-warning-asi294mc-pro-and-opt-triad-and-nb/
Your problem seems to be related.

Bernd

Hi Bernd

Interesting topic, read through it. So it's possible either a issue with the sensor itself, or incorrect flat process (exposure/ADU?). My ADU was set to 27000 for the APT flats Aid. I'll try a stack later without the flats (and dark flats)? I'll also try taking some new flats with the flat field generator at full (12V) brightness. Is my ADU correct?

I'm going to try some tests without my rotator in as well as when I check my lights with and without the rotator, there was a clear tilt to stacked lights with the rotator. Of course I can't reprocess without the rotator as it won't match up to the lights.

Thanks for your advise so far, much appreciated :) BTW how did you show the CFA values for each colour? Is that in Pixinsight? If so I'll test that on my other flat sets that used different filters and also on the new set @ 12v.

Andy

Offline andythilo

  • Newcomer
  • Posts: 18
Re: Help - What's wrong with my master light?
« Reply #8 on: 2020 January 23 13:18:55 »
Ok well I've processed without flats. So my 45 lights, and 40 darks. DSS on the left (forgot to turn off drizzle) and PI's BPP on the right. Weird how BPP didn't remove the amp glow properly but DSS did. However PI did a better job of removing the left side gradient which I think is from sensor tilt as seen in CCD Inspector.

Both images received DBE subtraction and SNCR (green). In the PI image, DBE allowed points to be placed on the gradient, DSS's image didn't.




Offline bulrichl

  • PixInsight Guru
  • ****
  • Posts: 524
Re: Help - What's wrong with my master light?
« Reply #9 on: 2020 January 23 13:28:14 »
Interesting topic, read through it. So it's possible either a issue with the sensor itself, or incorrect flat process (exposure/ADU?). My ADU was set to 27000 for the APT flats Aid. I'll try a stack later without the flats (and dark flats)? I'll also try taking some new flats with the flat field generator at full (12V) brightness. Is my ADU correct?

A mean of 27000 ADU should be fine. It is the large discrepancy between the weak red channel and the rest of the channels that might pose a problem. That means a light source with more red light possibly could improve the situation. However (as I wrote before), I am not shure whether such a measure is the solution of your problem.

Thanks for your advise so far, much appreciated :) BTW how did you show the CFA values for each colour? Is that in Pixinsight? If so I'll test that on my other flat sets that used different filters and also on the new set @ 12v.

Data of an OSC camera in raw format (CFA) can be split into the 4 CFA channels with the SplitCFA process. Then you apply Statistics to each of the images generated by SplitCFA.

Bernd




Offline bulrichl

  • PixInsight Guru
  • ****
  • Posts: 524
Re: Help - What's wrong with my master light?
« Reply #10 on: 2020 January 23 13:35:22 »
Ok well I've processed without flats. So my 45 lights, and 40 darks. DSS on the left (forgot to turn off drizzle) and PI's BPP on the right. Weird how BPP didn't remove the amp glow properly but DSS did. However PI did a better job of removing the left side gradient which I think is from sensor tilt as seen in CCD Inspector.

If BPP didn't remove the amp glow, the settings for ImageCalibration were wrong. When I tried ImageCalibration on your data applying only the MasterDark, the amp glow was removed completely.

Bernd

Offline andythilo

  • Newcomer
  • Posts: 18
Re: Help - What's wrong with my master light?
« Reply #11 on: 2020 January 23 13:42:09 »
Ok well I've processed without flats. So my 45 lights, and 40 darks. DSS on the left (forgot to turn off drizzle) and PI's BPP on the right. Weird how BPP didn't remove the amp glow properly but DSS did. However PI did a better job of removing the left side gradient which I think is from sensor tilt as seen in CCD Inspector.

If BPP didn't remove the amp glow, the settings for ImageCalibration were wrong. When I tried ImageCalibration on your data applying only the MasterDark, the amp glow was removed completely.

Bernd


Can you remember what settings you used? I did a quick and dirty edit with the DSS stack and am much happier with the colours.


Offline andythilo

  • Newcomer
  • Posts: 18
Re: Help - What's wrong with my master light?
« Reply #12 on: 2020 January 23 14:01:11 »
Tried again with Linear Fit selected for both Darks and Lights. The amp glow is still there :(.

Offline bulrichl

  • PixInsight Guru
  • ****
  • Posts: 524
Re: Help - What's wrong with my master light?
« Reply #13 on: 2020 January 23 15:05:39 »
Tried again with Linear Fit selected for both Darks and Lights. The amp glow is still there :(.

???
I referred to ImageCalibration. When you tried 'Linear Fit' I guess you referred to ImageIntegration?

I didn't use BPP but performed the image calibration with the ImageCalibration process (Section 'MasterDark': both options 'Calibrate' and 'Optimize' disabled; Section 'MasterFlat': option 'Calibrate' disabled). BPP will yield the same result whith the correct settings.

Bernd

Offline andythilo

  • Newcomer
  • Posts: 18
Re: Help - What's wrong with my master light?
« Reply #14 on: 2020 January 23 23:05:40 »
Hi Bernd

Ok so I followed the manual integration process from the Inside Pixinsight book. Much better result and zero amp glow :). Here's my finished result fully processed with final framing in lightroom. Maybe I don't need flats at all?

I'm going to have a play with various flat settings (exposure times/ADU values) over the weekend and see how they impact the stacked image. Thanks for all your help :)

Andy

NGC 2174 Monkey Head Nebula V2 by Andy Thilo, on Flickr