Preprocessing integration error

[basskep]

ok Rob no pb where do i upload the files ?

[pfile]

dropbox, google drive, onedrive, etc. something like that. then post a link here.

rob

[basskep]

Ok thank you.
You will find the masters (dark, flat, super bias), light frames (0,1,10,100) and the BPP logs here :
https://drive.google.com/open?id=1HZ3x1P5GHo2E71P_VV5NQvmmu_wIQ2C7

Indeed i have errors on log with light frame 0 and 10 but not with 1 and 100.

Upload will be finished in 30mn.

[pfile]

ok well, something is funny with the superbias - there is essentially no structure at all there, it is almost uniform. i would suggest just using a regular master bias frame. its not clear a superbias is the right way to go for a CMOS camera anyway. jon rista has written a lot about this on cloudy nights, you can search there to see.

was the dark made from bias calibrated subs? there are a lot of pixels with the value 0 in the dark. even for a cmos camera at 4 seconds, that doesn't seem right to me. there should be at least a bias signal if the dark subs were not calibrated. and if the master dark was made from calibrated subs, i'm very surprised to see "perfect" bias subtraction from the dark. there should be very few value 0 pixels in the dark.

rob

[basskep]

Thank you Rob for your help and explanations.
For information i have uploaded a new file on the same link which is "Capture_00001.fits". It is a single bias frame (i have done the super bias with 200 of them).
I will do a regular master bias frame as you mentioned and will let you know. I will check Cloudy Nights too :-)

was the dark made from bias calibrated subs ? Yes unfortunately it was :-(

From the uploaded logs i also noticed several warnings in red at the beginning of the process :

[2018-10-24 15:17:43] * Begin calibration of light frames
[2018-10-24 15:17:43] ************************************************************
[2018-10-24 15:17:43]
[2018-10-24 15:17:43] * Searching for a master dark frame with exposure time = 4s -- best match is a master dark frame of unknown exposure time.
[2018-10-24 15:17:43] * Master bias: /Volumes/LACIE/SharpCap Captures/M42_2018-10-13_Mouvex_Gite_La_Galottiere/Master_Bias/Master_Superbias.fit
[2018-10-24 15:17:43] * Master dark: /Volumes/LACIE/SharpCap Captures/M42_2018-10-13_Mouvex_Gite_La_Galottiere/Master_Dark/MasterDark_4s_WinsorizedSigmaClipping.xisf
[2018-10-24 15:17:43] * Master flat: /Volumes/LACIE/SharpCap Captures/M42_2018-10-13_Mouvex_Gite_La_Galottiere/Master_Flat/MasterFlat_4s_356_PercentileClipping_0_0_10.xisf
[2018-10-24 15:17:43]
[2018-10-24 15:17:43] ImageCalibration: Global context
[2018-10-24 15:17:43]
[2018-10-24 15:17:43] Loading master calibration frames:
[2018-10-24 15:17:43] Loading calibration frame image:
[2018-10-24 15:17:43] /Volumes/LACIE/SharpCap Captures/M42_2018-10-13_Mouvex_Gite_La_Galottiere/Master_Bias/Master_Superbias.fit
[2018-10-24 15:17:43] * Ignoring 1 additional image(s) in master calibration frame.
[2018-10-24 15:17:43] Reading FITS image: 32-bit floating point, 1 channel(s), 4144x2822 pixels: done
[2018-10-24 15:17:44] 1243 FITS keywords extracted.
[2018-10-24 15:17:44] Loading calibration frame image:
[2018-10-24 15:17:44] /Volumes/LACIE/SharpCap Captures/M42_2018-10-13_Mouvex_Gite_La_Galottiere/Master_Dark/MasterDark_4s_WinsorizedSigmaClipping.xisf
[2018-10-24 15:17:44] Loading image: w=4144 h=2822 n=1 Gray Float32
[2018-10-24 15:17:44] 197 FITS keyword(s) extracted.
[2018-10-24 15:17:44] ** Warning: The file format reports no CFA pattern for the master dark frame, but it is being forced as per process instance parameters.
[2018-10-24 15:17:44] Loading calibration frame image:
[2018-10-24 15:17:44] /Volumes/LACIE/SharpCap Captures/M42_2018-10-13_Mouvex_Gite_La_Galottiere/Master_Flat/MasterFlat_4s_356_PercentileClipping_0_0_10.xisf
[2018-10-24 15:17:44] Loading image: w=4144 h=2822 n=1 Gray Float32
[2018-10-24 15:17:44] 255 FITS keyword(s) extracted.
[2018-10-24 15:17:44]
[2018-10-24 15:17:44] Applying bias correction: master dark frame ...
[2018-10-24 15:17:44]
[2018-10-24 15:17:44] Dark frame optimization thresholds:
[2018-10-24 15:17:44] Td0 = 0.00000000 (18 px = 0.001%)
[2018-10-24 15:17:44] ** Warning: The dark frame optimization threshold is probably too high (channel 0).
[2018-10-24 15:17:44] Computing master flat scaling factors ...
[2018-10-24 15:17:44] s0 = 0.047704
[2018-10-24 15:17:44]
[2018-10-24 15:17:44] Calibration of 304 target frames:
[2018-10-24 15:17:44] * Using 4 worker threads

[pfile]

ok so try making an uncalibrated dark master and forget about the bias.

i think rather than trying to use BPP you might do the calibration manually using ImageCalibration just to get a handle on how things work.

also, read this post, it contains a lot of good information: https://pixinsight.com/forum/index.php?topic=11968.0

rob

[basskep]

Hi Rob,

I did an uncalibrated dark master without using any bias. It really works better now :-) I also did all the required steps manually and I have no errors at all now.
The only problem I have now is when I try to use drizzle integration with the final light frame. Drizzle integration frame shows up successfully but as soon as I click on the Auto stretch button to see the result then PI crashes. I have upload the logs in attachment for purpose. But anyway is drizzle integration really necessary ?
And just a last question : do you know how to check all the raw frames before the preprocessing steps to see if any frames are corrupted or not ?

[pfile]

drizzle is only necessary if your pixel scale is much larger than the quality of your sky. i didn't measure your pixel scale but unless it's like 3-4 arcseconds per pixel drizzle probably won't get you anything.

it seems that something funny is going on with your machine - i've never heard of STF causing PI to crash. do you have any kind of 3rd party extensions installed on the computer?

rob

[basskep]

Thanks for the Drizzle information :-)
No i don't have any third party extensions installed on this macbook pro. I will try the same process on my other mac and will let you know.