Problem with Local Normalisation

MrBee@101

Well-known member
Hello, I'm stacking some data for a friend using WBPP. Local Normalisation is producing some errors and Image Integration fails. Here are some of the messages from the log. Any help would be appreciated.

[2022-07-08 20:03:06] [000] D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0024r_c_cc_d_r.xisf
[2022-07-08 20:03:06]
[2022-07-08 20:03:39] Loading target file: D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0021r_c_cc_d_r.xisf
[2022-07-08 20:03:39] Loading image: w=3072 h=2080 n=3 RGB Float32
[2022-07-08 20:03:39] 3 image properties
[2022-07-08 20:03:39] 110 FITS keyword(s) extracted
[2022-07-08 20:03:39] * Generating local background model
[2022-07-08 20:03:39] Pixel rejection: done
[2022-07-08 20:03:39] Local background: done
[2022-07-08 20:03:39] * Estimating global scale factors
[2022-07-08 20:03:39] Fitting 4 stars:
[2022-07-08 20:03:39] ch 0 : scale = 1.5049, sigma = -4.3666e-03, 4 valid PSF fits, 2 PSF signal estimates
[2022-07-08 20:03:39] Fitting 6 stars:
[2022-07-08 20:03:39] ch 1 : scale = 1.4227, sigma = -0.0000e+00, 6 valid PSF fits, 1 PSF signal estimates
[2022-07-08 20:03:39] Fitting 2 stars:
[2022-07-08 20:03:39] *** Error: Unable to compute a valid scale estimate (channel 2)
[2022-07-08 20:03:39] Writing output file: D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0021r_c_cc_d_r.xnml
[2022-07-08 20:03:39] ** Warning: Writing a local normalization data file tagged as invalid.
[2022-07-08 20:03:39]

[2022-07-08 20:13:23] ===== LocalNormalization: 31 succeeded, 15 failed, 0 skipped =====
[2022-07-08 20:13:23] 18:18.56
[2022-07-08 20:13:23] ** Warning: Invalid local normalization data generated for file D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0001r_c_cc_d_r.xisf
[2022-07-08 20:13:23] ** Warning: Invalid local normalization data generated for file D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0021r_c_cc_d_r.xisf
[2022-07-08 20:13:23] ** Warning: Invalid local normalization data generated for file D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0033r_c_cc_d_r.xisf
[2022-07-08 20:13:23] ** Warning: Invalid local normalization data generated for file D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0038r_c_cc_d_r.xisf
[2022-07-08 20:13:23] ** Warning: Invalid local normalization data generated for file D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0039r_c_cc_d_r.xisf
[2022-07-08 20:13:23] ** Warning: Invalid local normalization data generated for file D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0040r_c_cc_d_r.xisf
[2022-07-08 20:13:23] ** Warning: Invalid local normalization data generated for file D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0041r_c_cc_d_r.xisf
[2022-07-08 20:13:23] ** Warning: Invalid local normalization data generated for file D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0042r_c_cc_d_r.xisf
[2022-07-08 20:13:23] ** Warning: Invalid local normalization data generated for file D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0043r_c_cc_d_r.xisf
[2022-07-08 20:13:23] ** Warning: Invalid local normalization data generated for file D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0044r_c_cc_d_r.xisf
[2022-07-08 20:13:23] ** Warning: Invalid local normalization data generated for file D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0045r_c_cc_d_r.xisf
[2022-07-08 20:13:23] ** Warning: Invalid local normalization data generated for file D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0046r_c_cc_d_r.xisf
[2022-07-08 20:13:23] ** Warning: Invalid local normalization data generated for file D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0047r_c_cc_d_r.xisf
[2022-07-08 20:13:23] ** Warning: Invalid local normalization data generated for file D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0048r_c_cc_d_r.xisf
[2022-07-08 20:13:23] ** Warning: Invalid local normalization data generated for file D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0050r_c_cc_d_r.xisf
[2022-07-08 20:13:23]
[2022-07-08 20:13:23] ************************************************************
[2022-07-08 20:13:23] * End local normalization of light frames
[2022-07-08 20:13:23] ************************************************************

[2022-07-08 20:13:24] ImageIntegration: Global context
[2022-07-08 20:13:24]
[2022-07-08 20:13:24] Opening files:
[2022-07-08 20:13:24]
[2022-07-08 20:13:24]
[2022-07-08 20:13:24] * Available physical memory: 3.209 GiB
[2022-07-08 20:13:24] D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0001r_c_cc_d_r.xisf
[2022-07-08 20:13:24] D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0001r_c_cc_d_r.xnml
[2022-07-08 20:13:24] Loading image: w=3072 h=2080 n=3 RGB Float32
[2022-07-08 20:13:24] 3 image properties
[2022-07-08 20:13:24] 110 FITS keyword(s) extracted
[2022-07-08 20:13:26] Computing image statistics: done
[2022-07-08 20:13:28] PSF signal estimates:
[2022-07-08 20:13:28] ch 0 : TFlux = 2.7795e+01, TMeanFlux = 1.5540e+00, M* = 3.8557e-03, N* = 5.5815e-03, 35 PSF fits
[2022-07-08 20:13:28] ch 1 : TFlux = 1.1817e+01, TMeanFlux = 4.6941e-01, M* = 2.8907e-03, N* = 4.2001e-03, 19 PSF fits
[2022-07-08 20:13:28] ch 2 : TFlux = 4.1794e+01, TMeanFlux = 7.3625e-01, M* = 6.7381e-03, N* = 9.7273e-03, 11 PSF fits
[2022-07-08 20:13:28] Noise estimates:
[2022-07-08 20:13:28] ch 0 : sigma_n = 5.7707e-03
[2022-07-08 20:13:28] ch 1 : sigma_n = 4.3034e-03
[2022-07-08 20:13:28] ch 2 : sigma_n = 9.9099e-03
[2022-07-08 20:13:28] Noise scaling factors:
[2022-07-08 20:13:28] ch 0 : sigma_low = 2.985753e-03, sigma_high = 3.389427e-03
[2022-07-08 20:13:28] ch 1 : sigma_low = 2.286843e-03, sigma_high = 2.524608e-03
[2022-07-08 20:13:28] ch 2 : sigma_low = 5.164798e-03, sigma_high = 5.683639e-03
[2022-07-08 20:13:28] Relative location and scale:
[2022-07-08 20:13:28] ch 0 : zero_offset = +0.000000e+00, scale_low = 1.000000e+00, scale_high = 1.000000e+00
[2022-07-08 20:13:28] ch 1 : zero_offset = +0.000000e+00, scale_low = 1.000000e+00, scale_high = 1.000000e+00
[2022-07-08 20:13:28] ch 2 : zero_offset = +0.000000e+00, scale_low = 1.000000e+00, scale_high = 1.000000e+00
[2022-07-08 20:13:28] ** Warning: Invalid local normalization data - file will be excluded from the integration.
[2022-07-08 20:13:28]
[2022-07-08 20:13:28] * Using 4 worker threads.
[2022-07-08 20:13:28] [000] D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0003r_c_cc_d_r.xisf
[2022-07-08 20:13:28] [001] D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0004r_c_cc_d_r.xisf
[2022-07-08 20:13:28] [002] D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0005r_c_cc_d_r.xisf
[2022-07-08 20:13:28] [003] D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0006r_c_cc_d_r.xisf
[2022-07-08 20:13:28] D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0003r_c_cc_d_r.xisf
[2022-07-08 20:13:28] D:/Astronomy/KimmitNGC7023IrisNebula1-50/Processed/registered/Light_BIN-1_3072x2080_EXPOSURE-20000.00s_FILTER-NoFilter_RGB/img-0003r_c_cc_d_r.xnml
[2022-07-08 20:13:28] Loading image: w=3072 h=2080 n=3 RGB Float32
[2022-07-08 20:13:28] 3 image properties
[2022-07-08 20:13:28] * Retrieved 7 data item(s) from file cache.
[2022-07-08 20:13:28] PSF signal estimates:
[2022-07-08 20:13:28] ch 0 : TFlux = 8.4135e+01, TMeanFlux = 3.7564e+00, M* = 3.9590e-03, N* = 5.7290e-03, 63 PSF fits
[2022-07-08 20:13:28] ch 1 : TFlux = 6.5983e+01, TMeanFlux = 2.0551e+00, M* = 2.9352e-03, N* = 4.2566e-03, 45 PSF fits
[2022-07-08 20:13:28] ch 2 : TFlux = 7.1257e+01, TMeanFlux = 2.0478e+00, M* = 6.6961e-03, N* = 9.6939e-03, 26 PSF fits
[2022-07-08 20:13:28] Noise estimates:
[2022-07-08 20:13:28] ch 0 : sigma_n = 5.9346e-03
[2022-07-08 20:13:28] ch 1 : sigma_n = 4.3408e-03
[2022-07-08 20:13:28] ch 2 : sigma_n = 9.9358e-03
[2022-07-08 20:13:28] Noise scaling factors:
[2022-07-08 20:13:28] ch 0 : sigma_low = 3.078980e-03, sigma_high = 3.485472e-03
[2022-07-08 20:13:28] ch 1 : sigma_low = 2.327512e-03, sigma_high = 2.546863e-03
[2022-07-08 20:13:28] ch 2 : sigma_low = 5.191218e-03, sigma_high = 5.715481e-03
[2022-07-08 20:13:28] Relative location and scale:
[2022-07-08 20:13:28] ch 0 : zero_offset = -2.115163e-03, scale_low = 9.734588e-01, scale_high = 9.805684e-01
[2022-07-08 20:13:28] ch 1 : zero_offset = -1.058492e-03, scale_low = 9.815785e-01, scale_high = 9.871569e-01
[2022-07-08 20:13:28] ch 2 : zero_offset = -8.028484e-04, scale_low = 9.895481e-01, scale_high = 9.922805e-01
[2022-07-08 20:13:28] Relative weights:
[2022-07-08 20:13:28]
[2022-07-08 20:13:28]
[2022-07-08 20:13:28] * Waiting for running tasks to terminate...
[2022-07-08 20:13:28] *** Error:
[2022-07-08 20:13:28] *** Error: Unknown exception
[2022-07-08 20:13:28] <* failed *>
[2022-07-08 20:13:28] ** Warning: ImageIntegration failed.
[2022-07-08 20:13:28]
[2022-07-08 20:13:28] ************************************************************
[2022-07-08 20:13:28] * End integration of Light frames
[2022-07-08 20:13:28] ************************************************************
[2022-07-08 20:13:28] ** Warning: Master Light file was not generated.
[2022-07-08 20:13:46]
[2022-07-08 20:13:46] * WeightedBatchPreprocessing: 40:23.29
 
OK, this was from a subset of the first 50 subs for the imaging sessions (20 second subs). I analysed using subframe selector the whole session, and it looks like these subs, and the latter subs of the session are much lower weighted. I've therefore only stacked the higher weighted subs from the middle of the session which has worked successfully.
 
Please use English. See Forum Rules: https://pixinsight.com/forum/index.php?threads/forum-rules-and-guidelines.9037/
Ciao ma alla fine è corretto che WBPP 2.4.5 sia così selettivo? Se si, c'è qualche parametro da impostare nella configurazione del menù Normalizzazione Locale in WBPP, in modo da digerire anche le immagini con minor peso, come ad esempio è possibile farlo con il processo manuale di Normalizzazione locale? Infatti, nel processo manuale, se viene spuntata la voce NESSUN COMPONENTE SCALA, tutto fila liscio, nel senso che tutte le immagini vengono comunque riconosciute e quindi elaborate dal processo. Visto che il primo digerisce tutto mentre il WBPP ferma tutto o quasi tutto, i due processi sono paragonabili? Qualcuno sa darmi una spiegazione?
 

Attachments

  • local normalization.png
    local normalization.png
    42.4 KB · Views: 161
Back
Top