Author Topic: failure in calibration  (Read 2601 times)

Offline jamesRC

  • PixInsight Addict
  • ***
  • Posts: 102
failure in calibration
« on: 2017 October 23 14:41:26 »
Hello, people,

I get bad results from my efforts to calibrate my lights. :surprised:
I know the input subs are good. I believe my superbias, masterdark, and masterflat are OK. I have not checked
the "calibrate" boxes under masterdark or masterbias.
When I execute the calibration the resulting files are much darker than the original. A pretty decent field of stars has been knocked
down to just a few. More surprisingly, when I try auto stretch with ctrl-a, nothing happens. ADDENDUM: f12 doesnt do anything either.
What user error might I have discovered this time, please?  :'( :(

James
« Last Edit: 2017 October 23 17:47:35 by jamesRC »

Offline jamesRC

  • PixInsight Addict
  • ***
  • Posts: 102
Re: failure in calibration
« Reply #1 on: 2017 October 24 07:54:57 »
Hi,

I've repeated these processes so often I forget which side of my monitor is the front! :-\
Every time, with all good files, my images do not survive the light calibration step.
I have tried this with other images, and it seems to be working OK.

Could my source images be so faint that the image drops out during some normal part of image calibration? I do have a whole lot of bias files, about 90, vs 15 subs. The image is faint, but definitely there. It's visible with auto stretch of the original subs. When I try to stack these images with Deep Sky Stacker, I get a single line in the histogram, nothing I can work with. BTW when I used PI I reset all the processes to make sure there wasn't a really bad input. No difference.

I have no idea what to do next. Must I discard a whole long nights worth of data collection and try to evaluate this limit in PI?  :surprised: :'( :o

Can somebody suggest another plan of attack, please, even with such general info?

Thank you very much.

James

Offline georgian82

  • Member
  • *
  • Posts: 57
Re: failure in calibration
« Reply #2 on: 2017 October 24 10:20:14 »
Hi James,

Can you share some of your data to understand what is going on? I have been having lots of trouble with calibrating/integrating my own images in the new version of PI and I am wondering if we are both having the same issue...

I started a new thread last night (what am I doing wrong? Issues with image calibration/integration) where I explain the issues I am encountering and also a link to the files on dropbox. Take a look when you get a chance.

Thanks,
Sebastian

Offline sharkmelley

  • PTeam Member
  • PixInsight Addict
  • ***
  • Posts: 241
    • Mark Shelley Astrophotography
Re: failure in calibration
« Reply #3 on: 2017 October 26 04:20:54 »
It MIGHT be possible to diagnose where things are going wrong if you give us image statistics (run the Statistics process or BatchStatistics script) on the following files:

  • a typical bias exposure and the Master bias
  • a typical dark exposure and the Master dark
  • a typical flat exposure and the Master flat
  • a typical light and the corresponding calibrated light

The mean, median, min, max and standard deviation should be sufficient.

Mark
Takahashi Epsilon 180ED
H-alpha modified Sony A7S
http://www.markshelley.co.uk/Astronomy/

Offline DaveB

  • Newcomer
  • Posts: 21
Re: failure in calibration
« Reply #4 on: 2017 October 26 14:11:53 »
Hopefully this is not a thread hijack, but I was going to post basically the identical question/issue. If this sounds different, then let me know and I'll start a different thread.

In my case, I will narrow it down to a sequence of four 10-minute Ha frames that I took consecutively. When I look at the raw frames, they look pretty much identical except for an occasional satellite or cosmic ray hit. However, after I run them through the image integration process, three out of the four have their signal nearly eliminated. After running the calibration script, images 1, 2, and 4 in the sequence look nearly black (even after STF), while image 3 looks similar to the raw frame. I tried eliminating the flat frame from the integration, but that didn't change anything. I also tried changing the noise evaluation algorithm, but that didn't matter either.

To see it visually, I've captured a screenshot showing two raw frames on the bottom row (image 3 & 4 in the sequence) along with the corresponding calibrated frames above them. STF was applied to all four images.

The four raw frames, four calibrated frames, and master dark/bias/flat can be found here: https://www.dropbox.com/sh/jeg7g5r14yuvbds/AAB8C5jOvCZn8fBsoZSTCcNAa?dl=0

I've attached a csv file from a run with a BatchStatistics script against the four raw frames. The data looks nearly identical between all four images, at least from what I can see.

Below is the console output from the integration process for the four frames. Note the significant differences in k0, s0, and n0 values between image 3 (the good image after calibration) vs. the other three images:

Writing output file: C:/Users/Kathy/Desktop/PI_cache/IC5146/Cal2/IC5146_Ha_600sec_1x1_0C_20170823_0005_c.xisf
Dark scaling factors:
k0 = 0.545
Gaussian noise estimates:
s0 = 5.145e-10, n0 = 0.857 (K-Sigma)
Writing image: w=3326 h=2504 n=1 Gray Float32
70 FITS keyword(s) embedded.

Writing output file: C:/.../IC5146/Cal2/IC5146_Ha_600sec_1x1_0C_20170911_0001_c.xisf
Dark scaling factors:
k0 = 0.550
Gaussian noise estimates:
s0 = 8.517e-09, n0 = 0.821 (K-Sigma)
Writing image: w=3326 h=2504 n=1 Gray Float32
70 FITS keyword(s) embedded.

Writing output file: C:/.../IC5146/Cal2/IC5146_Ha_600sec_1x1_0C_20170911_0003_c.xisf
Dark scaling factors:
k0 = 0.158
Gaussian noise estimates:
s0 = 3.018e-04, n0 = 0.258 (MRS)
Writing image: w=3326 h=2504 n=1 Gray Float32
70 FITS keyword(s) embedded.

Writing output file: C:/.../IC5146/Cal2/IC5146_Ha_600sec_1x1_0C_20170911_0002_c.xisf
Dark scaling factors:
k0 = 0.552
Gaussian noise estimates:
s0 = 2.247e-08, n0 = 0.807 (K-Sigma)
Writing image: w=3326 h=2504 n=1 Gray Float32
70 FITS keyword(s) embedded.

Writing output file: C:/Users/.../IC5146/Cal2/IC5146_Ha_600sec_1x1_0C_20170911_0004_c.xisf
Dark scaling factors:
k0 = 0.559
Gaussian noise estimates:
s0 = 9.518e-09, n0 = 0.820 (K-Sigma)
Writing image: w=3326 h=2504 n=1 Gray Float32
70 FITS keyword(s) embedded.

Offline DaveB

  • Newcomer
  • Posts: 21
Re: failure in calibration
« Reply #5 on: 2017 October 26 14:47:54 »
FYI - I copied my reply as a new post in the bug reports forum. If I hear anything from that, I'll try to remember to update this thread.

Offline sharkmelley

  • PTeam Member
  • PixInsight Addict
  • ***
  • Posts: 241
    • Mark Shelley Astrophotography
Re: failure in calibration
« Reply #6 on: 2017 October 26 15:41:27 »
Quote from: DaveB
FYI - I copied my reply as a new post in the bug reports forum. If I hear anything from that, I'll try to remember to update this thread.

See my reply here to your post in Bug Reports: https://pixinsight.com/forum/index.php?topic=11743.msg72358#msg72358
You need to tick the Calibrate option in the Master Dark section of ImageCalibration.

Mark
Takahashi Epsilon 180ED
H-alpha modified Sony A7S
http://www.markshelley.co.uk/Astronomy/

Offline sharkmelley

  • PTeam Member
  • PixInsight Addict
  • ***
  • Posts: 241
    • Mark Shelley Astrophotography
Re: failure in calibration
« Reply #7 on: 2017 October 26 16:00:03 »
Quote from: jamesRC

I get bad results from my efforts to calibrate my lights. :surprised:
I know the input subs are good. I believe my superbias, masterdark, and masterflat are OK. I have not checked
the "calibrate" boxes under masterdark or masterbias.

Hi James,
Try ticking the Calibrate option under Master Dark.  It is possible your issue is the same as that from DaveB.
Mark
Takahashi Epsilon 180ED
H-alpha modified Sony A7S
http://www.markshelley.co.uk/Astronomy/