Author Topic: calibration module fix column etc  (Read 8572 times)

Offline mmirot

  • PixInsight Padawan
  • ****
  • Posts: 881
calibration module fix column etc
« on: 2010 January 25 08:48:52 »
I am hoping the calibration module will here shortly.
 Hopefully It will have the ability to automate to process somewhat similar to DSS.
 I would be nice to have to option to apply a bad pixel map after calibration and do drizzle too.

Max

Offline Niall Saunders

  • PTeam Member
  • PixInsight Jedi Knight
  • *****
  • Posts: 1456
  • We have cookies? Where ?
Re: calibration module fix column etc
« Reply #1 on: 2010 January 25 12:46:53 »
Quote
and do drizzle too

Hi all,

I always considered 'drizzle' to be a function of 'alignment'.

In other words the 'pre-processing' stage is broken down into the following discrete stages

1.) Acquisition of subframes - Lights, Darks, Flats, FlatDarks, BiasOffsets (the only specific requisite being, obviously, Lights)

2.) Calibration pre-processing, comprising :-
   a.) Batch processing of MasterFlatDarks (optionally, obviously - and could involve BiasOffsets instead of FlatDarks)
   b.) Batch processing of Flats with the MasterFlatDark (optional)
   c.) Batch processing of MasterDarks (again, optional, and again could involve BiasOffsets instead of Darks)
   d.) Batch processing of Lights with the MasterDark (a necessary step, even if only using a MasterBiasOffset)
   e.) Batch processing of DarkCorrectedLights with the (normalised) MasterFlat (if Flats are being used)

3.) Alignment, or registration, of all CalibratedLights, choosing from the following :-
   a.) Simple alignment
   b.) Mosaic alignment
   c.) Dither aligment (upsample, downsample, etc.)

4.) Integration, or stacking, of all AlignedCalibratedLights using some, or all, of the following :-
   a.) Sum, Average, Median, Minimum or Maximum combination
   b.) Additive or Multiplicative, Scaled or UnScaled Normalisation - if desired
   c.) Noise Weighting of images (optional)
   d.) Outlier Pixel Rejection (from simple Sigma-Clip algorithms to sophisticated Winsorized Iterative methods)

Which then gives a final image ready for the 'hard work' to start  ;)

As I see things, we already have stages 3 and 4 available in PixInsight, and step 1 is up to 'us', the 'imagers'.

So that really only leaves step 2 - and, in fact, most of step 2 is already completely available within PixInsight - just in a very time-consuming 'manual' mode.

Am I missing anything?

Cheers,
Cheers,
Niall Saunders
Clinterty Observatories
Aberdeen, UK

Altair Astro GSO 10" f/8 Ritchey Chrétien CF OTA on EQ8 mount with homebrew 3D Balance and Pier
Moonfish ED80 APO & Celestron Omni XLT 120
QHY10 CCD & QHY5L-II Colour
9mm TS-OAG and Meade DSI-IIC

Offline Harry page

  • PTeam Member
  • PixInsight Jedi Knight
  • *****
  • Posts: 1458
    • http://www.harrysastroshed.com
Re: calibration module fix column etc
« Reply #2 on: 2010 January 25 12:54:52 »


Yes step 2 I want step 2  ;D

Harry
Harry Page

Offline mmirot

  • PixInsight Padawan
  • ****
  • Posts: 881
Re: calibration module fix column etc
« Reply #3 on: 2010 January 25 19:53:45 »
Niall,

It would be nice to have a whole work flow. I think there should be no need to do the steps individually unless you need to.
Right now you can not use image container and process container to process register then integrate a set of images automatically.
I really would prefer not to calibrate then come back in 5-10mins, then do registration come back in 5-10 min, and then start integration.  It becomes a pain especially if you have three or more channels.
It is best a to have the ability to do it all at a one go and as well as individual steps.

It becomes even a bigger mess if you have to do drizzle in since there are extras re sampling steps involved.
Also, if you have a bad column I find it best to apply a bad pixel map right after calibration.
If we want to batch and link these steps together it would be nice to to think about these options.
I take it for granted that we will have a nice calibration function coming soon.
I probably should have suggested this sooner since it probably is mostly finished. 
I am sure some of these feature are planned or will be included eventually.
We have dream of new nightmares for Juan and company. They don't have enough to do. :)

Max

Offline NKV

  • PTeam Member
  • PixInsight Guru
  • ****
  • Posts: 677
Re: calibration module fix column etc
« Reply #4 on: 2010 January 25 23:58:07 »
Am I missing anything?
Cosmetic correction (dead and hot pixels and column) ;)
And sorry, but how to do it in PixInsight?

Offline mmirot

  • PixInsight Padawan
  • ****
  • Posts: 881
Re: calibration module fix column etc
« Reply #5 on: 2010 January 26 06:10:00 »
I know there is a way to do it in pixel math manually. Check some of the old tutorials

It would be nice to have bad pixel map to apply at once.

Max

Offline Jack Harvey

  • PTeam Member
  • PixInsight Padawan
  • ****
  • Posts: 975
    • PegasusAstronomy.com & Starshadows.com
Re: calibration module fix column etc
« Reply #6 on: 2010 January 26 10:11:24 »
I have created my bad pixel map in Maxim DL.  The you go to Set Calibration and click the Advanced Tab.  Here you find a checkbox to have the bad pixel map applied at the time of image download from the camera.  If you have Maxim 4 then create the BPM and use batch process to apply for now.  Finally I have found Winsorized rejection often solves the bad column issue.
Jack Harvey, PTeam Member
Team Leader, SSRO/PROMPT Imaging Team, CTIO

Offline mmirot

  • PixInsight Padawan
  • ****
  • Posts: 881
Re: calibration module fix column etc
« Reply #7 on: 2010 January 26 10:47:58 »
I have created my bad pixel map in Maxim DL.  The you go to Set Calibration and click the Advanced Tab.  Here you find a checkbox to have the bad pixel map applied at the time of image download from the camera.  If you have Maxim 4 then create the BPM and use batch process to apply for now.  Finally I have found Winsorized rejection often solves the bad column issue.

Thanks I never tried the pixel map at acquistion time. I use the bad pixel map with MaxIM now during calibration with batch convert and save.  I have some trouble setting the noise level
 I would be nice to do the same with PI.

Max

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: calibration module fix column etc
« Reply #8 on: 2010 January 29 01:24:44 »
Just a bit more of patience, folks.

As the calibration module will be released under GPL V3 license, everybody will have the complete source code at their avail. I definitely want more developers involved into this project. Our initial release will be relatively simple but sufficient and efficient. Hopefully the calibration module will benefit from many contributions outside Pleiades Astrophoto. In this sense this module is a bit of an experiment :)
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline mmirot

  • PixInsight Padawan
  • ****
  • Posts: 881
Re: calibration module fix column etc
« Reply #9 on: 2010 January 29 10:06:57 »
Just a bit more of patience, folks.

As the calibration module will be released under GPL V3 license, everybody will have the complete source code at their avail. I definitely want more developers involved into this project. Our initial release will be relatively simple but sufficient and efficient. Hopefully the calibration module will benefit from many contributions outside Pleiades Astrophoto. In this sense this module is a bit of an experiment :)
Yes, Yes,

I need a my update soon I am starting to go into Pixel insight withdrawal.

Max