Author Topic: Bayer Drizzle  (Read 6538 times)

Offline avan1

  • Newcomer
  • Posts: 23
Bayer Drizzle
« on: 2017 August 27 18:33:13 »

  After playing several hours with Bayer drizzle , I still have no luck to get a color image  :(
No matter where I put the raw/registered files , the error "missing CFA source file path" appear.
What is the correct procedure to do bayer drizzle ?

Alan

Offline ajniskan

  • Newcomer
  • Posts: 12
Re: Bayer Drizzle
« Reply #1 on: 2017 September 27 10:57:09 »
I, too, have the same issue in 1.8.5.1353. My bayer drizzle process workflow worked in older versions with the 'old' process flow, but some things are now missing / relocated in the latest version and I can't find a working process flow.

I'm doing the entire processing flow up to DrizzleIntegration using the grayscale (CFA) images. My images originate from a DSLR and I convert those into grayscale with 'raw cfa' input hints in BatchFormatConversion. Then I proceed through all the steps in the processing flow:
- cosmetic correction
- subframe selection
- registering
- integration

All this is done using the grayscale images with the hopes of the final DrizzleIntegration perfoming a bayer drizzle when the CFA option is enabled.

Can anyone point where this is going wrong (which results in the error described by OP in DrizzleIntegration) and hopefully how to do it properly :)

kind regards,
Antti
« Last Edit: 2017 September 27 11:10:46 by ajniskan »
Imaging with: iOptron CEM25P, TS-Pro 6" RC with Pegasus FocusCube, Altair Astro Hypercam 178C or unmodded Canon 6D. Guiding with SW EvoGuide 50SD, AltairAstro GPcam & PHD2. Control via laptop, huge battery pack & APT/BYE.

Offline sharkmelley

  • PTeam Member
  • PixInsight Addict
  • ***
  • Posts: 241
    • Mark Shelley Astrophotography
Re: Bayer Drizzle
« Reply #2 on: 2017 September 27 15:55:44 »
Try the Bayer Drizzle workflow Juan suggests here:
https://pixinsight.com/forum/index.php?topic=7184.msg71479#msg71479

Mark
Takahashi Epsilon 180ED
H-alpha modified Sony A7S
http://www.markshelley.co.uk/Astronomy/

Offline chris.bailey

  • PixInsight Addict
  • ***
  • Posts: 235
Re: Bayer Drizzle
« Reply #3 on: 2017 September 28 00:28:38 »
I "think" you need to add the Debayer Process to the workflow. CFA Drizzle will then pick up the CFA data from the un-debayered files so you run the whole OSC process as normal (Calibrate>Debayer>Align>Integrate) with generate drizzle data enabled and then add the CFA Drizzle at the end. If you run Cosmetic Correction the CFA drizzle process will even pick up the CC output.

Offline ajniskan

  • Newcomer
  • Posts: 12
Re: Bayer Drizzle
« Reply #4 on: 2017 October 05 07:45:32 »
I did some experimenting, and can now confirm that this process flow worked:
- convert RAW files into CFA
- cosmetic correction
- subframe selection
- debayering
- registering
- integration
- drizzle integration

When I seleceted 'CFA' in the DrizzleIntegration options, DI was performed using the CFA files which I had debayered just before the registration step. In other words, that's how you Bayer Drizzle these days :) This worked nicely with Local Normalization as well. So, as long as you don't delete (or move) the final CFA images from before debayering, you should be able to Bayer Drizzle as well. As a side note, I used 1x scale in the DrizzleIntegration for BayerDrizzle step.

Antti
Imaging with: iOptron CEM25P, TS-Pro 6" RC with Pegasus FocusCube, Altair Astro Hypercam 178C or unmodded Canon 6D. Guiding with SW EvoGuide 50SD, AltairAstro GPcam & PHD2. Control via laptop, huge battery pack & APT/BYE.

Offline avan1

  • Newcomer
  • Posts: 23
Re: Bayer Drizzle
« Reply #5 on: 2017 October 05 17:34:11 »
I did some experimenting, and can now confirm that this process flow worked:
- convert RAW files into CFA
- cosmetic correction
- subframe selection
- debayering
- registering
- integration
- drizzle integration

When I seleceted 'CFA' in the DrizzleIntegration options, DI was performed using the CFA files which I had debayered just before the registration step. In other words, that's how you Bayer Drizzle these days :) This worked nicely with Local Normalization as well. So, as long as you don't delete (or move) the final CFA images from before debayering, you should be able to Bayer Drizzle as well. As a side note, I used 1x scale in the DrizzleIntegration for BayerDrizzle step.

Antti

 Thank you   :D

Offline jtrezzo

  • Newcomer
  • Posts: 8
Re: Bayer Drizzle
« Reply #6 on: 2017 November 29 06:19:04 »
I did some experimenting, and can now confirm that this process flow worked:
- convert RAW files into CFA
- cosmetic correction
- subframe selection
- debayering
- registering
- integration
- drizzle integration

When I seleceted 'CFA' in the DrizzleIntegration options, DI was performed using the CFA files which I had debayered just before the registration step. In other words, that's how you Bayer Drizzle these days :) This worked nicely with Local Normalization as well. So, as long as you don't delete (or move) the final CFA images from before debayering, you should be able to Bayer Drizzle as well. As a side note, I used 1x scale in the DrizzleIntegration for BayerDrizzle step.

Antti

What do you mean by your first step "Convert RAW files into CFA"? I am using FITS files from a cooled CMOS. How is that done?
« Last Edit: 2017 November 29 08:31:20 by jtrezzo »

Offline jtrezzo

  • Newcomer
  • Posts: 8
Re: Bayer Drizzle
« Reply #7 on: 2017 November 29 11:29:34 »
I am trying to figure out how to do this manually, as I do not want to use BatchPreProcessing. I keep getting an error "Missing CFA source file path".
 
Here is my current process to get to the failed state. I am starting with raw FITS files from QHY247C.
 
1. Calibrate lights with darks and flats
2. Debayer calibrated lights (I have tried skipping this too with the same failed result)
3. StarAlignment on debayered frames with generate drizzle data ticked
4. Image Integration of debayered frames with drizzle files added
5. Drizzle Integration with drizzle files (fails - "Missing CFA source file path" error)

There must be some other step that is needed to get this work properly. What am I doing wrong?

Offline Scooot

  • Member
  • *
  • Posts: 64
Re: Bayer Drizzle
« Reply #8 on: 2017 November 30 04:34:55 »
I am trying to figure out how to do this manually, as I do not want to use BatchPreProcessing. I keep getting an error "Missing CFA source file path".
 
Here is my current process to get to the failed state. I am starting with raw FITS files from QHY247C.
 
1. Calibrate lights with darks and flats
2. Debayer calibrated lights (I have tried skipping this too with the same failed result)
3. StarAlignment on debayered frames with generate drizzle data ticked
4. Image Integration of debayered frames with drizzle files added
5. Drizzle Integration with drizzle files (fails - "Missing CFA source file path" error)

There must be some other step that is needed to get this work properly. What am I doing wrong?

Hi jtrezzo
A couple of questions:
Have you checked that the individual debayered subs are in colour if you STF one?
Is the resulting integrated image prior to drizzle integration in colour?
Just trying to narrow down to where the process loses the colour.
Richard

Offline jtrezzo

  • Newcomer
  • Posts: 8
Re: Bayer Drizzle
« Reply #9 on: 2017 November 30 07:50:24 »
I am trying to figure out how to do this manually, as I do not want to use BatchPreProcessing. I keep getting an error "Missing CFA source file path".
 
Here is my current process to get to the failed state. I am starting with raw FITS files from QHY247C.
 
1. Calibrate lights with darks and flats
2. Debayer calibrated lights (I have tried skipping this too with the same failed result)
3. StarAlignment on debayered frames with generate drizzle data ticked
4. Image Integration of debayered frames with drizzle files added
5. Drizzle Integration with drizzle files (fails - "Missing CFA source file path" error)

There must be some other step that is needed to get this work properly. What am I doing wrong?

Hi jtrezzo
A couple of questions:
Have you checked that the individual debayered subs are in colour if you STF one?
Is the resulting integrated image prior to drizzle integration in colour?
Just trying to narrow down to where the process loses the colour.

Hi Scoot,

Yes it's color all the way for the debayered subs and the integration.

Offline Scooot

  • Member
  • *
  • Posts: 64
Re: Bayer Drizzle
« Reply #10 on: 2017 November 30 10:20:25 »
This is what I do.
Add the star aligned files to drizzle integration. EG an Xisf file with an extension like this
IMG_3876_c_cc_d_a_r

Add the local Normalisation files with EG an extension like this
IMG_3876_c_cc_d_a_r.xnml

This puts an n in front of the added files in the drizzle integration input data window

I use the default settings for drizzle integration, so "Enable CFA Drizzle" is not ticked.

and a colour image results. If you're doing this I can't help I'm afraid, sorry.
Richard

Offline ajniskan

  • Newcomer
  • Posts: 12
Re: Bayer Drizzle
« Reply #11 on: 2018 March 09 00:06:40 »
I am trying to figure out how to do this manually, as I do not want to use BatchPreProcessing. I keep getting an error "Missing CFA source file path".
 
Here is my current process to get to the failed state. I am starting with raw FITS files from QHY247C.
 
1. Calibrate lights with darks and flats
2. Debayer calibrated lights (I have tried skipping this too with the same failed result)
3. StarAlignment on debayered frames with generate drizzle data ticked
4. Image Integration of debayered frames with drizzle files added
5. Drizzle Integration with drizzle files (fails - "Missing CFA source file path" error)

There must be some other step that is needed to get this work properly. What am I doing wrong?

Haven't been too active here lately... What you need to do is convert your images from FITS to XIFS format with Batch format conversion and output format hint 'CFA'.

You can have the FITS-> CFA format conversion between your steps 1 & 2. I personally would inject CosmeticCorrection and SubFrameSelection also there. Then debayer before registration and proceed as you wrote. Also a good method to debug this is to do the processing steps with only a few (less than 10) images, just to quickly see if you have the procedure nailed down.

Antti
Imaging with: iOptron CEM25P, TS-Pro 6" RC with Pegasus FocusCube, Altair Astro Hypercam 178C or unmodded Canon 6D. Guiding with SW EvoGuide 50SD, AltairAstro GPcam & PHD2. Control via laptop, huge battery pack & APT/BYE.

Offline Tromat

  • Newcomer
  • Posts: 21
Re: Bayer Drizzle
« Reply #12 on: 2018 April 07 05:53:58 »
I had the same issue with the "missing cfa source file path" and after a few tests I found the aswer.
The problem comes from the subframe selector script, it seems to not transmit the CFA path or something.

I followed these steps:
- calibration
- debayer
- subframe selector script
- local normalization
- Image integration
- CFA Drizzle
and meet the missing path problem, but if I jump from debayer to local norm it works.

The real problem is that you can't use subframe selection and bayer drizzle :-\

Offline ajniskan

  • Newcomer
  • Posts: 12
Re: Bayer Drizzle
« Reply #13 on: 2018 April 08 04:55:02 »
Hi Tromat,

I've used subframeselector before debayering. The way I thought of this is: I'm only looking at star FWHM, eccentricity and SNR. The first two should not be affected by using a CFA image. On the third one, any contribution from using a CFA image should be the same. So, as long as all my files are CFA, the numbers should be comparable.

If you suspect you've encountered a bug with the subframeselector, you can troubleshoot it a bit:
1) check that you correctly get the CFASourceFilePath, CFASourceInterpolation and CFASourcePattern in the properties field in the 'View Explorer' after debayering.
2) check after each processing step if they are lost or corrupted

This approach should help in resolving any CFA source path -related issues, in general.

Antti
Imaging with: iOptron CEM25P, TS-Pro 6" RC with Pegasus FocusCube, Altair Astro Hypercam 178C or unmodded Canon 6D. Guiding with SW EvoGuide 50SD, AltairAstro GPcam & PHD2. Control via laptop, huge battery pack & APT/BYE.

Offline Tromat

  • Newcomer
  • Posts: 21
Re: Bayer Drizzle
« Reply #14 on: 2018 April 09 02:48:41 »
Thanks for the feedback !

I checked the properties with the view explorer and I can find the CFA path information after Debayer process but not after using the script. I should maybe try to use the "move" output option instead of "copy".
Using the script with the raw CFA files sounds a bit weird to me but I should give it a try.