Author Topic: Calibration and align batch operations  (Read 135806 times)

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7096
    • View Profile
    • http://pixinsight.com/
Re: Calibration and align batch operations
« Reply #225 on: 2012 April 02 03:32:06 »
Oops! I forgot that the current public version has a bug that breaks direct file generation in PJSR (the bug is naturally fixed in the development versions that I use). I'll release an update to the core tomorrow. In the meanwhile, please use version 0.4a of the script.

Version 0.4a will also calibrate Harry's files with the latest version of the FITS module, and FITS keywords will also be preserved by the latest Debayer module.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline mmirot

  • PixInsight Padawan
  • ****
  • Posts: 881
    • View Profile
Re: Calibration and align batch operations
« Reply #226 on: 2012 April 02 06:13:47 »
Great work Juan,

You and Kai are going to be very popular once this is released  :cheesy:

I hope you can add bad pixel map / cosmetic correction to the script. 
When I get ride of my bad columns first the rejection routines in integration are much easier to apply.

I was working with Kai to add a function to match flats for those of us with rotators. My rotator does a 180 on the other side of the merdian to capture the guide star automatically.  The flip requires flats to match the lights from each side of the merdian. 

We had a version that match the lights and flats with the Fits header automatically. It worked but a more general method would be perferrable. Could we add a function where we could manually select a sub group of lights and flats frames in the set?

Also is there anyway to add integration? I realise we need to optimise integration with iteration. Could we add a ROI and give the script the tools to integrate too?

Max


Offline Harry page

  • PTeam Member
  • PixInsight Jedi Knight
  • *****
  • Posts: 1457
    • View Profile
    • http://www.harrysastroshed.com
Re: Calibration and align batch operations
« Reply #227 on: 2012 April 02 10:26:31 »
Hi

Ok fully tested with mono images and all is ok  ;D ;D ;D ;D ;D ;D :-* :-* :-* :-* :-* :-* :-*

The fits mod has also seemed to fix the other  outstanding problems I had loading images  ;D ;D ;D ;D :-* :-* :-*

So good this Improved version , go on tell us how it was improved  ;D

Harry

BTW great work , this will help PI greatly
Harry Page

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7096
    • View Profile
    • http://pixinsight.com/
Re: Calibration and align batch operations
« Reply #228 on: 2012 April 02 10:50:31 »
Quote
go on tell us how it was improved

Shhh. I would have to kill you if I told you 8)

I am happy to know you can calibrate your images in PixInsight, at last ...  >:D

Quote
BTW great work , this will help PI greatly

Thank you so much. Seriously now, I agree and I am particularly happy in this case because this has been born as a community initiative. Kai has made a terrific and brave work starting out this project.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Harry page

  • PTeam Member
  • PixInsight Jedi Knight
  • *****
  • Posts: 1457
    • View Profile
    • http://www.harrysastroshed.com
Re: Calibration and align batch operations
« Reply #229 on: 2012 April 02 10:58:45 »
Hi

Tested with OSC sxvf m25 and all is great  ;D :laugh: :cheesy:

I can't cope with things working  :o

Harry
Harry Page

Offline slang

  • Member
  • *
  • Posts: 60
    • View Profile
Re: Calibration and align batch operations
« Reply #230 on: 2012 April 03 13:28:47 »
Hi.

I have tested this several times with .cr2 output from an EOS450D, and it has worked SWEET. Very very good. I am very very happy.

Absollutely AWESOME.

Cheers -
--
Mounts: Orion Atlas 10 eq-g, Explore Scientific G11-PMC8
Scopes: GSO RC8, Astrophysics CCDT67, ES FCD100-80, TSFLAT2
Guiding: ST80/QHY OAG/QHY5L-II-M
Cameras: Canon EOS 450D (IR Mod), QHY8L, QHY163m/QHYFW2-US/Astronomik LRGBHaSiiOii

Offline mmirot

  • PixInsight Padawan
  • ****
  • Posts: 881
    • View Profile
Re: Calibration and align batch operations
« Reply #231 on: 2012 April 03 17:11:33 »
Great work Juan,

You and Kai are going to be very popular once this is released  :cheesy:

I hope you can add bad pixel map / cosmetic correction to the script. 
When I get ride of my bad columns first the rejection routines in integration are much easier to apply.

I was working with Kai to add a function to match flats for those of us with rotators. My rotator does a 180 on the other side of the merdian to capture the guide star automatically.  The flip requires flats to match the lights from each side of the merdian. 

We had a version that match the lights and flats with the Fits header automatically. It worked but a more general method would be perferrable. Could we add a function where we could manually select a sub group of lights and flats frames in the set?

Also is there anyway to add integration? I realise we need to optimise integration with iteration. Could we add a ROI and give the script the tools to integrate too?

Max

Juan,

Again great work. Any thoughts on the above questions?

Max

Offline mmirot

  • PixInsight Padawan
  • ****
  • Posts: 881
    • View Profile
Re: Calibration and align batch operations
« Reply #232 on: 2012 April 04 08:12:48 »
Matching a subset of flats to a subset lights could be helpful for situations other than a rotator.


You may have several sets of flats from different session dates to avoid dust doughnuts.

 The ability to link the flats with a set of light and sures beats running the script over for each set.

Max

Offline georg.viehoever

  • PTeam Member
  • PixInsight Jedi Master
  • ******
  • Posts: 2132
    • View Profile
Re: Calibration and align batch operations
« Reply #233 on: 2012 April 04 23:41:04 »
Oops! I forgot that the current public version has a bug that breaks direct file generation in PJSR (the bug is naturally fixed in the development versions that I use). I'll release an update to the core tomorrow. In the meanwhile, please use version 0.4a of the script.
The latest version works nicely with the new core released yesterday. I noted however that the orientation of the integrated image changed: Compared to previous versions, it is mirrored along the x-axis (no, I did not play with the FITS settings, source images are CR2). Dont know if this is a problem.

Most important missing feature for me is defect map handling.

Georg
Georg (6 inch Newton, unmodified Canon EOS40D+80D, unguided EQ5 mount)

Offline chris_todd

  • PixInsight Enthusiast
  • **
  • Posts: 89
    • View Profile
    • I don't have hobbies, I have obsessions...
Re: Calibration and align batch operations
« Reply #234 on: 2012 April 05 08:02:59 »
Hi.

I have tested this several times with .cr2 output from an EOS450D, and it has worked SWEET. Very very good. I am very very happy.

Absollutely AWESOME.

Cheers -

I can also confirm that this seems to work well on my Mac with the latest core PI updates I installed last night.  As a noob who has only been through the DSLR_RAW tutorial procedures a few times, I can say this script is very helpful.  Thanks!  52 minutes from Canon RAW to calibrated lights, nice!  Time for two glasses of wine (but then ImageIntegration gets all screwed up), LOL.  (2.5GHz Intel Core 2 duo, 4GB RAM MacBook Pro)
Uncooled, unmodified Canon T2i/550D, various lenses, and AstroTrac TT320X-AG
I don't have hobbies, I have obsessions...

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7096
    • View Profile
    • http://pixinsight.com/
Re: Calibration and align batch operations
« Reply #235 on: 2012 April 05 08:33:43 »
New version 0.6 attached:

 * Core version >= 1.7.6 required. Enforced with a conditional #error directive.

 * New automatic load/save settings functionality. The script now remembers most working parameters across sessions. Note that this does not include file lists, since in my opinion file lists should be managed with process icons.

 * New Reset Preprocessing Engine dialog. This dialog opens by clicking the Reset button. It allows you to select whether you want to clear everything (including file lists), load stored settings since the last session, or reset parameters to factory-default settings.

Thanks to everybody for the nice words. I'm glad you find this script useful.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Harry page

  • PTeam Member
  • PixInsight Jedi Knight
  • *****
  • Posts: 1457
    • View Profile
    • http://www.harrysastroshed.com
Re: Calibration and align batch operations
« Reply #236 on: 2012 April 05 10:13:01 »
Hi

where did 0.5 go  >:D

And I will join in on the defect map chorus  ;D

Harry
Harry Page

Offline mmirot

  • PixInsight Padawan
  • ****
  • Posts: 881
    • View Profile
Re: Calibration and align batch operations
« Reply #237 on: 2012 April 05 13:56:36 »
New version 0.6 attached:

 * New automatic load/save settings functionality. The script now remembers most working parameters across sessions. Note that this does not include file lists, since in my opinion file lists should be managed with process icons.

 

How does a file list become as process icon?
I am not sure everyone will automatically how this done.

Max

Offline mmirot

  • PixInsight Padawan
  • ****
  • Posts: 881
    • View Profile
Re: Calibration and align batch operations
« Reply #238 on: 2012 April 05 14:10:54 »
Hi

where did 0.5 go  >:D

And I will join in on the defect map chorus  ;D

Harry

I was hoping Juan would engage in discussion what features he might consider adding before release. 

I don't see integration happening since Juan does think it will work effectively. I respect this point of view.

However, it seems like such as waste of time to have all those registered images flowing through memory to disk. Openning many images takes my system quite a bit of processing time.

I think there could be clever way load them into the integration module. Perhap it is not a real time saver

.... Juan is ignoring me  :-\

Max


Max

Offline georg.viehoever

  • PTeam Member
  • PixInsight Jedi Master
  • ******
  • Posts: 2132
    • View Profile
Re: Calibration and align batch operations
« Reply #239 on: 2012 April 06 08:23:11 »
Latest version 0.6 works well.
Problems:
- when selecting the output directory, I get a very long dialog, see screenshot.
- By default Up-bottom FITS is activated. This also flips the orientation when working purely with RAW (.CR2 files). Unexpected.

Wishlist:
- Defect/Cosmetic correction handling
- some way to control the memory consumption of the embedded image integration processes (see some posts above for proposals)
- improved dialog layout

Georg
Georg (6 inch Newton, unmodified Canon EOS40D+80D, unguided EQ5 mount)