Author Topic: Calibration and align batch operations  (Read 135718 times)

Offline georg.viehoever

  • PTeam Member
  • PixInsight Jedi Master
  • ******
  • Posts: 2132
    • View Profile
Re: Calibration and align batch operations
« Reply #180 on: 2012 March 27 05:12:47 »
Most likely memory shortage.
- Monitor memory usage using Windows Task Manager
- Try reducing the Buffer- and StackSize parameters
- Do yourself a favor, and upgrade to 64bits Windows. It helped a lot with my laptop, which is similar to your system.
Georg
Georg (6 inch Newton, unmodified Canon EOS40D+80D, unguided EQ5 mount)

Offline Fco. Bosch

  • Member
  • *
  • Posts: 66
    • View Profile
Re: Calibration and align batch operations
« Reply #181 on: 2012 March 27 07:36:11 »
But isn't posiible to manage these parameters with the sript ...  :(

Now I realize that a similar problem was reported month ago with image integration http://pixinsight.com/forum/index.php?topic=3877.msg26615#msg26615; and this http://pixinsight.com/forum/index.php?topic=3545.msg25044#msg25044, to that the first links; and others. The mine seems simply another instance of the same matter...
Fco. Bosch

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7089
    • View Profile
    • http://pixinsight.com/
Re: Calibration and align batch operations
« Reply #182 on: 2012 March 27 17:03:49 »
Hi there!

New version 0.4 attached to this post. This version is able to calibrate and align DSLR and OSC raw frames directly, without any previous conversion to the FITS format:

* Direct integration of CFA images (CR2, NEF, DNG, OSC, etc.) for master bias and dark generation. Requires the latest versions of the ImageIntegration and DSLR_RAW modules, which we have just released.

* Exposure times acquired from EXIF metadata for file formats different from FITS (e.g. DSLR_RAW and TIFF).

* New file list management functions: remove selected and invert selection (useful to handle master frames).

* Improved diagnostic information generation.

* Many minor bug fixes.

Please test it and report any bugs and problems that you find. Enjoy!
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline kwiechen

  • PixInsight Addict
  • ***
  • Posts: 186
    • View Profile
Re: Calibration and align batch operations
« Reply #183 on: 2012 March 28 03:11:13 »
But isn't posiible to manage these parameters with the sript ...  :(

Now I realize that a similar problem was reported month ago with image integration http://pixinsight.com/forum/index.php?topic=3877.msg26615#msg26615; and this http://pixinsight.com/forum/index.php?topic=3545.msg25044#msg25044, to that the first links; and others. The mine seems simply another instance of the same matter...

I think a 64bit OS will solve the problems. You can also try to edit the script II parameters manually (see some pages below)

Hi there!

New version 0.4 attached to this post. This version is able to calibrate and align DSLR and OSC raw frames directly, without any previous conversion to the FITS format:

* Direct integration of CFA images (CR2, NEF, DNG, OSC, etc.) for master bias and dark generation. Requires the latest versions of the ImageIntegration and DSLR_RAW modules, which we have just released.

* Exposure times acquired from EXIF metadata for file formats different from FITS (e.g. DSLR_RAW and TIFF).

* New file list management functions: remove selected and invert selection (useful to handle master frames).

* Improved diagnostic information generation.

* Many minor bug fixes.

Please test it and report any bugs and problems that you find. Enjoy!


Excellent news. Use of image metadata directly from DSLR files will help in several other projects.

Best

Kai

 

Offline NKV

  • PTeam Member
  • PixInsight Guru
  • ****
  • Posts: 677
    • View Profile
Re: Calibration and align batch operations
« Reply #184 on: 2012 March 28 07:01:14 »
I guess Nikolay is already working on such tool. This task should be performed to filter out bad images before calibration and alignment.
Yes, it's true. Also it will show field curvature in 3D.

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7089
    • View Profile
    • http://pixinsight.com/
Re: Calibration and align batch operations
« Reply #185 on: 2012 March 28 09:43:12 »
Hmm, Voronoi diagrams? What are you doing with Voronoi diagrams? :)
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Harry page

  • PTeam Member
  • PixInsight Jedi Knight
  • *****
  • Posts: 1457
    • View Profile
    • http://www.harrysastroshed.com
Re: Calibration and align batch operations
« Reply #186 on: 2012 March 28 09:57:10 »
Hi

I can not get my images to calibrate correctley  :yell:
I am using master bias / darks prepared in astroart will this have a effect if so why ?

Regards Harry
Harry Page

Offline kwiechen

  • PixInsight Addict
  • ***
  • Posts: 186
    • View Profile
Re: Calibration and align batch operations
« Reply #187 on: 2012 March 28 10:59:41 »
Hi

I can not get my images to calibrate correctley  :yell:
I am using master bias / darks prepared in astroart will this have a effect if so why ?

Regards Harry

console log, error messages?

Kai


Offline Harry page

  • PTeam Member
  • PixInsight Jedi Knight
  • *****
  • Posts: 1457
    • View Profile
    • http://www.harrysastroshed.com
Re: Calibration and align batch operations
« Reply #188 on: 2012 March 28 11:04:42 »
Hi

Sorry , should have made it clearer  :-[

The script works , just does not correctly calibrate my images ?

Harry
Harry Page

Offline NKV

  • PTeam Member
  • PixInsight Guru
  • ****
  • Posts: 677
    • View Profile
Re: Calibration and align batch operations
« Reply #189 on: 2012 March 28 11:05:57 »
Hmm, Voronoi diagrams? What are you doing with Voronoi diagrams? :)
I'm use Delaunay triangulation to building a grid of FWHM/roundness/etc in the image.

Offline georg.viehoever

  • PTeam Member
  • PixInsight Jedi Master
  • ******
  • Posts: 2132
    • View Profile
Re: Calibration and align batch operations
« Reply #190 on: 2012 March 28 11:23:58 »
...Please test it and report any bugs and problems that you find. Enjoy!

Script works very nicely for me. I did not observe the change color balanced observed by someone else. My remaining wishlist:
- Integration of DefectMap/CosmeticCorrection
- Due to frequent memory shortage problems: You may want to make the integration parameters BufferSize and StackSize configurable. Even better: Let the user only specify maximum memory consumption, and let the script estimate good BufferSize, StackSize parameters from this and the number of images.
- some progress indicator (at least on the Processing Console, something like "5 of 99 images processed")
- you may want to reconsider the layout: most tools have a vertical layout, this script has a horizontal one. Since I arrange my image to fit the vertical tools, the script does not really fit in.

Fantastic work!

Georg
Georg (6 inch Newton, unmodified Canon EOS40D+80D, unguided EQ5 mount)

Offline Harry page

  • PTeam Member
  • PixInsight Jedi Knight
  • *****
  • Posts: 1457
    • View Profile
    • http://www.harrysastroshed.com
Re: Calibration and align batch operations
« Reply #191 on: 2012 March 28 11:36:40 »
Hi

This is what I get , these files work in Astro art  >:D

Harry
Harry Page

Offline Fco. Bosch

  • Member
  • *
  • Posts: 66
    • View Profile
Re: Calibration and align batch operations
« Reply #192 on: 2012 March 28 13:54:14 »
Quote
- Due to frequent memory shortage problems: You may want to make the integration parameters BufferSize and StackSize configurable. Even better: Let the user only specify maximum memory consumption, and let the script estimate good BufferSize, StackSize parameters from this and the number of images.

I have these memory shortage and have followed the advices of Georg and Kai:

1) I have loweerd the values of BufferSize and StackSize
2) directly in the code of the script.

Now my "normal" configuration woks well (Win 32 and 4 GB) , without problems of memory, and for me isn't more matter.

But, do you think that a new user or one that aproaches for first time PI soll crak the sript? I think sincerely that isn't good for PI nor for the user (that most had a "normal" configuration).

Fco Bosch
Fco. Bosch

Offline georg.viehoever

  • PTeam Member
  • PixInsight Jedi Master
  • ******
  • Posts: 2132
    • View Profile
Re: Calibration and align batch operations
« Reply #193 on: 2012 March 28 14:15:28 »
But, do you think that a new user or one that aproaches for first time PI soll crak the sript? I think sincerely that isn't good for PI nor for the user (that most had a "normal" configuration).

I agree. Maybe it is possible to determine a default config for those parameters based on machine characteristics (such as available RAM, OS).
Georg
Georg (6 inch Newton, unmodified Canon EOS40D+80D, unguided EQ5 mount)

Offline kwiechen

  • PixInsight Addict
  • ***
  • Posts: 186
    • View Profile
Re: Calibration and align batch operations
« Reply #194 on: 2012 March 29 02:56:13 »
The script is still not released and windows xp 32 is not officially supported by PI (so far as I know). So I have only written these vars to the script code. To avoid overloading of the GUI components I have not yet exposed these vars by adding controls. Again I think a 64bit OS will solve the problems.

Hi

This is what I get , these files work in Astro art  >:D

Harry

Looks like no calibration at all. Is it the integration result of the /registered/ folder?

Kai