integration of 1166 tiff images

JFKoenig

Member
programme give me an error when integration large number off image
screen capture joint

thank you
 

Attachments

  • Capture d’écran de 2023-05-30 12-04-21.png
    Capture d’écran de 2023-05-30 12-04-21.png
    822.1 KB · Views: 53
hello NIco thank you for your replied
my english is not good but....
the size of one file is about 32Mo
I try with only 1000 files and it works fine
my computer memory is 8Go ram and I have a swap off about 200Go on a SSD reserved for this use
and actually I am trying with 1100 files
I will send the result as soon as the calculation (or the crash) is done
 
1100 image integration OK
but I change normalisation from additive with scaling to no normalization
so I need to tyr again :(.
on the right of the screen capture the memory and the swap used during calculation
 

Attachments

  • Capture d’écran de 2023-05-30 14-43-45.png
    Capture d’écran de 2023-05-30 14-43-45.png
    750.1 KB · Views: 43
8Go is very little RAM for such a task and with your camera (is it an ASI1600?). I'm not sure how the swap can compensate for that?
When you say it's working with 1000 files did it complete the integration?
 
yes it is an asi 1600
and the integration is complete if the number of images used is less than 1135 files

if I look at the evolution of the ram used and the swap used during the calculation
I can see the ram going to the maximun and then the swap usage increase and the ram decrease a little
then the ram usage increase to the maximum and then the swap usage increase and the ram decrease a little
and so on ...
but I dont see why the crash occurs?
juste before the last file the swap use is less than 40% of it
and the ram is juste beyond is limit

if you have any suggestions as to where this might come from
thank you very much
and if you have no suggestion
thank you very much too

bye JF
 
if it helps anyone,
i solved my problem by converting .tiff images to .xisf
with the batchformatconversion script to 32 bit IEEE 754 floating point format
then the integration process works fine
 
this then is likely because of the lack of incremental read support in tiff files. xisf and fits files can be read incrementally by PI and thus do not need to be held in memory in their entirety. using tiff or dslr RAW files will cause this for sure. i think this is the cause of your memory exhaustion problems.
 
Back
Top