Problem integrating images that are compressed xisf

[slang]

Hey.

I have a fast machine, some fast local cache disk, lotsa ram but majority of storage is network based NAS, so it's a bit slow.
To help compensate, and the fact that I've generally got oodles of CPU, i'm testing the compression of .xisf images. I currently have it set to 6.

I have a stack of 32 images, which are read into the local disk cache. When I try to integrate these (Image Integration), I get the following error message;

Code: [Select]

Integration of 31 images:
Pixel combination ......... average
Output normalization ...... additive + scaling
Weighting mode ............ noise evaluation
Scale estimator ........... iterative k-sigma / BWMV
Range rejection ........... range_low=0.000000
Pixel rejection ........... Winsorized sigma clipping
Rejection normalization ... scale + zero offset
Rejection clippings ....... low=yes high=yes
Rejection parameters ...... sigma_low=4.000 sigma_high=2.000

* Using 665 concurrent pixel stack(s) = 1022.98 MB

* Integrating channel 1 of 3:
Integrating pixel rows:     0 ->   976:   0%
*** Error: Cannot perform sequential/random disk read operations on a compressed data block.
<* failed *>

I have tried purging the file cache (manually deleting all files in the cache disks, as well as unselecting 'use file cache' as well, but I still get this error message whenever I try to integrate these (compressed .xisf) files.

My machine is an Intel i950, 24Gbyte RAM, 3xRaptor local cache, Linux 12.04, PI 01.08.03.1123.

Any suggestions?

[Juan Conejero]

*** Error: Cannot perform sequential/random disk read operations on a compressed data block.

Unfortunately, the ImageIntegration tool has no way to know in advance that compressed XISF files cannot be used for incremental file read operations (as happens, for example, with DSLR raw or JPEG files). This is not actually a bug, but a limitation of the current platform that will be overcome in the next version of PixInsight. For now, you need uncompressed XISF images for ImageIntegration.

[slang]

Thanx for the prompt response, greatly appreciated.

Look forward to the next version - I had wondered if it was something like that. Guess it's time to load in, and re-save all those files ;-)

Cheers -

[Juan Conejero]

You can use the BatchFormatConversion script. In the output format hints field enter "no-compress-data" (without quotes). Enter ".xisf" in output extension. Select your files, select an output directory, and click OK. This will save all your files without compression, irrespective of your current XISF preferences.

[slang]

Awesome, thanx.