BatchFormatConversion script not working 1.8 RC7

[Tel Lekatsas]

Hi all,

I've been trying to batch convert .nef raw files to .fits for preprocessing. The BatchformatConversion script results in files that are pure black (zero filled). I've tried running the script  in PI 1.8 RC5 and 1.8 RC7. It fails in both versions (no warnings on the console, nothing to indicate an issue.)

I've tried the script using PI on Ubuntu 64 bit and on Windows 7 and it fails on both platforms.

I note that this bug has been around for some time and has been reported here   http://pixinsight.com/forum/index.php?topic=5465.msg37583
and here   http://pixinsight.com/forum/index.php?topic=5036.msg34778

After using PI for more than a year now this is the first time I've had an issue with the software (this is the first time I've used PI with DSLR data).

Thanks,
Tel

[georg.viehoever]

Just to be sure: You did apply an STF on the converted images before viewing them?

[Tel Lekatsas]

Thanks Georg,

It's definitely all null.

I tried to integrate some darks and the process threw an error saying there was no data. STF and a quick HT confirms. Same issue with my lights, visible in the .nef file with an STF but gone after conversion.

In the end I converted them manually, calibrated and debayered and followed my usual processing workflow. Fortunately there were only about thirty images.

Tel

[Alejandro Tombolini]

Hi, I have similar situation with 1.8 RC7 in linux.

Saludos, Alejandro.

[Carlos Milovic]

Try an image container, and the nooperation process.

[Juan Conejero]

Hi Tel,

This bug is now fixed in version 1.3.0 of the BatchFormatConversion script, which I have released as an update. Besides fixing this problem, the script now preserves FITS header keywords (including exposure time, timestamp, aperture and ISO for converted DSLR RAW images) and ICC profiles. Sorry for the inconvenience.

[Tel Lekatsas]

Hi Juan, Carlos,

Juan thanks for the update. The script is working as intended now.

Carlos thanks for pointing me to image containers. An image container with a no-op did the trick.

As a bonus, I learnt a bit about using image and process containers, very useful!

Thanks

Tel

[edd]

I'm getting a segmentation violation in RC7, trying to convert files created by PixInsight into other formats (I've tried converting 32 bit float and 16 bit integer FITS files. The PI process survives this error, but can't do the format conversion. It reads the files fine otherwise, and can save them again manually in the format of my choice no problem. This happens running on Ubuntu 12.10 but Mac OS X is fine.

[ebrunner1]

Hi Juan,
I have installed RC7 + all updates (BatchFormatConversion v1.3.0). I'm trying to process Fuji-XE1 raw files. Direct debayering (BatchDeBayer) seems to be working properly. But I would like to get CFA image using BatchFormatConversion - the resulting image has all pixels with level 0.
My settings are as follows:
RAW format preferences  - only "Create RAW Bayer CFA image" is checked

Process console reports:
run --execute-mode=auto "C:/Program Files/PixInsight/src/scripts/BatchFormatConversion/BatchFormatConversion.js"

Processing script file: C:/Program Files/PixInsight/src/scripts/BatchFormatConversion/BatchFormatConversion.js

Converting file 1 of 1:
F:/DATA/archiv-foto/fuji-film_pok/raw/DSCF0001.RAF

Timestamp: Fri May 03 17:37:13 2013
Camera: FUJIFILM X-E1
ISO speed: 200
Shutter: 1/200.9 sec
Aperture: f/-1.$
Focal length: 24.0 mm
Embedded ICC profile: no
Number of raw images: 1
Thumb size:  1920 x 1280
Full size:   5120 x 3288
Image size:  4952 x 3288
Output size: 4952 x 3288
Raw colors: 3
Filter pattern: GGGGBRGGGGRBGGGG
Daylight multipliers: 2.074704 0.936865 1.353580
Camera multipliers: 644.000000 302.000000 529.000000 0.000000

Invoking: dcraw -D -k 0 -t 0 -o 0 -4
Decoding FUJIFILM X-E1 file (4952x3288 pixels, ISO=200, Exposure=1/201s): done
Loading raw image: done

Output file:
* File already exists: F:/DATA/archiv-foto/fuji-film_pok/raw/fit/DSCF0001.fit
* Writing to: F:/DATA/archiv-foto/fuji-film_pok/raw/fit/DSCF0001_3.fit
Writing FITS image: 16-bit integers, 1 channel(s), 4952x3288 pixels: done

===== 1 succeeded, 0 errors, 0 skipped =====


I'm a bit confused that DCRAW params are always dcraw -D -k 0 -t 0 -o 0 -4, no matter what is set in RAW format preferences.

Thanks for any response,
Evzen

[Juan Conejero]

Hi Evzen,

I'm a bit confused that DCRAW params are always dcraw -D -k 0 -t 0 -o 0 -4, no matter what is set in RAW format preferences.

The BatchPreprocessing script ignores your current DSLR_RAW module settings, to force loading of pure raw data with the above arguments.

Direct debayering (BatchDeBayer) seems to be working properly

using BatchFormatConversion - the resulting image has all pixels with level 0

This is very strange. I need one of these files from your camera to investigate what happens.

[ebrunner1]

Hi Juan,
thanks for explanation.
You can find RAW file from my camera here:http://depositfiles.com/files/ohgmeov15
In fact this is not big issue as this is my camera mostly for 'daytime' use.

In any case DCRAW seems to work in the correct way.

Thanks,
Evzen