Fuji RAF files : PI crashing

[pwsasus]

Hello,
I've tried to make ImageIntegration with a set of RAF files (bias).
Immediately after starting the process, PI crashed. Have tried it tree or four times.

br
Paul

[Juan Conejero]

Hi Paul,

Thanks for the report. But, as always, it is completely useless without a sample of data to reproduce it. I can load all .raf files I have at hand without problems. Can you upload one of the frames that is causing this problem, so I can reproduce/understand/fix it?

[pwsasus]

Hi Juan,

please try the link.

https://drive.google.com/drive/folders/0Bw5-m70VG0Y5bXJoSmxaN25ua3c?usp=sharing

The images are made with an Fuji X-T2. I'm running the latest version of PI on two machines - a macbook pro and iMac. Both on MacOS Sierra 10.12.6

br
Paul

[pwsasus]

Hi Juan,

UPDATE :

I've investigated the problem a bit deeper.

PI doesn't have a problem to interprete Fuji RAF files which are made with the 'old' 16 MP sensor of the X-T1. (setting in PI --> Raw format preferences : deBayer RGB standard settings). Changing the setting to pure raw and opening an X-T1 RAF file ends in an pure black file (yes, I have auto-stretch enabled).

All files, which are made with the new 24 MP sensor of Fuji cameras (like X-Pro2, X-T20 and X-T2 - regardless of lossless compressed or uncompressed which is a new setting in Fuji cameras for the 24MP sensor), PI obviously can't read the images.

I have uploaded in my google drive folder a sample of images for reproducing the problem.

Would be very very cool if you can fix the problem :-)))).

br and a nice day
Paul

[Juan Conejero]

Hi Paul,

Thank you for uploading these images. I'm afraid PixInsight currently does not support the Fuji X-T2 and X-T20 cameras. The problem is that dcraw still does not support them, and our DSLR_RAW module uses dcraw as its back-end to support digital camera raw formats. Unfortunately, dcraw crashes with a segmentation fault when feeded with one of these raw files (more specifically, the read_shorts() routine in dcraw.c attempts to access an invalid memory address). There is nothing I can do to fix this, besides trying to contact Dave Coffin to get information on the next release of dcraw.

As for the X-Pro2 image leading to the same crash, this is really weird, since dcraw, and hence our DSLR_RAW module, support this camera. For example, all .RAF files listed on the following page:

http://www.photographyblog.com/reviews/fujifilm_x_pro2_review/sample_images/

can be loaded and decoded without problems. Are you sure this file has been acquired with an X-Pro2 camera? Have you updated the camera's firmware (since this would explain the incompatibility)?

Changing the setting to pure raw and opening an X-T1 RAF file ends in an pure black file (yes, I have auto-stretch enabled).

Unfortunately, this is normal behavior. We don't support X-Trans CFA frames. Currently we only support 2x2 Bayer CFA patterns. X-Trans frames can only be loaded interpolated.

Sorry for not having something nicer to say about these issues. PixInsight is a large software development project and I am basically alone at the keyboard. Please understand that there are hundreds of priority tasks before adding support for very specific CFA patterns.

[pwsasus]

Hi Juan,

thanks a lot for the answer.

Yes, I'm sure that the file is from my X-Pro2. And as an huge Fuji fanboy I'm also sure, that the cam was loaded with the latest firmware. In my opinion the problem causes in the fact, that the RAF file from the X-Pro2 was lossless compressed. And I don't have a file from the X Pro2 in uncompressed format. But I found on the web a few informations about dcraw and x Trans for the 24 MP sensor.
Obviously there are products like Darktable and RawTherapee who also uses dcraw as fundamental for decoding RAW images. And it seems, that dcraw can decoding (uncompressed) RAF files from the 24MP sensor.

Here's a link to this topic:

https://github.com/Beep6581/RawTherapee/issues/3229#issuecomment-279159017

So, I'm no expert or software engineer but maybe there is an important information for you.

I've just started to deep dive in this wonderful piece of software called Pixinsight and I'm fascinated about the power of it.
My actual workaround to work with PI and my Fuji RAF files is to convert the RAF images with Iridient X Transformer (Iridient ist one of the best RAW converter for Fuji files - far better then ACR) from RAF to DNG and then import in PI.
Would it be better to convert the RAF files to TIFF before import in PI?

br
Paul

[Juan Conejero]

Hi Paul,

Thank YOU for your nice words and support.

from RAF to DNG and then import in PI

This is definitely the best way to import these files in PixInsight. DNG is the best approach we have to a 'universal' raw format. It is much better than TIFF for this purpose. I think you can import truly raw data (that is, without any interpolation) from your camera as DNG files in PixInsight.

Obviously there are products like Darktable and RawTherapee who also uses dcraw as fundamental for decoding RAW images. And it seems, that dcraw can decoding (uncompressed) RAF files from the 24MP sensor.

These applications use their own versions of dcraw, with modifications tightly adapted to their specific architectures. These open-source applications are quite specialized and have large teams of excellent developers working on them intensively. In contrast to them, PixInsight has a much wider scope and I am alone.

[entropia437]

I've just started to deep dive in this wonderful piece of software called Pixinsight and I'm fascinated about the power of it.
My actual workaround to work with PI and my Fuji RAF files is to convert the RAF images with Iridient X Transformer (Iridient ist one of the best RAW converter for Fuji files - far better then ACR) from RAF to DNG and then import in PI.


br
Paul

Hi Paul,
Please, can you tell me which setting you put to 24 Mpixel RAF files to convert to DNG in Iridient X Transformer?
Tanks a lot

br
Javier