New RAW Module - Ready for Testing

[mendimundi]

Hi Juan

Glad to read about this news although I am not very sure of what you are saying. As I wrote I tried to open the RAF files (using pure raw setting) but I only got back is a black image. Which settings do I have to use to open these raw images?

About interpolation you mean stacking them? It would be great to have the opportunity to check that update. As I am very new in PI program and web, where could I find the update-level depository?

Thanks for your time

Mendi

[bulrichl]

Hi Mendi,

About interpolation you mean stacking them?

No. Juan wrote it in his post:

With the new RAW module you can open Fuji X-T2 raw files without problems. However, unfortunately the current Debayer module cannot interpolate X-Trans frames.

'Interpolation' (= demosaicing) is the conversion of a Color Filter Array (CFA) image to a RGB image.

Presupposed that you did install the new Raw module according to the instructions given at the top of this thread and selected 'Pure raw' as option in Format Explorer/RAW, you should be able to open Fuji X-T2 raw files. When opening a raw image, a monochrome CFA image is displayed on the screen. It is normal that this image is very dark. Execute PROCESS/IntensityTransformations/ScreenTransferFunction (STF) and let it perform an Auto Stretch (radioactive symbol) to the image. This will display a stretched version of the monochrome CFA image.

Thus with the new RAW module you can open and display the monochrome CFA image, but the current Debayer module cannot convert it to a RGB image. Therefore, at present, you cannot align and integrate images that are taken in the Fuji X-T2 raw format.

However, Juan offered to make a prerelease (before the next version of PI is released, in which all this will be working) of the new Demosaic module, along with a modified version of BatchPreprocessing to support X-Trans demosaicing, if there is interest.

Bernd

[EastWind]

Mendi, I suspect since you are in trial mode that you are a new user and still learning the complex interface. While I’m sure Juan can make it available for testing, you may not have sufficient time to evaluate it before your trial expires.

Are you able to evaluate the product using a different method?  It’s not ideal but if you can convert to jpg in camera you can at least test some of the processing modules before your trial ends.

Pixinsight has a very steep learning curve and takes a very long time to master. Please start out with basic processing first and watch some of the fantastic videos on YouTube which show step by step how to perform the more advanced steps. 

In the mean time Juan appears committed to get the x-trans conversion working and he usually never misses a promise.

Enjoy.

[mendimundi]

Hi Bernd,

Thanks so much for your answer.

Presupposed that you did install the new Raw module according to the instructions given at the top of this thread and selected 'Pure raw' as option in Format Explorer/RAW, you should be able to open Fuji X-T2 raw files.

I have installed the new RAW module (not done before) but now I miss the "format explorer" tab that was in the left side and can not find the way to choose "Pure Raw" anymore. During the installation there were some fail messages (attached an image) that maybe are the cause of this situation.

Thanks for your help

Mendi

[mendimundi]

Hi Eastwind

Thanks for your help. I am still struggling trying to open the raw files... As you say I am learning with some great videos in the Internet but I got stuck in this very beginning part withe the RAWs in my fuji.

I will definitely try to convert in JPG but the problem now is that I have "lost" the Format Explorer Tab and can not choose the kind of format image...

I guess I am already very new in PI and as you say the learning curve is steep.

Regards

Mendi

[pfile]

the module did not load due to some kind of segmentation fault (illegal memory access.) i wonder if you are the first OSX user to try to load this module (i do not use a DSLR anymore, so i have not tried.)

juan would have to comment about this.

rob

[bulrichl]

Hi Mendi,

I am sorry that the new RAW module did not install correctly. On my computer (Windows 7 Professional) it installed and worked flawlessly (tested with Canon CR2 raw files).

Bernd

[EastWind]

Sorry you are having trouble. No telling what is causing the issue. Just to be safe, try uninstalling Pixinsight completely. Restart your system. Then reinstall using all defaults. Then after reinstalling the trial license if needed, reinstall the new raw module as before.

This should also resolve the lost tab issue but I’m sure there is a way to restore that. But considering the other issue, retrying the install would seem like a good plan B.

Hi Eastwind

Thanks for your help. I am still struggling trying to open the raw files... As you say I am learning with some great videos in the Internet but I got stuck in this very beginning part withe the RAWs in my fuji.

I will definitely try to convert in JPG but the problem now is that I have "lost" the Format Explorer Tab and can not choose the kind of format image...

I guess I am already very new in PI and as you say the learning curve is steep.

Regards

Mendi

[msmythers]

Mendi

If you haven't been able to get the new module working and would still like to know if you raw files will work with it I would suggest uploading one or two raw images to a file hosting site like Dropbox or Google Drive and post a link here. Some of us who have the module I'm sure would be more then happy to see if it works. I would suggest one of the images if possible be a daytime image maybe with some grass in the shot. The grass will make it very apparent if the right settings are chosen for color.



Mike

[mendimundi]

Hi Eastwind

Try what you said

When installing the missing Tab was still missed and when installing actualization they gave no error but can not find th "format Explorer" tab... so the Raw files are still black

Sorry you are having trouble. No telling what is causing the issue. Just to be safe, try uninstalling Pixinsight completely. Restart your system. Then reinstall using all defaults. Then after reinstalling the trial license if needed, reinstall the new raw module as before.

This should also resolve the lost tab issue but I’m sure there is a way to restore that. But considering the other issue, retrying the install would seem like a good plan B.

[mendimundi]

Here you have Mike

https://www.dropbox.com/s/ijm4v2s7izv0m8f/DSCF4697.RAF?dl=0

Thanks for the help

Mendi

Mendi

If you haven't been able to get the new module working and would still like to know if you raw files will work with it I would suggest uploading one or two raw images to a file hosting site like Dropbox or Google Drive and post a link here. Some of us who have the module I'm sure would be more then happy to see if it works. I would suggest one of the images if possible be a daytime image maybe with some grass in the shot. The grass will make it very apparent if the right settings are chosen for color.



Mike

[bulrichl]

Hi Mendi,

I use a computer with Windows 7 Professional, Pixinsight v 01.08.05.1353 Ripley (x64) with the new RAW module. In FormatExplorer/RAW I have set 'Pure raw'

When your file "DSCF4697.RAF" is opened, a monochrome image is diplayed. This is the output to Process console:
---------------------------------------
Reading 1 image(s):
C:/Users/BL/Downloads/DSCF4697.RAF
Reading metadata: done

Camera ........... Fujifilm X-T2
Timestamp ........ 2018-03-23T19:15:38Z
Exposure ......... 1/250s
ISO speed ........ 6400
Focal length ..... 19 mm
Aperture ......... f/3.2 = 5.9 mm
Author ...........
CFA pattern ...... RBGBRGGGRGGBGGBGGRBRGRBGGGBGGRGGRGGB
Raw dimensions ... w=6160 h=4032
Image geometry ... x=0 y=0 w=6032 h=4032

Raw decoding parameters:
Output mode ............... cfa
Auto crop ................. enabled
White balancing ........... disabled
Auto rotate ............... disabled
Output image .............. w=6032 h=4032 n=1 Gray

Reading RAW data: done
Scaling colors: done
Pre-interpolating: done
Converting to RGB: done
---------------------------------------

(I deleted the Author from the output.)

When I tried to debayer the image (Bayer/mosaic pattern: Auto), the error
"Unsupported or invalid CFA pattern 'RBGBRGGGRGGBGGBGGRBRGRBGGGBGGRGGRGGB'"
is displayed. So the module is working correctly here and the failing of the debayer process is expected behavior according to what Juan wrote in his post.

Your problem is indeed that the new RAW module didn't install correctly. Rob seemed to suppose that you are using OSX and that the problem of the failing module installation is connected with the operating system.


Bernd

[mendimundi]

Thanks, Bernd

That's correct. My computer is an iMac and I guess there is some kind of problem there but I can not fix it. I hope that Juan could give me an idea for the correct installation.

Regards

Mendi

[StefanG]

Dear Juan and other X-Trans users,

I would just like to wave hands and say that I am definitely interested in having a go with the new demosaic module should it be made available via update-devel channel. As I mentioned earlier, I would like to make more use of my Fuji X-T2 in astrophotography.

Regards,

Stefan

[RoMe]

Another waving hand here. 

Apart from the missing demosaicing the import seems to work fine with my Fuji pictures.

However, I've noticed that this module eats RAM like crazy. When I integrate 50 frames from compressed RAW files (Fuji X-T2) then it fills up my 16GB RAM and my 16GB swap partition after about 40 pictures. Of course PI crashes at this point and the system gets unstable and needs a restart.

When I convert the files to 32 bit float xisf first then PI only uses between 3GB and 5GB of RAM with the same settings (that sounds reasonable).