Author Topic: > 4GB files  (Read 357 times)

Offline whwang

  • Member
  • *
  • Posts: 62
    • View Profile
> 4GB files
« on: 2019 June 15 01:30:29 »
Hi,

I wonder how people handle files larger than 4GB in PI.  I often go back and forth between PI and Photoshop.  It works really well using 16 bit TIFF.  However, recently I am working on a 1 giga pixel mosaic and the file size exceeds the 4 GB limit of TIFF.  This prevents file exchange between the two platforms.  In Photoshop, I have to write the file in PSB format, which is not supported by PI. 

I wonder how people deal with this kind of situation.

Cheers,
Wei-Hao

Offline Niall Saunders

  • PTeam Member
  • PixInsight Jedi Knight
  • *****
  • Posts: 1456
  • We have cookies? Where ?
    • View Profile
Re: > 4GB files
« Reply #1 on: 2019 June 15 09:48:18 »
Hi,

What proces, or processes do you require to perform in PS?

Perhaps replicating and even improving them in PixInsight may be the best solution? This would leave the data in 'native' PixInsight format and would perhaps make processing even faster for you.

I hope this helps.
Cheers,
Niall Saunders
Clinterty Observatories
Aberdeen, UK

Altair Astro GSO 10" f/8 Ritchey Chr├ętien CF OTA on EQ8 mount with homebrew 3D Balance and Pier
Moonfish ED80 APO & Celestron Omni XLT 120
QHY10 CCD & QHY5L-II Colour
9mm TS-OAG and Meade DSI-IIC

Offline pfile

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 4629
    • View Profile
Re: > 4GB files
« Reply #2 on: 2019 June 15 09:57:53 »
is the file size < 4GB/3? you could split the file into 3 mono images and save as tiff, then use ChannelCombination in PI to put it back together. barring that it seems like the only way would be to crop to < 4GB files and reassemble with pixelmath in PI.

rob

Offline oldwexi

  • PixInsight Guru
  • ****
  • Posts: 625
    • View Profile
    • Astronomy Pages G.W.
Re: > 4GB files
« Reply #3 on: 2019 June 15 10:27:03 »
Hi,

I wonder how people handle files larger than 4GB in PI.  I often go back and forth between PI and Photoshop.  It works really well using 16 bit TIFF.  However, recently I am working on a 1 giga pixel mosaic and the file size exceeds the 4 GB limit of TIFF.  This prevents file exchange between the two platforms.  In Photoshop, I have to write the file in PSB format, which is not supported by PI. 

I wonder how people deal with this kind of situation.

Cheers,
Wei-Hao

Dont use TIFF as it takes 4 times the diskspace compared to XISF
Dont use PS you loose dynamic when saving in 16 Bit !!!!
PI offers the whole range of astronomical image processing also with mosaics, and it needs
less space with better dynamic.

At the beginnign of using PI i had also this bad habit of SW jumping.
This stopped after i erased this non astronomical programs from my computers!!!
I was forced to do everything in PI and it works and now it works even better.

You asked how people deal with having been in your situation...

Gerald

Offline msmythers

  • PTeam Member
  • PixInsight Jedi
  • *****
  • Posts: 1176
    • View Profile
    • astrobin
Re: > 4GB files
« Reply #4 on: 2019 June 15 11:37:24 »
Wei-Hao

Is tfif a requirement for GigaPan? Those images are amazing. You get to shoot from some amazing locations!


Mike

Offline whwang

  • Member
  • *
  • Posts: 62
    • View Profile
Re: > 4GB files
« Reply #5 on: 2019 June 15 14:58:23 »
Thank you, Mike.  GigaPan does not require TIFF.  It's just that I need a file format that allows me to go between PS and PI.

Rob, That's a good idea.  Thank you.  This will allow me to go to effectively 12 GB.  I was originally thinking about cut a large image into multiple pieces and then process them separately.  This won't be ideal for ABE/DBE.  But splitting the image into three channels should be OK.  Ultimately, I would hope I won't be limited to 12 GB.  But for now, it should be sufficient.

Gerald and Niall, I believe pretty much everything people do in PS can be done in PI.  It's just that I have used PS for more than 20 years.  I have a much longer history with PS and I am so used to its tool and interface.  Switching from PS to PI completely will hurt my productivity a lot.  So I do not consider it an option.  When I go from the 32 bit stacked image in PI to 16 bit TIFF for PS, I took some precaution.  So far, I see no evidence that my results are limited by the 16 bit resolution.

Cheers,
Wei-Hao