Author Topic: Writing FITS from PI to flash is very very slow  (Read 3432 times)

Offline Nocturnal

  • PixInsight Jedi Council Member
  • *******
  • Posts: 2727
    • http://www.carpephoton.com
Writing FITS from PI to flash is very very slow
« on: 2010 July 05 10:45:50 »

Hi,

I opened a 27 MB 16b FITS file in PI, changed it and saved it. The file writing operation is reported in the console without time but it took a few minutes. The target drive is a 2 GB Cruzer flash drive, nothing fancy. Creating a copy from the drive to the drive itself takes only 5 seconds or so, indicating that the throughput is plenty for acceptable throughput. Somehow the way PI writes the file is very very slow.

This is on a rather demunitive dual core laptop, 1.6G, Win XP 32b.
Best,

    Sander
---
Edge HD 1100
QHY-8 for imaging, IMG0H mono for guiding, video cameras for occulations
ASI224, QHY5L-IIc
HyperStar3
WO-M110ED+FR-III/TRF-2008
Takahashi EM-400
PIxInsight, DeepSkyStacker, PHD, Nebulosity

Offline Nocturnal

  • PixInsight Jedi Council Member
  • *******
  • Posts: 2727
    • http://www.carpephoton.com
Re: Writing FITS from PI to flash is very very slow
« Reply #1 on: 2010 July 05 10:55:04 »
Ok, I was exaggerating a little :) It takes about 50s to save the file. On the other hand saving a 16b ZIP compressed TIFF takes about 1s.
Best,

    Sander
---
Edge HD 1100
QHY-8 for imaging, IMG0H mono for guiding, video cameras for occulations
ASI224, QHY5L-IIc
HyperStar3
WO-M110ED+FR-III/TRF-2008
Takahashi EM-400
PIxInsight, DeepSkyStacker, PHD, Nebulosity

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: Writing FITS from PI to flash is very very slow
« Reply #2 on: 2010 July 08 04:39:53 »
Hi Sander,

This looks like a problem with the way CFITSIO writes files to disk. Unfortunately there's not too much I can do to improve this, as far as I know. No, hacking CFITSIO's code is not an option :)

Sorry for not having something more constructive to say. When we have the new XML-based image format, FITS will become totally obsolete in PI and most users will rarely use it, except to import raw data.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Niall Saunders

  • PTeam Member
  • PixInsight Jedi Knight
  • *****
  • Posts: 1456
  • We have cookies? Where ?
Re: Writing FITS from PI to flash is very very slow
« Reply #3 on: 2010 July 08 06:51:59 »
Can I make a suggestion for the filename extension then Juan?

Instead of FITS, can we have SPIITS - "Special PixInsight Image Transport System"

(or, alternatively, PITS, SPIT, SPOT, etc., etc.)

:laugh: :laugh: :laugh:

Cheers,
Cheers,
Niall Saunders
Clinterty Observatories
Aberdeen, UK

Altair Astro GSO 10" f/8 Ritchey Chrétien CF OTA on EQ8 mount with homebrew 3D Balance and Pier
Moonfish ED80 APO & Celestron Omni XLT 120
QHY10 CCD & QHY5L-II Colour
9mm TS-OAG and Meade DSI-IIC

Offline Nocturnal

  • PixInsight Jedi Council Member
  • *******
  • Posts: 2727
    • http://www.carpephoton.com
Re: Writing FITS from PI to flash is very very slow
« Reply #4 on: 2010 July 08 07:44:33 »
Alright Juan, will keep it in mind. In this case I was dealing with downloaded DSS images so I wanted to keep the keywords in the FITS header. Otherwise I would have saved the file as TIFF.
Best,

    Sander
---
Edge HD 1100
QHY-8 for imaging, IMG0H mono for guiding, video cameras for occulations
ASI224, QHY5L-IIc
HyperStar3
WO-M110ED+FR-III/TRF-2008
Takahashi EM-400
PIxInsight, DeepSkyStacker, PHD, Nebulosity