Author Topic: XISF previews available in OS X Observatory from Code Obsession  (Read 3802 times)

Offline dwormuth

  • Newcomer
  • Posts: 21
I have no connection to Code Obsession except as a user.

Observatory is "Adobe Lightroom" for astrophotos. The latest version supports XISF images!

http://codeobsession.com/observatory/

Offline Russ

  • Newcomer
  • Posts: 16
Re: XISF previews available in OS X Observatory from Code Obsession
« Reply #1 on: 2016 November 14 09:34:16 »
My two cents worth: this is a fascinating program. I hope the developer gets enough positive feedback so that he stays as productive and creative as he's been so far.

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: XISF previews available in OS X Observatory from Code Obsession
« Reply #2 on: 2016 November 16 01:12:04 »
Very interesting! This is AFAIK the first time XISF receives some third-party support. Well, it seems PixInsight may be slightly important, after all. That's great indeed, thanks for the heads up, and thanks to the developers of this software.

Now I guess I'll have to find the time to complete the XISF format specification document, as well as the XISF C++ support library. Just when I was almost convinced that no one would ever be interested in these things... :)
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline sander

  • Newcomer
  • Posts: 8
Re: XISF previews available in OS X Observatory from Code Obsession
« Reply #3 on: 2016 November 23 11:39:27 »
Thank you for the kind words!

The latest update of Observatory indeed adds XISF support. This includes Quick Look and Spotlight plugins for XISF, in addition to its FITS and SBIG plugins.

What this means is that your images are shown as actual thumbnails in the Finder, instead of static icons, and it lets you view an image by selecting it in the Finder and then pressing the spacebar. There’s no need to wait for the image to open in any application.

These thumbnails and previews are not only available in the Finder, but also in the Open File Dialog of PixIninsight itself. In a way, the files now appear as any regular image file.

The Spotlight support means that you can search for XISF, FITS and SBIG images using their metadata in the Finder. For example, you can find XISF images of certain dimensions, taken with a certain filter, telescope, exposure time (or range), CCD temperature, RA, Dec, etc, all from the Finder itself. Your XISF, FITS and SBIG images are treated nearly as if they were regular image files with extra metadata. It will display some of this extra metadata in the Finder itself as well.

You can read more about it at
http://codeobsession.com/observatory/doc/quicklook.html
and
http://codeobsession.com/observatory/doc/spotlight.html

Observatory and its XISF support go way beyond these plugins of course. At its core it is an image organizer, specifically designed for astronomical images. You use it to create libraries of your image metadata. That allows you to organize your images any way you want, and quickly find them.

It will even tag your images automatically. For example, if you import a plate solved image of M1, it wil automatically tag it with an “M1” tag, but also adds a “SNR” tag, and tags for other objects in the same image.

Observatory is not dedicated astronomical image processing software like PixInsight, but they work very well together. For example, you can open images directly in PixInsight from Observatory, and Observatory will automatically detect if you modified an image with PixInsight.

For a quick overview of some of the features of Observatory go here:

http://codeobsession.com/video/

In addition, Observatory makes it trivial to obtain original FITS images from professional observatories. That opens up a lot of new possibilities. One example: Why not combine your last night’s image with infrared data obtained by WISE? Instead of having to go to all kinds of places to obtain these images, just tell Observatory what you want, and it will search the archives for you, all simultaneously.

All documentation is available on the website. For example, more about Virtual Observatory can be found here:

http://codeobsession.com/observatory/doc/virtualobservatory.html


Juan, keep up the good work with PixInsight! Without the XISF format specification document and support library it had not been possible to support XISF. Our implementation is not based on the library itself (ours is written in Objective C and based on our preexisting code), but we used the library to clarify some things we noticed in the files that were not immediately clear from the specification, e.g. some of the compression & byte shuffling handling.

Sander Berents
Code Obsession, LLC
http://codeobsession.com
Sander Berents
Code Obsession, LLC
http://codeobsession.com

Offline pfile

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 4729
Re: XISF previews available in OS X Observatory from Code Obsession
« Reply #4 on: 2016 November 23 11:48:37 »
there is a longstanding bug in PI for OSX where the finder can not see FITS or XISF files when you attempt a search from the open file dialog.

does your finder plugin fix this problem by any chance?

thanks

rob

Offline sander

  • Newcomer
  • Posts: 8
Re: XISF previews available in OS X Observatory from Code Obsession
« Reply #5 on: 2016 November 23 12:09:02 »
The plugins do not contain any special handling for this, but I have no problems searching for FITS or XISF files on my system inside the open file dialog. Globally, or within the subfolders of the currently selected folder. I have the plugins installed of course.

I can search FITS and XISF files by name, from within this dialog, and I can search by other attributes, e.g. if I select the FITS file type at the top right of the dialog, then click the + button and select "Detector temperature" - "is less than" and enter "-30", it will only show me the FITS files that were obtained with my CCD at less than -30 degrees celcius. I can even hit Command-I while having a file selected in the dialog, to quickly inspect some of its metadata with the Finder's Show Info window. Or I can hit the spacebar, to preview it before actually opening.
Sander Berents
Code Obsession, LLC
http://codeobsession.com

Offline pfile

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 4729
Re: XISF previews available in OS X Observatory from Code Obsession
« Reply #6 on: 2016 November 23 16:11:45 »
that's good news. juan confirmed the bug sometime back but i guess a solution is difficult to find. i've resorted to writing scripts to build calibration process icons since at this point i'm limited to using 'find' on the command line to find the subs i'm interested in!

rob

Offline pfile

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 4729
Re: XISF previews available in OS X Observatory from Code Obsession
« Reply #7 on: 2016 November 25 12:03:03 »
The plugins do not contain any special handling for this, but I have no problems searching for FITS or XISF files on my system inside the open file dialog. Globally, or within the subfolders of the currently selected folder. I have the plugins installed of course.

I can search FITS and XISF files by name, from within this dialog, and I can search by other attributes, e.g. if I select the FITS file type at the top right of the dialog, then click the + button and select "Detector temperature" - "is less than" and enter "-30", it will only show me the FITS files that were obtained with my CCD at less than -30 degrees celcius. I can even hit Command-I while having a file selected in the dialog, to quickly inspect some of its metadata with the Finder's Show Info window. Or I can hit the spacebar, to preview it before actually opening.

just to be clear, are you talking about from within Observatory or within PixInsight? because after installing observatory and making sure the finder plugins are working, PI is still unable to find xisf or fits files from its own open file dialogs. maybe you are running Sierra and the problem does not manifest there.

as an aside, my images are all stored on a NAS and unfortunately observatory seems to want to read every file in the catalog whenever a view change is made (for instance, sort by date to sort by name), or when i scroll a viewport containing thumbnails, which results in the program slowing down a lot as the read bandwidth is on the order of 50MB/sec. i probably have 20,000 fits files from my STT-8300M, but i have only loaded about 1600 into observatory. i guess to support slow disks a whole lot more caching of image metadata is going to be necessary.

rob



Offline sander

  • Newcomer
  • Posts: 8
Re: XISF previews available in OS X Observatory from Code Obsession
« Reply #8 on: 2016 November 25 18:16:25 »
The plugins do not contain any special handling for this, but I have no problems searching for FITS or XISF files on my system inside the open file dialog. Globally, or within the subfolders of the currently selected folder. I have the plugins installed of course.

I can search FITS and XISF files by name, from within this dialog, and I can search by other attributes, e.g. if I select the FITS file type at the top right of the dialog, then click the + button and select "Detector temperature" - "is less than" and enter "-30", it will only show me the FITS files that were obtained with my CCD at less than -30 degrees celcius. I can even hit Command-I while having a file selected in the dialog, to quickly inspect some of its metadata with the Finder's Show Info window. Or I can hit the spacebar, to preview it before actually opening.

just to be clear, are you talking about from within Observatory or within PixInsight? because after installing observatory and making sure the finder plugins are working, PI is still unable to find xisf or fits files from its own open file dialogs. maybe you are running Sierra and the problem does not manifest there.

as an aside, my images are all stored on a NAS and unfortunately observatory seems to want to read every file in the catalog whenever a view change is made (for instance, sort by date to sort by name), or when i scroll a viewport containing thumbnails, which results in the program slowing down a lot as the read bandwidth is on the order of 50MB/sec. i probably have 20,000 fits files from my STT-8300M, but i have only loaded about 1600 into observatory. i guess to support slow disks a whole lot more caching of image metadata is going to be necessary.

rob

Hi Rob,

I was indeed describing the PixInsight "Open File" dialog. I am still on El Capitan (10.11.6). I can search for FITS and XISF files without problems from within that "Open File" dialog, and use the advanced features that the plugins offer as described above.

I did an experiment, and believe I figured out what the culprit is of the PixInsight "Open File" dialog search issue. I did the following:

a)
1. Created a Virtual Machine of 10.11.6 using VMWare Fusion
2. Dragged my copy of PixInsight in it, as well as the license, and a few images
3. I confirmed that search did not work in the "Open File" dialog
4. I reset the Spotlight index
5. I once again confirmed that search did not work in the "Open File" dialog

b)
1. Same as above
2. Same as above
3. Same as above
4. I installed Observatory
5. I ensured OS X picked up the plugins. OS X is supposed to do that within 30 seconds, but I found that it sometimes takes much longer so I just rebooted the Virtual Machine.
6. I once again confirmed that search did not work in the "Open File" dialog
7. I reset the Spotlight index
8. Now search is working in the "Open File" dialog. You may need to wait a bit, to give Spotlight time to reindex. I didn't have to because of the clean install of everything and the few images I tested it with.

So, I believe that
1. It only works when you have Observatory. I suspect because Observatory has Spotlight plugins for FITS and XISF files.
2. You do need to reset your Spotlight index after installing it.

To reset the Spotlight index for a drive:
1. Choose System Preferences
2. Select "Spotlight"
3. Click the "Privacy" tab
4. Click the "+" button and add your drive. Spotlight will warn you that this will prevent you from searching the drive. Click "OK"
5. Now select the drive you just added to the list
6. Click the "-" button. This will cause Spotlight to completely reindex that drive. When its done, it should work.

Rob, please ensure that your NAS is not in the "Privacy" list. If it is, then you cannot search it, not even from the Finder.


As for your second issue:
When you first import images into Observatory, it will only create thumbnails for those images that you see in the window. As you scroll through or sort the images, it will create additional thumbnails as needed. It does cache all these thumbnails. You can force it to create all thumbnails for the whole library at once by choosing "File - Optimize Library…". You can see this menu item by pressing the Option key while opening the File menu.

If you still see it accessing the NAS when you just scroll through the images, then please let me know by sending an email to support@codeobsession.com.
Sander Berents
Code Obsession, LLC
http://codeobsession.com

Offline pfile

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 4729
Re: XISF previews available in OS X Observatory from Code Obsession
« Reply #9 on: 2016 November 26 00:43:59 »
OK let me try resetting the spotlight index. the nas was not in the privacy list, but mdutil -s indicated that indexing was turned off. i did mdutil -i on /path/to/nas and now mds seems to be grinding away. the add/delete from the privacy menu did not seem to have any effect.

after doing this and restarting pixinsight, the search in PI's file open dialog is working for me now! thanks for the help!

rob

edit: sure enough i can only search files that have metadata visible from "mdls", which appears to be put there by Observatory's plugin. strangely not all of my fits files on the volume have this metadata. perhaps i just have to wait longer for it to be indexed??

Code: [Select]
mdls ./2016-11-18/tmb_ori_heart500_Light_Ha_5nm_2016-11-18_000602_1800s_bin1x1_sky_359.2deg_rot_195.3deg_Ha.fit
_kMDItemOwnerUserID                   = 10017
com_codeobsession_Declination         = 61.6140804034269
com_codeobsession_DetectorTemperature = -30.03125
com_codeobsession_Filter              = "Ha_5nm"
com_codeobsession_ImageType           = "LIGHT"
com_codeobsession_RightAscension      = 38.0649935692163
kMDItemAcquisitionModel               = "AstroPhysics GTO V2 Mount; SBIG STT-8300 3 CCD Camera"
kMDItemBitsPerSample                  = 16
kMDItemContentCreationDate            = 2016-11-18 08:06:13 +0000
kMDItemContentModificationDate        = 2016-11-18 08:36:30 +0000
kMDItemContentType                    = "gov.nasa.gsfc.fits"
kMDItemContentTypeTree                = (
    "gov.nasa.gsfc.fits",
    "public.image",
    "public.data",
    "public.item",
    "public.content"
)
kMDItemDisplayName                    = "tmb_ori_heart500_Light_Ha_5nm_2016-11-18_000602_1800s_bin1x1_sky_359.2deg_rot_195.3deg_Ha.fit"
kMDItemExposureTimeSeconds            = 1800
kMDItemFocalLength                    = 500
kMDItemFSContentChangeDate            = 2016-11-18 08:36:30 +0000
kMDItemFSCreationDate                 = 2016-11-18 08:36:33 +0000
kMDItemFSCreatorCode                  = ""
kMDItemFSFinderFlags                  = 0
kMDItemFSHasCustomIcon                = (null)
kMDItemFSInvisible                    = 0
kMDItemFSIsExtensionHidden            = 0
kMDItemFSIsStationery                 = (null)
kMDItemFSLabel                        = 0
kMDItemFSName                         = "tmb_ori_heart500_Light_Ha_5nm_2016-11-18_000602_1800s_bin1x1_sky_359.2deg_rot_195.3deg_Ha.fit"
kMDItemFSNodeCount                    = (null)
kMDItemFSOwnerGroupID                 = 20
kMDItemFSOwnerUserID                  = 10017
kMDItemFSSize                         = 17038080
kMDItemFSTypeCode                     = ""
kMDItemKind                           = "Flexible Image Transport System File"
kMDItemLogicalSize                    = 17038080
kMDItemPhysicalSize                   = 17039360
kMDItemPixelCount                     = 8515888
kMDItemPixelHeight                    = 2536
kMDItemPixelWidth                     = 3358
kMDItemTitle                          = "heart500"

Code: [Select]
mdls ./2016-09-23/tmb_ori_heart500_Light_Ha_5nm_2016-09-23_044452_1800s_bin1x1_sky_180.8deg_rot_355.6deg_Ha.fit
kMDItemFSContentChangeDate = (null)
kMDItemFSCreationDate      = (null)
kMDItemFSCreatorCode       = ""
kMDItemFSFinderFlags       = (null)
kMDItemFSHasCustomIcon     = (null)
kMDItemFSInvisible         = 0
kMDItemFSIsExtensionHidden = (null)
kMDItemFSIsStationery      = (null)
kMDItemFSLabel             = (null)
kMDItemFSName              = (null)
kMDItemFSNodeCount         = (null)
kMDItemFSOwnerGroupID      = (null)
kMDItemFSOwnerUserID       = (null)
kMDItemFSSize              = (null)
kMDItemFSTypeCode          = ""

« Last Edit: 2016 November 26 01:04:49 by pfile »

Offline A.Steinel

  • Newcomer
  • Posts: 4
Re: XISF previews available in OS X Observatory from Code Obsession
« Reply #10 on: 2017 March 28 09:34:37 »
I just found out about the Observatory Quicklook plugin, yet I think that I can make a free one depending on the complexity to integrate the xifs code into a working quicklook program. I already wrote a Quicklook Plugin (https://github.com/lnxbil/quicklook-pfm), so it should be straight forward.

Offline sander

  • Newcomer
  • Posts: 8
(macOS) Acorn now can open XISF images
« Reply #11 on: 2017 June 17 01:08:06 »
After PixInsight and Observatory, Acorn now has support for PixInsight's XISF image format as well.

We have developed three plugins, which when installed allow you to open FITS, XISF and SBIG images in Acorn as easy as a JPEG or TIFF. The plugins are free, but you do need Observatory and Acorn to use them. They are a great addition to Observatory's Quick Look and Spotlight plugins for the same image formats.

So now you can process your images with PixInsight, see thumbnails and previews in the Finder, search their metadata, open them in Acorn and turn them into multi-layered images, add text, shapes, watermarks, and much more.
 
Read more about it here: http://codeobsession.com/observatory/doc/acorn.html

Sander Berents
Code Obsession, LLC
http://codeobsession.com

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Hi Sander,

That's very nice! Thank you so much for your support of XISF.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline sander

  • Newcomer
  • Posts: 8
Thanks Juan!

We have just released a free update to the plugins. Now they are also fully compatible with the recently released Acorn 6.

Enjoy!
Sander Berents
Code Obsession, LLC
http://codeobsession.com

Offline soffici

  • Newcomer
  • Posts: 1
Re: XISF previews available in OS X Observatory from Code Obsession
« Reply #14 on: 2019 January 08 19:13:27 »
Riviving an old topic (probably more like betting a dead horse...), but I’m interested in a plugin for Finder/Spotlight/Quicklook that makes them able to read xisf files without having to spend the mone for Observatory, which I frankly don’t need.
IMHO the PI team should take on the burden and make it.
After all, they created this “problem”.
But this is not happening, there fore I must be wrong in some assumptions...
Can someone explain to me where I’m wrong?
Thank you and happy 2019
Antonio