Author Topic: PixInsight 1.8 — New File Explorer window  (Read 15626 times)

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
PixInsight 1.8 — New File Explorer window
« on: 2012 August 11 08:59:06 »
Hi all,

One of the most important new features of the incoming version 1.8 of PixInsight is the File Explorer window. This is a long-awaited feature: a complete file system browser with advanced image inspection and analysis tools, integrated with the PixInsight Core application. This dream has now become true after many weeks of hard development and testing work.


File Explorer allows you to browse your local file system. You can also explore network files if you can mount the corresponding network devices transparently in your file system. So far this doesn't look too original—after all, your operating system or desktop environment already allows you to do that since ages. But if you look at the above screenshot, you'll notice a few things that are not so common. PixInsight's File Explorer is a specialized browser designed to let you explore and analyze your images with an outstanding degree of detail. Among its main features, File Explorer shows the following information for each selected image:

- It shows previews for all image formats supported by PixInsight.

- Computes and plots real-time histograms.

- Computes and shows real-time image statistics (mean, median, standard deviation, average absolute deviation from the median, minimum and maximum values).

- Lists all FITS header keywords for each previewed image (both actual header keywords (FITS format) and synthesized keywords (DSLR raw formats)).


File Explorer includes a fast navigation bar that allows you to quickly explore your entire file system. You can click one of the navigation tags to select a folder, or you can click one of the arrow icons to explore a list of sub-folders:


File Explorer is highly customizable to meet your specific needs. The following options are available for automatically generated file and image previews:

- Show/hide file system information (such as file sizes, access and modification dates, permissions, etc.).

- Show/hide image information (image geometry, color space, sample format, etc.).

- Show/hide image statistics (see above).

- Show/hide image histograms.

- Show/hide FITS header keywords.

- Auto stretch image previews.

- Enable/disable enlarged image thumbnails (useful to explore sets of small images, such as icons).

- Enable/disable recursive directory analysis. When you select a folder and this option is enabled, File Explorer automatically gathers information about all of the files and sub-folders under the selected folder. This happens in a background thread, so it doesn't affect responsiveness of the graphical interface.

- Select one among seven image thumbnail sizes, from 50 to 400 pixels.

- Enable/disable and manage the image file cache. The cache works in a background thread to store precomputed file data, which greatly improves your browsing experience.

Naturally, all of these settings, along with the currently selected browser column widths and panel dimensions, are stored and remembered across sessions.

As noted above, one of the most powerful and useful features of File Explorer is its ability to apply an auto stretch transformation to previewed images on the fly. The applied auto stretch function is very similar to the corresponding and well-known feature of the ScreenTransferFunction tool (STF). This is extremely useful to inspect raw CCD and DSLR data. Combined with the implemented file caching system, the auto stretch feature allows you to preview your raw images so quickly that you'll feel like using the Blink tool—with your keyboard's up and down keys.


File Explorer can work in read-only mode (always selected by default) and read-write mode. In read-only mode, File Explorer does not allow you to perform any action that may change your file system, such as rename, copy, move or remove files, or create new folders. This allows you to work in a secure way, knowing that no unwanted mouse dragging or key stroke can cause a disaster. In read-write mode, you can perform all of the referred actions in the usual way, as shown below.


The File Explorer window is fully integrated with both your operating system and the PixInsight platform. It always keeps itself synchronized with file system changes, thanks to a dedicated background task running in a low-priority thread. This works in a completely transparent way. For example, as you create new files, rename or delete existing ones, File Explorer always reflects the changes automatically. This works so reliably that we haven't implemented a 'Refresh' feature.

As for integration with PixInsight, you can double-click a file, or drag it to the workspace, to open it with PixInsight. This works for all supported image and text file formats. Image files are opened in the current workspace, and text files (plain text files, including JavaScript, PIDoc and C++ source code files) are automatically loaded by the Script Editor window (which has been also redesigned and rewritten completely, as I'll show in a separate post).

You can drag items from File Explorer to any tool supporting drag and drop operations based on MIME data. On the screenshot below you can see a selection of image files being dragged from the File Explorer window to the ImageContainer interface. You can also drag a folder, which allows you to select all the files in the folder automatically, to process them with ImageContainer.


To complete this brief description of the new File Explorer window, let me mention one of its most powerful features: file filters. A file filter is a file name template used to restrict the files shown on the browser. For example, to show only FITS files, one can specify this file filter:

*.fit

or if one wants to be sure that no FITS file escapes:

*fit,*fits,*.fts

Much more sophisticated—and useful—filters are possible. For example, to filter all flat frames acquired with a Red filter in  FITS format:

*bias*-Red.fit

assuming that the file names follow a template such as in "M101-bias-0097-Red.fit". The following screenshot shows an example to filter only JPEG and FITS files.


Regarding performance, File Explorer is fully multithreaded. All routines for file information gathering and generation of previews, statistics and histograms work on separate threads. The same is true for the implemented file cache. This allows us to keep the graphical interface fully responsive all the time. You'll never experience any interface blockage, even while browsing large sets of huge images.

I hope you'll like the new File Explorer window. Watch for more posts on this board with information about new features in PixInsight 1.8 Ripley.
« Last Edit: 2012 August 11 09:26:50 by Juan Conejero »
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Nocturnal

  • PixInsight Jedi Council Member
  • *******
  • Posts: 2727
    • http://www.carpephoton.com
Re: PixInsight 1.8 — New File Explorer window
« Reply #1 on: 2012 August 11 09:07:58 »
I expect PI 2.0 to be a fully bootable image that provides its own OS services. I'm sure there are lots of ways to improve the Linux and even FreeBSD kernels.

 >:D
Best,

    Sander
---
Edge HD 1100
QHY-8 for imaging, IMG0H mono for guiding, video cameras for occulations
ASI224, QHY5L-IIc
HyperStar3
WO-M110ED+FR-III/TRF-2008
Takahashi EM-400
PIxInsight, DeepSkyStacker, PHD, Nebulosity

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: PixInsight 1.8 — New File Explorer window
« Reply #2 on: 2012 August 11 09:21:12 »
Quote
I expect PI 2.0 to be a fully bootable image that provides its own OS services

Hmm, sounds well :) Look it this way: that would free us from having to port PI to four platforms  >:D
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Nocturnal

  • PixInsight Jedi Council Member
  • *******
  • Posts: 2727
    • http://www.carpephoton.com
Re: PixInsight 1.8 — New File Explorer window
« Reply #3 on: 2012 August 11 09:28:20 »

And in exchange you'll have to deal with a few hundred different graphics adapters and network cards :-)
Best,

    Sander
---
Edge HD 1100
QHY-8 for imaging, IMG0H mono for guiding, video cameras for occulations
ASI224, QHY5L-IIc
HyperStar3
WO-M110ED+FR-III/TRF-2008
Takahashi EM-400
PIxInsight, DeepSkyStacker, PHD, Nebulosity

Offline georg.viehoever

  • PTeam Member
  • PixInsight Jedi Master
  • ******
  • Posts: 2132
Re: PixInsight 1.8 — New File Explorer window
« Reply #4 on: 2012 August 11 09:29:45 »
I expect PI 2.0 to be a fully bootable image that provides its own OS services. I'm sure there are lots of ways to improve the Linux and even FreeBSD kernels.

"To be Jedi is to face the truth, and choose. Give off light, or darkness, Padawan. Be a candle, or the night." (Yoda)

 >:D
Georg (6 inch Newton, unmodified Canon EOS40D+80D, unguided EQ5 mount)

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: PixInsight 1.8 — New File Explorer window
« Reply #5 on: 2012 August 11 09:30:48 »
Quote
And in exchange you'll have to deal with a few hundred different graphics adapters and network cards :-)

bah, insignificant details...  O0
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Enzo De Bernardini

  • PTeam Member
  • PixInsight Addict
  • ***
  • Posts: 274
  • Resistance is futile.
    • Astronomí­a Sur
Re: PixInsight 1.8 — New File Explorer window
« Reply #6 on: 2012 August 11 11:26:02 »
Great! This will be very useful, I'm sure! Really nice feature. :)

Thanks!

Enzo.

Offline oldwexi

  • PixInsight Guru
  • ****
  • Posts: 627
    • Astronomy Pages G.W.
Re: PixInsight 1.8 — New File Explorer window
« Reply #7 on: 2012 August 11 11:40:16 »
YYEEESSSS!
Thats excellent!! 8)

Thanks.

Gerald

Offline Josh Lake

  • PixInsight Old Hand
  • ****
  • Posts: 424
Re: PixInsight 1.8 — New File Explorer window
« Reply #8 on: 2012 August 11 18:19:36 »
This looks amazing, Juan, great idea. I can't wait to try it out!

Offline troypiggo

  • PixInsight Addict
  • ***
  • Posts: 258
Re: PixInsight 1.8 — New File Explorer window
« Reply #9 on: 2012 August 11 19:09:40 »
That's not fair, Juan, making us drool over new features before it comes out.  Waiting with anticipation.   O0

Offline Ioannis Ioannou

  • PixInsight Addict
  • ***
  • Posts: 202
Re: PixInsight 1.8 — New File Explorer window
« Reply #10 on: 2012 August 13 05:47:16 »
I expect PI 2.0 to be a fully bootable image that provides its own OS services. I'm sure there are lots of ways to improve the Linux and even FreeBSD kernels.

 >:D

And the next step will be to integrate it into Emacs as a module, with documentation in Troff and graphics processing is postscript  ;D >:D :P

Keep up the good job guys  ^-^
Clear Skies
John (Ioannis)

FSQ106N+Robofocus+QHY-22+SX USB wheel+Baader filters
SX OAG+DSI Pro guiding a NEQ6
PI for the rest :)

Offline Alejandro Tombolini

  • PTeam Member
  • PixInsight Jedi
  • *****
  • Posts: 1267
    • Próxima Sur
Re: PixInsight 1.8 — New File Explorer window
« Reply #11 on: 2012 August 13 18:14:38 »
Hola Juan,

It looks like very nice. Congrats for the effort.

I wonder if the "Auto stretch image previews" has an option to link or not RGB Channel. Thinking in my images they will be all red when linked RGB channel.

Saludos,
Alejandro.

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: PixInsight 1.8 — New File Explorer window
« Reply #12 on: 2012 August 27 01:39:55 »
Hola Alejandro

Thank you :)

Quote
I wonder if the "Auto stretch image previews" has an option to link or not RGB Channel.

This is a good point. Right now the automatic stretch feature works with linked channels, so it shows the true contents of the images regarding color casts. I can change this very easily, though.

So I would like to pose the following questions for the automatic stretch feature of the new File Explorer window:

(1) Should we use a "linked channels" stretch, that is, apply a single histogram transformation to the three channels of RGB images? This option preserves the existing color casts in the generated thumbnail images.

(2) Should we use an "unlinked channels" stretch, that is, apply a different histogram transformation to each nominal channel of RGB images? This option removes overall color casts automatically.

(3) Should we have both options available? This would double the amount of disk space required to store File Explorer's cache.

???
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Josh Lake

  • PixInsight Old Hand
  • ****
  • Posts: 424
Re: PixInsight 1.8 — New File Explorer window
« Reply #13 on: 2012 August 27 04:16:22 »
I would favor option 2, unlinked. I always switch to this mode right away to get the best sense of what I'm working with. I know that I'll be able to handle the color cast in one of my first steps, so I use the unlinked mode until I'm ready.

However, I'd only like the stretch option to occur on linear data, of course -- is there the option to turn it off when perusing non-linear images?

Offline Alejandro Tombolini

  • PTeam Member
  • PixInsight Jedi
  • *****
  • Posts: 1267
    • Próxima Sur
Re: PixInsight 1.8 — New File Explorer window
« Reply #14 on: 2012 August 27 04:40:57 »
Hola Juan,

I think the best choise for visualization is the second option. The fist one would not be usefull for modified dsrl cameras as they will be showed as a red thumbnail.