Author Topic: New in PixInsight 1.8.5: FrameAdaptation  (Read 10440 times)

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 6201
    • View Profile
    • http://pixinsight.com/
New in PixInsight 1.8.5: FrameAdaptation
« on: 2017 May 11 16:48:58 »
Hi all,

It's been pretty quiet here lately, so just wanted to warm things up a little bit. We have a new tool almost ready for the next 1.8.5 release of PixInsight: FrameAdaptation. This tool performs a local normalization of images based on multiscale robust statistics analysis. Here is a comparison:

Before FrameAdaptation:


After FrameAdaptation:


What you see here are screenshots of my workstation with a working/testing version of the tool. The final version will be very different. It will work in batch mode just like StarAlignment, and will have a few more parameters. In this example, the reference image is on the left. On the right we have a different image of the same data set, with much less signal and a very strong gradient. Obviously, both images have been previously calibrated and registered.

After FrameAdaptation, background and signal levels have been normalized on a pixel-per-pixel basis. The gradient is completely gone as a result of this local normalization process. FrameAdaptation will be an optional image preprocessing step between registration and integration. It has other interesting applications, such as color correction and automatic gradient modeling/correction, among others. More or less, you can think of FrameAdaptation as a local version of LinearFit, able to work at different dimensional scales.

More warm-ups coming soon, so stay tuned. The next one will probably be a new mosaic blending tool based on... let's keep this secret for now :) Just two words to describe it: *seamless* mosaics. I'm working on it.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline msmythers

  • PTeam Member
  • PixInsight Jedi
  • *****
  • Posts: 1109
    • View Profile
    • astrobin
Re: New in PixInsight 1.8.5: FrameAdaptation
« Reply #1 on: 2017 May 11 17:27:35 »
Juan

Thank you!!! :) :) :) :)

I can see this for images from multiple days or years collection.


Mike

Offline chris.bailey

  • PixInsight Addict
  • ***
  • Posts: 196
    • View Profile
Re: New in PixInsight 1.8.5: FrameAdaptation
« Reply #2 on: 2017 May 12 06:46:09 »
Oooh nice.

Chris

Offline RickS

  • PTeam Member
  • PixInsight Jedi
  • *****
  • Posts: 1214
    • View Profile
Re: New in PixInsight 1.8.5: FrameAdaptation
« Reply #3 on: 2017 May 12 07:03:57 »
Looks very useful, Juan, speaking as someone who has been blending data from multiple scope/camera combinations lately.

Offline pfile

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 3872
    • View Profile
Re: New in PixInsight 1.8.5: FrameAdaptation
« Reply #4 on: 2017 May 12 07:07:37 »
this is great - i've often worried about bad LP gradients messing up the statistics during integration and have gone as far as to run ABE on all my input frames before registration/integration. but that does not always work well because the gradient changes from hour to hour and night to night and the single set of ABE settings do not always capture the gradients properly.

so in batch mode, one should prepare a high-quality DBE'd version of the reference sub for the other frames to be adapted to?

thanks

rob

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 6201
    • View Profile
    • http://pixinsight.com/
Re: New in PixInsight 1.8.5: FrameAdaptation
« Reply #5 on: 2017 May 12 07:22:56 »
Guys, thanks.

Quote
so in batch mode, one should prepare a high-quality DBE'd version of the reference sub for the other frames to be adapted to?

Yes, this is one of this tool's main applications. After local normalization, all works better and more accurately in ImageIntegration. This tool, along with the new large scale rejection feature that we have already implemented, will make the image integration task better and easier to use than ever before. We'll put a few examples later.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Niall Saunders

  • PTeam Member
  • PixInsight Jedi Knight
  • *****
  • Posts: 1394
  • We have cookies? Where ?
    • View Profile
Re: New in PixInsight 1.8.5: FrameAdaptation
« Reply #6 on: 2017 May 12 11:27:24 »
Quote
We'll put a few examples later

There's that relativistic time frame again  :police:

Looking forward to it Juan
Cheers,
Niall Saunders
Clinterty Observatories
Aberdeen, UK

Altair Astro GSO 10" f/8 Ritchey Chr├ętien CF OTA on EQ8 mount with homebrew 3D Balance and Pier
Moonfish ED80 APO & Celestron Omni XLT 120
QHY10 CCD & QHY5L-II Colour
9mm TS-OAG and Meade DSI-IIC

Offline Ignacio

  • PixInsight Old Hand
  • ****
  • Posts: 369
    • View Profile
    • PampaSkies
Re: New in PixInsight 1.8.5: FrameAdaptation
« Reply #7 on: 2017 May 12 16:28:04 »
This one looks very promising!

Does this mean that one can skip the normalization step in ImageIntergation?

Ignacio

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 6201
    • View Profile
    • http://pixinsight.com/
Re: New in PixInsight 1.8.5: FrameAdaptation
« Reply #8 on: 2017 May 12 16:42:35 »
Hi Ignacio,

Yes, after applying FrameAdaptation to a set of frames you can disable normalization in ImageIntegration, both rejection and output normalizations.

After local normalization with respect to a common reference image (which not necessarily has to be one of the individual frames; it can be the result of a previous integration for example), all of the frames in the set are statistically compatible. FrameAdaptation functions will be included in drizzle data files (new XDRZ XML-based format), so the same normalization will be applied by the DrizzleIntegration tool. This also applies to mosaiced data, since DrizzleIntegration now supports direct integration from monochrome CFA frames (Bayer drizzle).
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Ignacio

  • PixInsight Old Hand
  • ****
  • Posts: 369
    • View Profile
    • PampaSkies
Re: New in PixInsight 1.8.5: FrameAdaptation
« Reply #9 on: 2017 May 12 17:03:35 »
Wonderful. I guess that the SNR weighting in ImageIntergration is going to work much better after FA.

Ignacio

Offline msmythers

  • PTeam Member
  • PixInsight Jedi
  • *****
  • Posts: 1109
    • View Profile
    • astrobin
Re: New in PixInsight 1.8.5: FrameAdaptation
« Reply #10 on: 2017 May 12 17:27:44 »
Juan and team!


You like making more work for us. Now I get to reprocess my old data all over again. ::) ::) ::)

Thanks for all the hard work.



Mike

Offline polare70

  • Newcomer
  • Posts: 29
    • View Profile
Re: New in PixInsight 1.8.5: FrameAdaptation
« Reply #11 on: 2017 May 12 19:50:27 »
Nice Work Juan-Tnx. !
clear skies at all;)
Astrobin page at; http://www.astrobin.com/users/orooro/

-Gemini G53F/Celestron CG5
-Apo triplet T.Sky 130/900-EDT 80/480
-Starlight Lodestar
- Moravian G2-4000,Atik 414EX

Offline tsaban

  • Newcomer
  • Posts: 49
    • View Profile
Re: New in PixInsight 1.8.5: FrameAdaptation
« Reply #12 on: 2017 May 14 20:06:25 »
Very interesting tool for me too. Since I have to do imaging at some distance from my home I only get a few hours per session. I always end up with sets of frames which differ a lot.

Thanks
Clear skies!
Tahir Saban

Offline Astrodoc

  • PixInsight Old Hand
  • ****
  • Posts: 343
    • View Profile
    • AstroDoc - Astrophotography by Ron Brecher
Re: New in PixInsight 1.8.5: FrameAdaptation
« Reply #13 on: 2017 May 24 23:47:46 »
Will the Frame Adaptation step be included in the BPP script?

Clear skies,
Ron
Clear skies,
Ron

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 6201
    • View Profile
    • http://pixinsight.com/
Re: New in PixInsight 1.8.5: FrameAdaptation
« Reply #14 on: 2017 May 25 07:29:10 »
Hi Ron,

This tool will be named MultiscaleLocalNormalization (MLN) instead of FrameAdaptation, since MLN describes much better what it does and how it works. No, MLN won't be part of BPP, since BPP must not be used for image integration of light frames. MLN will be available in the ImageIntegration tool as a new pixel rejection normalization algorithm. Thanks to MLN, pixel rejection will work independently of gradients and other local signal variations, which leads to important SNR improvements. Here is an example:


In this example we have integrated a data set with strong signal variations and gradients caused by varying atmospheric conditions. With the usual scale + zero offset rejection normalization, pixel rejection (Winsorized sigma clipping in this case) makes many mistakes because local illumination variations cannot be modeled correctly with a global image normalization. These mistakes lead to many outlier pixels surviving the rejection phase, as can be seen on the left of the above screenshot. With the MLN algorithm (on the right, applied at the scale of 256 pixels in this case), pixel rejection is virtually perfect even in this difficult case. In this example, MLN has also been applied as an output normalization for integration.

MLN, along with the new large-scale pixel rejection algorithm, are an important step forward in our image preprocessing tool chain.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/