Author Topic: New Tool: Superbias  (Read 28130 times)

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
New Tool: Superbias
« on: 2014 July 05 13:23:33 »
Hi all,

I have just released an update to the ImageCalibration module that includes a new tool: Superbias. This update is now available on all supported platforms: FreeBSD, Linux, Mac OS X, and Windows.

The Superbias method was created by Vicent Peris, and initially implemented as an unofficial module by Carlos Milovic, back in 2011. Today we have released a completely revised implementation as a new standard PixInsight tool.

The Superbias algorithm generates a noise-free master bias frame, equivalent to a master bias integrated from thousands of individual bias frames, by extracting pixel-to-pixel differences with vertical (or horizontal) orientation and large-scale structures from a real master bias. The better the source master bias you use, the better the generated superbias will be, but excellent results can be obtained from a master integrating a reduced number of frames, say just 20 or 40 bias frames. You can use a superbias for image calibration purposes, just as a regular master bias frame. By calibrating your data with a superbias, you save the noise introduced by subtraction of a real master bias frame, and your images benefit from a more accurate modelling of the bias signal.

The new implementation uses the multiscale median transform (MMT) to perform the necessary multiscale analysis. Previously the starlet transform (AKA à trous wavelet transform) was used, which is now also available as an option. The MMT, despite being computationally expensive, is now used by default because it is much better at isolating structures in the multiscale representation. The new tool also implements a robust trimmed mean algorithm to compute the mean value of each column (or row), which replaces a previous implementation using more traditional statistical methods (one-step rejection based on the standard deviation), and an option to remove large-scale gradients from the internal working images used for calculation of mean column (row) values. Most of these features have been suggested recently by Mr. Peris.

To use Superbias, open a master bias frame and apply the Superbias tool to it. It's just that simple. A new image window will be generated with the superbias frame, which you can save to a FITS file for later use. To inspect a superbias, you should use the ScreenTransferFunction tool (STF), or simply press Ctrl(Cmd)+A to apply STF AutoStretch. Using 24-bit STF LUTs is necessary in most cases.

See the following screenshot for an example of superbias generation. In this case the source master bias has been integrated from 40 bias frames.


I hope you'll find this new tool useful. Thank you for your continued support.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Andres.Pozo

  • PTeam Member
  • PixInsight Padawan
  • ****
  • Posts: 927
Re: New Tool: Superbias
« Reply #1 on: 2014 July 06 04:44:00 »
I don't know if I am doing something wrong, but the SuperBias process doesn't seem to work with my bias images. I have a QSI540 with a KAI-04022 sensor. This sensor produces quite "dirty" raw images but the calibration fixes them very well.
I have applied SuperBias to a 200 frame bias and the result is worse than the original. In the original there are partially lighter columns that in the SuperBias go fully from top to bottom. I have attached a cropped comparison of the same area.

I don't know whether this process can be used with my camera or I am doing something wrong.

Offline vicent_peris

  • PTeam Member
  • PixInsight Padawan
  • ****
  • Posts: 988
    • http://www.astrofoto.es/
Re: New Tool: Superbias
« Reply #2 on: 2014 July 06 05:09:50 »
Hi,

The Superbias tool is designed to reproduce the column structure of the bias pattern, so it doesn't work with bias frames with partial columns. But I think we can think on a solution for this and publish an update in the future.

Thanks,
Vicent.

Offline btracy

  • Newcomer
  • Posts: 7
Re: New Tool: Superbias
« Reply #3 on: 2014 July 06 07:56:38 »
I got the same sort of results as Andres.  The master bias was built from 20 frames from my ST-8300.  Could be that I am at (or below) the minimum needed for the new process to work.

Bob
Bob Tracy
Driftwood, TX

Offline Carlos Milovic

  • PTeam Member
  • PixInsight Jedi Master
  • ******
  • Posts: 2172
  • Join the dark side... we have cookies
    • http://www.astrophoto.cl
Re: New Tool: Superbias
« Reply #4 on: 2014 July 06 09:05:00 »
Bob, are you looking at the data with the 24bits STF enabled?
Regards,

Carlos Milovic F.
--------------------------------
PixInsight Project Developer
http://www.pixinsight.com

Offline btracy

  • Newcomer
  • Posts: 7
Re: New Tool: Superbias
« Reply #5 on: 2014 July 06 09:09:41 »
Yes.
Bob Tracy
Driftwood, TX

Offline vicent_peris

  • PTeam Member
  • PixInsight Padawan
  • ****
  • Posts: 988
    • http://www.astrofoto.es/
Re: New Tool: Superbias
« Reply #6 on: 2014 July 06 09:37:50 »
Bob, enable the track view of the STF to see the STF settings of the regular bias. Then, drag and drop the triangle over the superbias image to apply the same STF settings to both images.

V.

Offline btracy

  • Newcomer
  • Posts: 7
Re: New Tool: Superbias
« Reply #7 on: 2014 July 06 10:22:52 »
Thanks Vincent,

I didn't think about that at the time, too much of a newbie.  Looks better when you apply the same stretch.  I really appreciate the help.

Bob
Bob Tracy
Driftwood, TX

Offline Harry page

  • PTeam Member
  • PixInsight Jedi Knight
  • *****
  • Posts: 1458
    • http://www.harrysastroshed.com
Re: New Tool: Superbias
« Reply #8 on: 2014 July 06 10:48:51 »
Hi
I also have this problem !!!

Harry


I don't know if I am doing something wrong, but the SuperBias process doesn't seem to work with my bias images. I have a QSI540 with a KAI-04022 sensor. This sensor produces quite "dirty" raw images but the calibration fixes them very well.
I have applied SuperBias to a 200 frame bias and the result is worse than the original. In the original there are partially lighter columns that in the SuperBias go fully from top to bottom. I have attached a cropped comparison of the same area.

I don't know whether this process can be used with my camera or I am doing something wrong.
Harry Page

Offline ftherrmann

  • PixInsight Enthusiast
  • **
  • Posts: 83
Re: New Tool: Superbias
« Reply #9 on: 2014 July 06 15:10:33 »
Here's a 24 bit display.  Doesn't look right to me.  STT-8300.  The partial column went full length and it generated a type of moire pattern.  I can't see this working better than the original bias.

Fred

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: New Tool: Superbias
« Reply #10 on: 2014 July 06 16:00:15 »
Bias frames with partial columns are still not supported by the Superbias tool. Sorry for the inconvenience. We'll release a new version to overcome this limitation, but probably not before September.

Quote
...it generated a type of moire pattern.

Superbias images definitely require 24-bit STF for proper visualization. I see some screenshots posted here where normal 16-bit STFs are still being used.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline brew

  • Newcomer
  • Posts: 47
Re: Superbias and MaximDL
« Reply #11 on: 2014 July 06 17:19:21 »
I created some superbias frames, then tried to use them in MaximDL. Maxim does not recognize the frames as Bias frames in the Calibration Setup tab.

After experimenting, I found that the IMAGTYPE keyword in the Fits header needed to be changed. PI is using "Master Bias", while Maxim is looking for "BIAS". When I changed this keyword, the frames worked as expected.

I am another ACP user, so I need to use Maxim for image collection. Calibration is very convenient, since the images are calibrated as they are collected. I do not have to do anything, the calibrated images are ready the next morning. I use PI for alignment and everything after that.


Offline sedonapete

  • Newcomer
  • Posts: 1
Re: New Tool: Superbias
« Reply #12 on: 2014 July 06 17:36:18 »
Works a treat for me.

Thanks for all the work.

Offline vpcirc

  • Newcomer
  • Posts: 34
Re: New Tool: Superbias
« Reply #13 on: 2014 July 06 18:18:09 »
Worked great with my 16803 chip and 40 bias frames, now if only it could work on darks!

Offline ftherrmann

  • PixInsight Enthusiast
  • **
  • Posts: 83
Re: New Tool: Superbias
« Reply #14 on: 2014 July 06 18:21:01 »
Juan,

Yes I was aware of the column issue.  I am however more concerned with the pattern that the SuperBias is producing.  This same pattern is also seen in other images posted.  I did select 24 bit from PI.  Is there a 24 bit setting somewhere else that I need to set?  I know of only one place and that's at the bottom of the PI screen.

Thanks,

Fred