Author Topic: Rejecting hot pixels in small sets  (Read 5163 times)

Offline papaf

  • PixInsight Addict
  • ***
  • Posts: 182
Rejecting hot pixels in small sets
« on: 2011 April 04 01:20:33 »
Hi all,
I'm facing a problem and I'm unable to get the better of it. I hope someone will chime in with some suggestion.
I work with a b/w camera, and because of very high time constraint, I shoot very few color images and tend to spend my time on luminance. I generally shoot 3 images per color channel.
The problem is that I cannot get rid of some hot pixels, which admittedly are very few, but still... I use dithering, and I can see in the stacked images that they don't overlap. I can literally count three green, three red and three blue hot pixel. Now, correct me if I'm wrong, but shouldnt non overlapping and clearly out of place pixels get obliterated by pretty much every pixel rejection algorithm? Why are they still there, and what could I do?

Thanks!

Fabio

Offline Philip de Louraille

  • PixInsight Addict
  • ***
  • Posts: 289
Re: Rejecting hot pixels in small sets
« Reply #1 on: 2011 April 04 05:37:29 »
I think that you need 4 or more such frames... What options are you using in the ImageIntegration fields?
1) Image Integration
2) Pixel Rejection (1)
Philip de Louraille

Offline Nocturnal

  • PixInsight Jedi Council Member
  • *******
  • Posts: 2727
    • http://www.carpephoton.com
Re: Rejecting hot pixels in small sets
« Reply #2 on: 2011 April 04 06:31:46 »
Hi Fabio,

the way I would get rid of such hot pixels is to detect them in your dark frame and averaging them out before stacking. Do you have dark frames that match your lights well enough that you can see the same hot pixels?

Filipe is right that sigma rejection algorithms probably need more than 3 frames to work well. You'd say that with 3 values you could detect an outlier but it depends on how much the outlier sticks out and what your sigma value is. You could experiment with a spreadsheet and a few real values from your stack.
Best,

    Sander
---
Edge HD 1100
QHY-8 for imaging, IMG0H mono for guiding, video cameras for occulations
ASI224, QHY5L-IIc
HyperStar3
WO-M110ED+FR-III/TRF-2008
Takahashi EM-400
PIxInsight, DeepSkyStacker, PHD, Nebulosity

Offline papaf

  • PixInsight Addict
  • ***
  • Posts: 182
Re: Rejecting hot pixels in small sets
« Reply #3 on: 2011 April 04 06:42:20 »
Thanks to the both of you.
I'll have to check tonight for the parameters, but I keep them on defaults.
For the darks, I don't have any, since my camera is Sony based and doesn't need them. I thought with 3, which is the minimum, I could get rid of those few pixels.. I guess they're so few I could even go in and take them out myself...

Fabio

Offline Nocturnal

  • PixInsight Jedi Council Member
  • *******
  • Posts: 2727
    • http://www.carpephoton.com
Re: Rejecting hot pixels in small sets
« Reply #4 on: 2011 April 04 06:53:27 »

Hi Fabio,

my QHY8 doesn't need darks either but I use them for hot pixel detection. I don't stack with them. I wrote a utility to quickly fix hot pixels.

http://www.tungstentech.com/Software/FixFITS/tabid/78/Default.aspx

Best,

    Sander
---
Edge HD 1100
QHY-8 for imaging, IMG0H mono for guiding, video cameras for occulations
ASI224, QHY5L-IIc
HyperStar3
WO-M110ED+FR-III/TRF-2008
Takahashi EM-400
PIxInsight, DeepSkyStacker, PHD, Nebulosity

Offline Philip de Louraille

  • PixInsight Addict
  • ***
  • Posts: 289
Re: Rejecting hot pixels in small sets
« Reply #5 on: 2011 April 04 10:27:53 »
In the ImageIntegration step, you do not want to use the defaults for the Pixel Reject (1)
Use Winsorized Sigma Clipping and scale + zero offset.

In the ImageIntegration subwindow above, use additive+scaling
Philip de Louraille

Offline papaf

  • PixInsight Addict
  • ***
  • Posts: 182
Re: Rejecting hot pixels in small sets
« Reply #6 on: 2011 April 05 04:31:51 »
Thanks again.
Philip, I tried your settings but I'm afraid I simply have too little info here, as the result is the same.
Sander, will your program do something like the Cosmetic correction script in PI?

Fabio

Offline Nocturnal

  • PixInsight Jedi Council Member
  • *******
  • Posts: 2727
    • http://www.carpephoton.com
Re: Rejecting hot pixels in small sets
« Reply #7 on: 2011 April 05 12:15:26 »
Fabio,

I don't know what that process does :) My program finds hot pixels with statistical analysis and fixes them by replacing them with the average of its neighbors. With an OSC camera (default) it uses pixels 2 columns away.
Best,

    Sander
---
Edge HD 1100
QHY-8 for imaging, IMG0H mono for guiding, video cameras for occulations
ASI224, QHY5L-IIc
HyperStar3
WO-M110ED+FR-III/TRF-2008
Takahashi EM-400
PIxInsight, DeepSkyStacker, PHD, Nebulosity

Offline papaf

  • PixInsight Addict
  • ***
  • Posts: 182
Re: Rejecting hot pixels in small sets
« Reply #8 on: 2011 April 06 04:20:41 »
But it still needs darks, right? You can't do it without them?

Fabio

Offline Nocturnal

  • PixInsight Jedi Council Member
  • *******
  • Posts: 2727
    • http://www.carpephoton.com
Re: Rejecting hot pixels in small sets
« Reply #9 on: 2011 April 06 06:46:20 »
Quote
my QHY8 doesn't need darks either but I use them for hot pixel detection. I don't stack with them. I wrote a utility to quickly fix hot pixels.
Best,

    Sander
---
Edge HD 1100
QHY-8 for imaging, IMG0H mono for guiding, video cameras for occulations
ASI224, QHY5L-IIc
HyperStar3
WO-M110ED+FR-III/TRF-2008
Takahashi EM-400
PIxInsight, DeepSkyStacker, PHD, Nebulosity

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: Rejecting hot pixels in small sets
« Reply #10 on: 2011 April 09 01:08:48 »
Quote
I wrote a utility to quickly fix hot pixels.

... which could be ported to PI, even as a command-line utility, or even better, with both a CLI and a GUI ...  ::)  :angel:
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Nocturnal

  • PixInsight Jedi Council Member
  • *******
  • Posts: 2727
    • http://www.carpephoton.com
Re: Rejecting hot pixels in small sets
« Reply #11 on: 2011 April 09 06:11:24 »
Yes but it's working fine and is already available for free so why bother? If I could make a buck I'd give it a go.  >:D
Best,

    Sander
---
Edge HD 1100
QHY-8 for imaging, IMG0H mono for guiding, video cameras for occulations
ASI224, QHY5L-IIc
HyperStar3
WO-M110ED+FR-III/TRF-2008
Takahashi EM-400
PIxInsight, DeepSkyStacker, PHD, Nebulosity