Author Topic: Hot/Cold Pixels  (Read 19489 times)

Offline sreilly

  • PixInsight Padawan
  • ****
  • Posts: 791
    • Imaging at Dogwood Ridge Observatory
Hot/Cold Pixels
« on: 2013 February 10 09:47:27 »
My work flow prior to PI was to calibrate all data using appropriate flats, darks, and bias frames, and then run the Kernel Filter to remove Hot/Dead Pixels. In MaxIm you can set a threshold of % for each and I've always used 80% for dead and 20% for hot pixels. I've just started looking at the Cosmetic Correction Module and not sure how to accomplish the same results. On the image I've been working on, a wide field image of the Cone Nebula, I've seen issues that are not present if I calibrate using MaxIm and run the Kernel Filters for Hot/Dead pixels, and then continue in PI. So that seems to be a factor. I don't think it's the calibration as I've always seemed to get a cleaner calibration when in PI with PI made master calibration darks and calibrated flats. Maybe I'm wrong but in the interest of moving ahead and learning something here I'd like some input. I do used dithered guiding BTW. Maybe it's in my rejection method when combining using Image Integration? Sorry to reference other software's but that's what I've used and know.

Thanks for any insight. I'll post cropped examples soon.
Steve
www.astral-imaging.com
AP1200
OGS 12.5" RC
Tak FSQ-106ED
ST10XME/CFW8/AO8
STL-11000M/FW8/AO-L
Pyxis 3" Rotator
Baader LRGBHa Filters
PixInsight/MaxIm/ACP/Registar/Mira AP/PS CS5

Offline sreilly

  • PixInsight Padawan
  • ****
  • Posts: 791
    • Imaging at Dogwood Ridge Observatory
Re: Hot/Cold Pixels
« Reply #1 on: 2013 February 10 11:31:33 »
The image on the left has just been combined without hot/dead pixel removal in MaxIm. Image on right had hot/dead removal before combine in PI.
Steve
www.astral-imaging.com
AP1200
OGS 12.5" RC
Tak FSQ-106ED
ST10XME/CFW8/AO8
STL-11000M/FW8/AO-L
Pyxis 3" Rotator
Baader LRGBHa Filters
PixInsight/MaxIm/ACP/Registar/Mira AP/PS CS5

Offline pfile

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 4729
Re: Hot/Cold Pixels
« Reply #2 on: 2013 February 10 12:47:24 »
i think those are ringing artifacts caused by the lanczos interpolation in staralignment. you can try messing around with the clamping factor or switch back to bilinear...

Offline sreilly

  • PixInsight Padawan
  • ****
  • Posts: 791
    • Imaging at Dogwood Ridge Observatory
Re: Hot/Cold Pixels
« Reply #3 on: 2013 February 10 14:02:25 »
Well let me ask this, at what stage should cosmetic_correction be used and is there any information on just how to use this?
Steve
www.astral-imaging.com
AP1200
OGS 12.5" RC
Tak FSQ-106ED
ST10XME/CFW8/AO8
STL-11000M/FW8/AO-L
Pyxis 3" Rotator
Baader LRGBHa Filters
PixInsight/MaxIm/ACP/Registar/Mira AP/PS CS5

Offline Harry page

  • PTeam Member
  • PixInsight Jedi Knight
  • *****
  • Posts: 1458
    • http://www.harrysastroshed.com
Re: Hot/Cold Pixels
« Reply #4 on: 2013 February 10 14:30:22 »
Harry Page

Offline sreilly

  • PixInsight Padawan
  • ****
  • Posts: 791
    • Imaging at Dogwood Ridge Observatory
Re: Hot/Cold Pixels
« Reply #5 on: 2013 February 10 14:35:53 »
Fantastic, why didn't I just look at your site?

Thanks Harry, Steve.
Steve
www.astral-imaging.com
AP1200
OGS 12.5" RC
Tak FSQ-106ED
ST10XME/CFW8/AO8
STL-11000M/FW8/AO-L
Pyxis 3" Rotator
Baader LRGBHa Filters
PixInsight/MaxIm/ACP/Registar/Mira AP/PS CS5

Offline sreilly

  • PixInsight Padawan
  • ****
  • Posts: 791
    • Imaging at Dogwood Ridge Observatory
Re: Hot/Cold Pixels
« Reply #6 on: 2013 February 10 15:17:37 »
Harry, as usual you have a clear explanation. One thing that I don't see is that when I load my master flats, which are designated by East/West, such as seen in the capture image. These are acquired using ACP with MaxIm and include the use of a 3" Pyxis rotator thus the East/West side reporting. The Batch Preprocessing doesn't see this as seen below. Is there a way to use these properly? I'm thinking I'll need to process these with doing all East exposures first in one group with the appropriate East master flats and then the West images with their West master flats. Is this correct?
Steve
www.astral-imaging.com
AP1200
OGS 12.5" RC
Tak FSQ-106ED
ST10XME/CFW8/AO8
STL-11000M/FW8/AO-L
Pyxis 3" Rotator
Baader LRGBHa Filters
PixInsight/MaxIm/ACP/Registar/Mira AP/PS CS5

Offline sreilly

  • PixInsight Padawan
  • ****
  • Posts: 791
    • Imaging at Dogwood Ridge Observatory
Re: Hot/Cold Pixels
« Reply #7 on: 2013 February 10 15:20:18 »
With just the East master Flats I still get only one being shown as a master flat.
Steve
www.astral-imaging.com
AP1200
OGS 12.5" RC
Tak FSQ-106ED
ST10XME/CFW8/AO8
STL-11000M/FW8/AO-L
Pyxis 3" Rotator
Baader LRGBHa Filters
PixInsight/MaxIm/ACP/Registar/Mira AP/PS CS5

Offline sreilly

  • PixInsight Padawan
  • ****
  • Posts: 791
    • Imaging at Dogwood Ridge Observatory
Re: Hot/Cold Pixels
« Reply #8 on: 2013 February 15 12:13:37 »
What I found is that I could load my flats files individually and they would load as red/Bin 1 and so on. Then BPP would create a master of each that could be used in future BPP runs without issue. See below:
Steve
www.astral-imaging.com
AP1200
OGS 12.5" RC
Tak FSQ-106ED
ST10XME/CFW8/AO8
STL-11000M/FW8/AO-L
Pyxis 3" Rotator
Baader LRGBHa Filters
PixInsight/MaxIm/ACP/Registar/Mira AP/PS CS5

Offline sreilly

  • PixInsight Padawan
  • ****
  • Posts: 791
    • Imaging at Dogwood Ridge Observatory
Re: Hot/Cold Pixels
« Reply #9 on: 2013 February 15 15:44:28 »
I'm still very confused and concerned of my not being able to get good hot/cold pixel rejection using the Cosmetic Correction tool. I took my raw images into CCDStack and MaxImDl and calibrated using my darks, flats, and bias frames. In MaxImDl there is the Kernel tool to remove hot/Dead pixels that has always worked well for me and no mystery on using it. CCDStack has pixel rejection methods of which I use as seen below. I love PI and use it more than any other software I own. I can not get the real time preview to work so I can't see what the settings are actually doing as far as rejecting pixels. I have watched Harry's video and followed along using my images. Maybe a difference in versions? Currently I'm using 1.8 RC3 fully up to date. I don't know where else I could be in error. Any suggestions would be great. I've posted a page that has the images for comparrison here http://www.astral-imaging.com/IC410-Wide%20Field.htm

-Steve
Steve
www.astral-imaging.com
AP1200
OGS 12.5" RC
Tak FSQ-106ED
ST10XME/CFW8/AO8
STL-11000M/FW8/AO-L
Pyxis 3" Rotator
Baader LRGBHa Filters
PixInsight/MaxIm/ACP/Registar/Mira AP/PS CS5

Offline Harry page

  • PTeam Member
  • PixInsight Jedi Knight
  • *****
  • Posts: 1458
    • http://www.harrysastroshed.com
Re: Hot/Cold Pixels
« Reply #10 on: 2013 February 15 23:26:50 »
Hi

Can you let me have some images/darks and I will have a look  ;D

Harry
Harry Page

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: Hot/Cold Pixels
« Reply #11 on: 2013 February 16 02:30:40 »
Steve,

As Harry has said, we need a good sample of your data in order to help you. How about packing the whole set as a zip file and uploading it? Do you have an Endor account (http://endor.uv.es/) ?
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline sreilly

  • PixInsight Padawan
  • ****
  • Posts: 791
    • Imaging at Dogwood Ridge Observatory
Re: Hot/Cold Pixels
« Reply #12 on: 2013 February 16 08:11:07 »
Quote
Do you have an Endor account (http://endor.uv.es/) ?

No, I don't. I can upload a zipped folder to my web page for download but I fear they will be large as the camera I'm using is the STL-11000M, about 20 MBs per image. Larger if they are masters or calibrated.

-Steve
Steve
www.astral-imaging.com
AP1200
OGS 12.5" RC
Tak FSQ-106ED
ST10XME/CFW8/AO8
STL-11000M/FW8/AO-L
Pyxis 3" Rotator
Baader LRGBHa Filters
PixInsight/MaxIm/ACP/Registar/Mira AP/PS CS5

Offline sreilly

  • PixInsight Padawan
  • ****
  • Posts: 791
    • Imaging at Dogwood Ridge Observatory
Re: Hot/Cold Pixels
« Reply #13 on: 2013 February 16 08:38:33 »
I've uploaded a zipped folder that has my -30-600 second master dark and a raw light to http://www.astral-imaging.com/PI-Images.zip Total size is 33MBs.

-Thanks
Steve
www.astral-imaging.com
AP1200
OGS 12.5" RC
Tak FSQ-106ED
ST10XME/CFW8/AO8
STL-11000M/FW8/AO-L
Pyxis 3" Rotator
Baader LRGBHa Filters
PixInsight/MaxIm/ACP/Registar/Mira AP/PS CS5

Offline sreilly

  • PixInsight Padawan
  • ****
  • Posts: 791
    • Imaging at Dogwood Ridge Observatory
Re: Hot/Cold Pixels
« Reply #14 on: 2013 February 16 09:19:35 »
I've also uploaded a set of 6 raw uncalibrated frames here http://www.astral-imaging.com/PI-IC410_Images.zip 84.6 MBs
Steve
www.astral-imaging.com
AP1200
OGS 12.5" RC
Tak FSQ-106ED
ST10XME/CFW8/AO8
STL-11000M/FW8/AO-L
Pyxis 3" Rotator
Baader LRGBHa Filters
PixInsight/MaxIm/ACP/Registar/Mira AP/PS CS5