Author Topic: Using the defect map  (Read 16701 times)

Offline Geoff

  • PixInsight Padawan
  • ****
  • Posts: 908
Using the defect map
« on: 2012 May 03 00:56:17 »
I have no idea how to use this feature. My naive assumption is that one of its uses would be to build a map of hot/cold pixels, which can saved and used in image calibration.  Can someone clarify the use of this tool?
Geoff
Don't panic! (Douglas Adams)
Astrobin page at http://www.astrobin.com/users/Geoff/
Webpage (under construction) http://geoffsastro.smugmug.com/

Offline Carlos Milovic

  • PTeam Member
  • PixInsight Jedi Master
  • ******
  • Posts: 2172
  • Join the dark side... we have cookies
    • http://www.astrophoto.cl
Re: Using the defect map
« Reply #1 on: 2012 May 03 10:27:08 »
Hi Geoff

Juan already have the documentation of this process, and should release it soon (I hope so...).

In the meanwhile: This process uses a hot/cold/bad pixel map that you created by other means (for example, simple binarization of a master dark frame). The idea is that it uses only information from neighbouring pixels to replace the bad pixel. You select the neighbourhood shape, but the size is automatically calculated, depending on the number of bad pixels surrounding the current pixel to fix.
Regards,

Carlos Milovic F.
--------------------------------
PixInsight Project Developer
http://www.pixinsight.com

Offline Harry page

  • PTeam Member
  • PixInsight Jedi Knight
  • *****
  • Posts: 1458
    • http://www.harrysastroshed.com
Re: Using the defect map
« Reply #2 on: 2012 May 03 11:49:43 »
Hi

I do show how to use it here http://www.harrysastroshed.com/Calibration.html  :-*

Harry
Harry Page

Offline Geoff

  • PixInsight Padawan
  • ****
  • Posts: 908
Re: Using the defect map
« Reply #3 on: 2012 May 03 17:27:27 »
This process uses a hot/cold/bad pixel map that you created by other means (for example, simple binarization of a master dark frame). The idea is that it uses only information from neighbouring pixels to replace the bad pixel. You select the neighbourhood shape, but the size is automatically calculated, depending on the number of bad pixels surrounding the current pixel to fix.
Thanks Carlos.  I have now tried this but the process seems incredibly slow.  I must be doing something wrong.  I binarized a dark frame, then loaded the binarized frame into the DefectMap panel and dragged the new instance triangle to a light frame. I thought it had hung up, showing 0% in the Process Console for a long time, but then it moved on to 1% and after I'd had a shower it had got to 3%, so I aborted.
Hi

I do show how to use it here http://www.harrysastroshed.com/Calibration.html  :-*

Harry
Thanks Harry.  Yes I've used the CosmeticCorrection tool following your video and it works very well.  I was exploring the DefectMap (Process > ImageCalibration > DefectMap) as an additional arrow to my bow.
Geoff
Don't panic! (Douglas Adams)
Astrobin page at http://www.astrobin.com/users/Geoff/
Webpage (under construction) http://geoffsastro.smugmug.com/

Offline Geoff

  • PixInsight Padawan
  • ****
  • Posts: 908
Re: Using the defect map
« Reply #4 on: 2012 May 03 17:42:41 »
I have now tried this but the process seems incredibly slow.  I must be doing something wrong.  I binarized a dark frame, then loaded the binarized frame into the DefectMap panel and dragged the new instance triangle to a light frame. I thought it had hung up, showing 0% in the Process Console for a long time, but then it moved on to 1% and after I'd had a shower it had got to 3%, so I aborted.

OK I've figured it out.  I was doing something wrong. (The error often lies between the back of the chair and the keyboard.)  After binarizing the dark frame, you have to invert it and use the inverted image as the defect map.
Don't panic! (Douglas Adams)
Astrobin page at http://www.astrobin.com/users/Geoff/
Webpage (under construction) http://geoffsastro.smugmug.com/

Offline Carlos Milovic

  • PTeam Member
  • PixInsight Jedi Master
  • ******
  • Posts: 2172
  • Join the dark side... we have cookies
    • http://www.astrophoto.cl
Re: Using the defect map
« Reply #5 on: 2012 May 04 07:01:00 »
Sorry, this happens quite often with this tool... I've been wondering if I should change the policy of its internal workings to make it a bit more intuitive  (anyway, it was explained in the documentation (Juan....)).
Regards,

Carlos Milovic F.
--------------------------------
PixInsight Project Developer
http://www.pixinsight.com

Offline LukeB

  • Newcomer
  • Posts: 20
  • Live Long And Prosper
Re: Using the defect map
« Reply #6 on: 2012 July 06 22:14:47 »
Guys,
I just want to thank you all for these VERY helpful processing tips.

I have applied them to a couple of the images that were causing me much dismay and thanks to you guys I feel that I have made some progress at last.

Harry, your tutorials are just fantastic and I would have been far behind without them.

Cheers,
Luke
QSI583WS, QSI520ci, Loadstar Guide camera, Orion SSAG
GSO 250mm RC @F8, SW ED80, WS150 Acro
Orion SteadyStar AO
Paramount ME, EQ6
The Sky6, MaxImDL5 Pro, Starry Night Pro 6
PixInsight, ImagesPlus, Nebulosity, DeepSkyStacker

Offline mads0100

  • PixInsight Addict
  • ***
  • Posts: 116
Re: Using the defect map
« Reply #7 on: 2013 February 26 20:28:28 »
Just wanted to spell this out for future readers of this post since there is no documentation for the DefectMap:

1. Create a master dark
2. Use the Binarize tool.  You'll need to play around with this using the slider (and lower than the slider will go) to get the value low enough to highlight your hot/cold pixels.
3. Invert the image.
4. Save as your DefectMap.
5. Open your un-calibrated images
6. Use the DefectMap tool. This will allow you to select your DefectMap view.  I don't know what the various options mean nor is there any tool tips for the various options.  Hopefully someone else can fill this in for us. 

Now, apply the 'triangle' to each image.  You'll notice the noise is significantly reduced similar to calibrating with darks.  In addition, it will correct defects such as hot/cold pixels.

I hope this will help someone else.  It really saved the data I was gathering as just using darks wasn't enough. 

Offline cfranks

  • PixInsight Addict
  • ***
  • Posts: 138
Re: Using the defect map
« Reply #8 on: 2013 February 27 03:26:02 »
I just tried the above sequence and get an 'invalid memory read operation' error.  It is such a simple process that Mads0100 kindly listed that I can't see what I might have done wrong.
Ripley RC3, Win 7  64 bit, 16GB RAM

Charles


Offline Geoff

  • PixInsight Padawan
  • ****
  • Posts: 908
Re: Using the defect map
« Reply #9 on: 2013 February 27 04:21:02 »
I just tried the above sequence and get an 'invalid memory read operation' error.  It is such a simple process that Mads0100 kindly listed that I can't see what I might have done wrong.
Ripley RC3, Win 7  64 bit, 16GB RAM

Charles
I've also been getting that lately, but it's inconsistent. I've been waiting till I load  v1.8 before raising bug reports
Don't panic! (Douglas Adams)
Astrobin page at http://www.astrobin.com/users/Geoff/
Webpage (under construction) http://geoffsastro.smugmug.com/

Offline Carlos Milovic

  • PTeam Member
  • PixInsight Jedi Master
  • ******
  • Posts: 2172
  • Join the dark side... we have cookies
    • http://www.astrophoto.cl
Re: Using the defect map
« Reply #10 on: 2013 February 27 05:12:51 »
Does this error happen with the average operator? There was a bug (that i fixed, but i'm not sure that Juan updated the repository with the new code).
Regards,

Carlos Milovic F.
--------------------------------
PixInsight Project Developer
http://www.pixinsight.com

Offline derrickf

  • Newcomer
  • Posts: 24
Re: Using the defect map
« Reply #11 on: 2013 February 27 05:21:52 »
Does this error happen with the average operator? There was a bug (that i fixed, but i'm not sure that Juan updated the repository with the new code).

In my case Mean and Gaussian operators work without errors, the other three operators (Median, Minimum and Maximum) throw the error reported above.

HTH

Derrick

Offline Carlos Milovic

  • PTeam Member
  • PixInsight Jedi Master
  • ******
  • Posts: 2172
  • Join the dark side... we have cookies
    • http://www.astrophoto.cl
Re: Using the defect map
« Reply #12 on: 2013 February 27 05:28:27 »
Ok, so it could be the same bug I already fixed. I think we have to wait until RC4 is launched to put pressure on Juan to update this.
Regards,

Carlos Milovic F.
--------------------------------
PixInsight Project Developer
http://www.pixinsight.com

Offline Geoff

  • PixInsight Padawan
  • ****
  • Posts: 908
Re: Using the defect map
« Reply #13 on: 2013 February 28 17:15:50 »
Does this error happen with the average operator? There was a bug (that i fixed, but i'm not sure that Juan updated the repository with the new code).

In my case Mean and Gaussian operators work without errors, the other three operators (Median, Minimum and Maximum) throw the error reported above.

HTH

Derrick
+1
Don't panic! (Douglas Adams)
Astrobin page at http://www.astrobin.com/users/Geoff/
Webpage (under construction) http://geoffsastro.smugmug.com/

Offline cfranks

  • PixInsight Addict
  • ***
  • Posts: 138
Re: Using the defect map
« Reply #14 on: 2013 March 01 03:48:55 »
Thanks for the info, I will wait for RC4.  I tried 'Mean' for the Operation and had no failure so I just played around a bit with it.

Charles