Author Topic: Issues with BatchPreProcessing  (Read 15639 times)

Offline Eddy Timmermans

  • PixInsight Addict
  • ***
  • Posts: 149
Re: Issues with BatchPreProcessing
« Reply #15 on: 2013 October 03 00:01:40 »
No, same remarks.
DSS does the job (lights + flats + darks + bias) but creates an awful image.
So I guess there is something wrong with my darks.
I made some darks a few days ago (same lenght, same temperature)
I will use those and see

Thx
Eddy

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: Issues with BatchPreProcessing
« Reply #16 on: 2013 October 03 12:14:40 »
Hi Eddy,

To help you, we need to see one of the images that are giving you problems. Can you upload it somewhere?
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: Issues with BatchPreProcessing
« Reply #17 on: 2013 October 03 12:20:03 »
Hi Mick,

I would also like to know if it is possible for the script to write to a log of some sort.

Eddy

Every operation performed during BatchPreprocessing is written to the Process Console. You may need to increase the limit on the number of lines the console displays when working on a large stack of images. You can do this in the Global Preferences under the Miscellaneous Process Settings. Set to zero for unlimited lines(mouse-over for info box).

That's correct. In addition, you can use the new log file generation functionality in PixInsight 1.8. Enter the following command in PixInsight's console for details:

help log

Examples: To enable a log file on UNIX/Linux:

log -f /tmp/mylogfile.log

On Windows, you could use:

log -f C:/mylogfile.log

To stop log file generation:

log --close

The generated log file can be edited with PixInsight's Script Editor. Hope this helps.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Eddy Timmermans

  • PixInsight Addict
  • ***
  • Posts: 149
Re: Issues with BatchPreProcessing
« Reply #18 on: 2013 October 03 16:02:23 »
Juan,

I will upload 10 of eacht to my dropbox an send you the link

Eddy
THX

Offline Eddy Timmermans

  • PixInsight Addict
  • ***
  • Posts: 149
Re: Issues with BatchPreProcessing
« Reply #19 on: 2013 October 03 21:48:43 »
In the Photos folder you will find 10 images of each.

https://www.dropbox.com/sh/9l8083vibr391t0/d3_LyiE5Dk

Offline Eddy Timmermans

  • PixInsight Addict
  • ***
  • Posts: 149
Re: Issues with BatchPreProcessing
« Reply #20 on: 2013 October 03 22:14:04 »
I'm currently adding 15 more lights.
Is 25 enough to check what could be the error ?
These 25 have the lowest FWHM values of the series

Eddy

Offline Phil Leigh

  • PixInsight Addict
  • ***
  • Posts: 220
Re: Issues with BatchPreProcessing
« Reply #21 on: 2013 October 04 02:12:50 »
Eddy - I am processing your files now...
how did you create the master Bias file - it looks very strange to me. It has a visible Bayer pattern!
Can you upload some proper bias files (not a master bias)?
regards
Phil

Offline Eddy Timmermans

  • PixInsight Addict
  • ***
  • Posts: 149
Re: Issues with BatchPreProcessing
« Reply #22 on: 2013 October 04 02:17:22 »
I think it was created by DSS.
I will load the individual frames this evening.

Thank you for trying to sort this out.
I was very surprised it didn't work this time.
My previous image worked flawlessly.
So I think the problem lies within my images soemwhere  :-\

Eddy

Offline Phil Leigh

  • PixInsight Addict
  • ***
  • Posts: 220
Re: Issues with BatchPreProcessing
« Reply #23 on: 2013 October 04 02:21:52 »
I am running the Batch Processing Script right now with lights+flats+darks (no bias)... should be finished in about 20 minutes.

Unfortunately you can't reuse a master bias file from DSS in Pi. DSS writes non-standard tif files.

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: Issues with BatchPreProcessing
« Reply #24 on: 2013 October 04 02:43:37 »
Hi,

The master bias (MasterOffset_ISO1600.tif) has been created by DeepSkyStacker. Please don't use master calibration frames generated with other applications. You *have* to generate all master calibration frames with PixInsight if you want to preprocess your images with PixInsight.

Quote
DSS writes non-standard tif files

It is a valid, standards-compliant TIFF file storing an unsigned 16-bit CFA image. The problem is not with standards, but with the data values stored in the file. In general, master frame generation is unique to each application.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline Eddy Timmermans

  • PixInsight Addict
  • ***
  • Posts: 149
Re: Issues with BatchPreProcessing
« Reply #25 on: 2013 October 04 03:03:53 »
Juan,

That's what I did the previous time when eveything worked fine.
But I stored the master bias on my external hard drive which was in use by my teenage daughter.
So I used one  that was on my laptop.  :-[

I'll try again this evening

Thank you for the feedback

Eddy

Offline Phil Leigh

  • PixInsight Addict
  • ***
  • Posts: 220
Re: Issues with BatchPreProcessing
« Reply #26 on: 2013 October 04 03:26:39 »
@Eddy - The good news is that the light and dark frames look to be "OK". The flats look to have some problems to me... I'm re-calibrating without flats to show you the difference.

@ Juan - You are correct about the DSS master bias. However, DSS does generate some strange files. The autosave.tif file appears to be 16-bit data in a 32-bit tif file... some applications cannot open it unless you convert it to a "proper" 16-bit tif file using ImageMagick or similar. If you use the "file - save as" command in DSS, the resultant tif file is very odd. It looks like 8-bit data in a 16-bit file... really strange.

Anyway, as you say the issue here is that you can't use a DSS master calibration file in Pi.


Offline Eddy Timmermans

  • PixInsight Addict
  • ***
  • Posts: 149
Re: Issues with BatchPreProcessing
« Reply #27 on: 2013 October 04 03:34:46 »
Phil,

Thank you for your efforts.
However I also tried to stack only lights and darks, but that didn't work.
When te tool started stacking I got an error message saying that the reference frame had no stars or signal.

So, if everything works out fine, could you send me the settings you used ?

Eddy

Offline Phil Leigh

  • PixInsight Addict
  • ***
  • Posts: 220
Re: Issues with BatchPreProcessing
« Reply #28 on: 2013 October 04 04:00:29 »
So here are the first results: on the left is the script out put for just lights+darks, on the right lights+darks+flats. I have done an STF stretch and run ABE on both images.

The flats are not working properly.
I will upload the batch settings shortly...

Offline Eddy Timmermans

  • PixInsight Addict
  • ***
  • Posts: 149
Re: Issues with BatchPreProcessing
« Reply #29 on: 2013 October 04 04:06:11 »
Phil,

Thank you.
The left one looks OK I think. I uploaded only 25 images, I made 240 during that run.

I' curious about the settings. I didn't change them I think.

Eddy