Author Topic: processing 'projects' or fully saved histories  (Read 17715 times)

Offline Nocturnal

  • PixInsight Jedi Council Member
  • *******
  • Posts: 2727
    • http://www.carpephoton.com
processing 'projects' or fully saved histories
« on: 2008 November 27 09:46:17 »
Hi,

I think the time has some to revisit a topic we discussed before related to saving full saved processing histories.

I look at processing the way I look at writing code. You have code revisions with comments, maybe branches and you can always return to a previous revision if something went wrong. I think this model applies nicely to image processing. PI is close to this model while the image is loaded and being processed but what's lacking is persistency. Yes, you can extract the processing history and save it but because it's not explicitly attached to the image there's a risk for confusion, at least for me.

So what I'm proposing is that PI allows you to create a Project (or some other name) which is a container for all elements needed to process your image:

- originals
- generated images such as masks and DBE images
- intermediate images that show the state of the image at processing step X
- processing steps (currently processing history) to get from image X to X+1
- preview settings
- whatever else PI needs

Most likely this could be implemented by storing everything in a user selectable directory (like Visual Studio does when you create a new project), maybe with sub subdirectories to keep things organized.

One of the consequences of this approach is that the original image can never be modified and neither can the intermediates. So the project needs to keep track of file status (timestamp or CRC based) and alert the user that the project is no longer valid.

The project could have a cleanup routine that allows the user to delete intermediate images to save image. They could be re-generated because the original is still there as well as the processing steps.

Let me know what you think.
Best,

    Sander
---
Edge HD 1100
QHY-8 for imaging, IMG0H mono for guiding, video cameras for occulations
ASI224, QHY5L-IIc
HyperStar3
WO-M110ED+FR-III/TRF-2008
Takahashi EM-400
PIxInsight, DeepSkyStacker, PHD, Nebulosity

Offline Nocturnal

  • PixInsight Jedi Council Member
  • *******
  • Posts: 2727
    • http://www.carpephoton.com
processing 'projects' or fully saved histories
« Reply #1 on: 2008 November 27 19:21:33 »
Another thing that would be nice to add is the ability to 'disable' or change a processing step anywhere in the history and have that ripple through the remaining steps. This would allow you to do things like 'what if I hadn't done that curves transform' or 'what if I'd clipped that black point a tad more'. Ideally this recalculation of the entire step would be optional so you could re-tweak a certain processing step till you liked the result and then say 'go' and the remaining steps would be applied to this new intermediate image.
Best,

    Sander
---
Edge HD 1100
QHY-8 for imaging, IMG0H mono for guiding, video cameras for occulations
ASI224, QHY5L-IIc
HyperStar3
WO-M110ED+FR-III/TRF-2008
Takahashi EM-400
PIxInsight, DeepSkyStacker, PHD, Nebulosity

Offline jshortt

  • Newcomer
  • Posts: 36
Re: processing 'projects' or fully saved histories
« Reply #2 on: 2017 February 27 11:28:40 »
I like this idea and I guess it's probably a large amount of effort to achieve.

One enhancement that could be made that would bring much of the benefit of this idea would be to add to the image history the process & parameters that were used to create the image, not just those that updated the image.

John

Offline calan

  • Newcomer
  • Posts: 34
Re: processing 'projects' or fully saved histories
« Reply #3 on: 2017 March 16 06:43:44 »
Ehhh...the last reply is 9 years old...so I think you are correct.  :)

Odd that this just popped up right after I made a post asking for the exact same functionality (disable or tweak a process in the chain, and then continue). I got shot down there also, so I guess this ain't gonna be happening if it's been asked for since 9 years ago.  :)