PixInsight Forum

Software Development => New Scripts and Modules => Topic started by: mmisiura1 on 2019 June 15 16:13:10

Title: StarNet - new module for star removal
Post by: mmisiura1 on 2019 June 15 16:13:10
Hi, everyone!

For I while now (more than a year) I have been working on a new process for star removal. It is a specially trained neural network that is supposed to remove all the stars in one simple step and does not require any parameters to tune. It just works (or sometimes it does not :D).

Anyway, I released it a while ago and it was shown to work pretty well for most users. I was getting a lot of good feedback and also was asked a lot for a PI module version of the program.

So here is the link to download the new module: https://sourceforge.net/projects/starnet/files/PixInsight_module/

I consider it to be a beta release, so there might be some bugs. Also, one downside for now is that PI freezes and does not reply while the code is running. So keep that in mind and try on a small image at first.

Please read README.txt file for all the instructions and caveats. You can find some more information, discussion and examples of images if you search 'StarNet' on AB or in my releases on AB:

https://www.astrobin.com/409279/
https://www.astrobin.com/339099/


Let me know how it works for you! Also, it would be nice if someone could give me some idea on how to make PI not to freeze while the code is running!

Thank you!
Title: Re: StarNet - new module for star removal
Post by: dld on 2019 June 15 22:46:43
Hello Nikita,

I did some experiments with the command line tool and now with the module. It works well with my widefield images. The equation image = starless + stars seems to hold, and can be exploited to separate and treat stars and nebulosity differently. For that reason, I believe StarNet is a solution to the nebula/stars dynamic range problem and not for creating starless images :cheesy:

Thank you for this great tool!
Title: Re: StarNet - new module for star removal
Post by: Bernie on 2019 June 16 12:38:34
Hello Nikita

Great job and thank you so much for your work!

- Bernie
Title: Re: StarNet - new module for star removal
Post by: Juan Conejero on 2019 June 17 01:59:50
Hi Nikita,

Thank you so much for porting your work to PixInsight. This is a very interesting development project and a great contribution to our platform. Welcome to PixInsight development.

I am here to help and assist you with everything you need to develop this new module. Just a few remarks to help get this project running:

- To help you we need your C++ source code. Assuming that your want to release this module as an open-source project (as you already have done with the Python version), I have invited you to join us at our official GitLab repositories. You should upload your module implementation as a new merge request to the PCL repository.

- Any officially supported PixInsight module must be available on Linux, macOS and Windows at least. Note also that the reference implementation of PixInsight is the Linux version, so a Linux version of your module is necessary as soon as possible. Although I haven't seen your code, the only problem I can detect for this to happen with your module is its strong dependency on TensorFlow. Fortunately, TensorFlow is available as a stable C API on all required platforms, so this problem has an obvious solution. Since it has been released under Apache License, we can integrate the required parts of TensorFlow with our standard PCL distribution, just as a new third-party library. I assume that TensorFlow manages all GPU code and its associated dependencies internally on each platform, so we really don't need to care about this directly—let me know if I am wrong about this (we might have problems in such case).

- I see that only nonlinear (stretched) images can be processed. Is this an unavoidable limitation of the implemented algorithms, or just the result of lack of network training? The ability to work with linear images would be a very important feature of this process (example: deconvolution). If this is an algorithmic limitation I can devise some ways to circumvent it, which would be relatively easy to implement.

Congratulations for making possible a very exciting and useful project. Thank you again for sharing it with the PixInsight community.
Title: Re: StarNet - new module for star removal
Post by: dld on 2019 June 17 02:52:53
- I see that only nonlinear (stretched) images can be processed. Is this an unavoidable limitation of the implemented algorithms, or just the result of lack of network training? The ability to work with linear images would be a very important feature of this process (example: deconvolution). If this is an algorithmic limitation I can devise some ways to circumvent it, which would be relatively easy to implement.

For a reasonable invertible stretch function, and assuming StarNet preserves the bit depth of its input, maybe something can be done :)

I'll experiment on this later today ;)

EDIT/UPDATE:

After stretching a linear grayscale image using a simple MTF function, splitting into stars/background using StarNet, applying the inverse MTF separately at stars and background image, and then adding the result together, I noticed a loss in highlights. The most probable reasons for this are:  It is not easy to find non-trivial functions f for which f(x) + f(y) = f(x+y) (think f being the inverse MTF and x,y the stretched background and stars respectively). My lack of knowledge on imaging processing fundamentals (albeit the documentation on HistogramTransformation was very helpful).

I'll end this here since it's the wrong place for this, and I'll patiently wait for your thoughts on the subject.
Title: Re: StarNet - new module for star removal
Post by: paulsartory on 2019 June 17 17:21:30
Love to try this out but I keep getting the "missing checkpoint file" error. Downloaded the zip file and reinstalled the files as per instructions several times but to no avail?
Title: Re: StarNet - new module for star removal
Post by: paulsartory on 2019 June 17 17:43:42
I managed to use the command line exe (outside of PI) without a problem and it is very effective
Title: Re: StarNet - new module for star removal
Post by: paulsartory on 2019 June 17 18:27:02
Further clarification...the standalone exe is from the windows application not the PI process module.. ;)
Title: Re: StarNet - new module for star removal
Post by: paulsartory on 2019 June 17 21:20:15
Update....StarNet worked in a new PI "instance" but not within an existing project...I use a default project setup when starting PI for processing.
Title: Re: StarNet - new module for star removal
Post by: paulsartory on 2019 June 17 22:05:31
Yet another update :P!!!....Fired up my Default project setup and it now works fine...not sure why I had to launch and close a new instance for it to work within a project?
Title: Re: StarNet - new module for star removal
Post by: paulsartory on 2019 June 18 00:27:48
I think I spoke to soon...seems you still get the "missing checkpoint file" error whenever you run it within a saved project file
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 June 21 17:27:07
I think I spoke to soon...seems you still get the "missing checkpoint file" error whenever you run it within a saved project file

Thank you for your messages, your experiments can be very helpful for me! Could you please give me a recipe how to reproduce this problem? I never used saved project files and not sure what you mean by 'running within saved project file'?

I tried saving project file and then loading it back, and StarNet still worked fine...

Thank you!
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 June 21 17:35:59
- I see that only nonlinear (stretched) images can be processed. Is this an unavoidable limitation of the implemented algorithms, or just the result of lack of network training? The ability to work with linear images would be a very important feature of this process (example: deconvolution). If this is an algorithmic limitation I can devise some ways to circumvent it, which would be relatively easy to implement.

For a reasonable invertible stretch function, and assuming StarNet preserves the bit depth of its input, maybe something can be done :)

I'll experiment on this later today ;)

EDIT/UPDATE:

After stretching a linear grayscale image using a simple MTF function, splitting into stars/background using StarNet, applying the inverse MTF separately at stars and background image, and then adding the result together, I noticed a loss in highlights. The most probable reasons for this are:  It is not easy to find non-trivial functions f for which f(x) + f(y) = f(x+y) (think f being the inverse MTF and x,y the stretched background and stars respectively). My lack of knowledge on imaging processing fundamentals (albeit the documentation on HistogramTransformation was very helpful).

I'll end this here since it's the wrong place for this, and I'll patiently wait for your thoughts on the subject.

What you describe is actually one approach I was thinking of, but didn't get to try yet, so your input can be really useful here. Not sure why you would want to add back stars, however?) I thought that you just stretch the image, remove stars and then 'destretch' result back into its original form. Then, assuming that all the nebulosity is dim, you would get good image.

Anyway, I didn't think too much about it for now, but definitely something I should try and find out.

Thank you very much for your input! Feel free to let me know about your further experiments, if you want!
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 June 21 18:11:23
Juan,

Thank you vary much! I am glad to be helpful for the community! So far working with PCL was a real pleasure, BTW, so writing the existing code took not that much effort as I thought it would initially. And I am not too much of a C++ programmer really, this is basically my first code in C++ ever.

Compiling for different platforms is a biggest issue for now. I wonder, how do you guys do it? Do you have a few separate machines with different OS and compile binaries using those? Are there no shortcuts?

As far as I understand, tensorflow should not be a problem, it handles everything internally as you said. Don't see any problems here.

The fact that current implementation does not support linear images is that I could not get training data for those. As you probably know, to train a good neural network, you need a hefty amount of training data. In this case I had to spent countless hours removing stars in Photoshop by hand. Those were obviously stretched images. I don't know how to do this for linear data. Note, that using some other methods rather than 'by hand' will most likely leave artifacts and NN will learn to reproduce those artifacts. In other words, results generated by NN will always be worse than training data, so to get good results in this way, the training data should be next to perfect. This is one limitation I know of, there should be no technical limitations, but I can not say for sure right now.
Title: Re: StarNet - new module for star removal
Post by: paulsartory on 2019 June 21 20:28:37
Hello Nikita,

The error occurs if you launch Pixinsight by clicking on the project file rather launching Pixinsight first.

Cheers
Paul
Title: Re: StarNet - new module for star removal
Post by: acmalko on 2019 June 22 06:13:29
It works well, thanks :)

Tried 128 et 8 size stride. The last one was very time consuming  :sealed: ;D ;D

I've re-read the instructions written in the stand-alone version to remember what "stride" meant
Perhaps add those instructions in the readme file of the pi version ;)

Good job :) and thank you
Title: Re: StarNet - new module for star removal
Post by: dld on 2019 June 24 07:53:29
I thought that you just stretch the image, remove stars and then 'destretch' result back into its original form. Then, assuming that all the nebulosity is dim, you would get good image.

Hello Nikita, this is a great point!

For a starless region and an invertible MTF, the InverseMTF of MTF(starless) should return starless ;) Thus we can subtract the InverseMTF(starless) from the linear image and obtain the stars. No need to complicate things and trying to solve a more difficult mathematical problem (https://en.wikipedia.org/wiki/Cauchy%27s_functional_equation)!

I'll have to find some time to work on this. In the meantime, any input is always welcome!
Title: Re: StarNet - new module for star removal
Post by: praspekt on 2019 June 24 22:06:46
just tried to install starnet and it's not coming up when I search for it in pixinsight install modules. when I do an api check, everything is api version 0x162. i'm running a mac.

any advice?

thanks
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 June 24 22:20:22
it's windows-only at this point (unless something changed since i downloaded the zipfile a while back.)

rob
Title: Re: StarNet - new module for star removal
Post by: sfacchin on 2019 June 25 11:26:55
Hi Nikita,
I tried to install the module, but PI does not recognize it. I dowlnoaded the Starnet_PI folder and copied its contents into the folder C:\Program Files\PixInsight\bin.
I tried the command Install Module on the PI, the following messages appeared on a snall information window:

0 additional PixInsight module(s) were found on directory:
C:/Program Files/PixInsight/bin.

I'm running on windows 764 bits Ultimate up to date and with the last PI release.
Could you help me?

Thanks in advance for your support and best regards,
Sergio (Venice Italy)
Title: Re: StarNet - new module for star removal
Post by: John Massey on 2019 June 25 13:10:08
I had the same issue, my cpu is to old. reference the readme text file that came with Starnet.
"Second, the tensorflow.dll was compiled to support AVX instructions
and will only work if your CPU supports these AVX instructions.
Which means that CPUs made before 2011 will not work."
Title: Re: StarNet - new module for star removal
Post by: praspekt on 2019 June 25 13:28:32
it's windows-only at this point (unless something changed since i downloaded the zipfile a while back.)

rob

Thanks! I was so excited about it, I must have skipped over that part. would be amazing if it could be made for Mac!!!
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 June 25 13:28:55
you may be able to download a tensorflow.dll compiled without AVX instructions from tensorflow.org. if not, the only other option would be to recompile tensorflow from scratch for your CPU. it will be slow, but it will probably work.

https://tensorflow.org

rob
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 June 25 13:30:47
it's windows-only at this point (unless something changed since i downloaded the zipfile a while back.)

rob

Thanks! I was so excited about it, I must have skipped over that part. would be amazing if it could be made for Mac!!!

i think nikita is working on that, but had some trouble with it.

rob
Title: Re: StarNet - new module for star removal
Post by: pbkoden on 2019 June 25 17:33:21
Thank you for this. Your add-in works amazingly and this is a great native process addition to Pixinsight. I will be keeping an eye on this thread for further development. Some things I would love to see at some point in the future:



But great work!
Title: Re: StarNet - new module for star removal
Post by: sfacchin on 2019 June 26 10:42:28
 Hi,
probably my CPU is to old. In the weekend I'll try with a newer one.

     Thanks and best regards to all,
     Sergio
Title: Re: StarNet - new module for star removal
Post by: dave_galera on 2019 June 27 13:23:57
Hi Nikita,

I have downloaded the Mac version and it works perfectly with your supplied test .tif files, however, when I convert a .jpg file to a .tif file in Photoshop it does not work.......it goes through the motions and says done but does not save the processed image.....any ideas?

Thanks,
Dave

This is the console log:
Daves-MBP:StarNet_MacOS davewatson$ /Users/davewatson/Desktop/StarNet_MacOS/run_rgb_starnet.sh /Users/davewatson/Desktop/StarNet_MacOS/test.tif
Reading input image... Done!
Bits per sample: 16
Samples per pixel: 3
Height: 712
Width: 1048
Restoring neural network checkpoint... Done!
2019-06-27 22:17:59.934499: I tensorflow/core/platform/cpu_feature_guard.cc:141] Your CPU supports instructions that this TensorFlow binary was not compiled to use: SSE4.2 AVX AVX2 FMA
Total number of tiles: 204
100% finished

Done!
Title: Re: StarNet - new module for star removal
Post by: dave_galera on 2019 June 27 13:38:24
OK I sorted it the tif file was 8 bit and not 16 bit

Sry, Dave
Title: Re: StarNet - new module for star removal
Post by: dave_galera on 2019 June 28 09:16:53
My bad, I should have also congratulated Nikita on a superb piece of software....thanks

Dave
Title: Re: StarNet - new module for star removal
Post by: sfacchin on 2019 June 28 11:59:45
 Hello to all,
I tried again on the I5 processor, and the followoing error appeared.
Any idea? Could someone help me?

   Thanks a lot and best regards,
   Sergio

StarNet: Processing view: NGC7023_1920_1080
Writing swap files...
239.349 MiB/s
Starting star removal procedure...
Stride: 8
Image size: 1080x1920
Number of channels: 3
Color space: RGB
Bits per sample: 16
Has alpha channels: false
Float sample: false
Restoring neural network checkpoint...
 Error: Checkpoint file not found!
Reading swap files...
290.779 MiB/s
<* failed *>
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 June 28 23:02:10
Hello to all,
I tried again on the I5 processor, and the followoing error appeared.
Any idea? Could someone help me?

   Thanks a lot and best regards,
   Sergio

StarNet: Processing view: NGC7023_1920_1080
Writing swap files...
239.349 MiB/s
Starting star removal procedure...
Stride: 8
Image size: 1080x1920
Number of channels: 3
Color space: RGB
Bits per sample: 16
Has alpha channels: false
Float sample: false
Restoring neural network checkpoint...
 Error: Checkpoint file not found!
Reading swap files...
290.779 MiB/s
<* failed *>


Did you try restarting PI? Try that first.

If it will not work even after that, please go to process console, type 'pwd' command and copy the output here.

Thank you!
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 June 28 23:11:47
Sorry, I see I missed quite a bit. For some reason I am no longer getting notifications about new posts in this thread. Thank you all for kind words. Looks like Rob already sorted out most of the issues, but I will make a few remarks:

1. By this moment I am sure that if PI does not list StarNet as a new module in the search window, that means your CPU is not supported and the code will not work anyway.

2. If you installed module, but still getting checkpoint error, try restarting PI. If that still does not help, try opening Process Console and run 'pwd' command. Ideally, that should output PI's bin directory address, in my case its
C:/Program Files/PixInsight/bin
If it outputs something different, then try typing:
cd "C:/Program Files/PixInsight/bin"
Or other path depending on your PI's installation location. And don't forget double quotes here! That should solve the problem, I think. I will try to address this issue in the next version.

3. PI plugin for MacOS is on the way. I am a bit busy right now, but still working on it.

4. I do not recommend changing stride value anymore. Just live it at 128. It is much simpler to correct remaining artifacts in PS. The reason for that is that as you decrease the stride value, artifacts get less notable, yes, but on the other hand you start getting more of them since image is processed in smaller tiles.
Title: Re: StarNet - new module for star removal
Post by: astroedo on 2019 July 02 03:34:51
Thank you for the great job.

I have a request if it is not too compicate to do.
At the moment the "create starmask" flag allows to create the starmask when checked OR the starless image if unchecked.

It would be possible having BOTH? the starless image and the starmask image (eventually in a new image)

I know that I can get the same result with PixelMath with the "Normal_IMG-Starless_IMG" expression, but I'm a lazy guy  :D :P

Thank you very much!
Title: Re: StarNet - new module for star removal
Post by: dld on 2019 July 02 05:40:08
Hello StarNet fans,

If you haven't noticed it, the StarNet module seems to respect masks! Useful when you do want those tiny galaxies in your images!
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 July 02 21:12:44
Thank you for the great job.

I have a request if it is not too compicate to do.
At the moment the "create starmask" flag allows to create the starmask when checked OR the starless image if unchecked.

It would be possible having BOTH? the starless image and the starmask image (eventually in a new image)

I know that I can get the same result with PixelMath with the "Normal_IMG-Starless_IMG" expression, but I'm a lazy guy  :D :P

Thank you very much!

That will be implemented for sure in the next release!
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 July 02 21:14:20
Hello StarNet fans,

If you haven't noticed it, the StarNet module seems to respect masks! Useful when you do want those tiny galaxies in your images!

I actually didn't have to do anything for that - PI handles masks automatically! 8)
Title: Re: StarNet - new module for star removal
Post by: sfacchin on 2019 July 04 12:54:03
 Hello mmisiura1,
I restarted several times PI, but not good results. The pwd command response is the following:

pwd
C:/Program Files/PixInsight

   Regardas,
   Sergio
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 July 05 15:17:05
Hello mmisiura1,
I restarted several times PI, but not good results. The pwd command response is the following:

pwd
C:/Program Files/PixInsight

   Regardas,
   Sergio


Sergio,

Open the Process Console and paste the following command:

cd "C:/Program Files/PixInsight/bin"

After that, StarNet will work. I will address this issue in the next version.
Title: Re: StarNet - new module for star removal
Post by: sfacchin on 2019 July 08 12:32:33
 Hello,
now it works! Excellent tool and very useful.

        Thanks for your support and best regards,
         Sergio
Title: Re: StarNet - new module for star removal
Post by: mguandalini on 2019 July 11 00:57:50
Hi I'm Marco
I have two PC, a latop and desktop
When i install starnet on desktop, i have no problem, PI find a new module without error
On my latop Olivetti i try more time to search a module but PI don't recognise the form, even if the files are copied to the right folder
Please can you help me to solve this problem?
Thanks
Marco
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 July 12 15:58:48
Hi I'm Marco
I have two PC, a latop and desktop
When i install starnet on desktop, i have no problem, PI find a new module without error
On my latop Olivetti i try more time to search a module but PI don't recognise the form, even if the files are copied to the right folder
Please can you help me to solve this problem?
Thanks
Marco

Hi, Marco!

That means that the code will not work on your laptop! You can find more details in my posts above in this thread and in the README file distributed with StarNet to get more info on why!
Title: Re: StarNet - new module for star removal
Post by: gunny on 2019 July 13 09:10:41
  I had great hopes that this module would work.  I tried it on two different computers where I loaded into program files for PI bin and no luck. All files were present as shown in the readme section of the download.  Must be the cpu limitation.  Is there anyway that this can be further refined so that it operates with all cpu's?
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 July 14 16:57:08
  I had great hopes that this module would work.  I tried it on two different computers where I loaded into program files for PI bin and no luck. All files were present as shown in the readme section of the download.  Must be the cpu limitation.  Is there anyway that this can be further refined so that it operates with all cpu's?

This "limitation" isn't there for no reason. It's crucial to get decent performance and is very unlikely to go away. Please read README file for more information!
Title: Re: StarNet - new module for star removal
Post by: monkeybird747 on 2019 July 15 09:46:00
I will be anxiously awaiting the Linux version of this tool!
Title: Re: StarNet - new module for star removal
Post by: Robert Q. Kimball on 2019 July 16 19:54:56
Will this work on Mac OS machine?
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 July 16 21:05:34
not yet... the only module that exists right now is for windows. however there is a standalone program called starnet++ that runs on macosx. you need some familiarity with the osx command line to use it though.

rob
Title: Re: StarNet - new module for star removal
Post by: dave_galera on 2019 July 17 04:14:02
not yet... the only module that exists right now is for windows. however there is a standalone program called starnet++ that runs on macosx. you need some familiarity with the osx command line to use it though.

rob

And I can confirm that starnet++ on MacOS works perfectly well

Dave
Title: Re: StarNet - new module for star removal
Post by: Robert Q. Kimball on 2019 July 22 10:48:05
I am trying to run StarNet++ on my MAC OS but have never used the terminal before.  I have manage to open the Terminal and change the directory and list the contents of the folder I was assumming the something like exec run_rgb_starnet.sh would run the file but it didn't work.  Could you help me?
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 July 22 11:06:44
you don't need exec, you can either do:

chmod +x ./run_rgb_starnet.sh
./run_rgb_starnet.sh

that's going to run starnet with canned input and output filenames and a stride of 64. the input filename will have to be "rgb_test5.tif" (no quotes of course) and it will output the starless version in "rgb_test5_s.tif". you only have to do the chmod thing once.

if you want to just run starnet on some arbitrary file:

chmod +x ./rgb_starnet++
./rgb_starnet++ your_input_filename.tif whatever_output_filename_you_like.tif

i think nikita has recommended to just run with the default stride, so i have not put it on the command line shown above. also same as the first command, you only need to do the chmod +x thing one time.

rob
Title: Re: StarNet - new module for star removal
Post by: Robert Q. Kimball on 2019 July 22 16:00:18
Thank you Rob,

This the third or fouth time you've helped me over the years and I appreciate it!

I successfully ran the Mono script and got the starless output.  I then tried to repeat the process.  It didn't run.  See below:

RobertMac:StarNet_MacOS robertkimball$ chmod +x ./rgb_starnet++
RobertMac:StarNet_MacOS robertkimball$ ./run_rgb_starnet.sh
./run_rgb_starnet.sh: line 4: ./rgb_starnet++: cannot execute binary file
RobertMac:StarNet_MacOS robertkimball$
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 July 22 16:23:48
no problem on the help!

looks like you still need to do chmod +x ./run_rgb_starnet.sh

but given where you are, i think you should just skip the shell script. thinking about it more, i think the script was included in the zipfile so that one could double-click the .sh from the finder and it would just run. but that requires you to rename your input images to rgb_test5.tif every time you run it. since you're already successfully in Terminal.app and in the StarNet_MacOS directory, i think you might as well just run

./rgb_starnet++ your_input_image_name.tif whatever_you_want_to_call_the_output.tif

so maybe something like like

./rgb_starnet++ tadpoles_rgb.tif tadpoles_rgb_starless.tif

rob

Title: Re: StarNet - new module for star removal
Post by: Robert Q. Kimball on 2019 July 22 19:00:09
It's interesting that the RGB_starnet++ is of type "Alias" and the mono_starnet++ is of type "Unix Executible."  Could that be the problem?  I've got the mono_starnet working perfectly.
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 July 22 19:09:57
yeah i don’t think it should be an alias. i will check my installation when i get home.
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 July 22 19:41:49
yeah, both of course should be executables... not sure how yours became a link?

pfile% file mono_starnet++ rgb_starnet++
mono_starnet++: Mach-O 64-bit x86_64 executable, flags:<NOUNDEFS|DYLDLINK|TWOLEVEL|WEAK_DEFINES|BINDS_TO_WEAK|PIE>
rgb_starnet++:  Mach-O 64-bit x86_64 executable, flags:<NOUNDEFS|DYLDLINK|TWOLEVEL|WEAK_DEFINES|BINDS_TO_WEAK|PIE>

if you do

ls -l rgb_starnet++

you will see what it is pointing to.

rob


Title: Re: StarNet - new module for star removal
Post by: Robert Q. Kimball on 2019 July 22 19:45:10
It's the stangest thing!  I unzipped the folder again and the rgb_starnet++ was listed as Unix Executable.  It is running right now in the background.  Thanks so much for all your help.
Title: Re: StarNet - new module for star removal
Post by: Robert Q. Kimball on 2019 July 23 09:00:41
Having big fun now that Rob has helped me get StarNet++ running.  I have attached two examples.  They look much better when they are seen as 16 bit tifs.
Title: Re: StarNet - new module for star removal
Post by: SeattleStarGazer on 2019 July 24 18:36:26
Downloaded the module and moved all files into the Pixinsight bin directory. No new modules available, tried search, same thing. I'm running a pretty new workstation, Xeon processor and Quadro P5000 16 Gig graphics card. I'm new to module install, not sure what I'm missing
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 July 24 18:39:02
i wonder if the Xeon processors don't have all the vector instructions that the starnet module needs. a sanity check is to download starnet++ and see if it runs.

https://sourceforge.net/projects/starnet/

rob
Title: Re: StarNet - new module for star removal
Post by: SeattleStarGazer on 2019 July 24 20:49:28
Thanks! I did just run it from the .bat file included in the download and it worked fine. It just said the version of tensorflow included isn’t compiled to use the AVX2 extensions of the processor, but then went ahead and worked. All you are supposed to do is copy all the files in the download to the PI .bin directory then open the PI Process-> Modules command, right?

Wsyne
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 July 24 21:17:41
ok so that warning just means that if you come up with a tensorflow.dll that better supports your cpu it will run faster. i think the PI module checks if it can run and won’t install if it can’t, the most common reason being that the cpu lacks the minimum set of vector instructions. so that’s not the problem you’re having.

as for how to install the PI module, i am not sure since i usually use macosx and haven’t tried installing it on my windows machine (the module only exists for windows at this time.)

rob
Title: Re: StarNet - new module for star removal
Post by: Headworx on 2019 July 26 13:21:39
Maybe a dumb question... but how to use the StarNet++ to dim the stars (vs removing them completely) or remove the small ones and leave the big/bright ones?
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 July 26 13:32:33
you'll have to do something like this: create the starless image, then load both the starless image and the original image, and subtract the starless image from the original using pixelmath. if you are using mono images, now you have the best starmask that could ever be created. if using RGB images, you'll probably want to extract the L* from the difference image and use that as a star mask. maybe for good measure you might blur the star mask just a little bit with Atrous.

then you can do any number of things including the typical morphological transformation to dim down stars, or perhaps do a different stretch of the original image where the stars are not pushed as much, and then use pixelmath to replace the stars in the original image, thru the mask, with the dimmer stars.

rob

edit: also i forgot that of course you could blend the starless and original images together with pixelmath. although there are probably some screen-type formulae that might work best, doing a weighted average of the two images would probably be a reasonable start.
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 July 27 02:13:29
Thanks! I did just run it from the .bat file included in the download and it worked fine. It just said the version of tensorflow included isn’t compiled to use the AVX2 extensions of the processor, but then went ahead and worked. All you are supposed to do is copy all the files in the download to the PI .bin directory then open the PI Process-> Modules command, right?

Wsyne

That's pretty weird, the only other reason for that I can think of is maybe your antivirus software removes StarNet-pxm.dll from bin folder? Some people were reporting that.
Title: Re: StarNet - new module for star removal
Post by: Lammertus on 2019 July 27 11:40:11
Hi all,
I have been using the commandline IF for some time now and have seen this thread, now it is installed in Pixinsight as per the readme.txt file. Some strange behaviour though when you stretch an image with Arcsinh, then there are nearly no stars detected by starnet++ where if using the Histogram stretching or STF -> Histogram and applying, all seems to work well! Just thought to share this with you.
Regards,
Mert
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 July 27 15:35:48
Hi all,
I have been using the commandline IF for some time now and have seen this thread, now it is installed in Pixinsight as per the readme.txt file. Some strange behaviour though when you stretch an image with Arcsinh, then there are nearly no stars detected by starnet++ where if using the Histogram stretching or STF -> Histogram and applying, all seems to work well! Just thought to share this with you.
Regards,
Mert

Mert,

On one hand this seems logical, as I didn't use Arcsinh stretch and did not train the network on such images.

On the other hand, I just tried that (on a Greyscale image) and it worked flawlessly...Can you maybe share your example?
Title: Re: StarNet - new module for star removal
Post by: Lammertus on 2019 July 28 02:09:54
Hi Nikita,

Great work you have done, congratulations!!
Of course I can share images, but where do I post them to?
Maybe with a wetransfer?? Or do I embed them here in the forum
thread??
My camera is a OSC ASI1600MCC so I use debayered images.
http://lammertus.0fees.net/images/DSO/Nebulae/NGC6888-070519-10X40-RC8-UVIR-SOS-small.jpg (http://lammertus.0fees.net/images/DSO/Nebulae/NGC6888-070519-10X40-RC8-UVIR-SOS-small.jpg)
If you need more examples please feel free, easier would be
to have some way of sharing the raw files maybe? ( Wetransfer?? )
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 August 02 12:43:53
Hi Nikita,

Great work you have done, congratulations!!
Of course I can share images, but where do I post them to?
Maybe with a wetransfer?? Or do I embed them here in the forum
thread??
My camera is a OSC ASI1600MCC so I use debayered images.
http://lammertus.0fees.net/images/DSO/Nebulae/NGC6888-070519-10X40-RC8-UVIR-SOS-small.jpg (http://lammertus.0fees.net/images/DSO/Nebulae/NGC6888-070519-10X40-RC8-UVIR-SOS-small.jpg)
If you need more examples please feel free, easier would be
to have some way of sharing the raw files maybe? ( Wetransfer?? )


Mert,

Thanks, I think this one example is enough. Looking at your image I can say that the problem is that stars in your image are kinda dim and very fuzzy - I already know that starnet has problems working with such images. So the problem is not in Arcsinh stretch itself. I will try to improve that in the future versions.
Title: Re: StarNet - new module for star removal
Post by: Lammertus on 2019 August 04 09:51:24
Thanks Nikita,
I will have to take better care of my guiding!!

Regards,
Mert
Title: Re: StarNet - new module for star removal
Post by: tommy_nawratil on 2019 August 08 14:27:48
hello Nikita,

you are in for flowers and pralines and beer as much as you deserve: StarNet is working just awesome,
much less artefacts are left to be removed than with other methods I was using.
It saves lots of lifetime used up for removing masses of stupid dots, thank you so much!

Tommy
Title: Re: StarNet - new module for star removal
Post by: Bobinius on 2019 August 14 04:50:55
Hi Nikita,

I am not able to install the module, I used the link that you provided for the PI module but Pixinsight does not detect any new module in the directory when I tried to install it. Am I missing something? The zip file seems to be containing the same files as the .exe version of starnet.

Many thanks

Bogdan
Title: Re: StarNet - new module for star removal
Post by: Geoff on 2019 August 14 05:12:28
I seem to recall that you have to scroll further down the page to find the actual PixInsight link
Title: Re: StarNet - new module for star removal
Post by: Bobinius on 2019 August 15 00:39:52
Ok, I managed to found the PI link (the download link was modified I guess) and it works very well in Pixinsight.

However when I restart PI the module is no longer there and has to be reinstalled! Is this a known bug? I have the latest PI version.
Title: Re: StarNet - new module for star removal
Post by: kingjamez on 2019 August 15 13:16:58
I have two modern machines that I tried to install the PI module onto without any luck. Both are Intel Core-i7's and both have AVX according to CPU-Z. When I direct the install modules window to the unzipped Starnet_PI directory, it doesn't find any new module.

I've started and restarted PI, deleted and reinstalled, and tried it on two machines? What else can I try?

Never mind, I fixed it. You must actually follow the readme... do not copy the folder into the Pixinsight/Bin/ folder, copy the contents of the Starnet_PI folder into the /Bin folder. Even if you direct it to search the Starnet_PI folder, it will not detect unless the files are in the /bin folder.
-Jim
Title: Re: StarNet - new module for star removal
Post by: fatboy1271 on 2019 August 15 13:24:14
I just learned about StarNet today and it seems like an awesome tool! I had been asking about CloneStamp and its use on masks. Since I was trying to clean up masks with CloneStamp someone said that they use StarNet. Now I have a question as a noobie with PI:

The tutorial I'm using as a guide has you do RangeSelection to create a range_mask. After that you are supposed to use CloneStamp to touch up the range_mask. A few steps later you use StarMask. Some steps after that you use PixelMath to do range_mask - star_mask. Once again you are to use CloneStamp; however, this time it is to remove all of the stars and leave your Galaxy, Nebula, and so on.

My question is how would StarNet fit into this portion of the workflow, if at all? I'm attaching a screenshot of the entire workflow plus one of just the mask portion.

Thanks to Nakita for creating this and to anyone with any input :)
fat
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 August 18 16:29:36
Hi Nikita,

I am not able to install the module, I used the link that you provided for the PI module but Pixinsight does not detect any new module in the directory when I tried to install it. Am I missing something? The zip file seems to be containing the same files as the .exe version of starnet.

Many thanks

Bogdan

Hi, Bogdan!

Were you able to solve the issue? I think you just downloaded wrong distribution - look for file 'StarNet-pxm.dll'!
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 August 18 16:33:18
Ok, I managed to found the PI link (the download link was modified I guess) and it works very well in Pixinsight.

However when I restart PI the module is no longer there and has to be reinstalled! Is this a known bug? I have the latest PI version.

Missed this post - I don't think this is a known issue, it should not be like this... Does it just disappear from the list of installed modules?
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 August 18 16:38:00
I just learned about StarNet today and it seems like an awesome tool! I had been asking about CloneStamp and its use on masks. Since I was trying to clean up masks with CloneStamp someone said that they use StarNet. Now I have a question as a noobie with PI:

The tutorial I'm using as a guide has you do RangeSelection to create a range_mask. After that you are supposed to use CloneStamp to touch up the range_mask. A few steps later you use StarMask. Some steps after that you use PixelMath to do range_mask - star_mask. Once again you are to use CloneStamp; however, this time it is to remove all of the stars and leave your Galaxy, Nebula, and so on.

My question is how would StarNet fit into this portion of the workflow, if at all? I'm attaching a screenshot of the entire workflow plus one of just the mask portion.

Thanks to Nakita for creating this and to anyone with any input :)
fat


Hi! Thank you for kind words!

I am not sure I completely understood you - what are you trying to do with your workflow?
Title: Re: StarNet - new module for star removal
Post by: Jkulin on 2019 September 17 07:16:31
Hi,

Maybe I am being incredibly thick, but I cannot find a way to add the Script into PI

I have extracted the files from StarNet_Win.zip and then tried to add the script into PI but it said there was 0 to add.

I can run both of the .bat files and they work fine, but it would be nice to run them as a script.

Maybe I have missed it but is there a way after say you have removed the NB stars that you can then add in the RGB stars?

Apologies if this has been covered and I have missed it.

Thanks.
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 September 17 07:42:21
it's not a script, it is a module. so the "add script" menu won't do anything. are you using "Processe > Modules > Add Modules..." or "Script > Add Feature Script..."?

also since you are talking about .bat files, are you sure you downloaded the PI module and not the standalone StarNet++ executable?

rob
Title: Re: StarNet - new module for star removal
Post by: Jkulin on 2019 September 17 07:49:56
Hi Rob,

Thanks for the reply.

Yes initially I did add it as a script which failed, just tried to add it as a module and that failed, I have attached a list of the files

If I have the wrong files, can you advise of where I can download them please?

Many Thanks.

Regards,

John
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 September 17 07:52:49
yes those files are the standalone c++ version.

the PI module is here: https://sourceforge.net/projects/starnet/files/PixInsight_module/

rob
Title: Re: StarNet - new module for star removal
Post by: Jkulin on 2019 September 17 07:57:22
Thanks so much Rob, I did look everywhere, I must be blind!

Will this module allow you to put the stars back in or just remove them?
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 September 17 08:00:05
it just removes them, but what you can do is use pixelmath to subtract the starless image from the original image which creates a star mask. you can then apply that mask to the starless image and then use pixelmath to add the stars back in, with whatever modifications you've done of course (like a separate stretch which preserves star colors better or what have you)

rob
Title: Re: StarNet - new module for star removal
Post by: Jkulin on 2019 September 17 08:08:08
Thanks Rob, just tried to >process>modules.install modules and then pointed it to the directory where I have extracted them from as in C:\Program Files\PixInsight\starnet_win and o found, am I doing something wrong?
Title: Re: StarNet - new module for star removal
Post by: dave_galera on 2019 September 17 08:08:48
John, Just drop some pointers on your post on https://stargazerslounge.com/topic/341204-melotte-15/#comment-3710651

Sry can't help you on installation as I am on Mac
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 September 17 08:48:43
Thanks Rob, just tried to >process>modules.install modules and then pointed it to the directory where I have extracted them from as in C:\Program Files\PixInsight\starnet_win and o found, am I doing something wrong?

i've heard that if your CPU does not have the right AVX instructions that the module silently refuses to install. have you run starnet++ successfully from the command line? that would say whether or not your CPU is capable.

rob
Title: Re: StarNet - new module for star removal
Post by: Jkulin on 2019 September 17 08:54:48
Hi Rob,

Yes run from the command line al all perfect.

I'm running an Intel I7-3770 CPU @ 3.40GHz 16GB Ram Windows 10 Enterprise
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 September 17 10:07:30
well... did you click "recursive" and then "search" in the install modules dialog box?

rob
Title: Re: StarNet - new module for star removal
Post by: Jkulin on 2019 September 17 10:14:58
Hi Rob,

Yes I did as per attached
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 September 17 10:19:25
well... i don't know; like dave i am on a mac so i have never been able to test this. maybe someone running windows can chime in...

rob
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 September 18 15:43:56
Hi Rob,

Yes I did as per attached

You should copy files into PI's bin directory.
Title: Re: StarNet - new module for star removal
Post by: Jkulin on 2019 September 19 01:29:12
Thanks,

Just did that and still no joy.

0 Modules found either with the recursive checked or unchecked and all the files are in the c:\program files\pixinsight\bin directory
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 September 19 10:54:42
Thanks,

Just did that and still no joy.

0 Modules found either with the recursive checked or unchecked and all the files are in the c:\program files\pixinsight\bin directory

These are not PI module files, those are files for standalone version. Here is what you need: https://sourceforge.net/projects/starnet/files/PixInsight_module/
Title: Re: StarNet - new module for star removal
Post by: Jkulin on 2019 September 19 11:06:44
Thanks for that, I didn't check the download as sourceforge came up with its automatic download in 5 secs, is now I have gone and I think downloaded the correct module and will check.

Many Thanks.

NB. Update, Many Thanks, it is now working, appreciate your patience.
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 September 20 20:06:29
Thanks for that, I didn't check the download as sourceforge came up with its automatic download in 5 secs, is now I have gone and I think downloaded the correct module and will check.

Many Thanks.

NB. Update, Many Thanks, it is now working, appreciate your patience.

Yes, that automatic download is pretty confusing, I agree, but don't know how to change that...
Title: Re: StarNet - new module for star removal
Post by: photonhunter1 on 2019 September 21 09:08:01
I had the same issue, my cpu is to old. reference the readme text file that came with Starnet.
"Second, the tensorflow.dll was compiled to support AVX instructions
and will only work if your CPU supports these AVX instructions.
Which means that CPUs made before 2011 will not work."

I'm running an AMD Ryzen 1700X that is only 1.5 years old and I receive the same error message. Can it be that my relatively new AMD is not supported? Does this mean that I am unable to use the application at the command line as well? Thanks in advance for the guidance.

Mike
Title: Re: StarNet - new module for star removal
Post by: photonhunter1 on 2019 September 21 09:22:40
I had the same issue, my cpu is to old. reference the readme text file that came with Starnet.
"Second, the tensorflow.dll was compiled to support AVX instructions
and will only work if your CPU supports these AVX instructions.
Which means that CPUs made before 2011 will not work."

I'm running an AMD Ryzen 1700X that is only 1.5 years old and I receive the same error message. Can it be that my relatively new AMD is not supported? Does this mean that I am unable to use the application at the command line as well? Thanks in advance for the guidance.

I may have solved my problem - I didn't realize the auto download was not the PI file. I'm downloading the PI file and we'll try again.
Mike
Title: Re: StarNet - new module for star removal
Post by: photonhunter1 on 2019 September 21 09:27:21
I had the same issue, my cpu is to old. reference the readme text file that came with Starnet.
"Second, the tensorflow.dll was compiled to support AVX instructions
and will only work if your CPU supports these AVX instructions.
Which means that CPUs made before 2011 will not work."

I'm running an AMD Ryzen 1700X that is only 1.5 years old and I receive the same error message. Can it be that my relatively new AMD is not supported? Does this mean that I am unable to use the application at the command line as well? Thanks in advance for the guidance.

I may have solved my problem - I didn't realize the auto download was not the PI file. I'm downloading the PI file and we'll try again.
Mike

New file, same results. Does anyone know if the Ryzen 1700X does not support AVX?
Title: Re: StarNet - new module for star removal
Post by: dave_galera on 2019 September 21 09:57:37
I also get this message, but I just ignore it and everything works just fine, does it fail on your installation or is it working?
I think it may be just a general warning message.
Title: Re: StarNet - new module for star removal
Post by: photonhunter1 on 2019 September 21 17:17:52
Guess I either read the README file too quickly or I didn't understand that all of the files in the Starnet folder, with the exception of the LICENSE and README files, needed to be in PixInsight\bin and not PixInsight\bin\Starnet_PI. We're up and running. Thank you.

Mike

Title: Re: StarNet - new module for star removal
Post by: Juan Conejero on 2019 September 22 02:53:40
To Nikita and all users interested in this module,

Sorry so much for not being able to invest the required time and resources to put this module in the standard tool set. Nikita already uploaded his source code to our GitLab repository, and I have been taking a look. The module requires substantial work, but this is not difficult, just time-consuming. Perfectly normal for a new PixInsight tool.

The real problem here is TensorFlow. This is an extremely complex and huge software library (undoubtedly one of the most complex ones I've ever seen). There are several problems. Once of them is building TensorFlow on all platforms supported by PixInsight, which is not a trivial task. It is a very complex task that requires time and care. Unfortunately, the prebuilt libraries provided by Google (https://www.tensorflow.org/install/lang_c) don't work, so the only way to get this working is rebuilding everything.

Another problem is TensorFlow's dimensions. If included in PixInsight's standard distribution, it would increase the size of a PixInsight installation by about 300 MB. A fixed footprint like that is questionable to support a single module. A good solution to this problem is creating a dedicated update repository for StarNet on our official software distribution server, so the StarNet module would be an optional component. For example, the same will happen with the new Gaia star databases that we are preparing for version 1.8.7 of PixInsight.

Please bear with me while I can find the required time to perform all of these tasks as required. Currently we have a lot of priorities that require all of my attention and concentration. The new version of PixInsight comes with very important improvements (A rewritten StarAlignment tool with a completely new distortion correction algorithm, important new features in ImageIntegration and DrizzleIntegration, just to name a few) on which I have been working very hard during July, August and September. I ask for patience...
Title: Re: StarNet - new module for star removal
Post by: georg.viehoever on 2019 September 25 05:26:39
...The real problem here is TensorFlow. This is an extremely complex and huge software library (undoubtedly one of the most complex ones I've ever seen). There are several problems. Once of them is building TensorFlow on all platforms supported by PixInsight, which is not a trivial task. It is a very complex task that requires time and care. Unfortunately, the prebuilt libraries provided by Google (https://www.tensorflow.org/install/lang_c) don't work, so the only way to get this working is rebuilding everything.

Another problem is TensorFlow's dimensions. If included in PixInsight's standard distribution, it would increase the size of a PixInsight installation by about 300 MB. A fixed footprint like that is questionable to support a single module. A good solution to this problem is creating a dedicated update repository for StarNet on our official software distribution server, so the StarNet module would be an optional component. For example, the same will happen with the new Gaia star databases that we are preparing for version 1.8.7 of PixInsight.
....
Juan,

Yes, this is a real problem, and I have encountered it elsewhere as well. If you try to do everything in-process (i.e. inside the PixInsight binary), then each and every library that you use needs to be binary compatible, i.e. has to be built with a compatible compiler, and the library itself and all the libraries that it depends on need to be compatible with PixInsight and its libraries. For Tensorflow (and Python, and numpy, and scipy, and astropy, and ....) the number of dependent libs is huge.

A minimal installer for Tensorflow with Python on Linux is something like 320MB, and if you add the usual scientific stuff, you are at 640MB (compressed). Installed you are at 3.2GB.

A possible solution: Run Tensorflow et. al as an external process, and communicate with them via some RPC mechanism (like gRPC, Python pickle or the mechanism you designed for communication between PI instances). Let users install Tensorflow as an addon (for instance via the Anaconda distribution https://www.anaconda.com/distribution/, very liberal license and rather complete), which also removes from you the burden to compile all this stuff with PI.

Georg
Title: Re: StarNet - new module for star removal
Post by: Tertsi on 2019 September 29 07:12:18
I just installed PI Linux module and if I use StarNet++ process to image I get an error message:


Restoring neural network checkpoint...
*** Error: Checkpoint file not found!


I got it working after executing following command in ProcessConsole first:

cd /opt/PixInsight/bin

Then Stanet++ process woks.
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 October 02 16:58:07
A possible solution: Run Tensorflow et. al as an external process, and communicate with them via some RPC mechanism (like gRPC, Python pickle or the mechanism you designed for communication between PI instances). Let users install Tensorflow as an addon (for instance via the Anaconda distribution https://www.anaconda.com/distribution/, very liberal license and rather complete), which also removes from you the burden to compile all this stuff with PI.

This is a good idea, I personally like it, but unfortunately majority of users will hate it. Tensorflow does not come with Anaconda by default, so people will have to install it, which will be problematic for many. Plus we will have possible issues with a version control, which will cause problems for some people, I am sure.

I already tasted all this with my Python version of StarNet, many people just don't get all these things and don't wanna mess with it.
Title: Re: StarNet - new module for star removal
Post by: mmisiura1 on 2019 October 02 17:01:47
To Nikita and all users interested in this module,

Sorry so much for not being able to invest the required time and resources to put this module in the standard tool set. Nikita already uploaded his source code to our GitLab repository, and I have been taking a look. The module requires substantial work, but this is not difficult, just time-consuming. Perfectly normal for a new PixInsight tool.

The real problem here is TensorFlow. This is an extremely complex and huge software library (undoubtedly one of the most complex ones I've ever seen). There are several problems. Once of them is building TensorFlow on all platforms supported by PixInsight, which is not a trivial task. It is a very complex task that requires time and care. Unfortunately, the prebuilt libraries provided by Google (https://www.tensorflow.org/install/lang_c) don't work, so the only way to get this working is rebuilding everything.

Another problem is TensorFlow's dimensions. If included in PixInsight's standard distribution, it would increase the size of a PixInsight installation by about 300 MB. A fixed footprint like that is questionable to support a single module. A good solution to this problem is creating a dedicated update repository for StarNet on our official software distribution server, so the StarNet module would be an optional component. For example, the same will happen with the new Gaia star databases that we are preparing for version 1.8.7 of PixInsight.

Please bear with me while I can find the required time to perform all of these tasks as required. Currently we have a lot of priorities that require all of my attention and concentration. The new version of PixInsight comes with very important improvements (A rewritten StarAlignment tool with a completely new distortion correction algorithm, important new features in ImageIntegration and DrizzleIntegration, just to name a few) on which I have been working very hard during July, August and September. I ask for patience...

Juan,

Thank you for looking into it! This is not a trivial task indeed!
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 November 11 23:30:55
this has been built and released for OSX... check nikita's sourceforge page for the zipfile.

rob
Title: Re: StarNet - new module for star removal
Post by: jtalbot on 2019 November 12 08:05:41
Awesome,
Thank you Nikita...

Jon
Title: Re: StarNet - new module for star removal
Post by: dave_galera on 2019 November 12 08:46:55
Downloading it now....thanks Nikita
Title: Re: StarNet - new module for star removal
Post by: Philippe B. on 2019 November 13 04:04:00
Thank you very much, Nikita, for OSX files  ;)
Title: Re: StarNet - new module for star removal
Post by: FrankW on 2019 November 13 10:59:50
Nikita, you did a great job! Many Thanks.
Title: Re: StarNet - new module for star removal
Post by: hoxca on 2019 November 16 07:35:03
Thank you nikita.

This is just what i'm hoping for :)
Working with tensorflow outside of PI on OSX was possible but this module is very convenient.
Title: Re: StarNet - new module for star removal
Post by: KenR on 2019 November 17 06:50:10
Update....StarNet worked in a new PI "instance" but not within an existing project...I use a default project setup when starting PI for processing.

I can confirm I have the same problem. The StarNet++ module only works for me if I completely close out of PI and open a new instance, then open my image and finally StarNet++. If I try to use the module within my default project I get the "Checkpoint file not found" message. Hopefully this can be fixed in a future release because it is a very useful tool!

Thanks
Title: Re: StarNet - new module for star removal
Post by: pfile on 2019 November 17 08:57:11
that shouldnt happen on OSX, are you on windows?

rob