Author Topic: What is number of file threshold that can lead to crash  (Read 574 times)

Offline skyfall

  • Newcomer
  • Posts: 2
What is number of file threshold that can lead to crash
« on: 2020 January 04 03:57:59 »
Hi,

BIAS Integration crashed for 24 files, worked fine with 10 files. Similarly LocalNomalization crashed with 300files, and then crashed with 150 files too. LIGHT ImageIntegration also crashed with 150 LIGHT files. I had added 150 Drizzle files so total file count was 300. These crashes happened consistently. It was happening with TRAIL version of software. I thought may be FULL version is going to be different, but same problems continued.

So what I would like to know what is safe and realistic number of files?

Details
-----------
OS is Ubuntu 18.4.03
Pixinsight 1883
RAM: 24gb
Camera: Niikon Z7 (FF)

ERROR:
"Out of memory: Kill process 5910 (PixInsight) score 903 or sacrifice child"
Killed process 5910 (PixInsight) total-vm:26953212kB, anon-rss:22986624kB, file-rss:0kB, shmem-rss:27284kB
/opt/PixInsight/bin/PixInsight.sh: line 37:  5910 Killed                  /opt/PixInsight/bin/PixInsight


Thanks


Offline pfile

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 4729
Re: What is number of file threshold that can lead to crash
« Reply #1 on: 2020 January 04 09:42:28 »
you can reduce the memory footprint of ImageIntegration by adjusting the Buffer Size parameter in ImageIntegration. your DSLR files i'm sure are absolutely huge so the file limit is going to be different for your camera vs. others.

having said that, i'm not sure this is normal behavior. from your error message, the total-vm of PI was 25GB at the time it was killed. it makes me wonder about your swap configuration - it sounds like there is little to no swap available on your system.

rob

Offline skyfall

  • Newcomer
  • Posts: 2
Re: What is number of file threshold that can lead to crash
« Reply #2 on: 2020 January 08 06:03:11 »
Thanks for responding.
I will try increasing swap file size and see.