Author Topic: Out of Memory Error  (Read 4941 times)

Offline cfranks

  • PixInsight Addict
  • ***
  • Posts: 138
Out of Memory Error
« on: 2010 June 02 21:11:31 »
Similar to H0ughy's above, but not.

I get the Out of Memory error with ImageIntegration trying to integrate 100 Bias frames.  If I rerun with a smaller number of files, the Process runs very fast, indicating that the files were still in a Cache somewhere and the EOM error suggests this Cache is not large enough.  Is this Cache a part of PI as I haven't found a parameter anywhere that I can increase.  I run Win7 4GB RAM.
Thx
Charles

Offline Nocturnal

  • PixInsight Jedi Council Member
  • *******
  • Posts: 2727
    • http://www.carpephoton.com
Re: Out of Memory Error
« Reply #1 on: 2010 June 02 22:20:10 »
You are running on a 64b flavor of Win7? If not then only part of that 4GB is available to the OS.

I don't know how PI's combine routines work but if it uses memory to store intermediate data then I can see how you can run out of room. DeepSkyStacker uses disk files so it has no trouble with large sets of bias files. I regularly combine 100 6MP bias and flat files with DSS which is a 32b application.
Best,

    Sander
---
Edge HD 1100
QHY-8 for imaging, IMG0H mono for guiding, video cameras for occulations
ASI224, QHY5L-IIc
HyperStar3
WO-M110ED+FR-III/TRF-2008
Takahashi EM-400
PIxInsight, DeepSkyStacker, PHD, Nebulosity

Offline Juan Conejero

  • PTeam Member
  • PixInsight Jedi Grand Master
  • ********
  • Posts: 7111
    • http://pixinsight.com/
Re: Out of Memory Error
« Reply #2 on: 2010 June 03 01:01:58 »
Hi Charles,

ImageIntegration's cache is managed automatically; it requires a very small amount of RAM to store image statistical data and cannot be the cause of an out-of-memory error (unless you run under really severe memory constraints, but in such case PI probably wouldn't even run, anyway).

The probable cause is the amount of RAM required by all pixel buffers. There is an independent buffer for each integrated image. The default buffer size is 16 MB so with 100 images you're needing in excess of 1.6 GB (which, considering suboptimal memory allocation, may easily require 2 GB of effective allocated space). If you're running a 32-bit version of Windows, then here's the problem. Note that in such case your 4 GB are not available to applications due to the default Windows 32-bit memory management policy.

Try lowering the Buffer size parameter; for example, try setting it to 8 or 4 MB. If you enter zero for this parameter, then ImageIntegration will use just the space required to store one row of pixels, which is the absolute minimum. This may have a severe impact on performance though, as it will increase the frequency of disk accesses and will degrade the performance of multithreaded pixel rejection routines, but will probably let you work.
Juan Conejero
PixInsight Development Team
http://pixinsight.com/

Offline cfranks

  • PixInsight Addict
  • ***
  • Posts: 138
Re: Out of Memory Error
« Reply #3 on: 2010 June 03 18:02:29 »
Thanks for the replies.  Yes, Win 7 is my business system and is only 32bit.  My home system is 64 bit so I am OK for doing my actual work.  I will try reducing the buffer size by a small amount and see what happens.
Regards
Charles