Re: Memory problems with PyNio

From: Jesper Larsen <jl_at_nyahnyahspammersnyahnyah>
Date: Tue, 17 Apr 2007 15:14:35 +0200

On Tuesday 17 April 2007 14:42, Pavel Jurus wrote:
> I have problems when working with the large number of netcdf files. I can
> easily run out of memory - when I tried to optimize PyNgl scripts to use
> less memory, I found potential memory leak. Here is minimal example:
> Shape of the float array 'result' is (1, 30, 114, 165), so
> it should use around 30*114*165*4 ~ 2.25MB memory. Repeating assignment
> 100 times leads to python process using more than 225MB memory with no way
> to reuse this memory.

Hi Pavel,

I had the same problem a while ago. It turned out to be a memory leak in PyNIO
(only in the Numeric version - the numpy version does not seem to have this
problem). I recently got an updated build of PyNGL in which the leak was
fixed but it does not seem to have made its way to the official download
repository yet. Mary Haley might be able to provide more information on this?

My own inquiry was actually not about a memory leak - but whether there is
intentional RAM caching of data in PyNIO.

pyngl-talk mailing list
Received on Tue Apr 17 2007 - 07:14:35 MDT

This archive was generated by hypermail 2.2.0 : Tue Apr 17 2007 - 15:42:04 MDT