NIO: Problem creating NetCDF files larger 2GB

From: Michael Decker <m.decker_at_nyahnyahspammersnyahnyah>
Date: Thu Aug 12 2010 - 02:59:19 MDT

Dear all,

Yesterday I noticed that I was not able to create NetCDF files larger
than ~2GB using PyNIO. Strangely, it is no problem to _read_ from files
> 2GB (largest I tested was around 3GB so far). So I guess it is not a
general problem about a LARGEFILE option not being set if reading works
and only writing does not.

When the file size reaches the 2.xGB limit, nio just kills the whole
python process with the message "ncendef: ncid 65536: NetCDF: One or
more variable sizes violate format constraints". The ncid reported
varies depending on the layout of the file. The value given here is the
one I can reproduce with my test script.

I originally discovered the problem using PyNIO 1.3.0b4 yesterday. So I
upgraded to b5 but it changed nothing as far as I can tell.

Am I missing something? Does it only not work for me or is there a
general problem? Any hints are welcome.

my software versions are as follows:
Linux 2.6.30-2-amd64 #1 SMP Fri Sep 25 22:16:56 UTC 2009 x86_64
GNU/Linux (Debian stable)

Python 2.6.5 (r265:79063, Mar 20 2010, 03:56:44)

NIO 1.3.0b5 installed from PyNIO-1.3.0b5.linux-x86_64-py264-gcc432.tar.gz

numpy 1.3.0

My test script is attached.

Thanks for your help,

Michael Decker
Forschungszentrum Jülich
ICG-2: Troposphäre

pyngl-talk mailing list
List instructions, subscriber options, unsubscribe:

Received on Thu Aug 12 02:59:27 2010

This archive was generated by hypermail 2.1.8 : Fri Aug 13 2010 - 15:07:13 MDT