[daip] FITLD 2GB limit

[Eric Greisen]

Z.-Q. Shen writes:

 > I have problem in FITLD'ing data from tape when the total
 > size of data is larger than 2GB. I have run both 31DEC03
 > and 31DEC03 AIPS versions on 64-bit file system machine
 > (Solaris), even after I tried to write the compressed data
 > (douvcomp=1).
 > 
 > The abridged error message is as follows.
 > 
 > ----------------------------------------------------------
 > ...
 > FITLD1:    10000 vis. written
 > FITLD1:    20000 vis. written
 > FITLD1:    30000 vis. written
 > FITLD1: UV table spanned time:   0/13:45:15 -  0/13:55:29
 > FITLD1: Rejected    291 records based on weights
 > FITLD1:    35507 vis. written
 > FITLD1: ---------- FILE  14 LOADED ----------
 > FITLD1: Data with weight <  0.50 will be permanently flagged
 > FITLD1: Sky frequencies (MHz) before re-ordering occurs:
 > FITLD1: Incoming FREQID #   1
 > FITLD1: 43120.57  43136.57  43152.57  43168.57
 > FITLD1: Warning: table type OB is of zero length
 > FITLD1: Attaching data to ZSHEN_PASS1.UVDATA.   2 Vol:   2
 > FITLD1: CL table interval set at  0.10 minutes
 > FITLD1: Current file has    70189 visibilities
 > FITLD1: File ref. freq:    43120.57 MHz
 > FITLD1: ZEXPND: EXPANSION FAILED ON FILE DA02:UVD005001.2BF; NREC = 127004
 > FITLD1: ZERROR: ON FILE DA02:UVD005001.2BF;
 > FITLD1: ZERROR: IN ZEXPN2 ERRNO = 27 (File too large)
 > FITLD1: FILE EXPANSION FAILED - QUITTING
 > FITLD1:        0 vis. written
 > FITLD1: ---------- FILE  15 LOADED ----------
 > ...
 > ----------------------------------------------------------
 > 
 > What can I do?

I find this rather odd - Solaris has been compiling for > 2 Gbyte for
a very long time - unless of course your Solaris OS is a very old
one.

cd $AIPS_ROOT
source LOGIN.CSH
$CDTST
COMRPL $APLGEN/ZAND.C

This should show the compile option

 -D_FILE_OFFSET_BITS=64

If it does not then you are not set up correctly - but even 31DEC02
had this option unless changed during installation.

cd /usr/include
grep FILE_OFFSET *.h

should show lots and lots of references - if not your OS is too old.

If both of these are okay then I reallyt am clueless - we routinely
run with very large files although we use very few Solaris machines
anymore.

Eric Greisen