[daip] Image Header have incorrect Visibilities

jabulani maswanganye pop7paul at gmail.com
Wed Jul 18 02:32:45 EDT 2012


Hi Eric,

The file is large, about 32 GB.

I below are my input for ATLOD task, LISTR task output, AIPS_MSGSRV_7
output and imheader output. The visibilities in the imheader output does
not match with the  total number of the visibilities in the LISTR task
output. To be more direct, the visibility of the first scan is the one
which correspond with the visibilities in the imheader output. Threre was
an error while  loading the data. Which was ZERROR: ON FILE
DA01:UVD002001.002;
LOCALH> ATLOD1: ZERROR: IN ZCMPR2 ERRNO = 22 (Invalid argument)
LOCALH> ATLOD1: ATCLOS: ERROR COMPRESSING THE AIPS UV DISK FILE.


____________________________________________________________________________________

inp
AIPS 1: ATLOD:  Task which reads RPFITS format uv data into AIPS.
AIPS 1: Adverbs     Values                 Comments
AIPS 1: ----------------------------------------------------------------
AIPS 1: INTAPE        1                    Tape drive number (0 -> 1)
AIPS 1:                                    No REMOTE capability
AIPS 1: NSKIP         0                    Number of tape files to
AIPS 1:                                    skip (0 -> 0)
AIPS 1: NFILES        0                    Number of tape files to
AIPS 1:                                    load (0 -> 1)
AIPS 1: BCOUNT        1                    First scan to read (0 -> 1)
AIPS 1: NCOUNT        0                    No. scans to read (0 -> all)
AIPS 1: DATAIN     'H:V215B.RPF'           Disk file name
AIPS 1: OUTNAME    'V215B'                 Output uv file name (name)
AIPS 1:                                      blank -> source name
AIPS 1: OUTCLASS   'UVDATA'                Output uv file name (class)
AIPS 1:                                      blank -> UVDATA
AIPS 1: OUTSEQ        0                    Output uv sequence number
AIPS 1:                                      0 -> highest unique AND a
AIPS 1:                                      new file for EACH pass
AIPS 1: OUTDISK       1                    Output disk drive number
AIPS 1: OPTYPE     ' '                       'LOAD' load data (default)
AIPS 1:                                      'LIST' scan summary
AIPS 1:                                      'SUMM' file summary
AIPS 1:                                      'SYSC' dump syscal info
AIPS 1:                                        see CPARM(9)
AIPS 1: SOURCES    *all ' '                Source selection list
AIPS 1: TIMERANG   *all 0                  Time range selection
AIPS 1: FREQSEL    *all 0                  Frequencies to select (MHz)
AIPS 1: IFSEL      *all 0                  IFs to select
AIPS 1: CHANSEL    *all 0                  Channel selection array:
AIPS 1:                                      (1,n) start channel group n
AIPS 1:                                      (2,n) end channel group n
AIPS 1:                                      (3,n) incr. channel group n
AIPS 1: IFMAP         0                    True to map on-line IF chain
AIPS 1:                                    to AIPS IF axis.
AIPS 1: NIF           0                    Length of IF axis,
AIPS 1:                                    0 => ATLOD decides.
AIPS 1: DOUVCOMP     -1                    Use compressed data?
AIPS 1: ** press RETURN for more, enter Q or next line to quit print **
#
AIPS 1: APARM        -1           0        1) If > 0, convert to Stokes
AIPS 1:               1           0           if < 0, kludge RR,LL,RL,LR
AIPS 1:               0           0           if = 0, don't change the
AIPS 1:               1        *rest 0                polarizations
AIPS 1:                                    2) If true, keep flagged data
AIPS 1:                                    3) If true, retain
AIPS 1:                                       autocorrelations
AIPS 1:                                    4) Shadowing diameter (m)
AIPS 1:                                    5) max NX time gap (min)
AIPS 1:                                        0 -> 10 min
AIPS 1:                                    6) max NX scan length (min)
AIPS 1:                                        0 -> 60 min
AIPS 1:                                    7) CL entry interval (min)
AIPS 1:                                        0 -> 5 min
AIPS 1:                                    8) Number of integrations
AIPS 1:                                       over which to average Tsys
AIPS 1:                                        0 -> 1  See HELP/EXPLAIN
AIPS 1:                                    9) Number of integrations
AIPS 1:                                       over which to average XY
AIPS 1:                                       phase diff if APARM(1) = 1
AIPS 1:                                        0 -> 1  See HELP/EXPLAIN
AIPS 1:                                    10) If non-zero drop data on
AIPS 1:                                       quality of XY phase diff.
AIPS 1:                                       See HELP/EXPLAIN
AIPS 1: BPARM      *all 0                  Baselines to be rejected,
AIPS 1:                                    (see HELP)
AIPS 1: CPARM      *all 0                  Further control parameters:
AIPS 1:                                    1) System cal. info. print
AIPS 1:                                       level. See HELP/EXPLAIN
AIPS 1:                                    2) If true negate system XY
AIPS 1:                                       cal phase difference
AIPS 1:                                    3) If true, negate phases
AIPS 1:                                    4) If true, use XYPHASE array
AIPS 1:                                       instead of on-line values
AIPS 1:                                    5) If true, apply XY phase to
AIPS 1:                                       the Y gain
AIPS 1:                                    6) If 1, report antennas for
AIPS 1:                                       which sampler stats bad
AIPS 1: ** press RETURN for more, enter Q or next line to quit print **
#
AIPS 1:                                       If 2, drop baselines with
AIPS 1:                                       bad sampler statistics
AIPS 1:                                       If 3, do 1 and 2
AIPS 1:                                       If 4, correct data for
AIPS 1:                                       bad statistics.
AIPS 1:                                    7) Sampler tolerance
AIPS 1:                                    8) If true, DATAIN will be
AIPS 1:                                       read as lower case.  This
AIPS 1:                                       is intended for reading
AIPS 1:                                       from VAX disks mounted
AIPS 1:                                       under unix via multinet.
AIPS 1:                                    9) If OPTYPE='SYSC' then the
AIPS 1:                                       3 text files contain:
AIPS 1:                                      1 => XY phase, Tx & Ty
AIPS 1:                                      2 => X sampler stats
AIPS 1:                                      3 => Y sampler stats
AIPS 1:                                      0 => 1
AIPS 1:                                    10) If 1, Tsys from IF 1 is
AIPS 1:                                      applied to IF 2, if
AIPS 1:                                      APARM(8) is > 0
AIPS 1: XYPHASE    *all 0                  Enter XY phase difference for
AIPS 1:                                    each antenna & FQID (degrees)
AIPS 1: DPARM      *all 0                  1)  If > 0, then the scan
AIPS 1:                                      based source number of all
AIPS 1:                                      sources is set to 1.
AIPS 1:                                    2) If > 0, the spectra are
AIPS 1:                                      3-point Hanning smoothed.
AIPS 1:                                    3) If > 0 -> set weights to
AIPS 1:                                      D(3) instead of integration
AIPS 1:                                      time in units of 15s
>go
AIPS 1: Resumes
>pcat
AIPS 1: Catalog on disk  1
AIPS 1:  Cat Usid Mapname      Class   Seq  Pt     Last access      Stat
AIPS 1:    1    2 0637-752    .UVDATA.    1 UV 17-JUL-2012 15:39:56
AIPS 1:    2    2 V215B       .UVDATA.    1 UV 18-JUL-2012 07:59:52
>getname 2; imh
AIPS 1: Got(1)   disk= 1  user=   2   type=UV   V215B.UVDATA.1
AIPS 1: Image=0637-752  (UV)         Filename=V215B       .UVDATA.   1
AIPS 1: Telescope=ATLBA              Receiver=
AIPS 1: Observer=                    User #=    2
AIPS 1: Observ. date=20-MAR-2007     Map date=18-JUL-2012
AIPS 1: # visibilities      4500     Sort order  TB
AIPS 1: Rand axes: UU-L  VV-L  WW-L  BASELINE  TIME1  SOURCE  FREQSEL
AIPS 1: ----------------------------------------------------------------
AIPS 1: Type    Pixels   Coord value     at Pixel     Coord incr   Rotat
AIPS 1: COMPLEX      3   1.0000000E+00       1.00  1.0000000E+00    0.00
AIPS 1: STOKES       2  -1.0000000E+00       1.00 -1.0000000E+00    0.00
AIPS 1: FREQ      4097   6.6670000E+09       0.00  9.7656250E+02    0.00
AIPS 1: IF           1   1.0000000E+00       1.00  1.0000000E+00    0.00
AIPS 1: RA           1    06 35 46.508       1.00       3600.000    0.00
AIPS 1: DEC          1   -75 16 16.816       1.00       3600.000    0.00
AIPS 1: ----------------------------------------------------------------
AIPS 1: Coordinate equinox 2000.00
AIPS 1: Maximum version number of extension files of type HI is   1
AIPS 1: Maximum version number of extension files of type FQ is   1
AIPS 1: Maximum version number of extension files of type SU is   1
AIPS 1: Maximum version number of extension files of type AN is   1
AIPS 1: Maximum version number of extension files of type NX is   1
AIPS 1: Maximum version number of extension files of type CL is   1
>
LOCALH> ATLOD1: Task ATLOD  (release of 31DEC12) begins
LOCALH> ATLOD1: Dropping all flagged visibilities.
LOCALH> ATLOD1: Retaining autocorrelations.
LOCALH> ATLOD1: Vis weights set to integration time in units of 15 sec
LOCALH> ATLOD1: Averaging all pulsar bins
LOCALH> ATLOD1:
LOCALH> ATLOD1: Processing file:  1
LOCALH> ATLOD1: Input polarizations: RR,LL
LOCALH> ATLOD1: Kludging polarizations to be circular
LOCALH> ATLOD1:
LOCALH> ATLOD1: Create V215B       .UVDATA.   1 (UV)  on disk  1  cno    2
LOCALH> ATLOD1: Recomputing UVWs for pre-20/02/1998 LBA data
LOCALH> ATLOD1:
LOCALH> ATLOD1: File:  1,  Scan:   1
LOCALH> ATLOD1: Date: 2007-03-20    UT start:  0 13:00:01
LOCALH> ATLOD1:
LOCALH> ATLOD1: Visibilities accepted/rejected for each source/frequency:
LOCALH> ATLOD1:    Sideband              +1
LOCALH> ATLOD1:    AIPS IF axis           1
LOCALH> ATLOD1:    Source/Freq(GHz)   6.667000
LOCALH> ATLOD1:    0637-752           4500/0
LOCALH> ATLOD1:    1733-3722         17250/0
LOCALH> ATLOD1:    G351.78-0.54      90000/0
LOCALH> ATLOD1: Category summaries of visibilities for this scan:
LOCALH> ATLOD1: Recomputing UVWs for pre-20/02/1998 LBA data
LOCALH> ATLOD1:
LOCALH> ATLOD1: File:  1,  Scan:   2
LOCALH> ATLOD1: Date: 2007-03-20    UT start:  0 17:08:21
LOCALH> ATLOD1:
LOCALH> ATLOD1: Visibilities accepted/rejected for each source/frequency:
LOCALH> ATLOD1:    Sideband              +1
LOCALH> ATLOD1:    AIPS IF axis           1
LOCALH> ATLOD1:    Source/Freq(GHz)   6.667000
LOCALH> ATLOD1:    0637-752              0/0
LOCALH> ATLOD1:    1733-3722         61215/0
LOCALH> ATLOD1:    G351.78-0.54     266910/0
LOCALH> ATLOD1:    1921-293          44519/0
LOCALH> ATLOD1: Category summaries of visibilities for this scan:
LOCALH> ATLOD1:
LOCALH> ATLOD1: Finished reading file number  1.
LOCALH> ATLOD1: ZERROR: ON FILE DA01:UVD002001.002;
LOCALH> ATLOD1: ZERROR: IN ZCMPR2 ERRNO = 22 (Invalid argument)
LOCALH> ATLOD1: ATCLOS: ERROR COMPRESSING THE AIPS UV DISK FILE.
LOCALH> ATLOD1: Some of the AIPS files may have been left open.
LOCALH> ATLOD1: Appears to have ended successfully
LOCALH> ATLOD1: localhos 31DEC12 TST: Cpu=    260.4  Real=    738  IO=
45440


AIPS 1: Got(1)   disk= 1  user=   2   type=UV   V215B.UVDATA.1
 localhos  LISTR(31DEC12)      2     18-JUL-2012  08:22:23    Page    1
File = V215B       .UVDATA.   1 Vol = 1  Userid =    2
Freq =  6.667000000 GHz   Ncor =  2   No. vis =      4500
Scan summary listing

Scan      Source      Qual  Calcode Sub         Timerange          FrqID
START VIS  END VIS
   1 0637-752        : 0001           1  0/13:00:01 -   0/13:09:59
1       1       4500
   2 1733-3722       : 0001           1  0/13:10:01 -   0/13:14:59     1
4501       6750
   3 G351.78-0.54    : 0001           1  0/13:15:01 -   0/13:34:59     1
6751      15750
   4 1733-3722       : 0001           1  0/13:35:01 -   0/13:38:29     1
15751      17325
   5 G351.78-0.54    : 0001           1  0/13:38:31 -   0/13:58:29     1
17326      26325
   6 1733-3722       : 0001           1  0/13:58:31 -   0/14:01:59     1
26326      27900
   7 G351.78-0.54    : 0001           1  0/14:02:01 -   0/14:21:59     1
27901      36900
   8 1733-3722       : 0001           1  0/14:22:01 -   0/14:25:29     1
36901      38475
   9 G351.78-0.54    : 0001           1  0/14:25:31 -   0/14:45:29     1
38476      47475
  10 1733-3722       : 0001           1  0/14:45:31 -   0/14:48:59     1
47476      49050
  11 G351.78-0.54    : 0001           1  0/14:49:01 -   0/15:08:59     1
49051      58050
  12 1733-3722       : 0001           1  0/15:09:01 -   0/15:12:29     1
58051      59625
  13 G351.78-0.54    : 0001           1  0/15:12:31 -   0/15:32:29     1
59626      68625
  14 1733-3722       : 0001           1  0/15:32:31 -   0/15:35:59     1
68626      70200
  15 G351.78-0.54    : 0001           1  0/15:36:01 -   0/15:55:59     1
70201      79200
  16 1733-3722       : 0001           1  0/15:56:01 -   0/15:59:29     1
79201      80775
  17 G351.78-0.54    : 0001           1  0/15:59:31 -   0/16:19:29     1
80776      89775
  18 1733-3722       : 0001           1  0/16:19:31 -   0/16:22:59     1
89776      91350
  19 G351.78-0.54    : 0001           1  0/16:23:01 -   0/16:42:59     1
91351     100350
  20 1733-3722       : 0001           1  0/16:43:01 -   0/16:46:29     1
100351     101925
  21 G351.78-0.54    : 0001           1  0/16:46:31 -   0/17:06:29     1
101926     110925
  22 1733-3722       : 0001           1  0/17:06:31 -   0/17:08:19     1
110926     111750
  23 1733-3722       : 0001           1  0/17:08:21 -   0/17:09:59     1
111751     112800
  24 1921-293        : 0001           1  0/17:10:01 -   0/17:19:59     1
112801     119100
  25 1733-3722       : 0001           1  0/17:20:01 -   0/17:24:29     1
119101     121935
  26 G351.78-0.54    : 0001           1  0/17:24:31 -   0/17:44:29     1
121936     134535
  27 1733-3722       : 0001           1  0/17:44:31 -   0/17:47:59     1
134536     136740
  28 G351.78-0.54    : 0001           1  0/17:48:01 -   0/18:07:59     1
136741     149340
  29 1733-3722       : 0001           1  0/18:08:01 -   0/18:11:29     1
149341     151545
  30 G351.78-0.54    : 0001           1  0/18:11:31 -   0/18:31:29     1
151546     164145
  31 1733-3722       : 0001           1  0/18:31:31 -   0/18:34:59     1
164146     166350
  32 G351.78-0.54    : 0001           1  0/18:35:01 -   0/18:54:59     1
166351     178950
  33 1733-3722       : 0001           1  0/18:55:01 -   0/18:58:29     1
178951     181155
Type Q to stop, just hit RETURN to
continue


 localhos  LISTR(31DEC12)      2     18-JUL-2012  08:22:30    Page    2
File = V215B       .UVDATA.   1 Vol = 1  Userid =    2
Scan      Source      Qual  Calcode Sub         Timerange          FrqID
START VIS  END VIS
  34 1921-293        : 0001           1  0/18:58:31 -   0/19:08:29     1
181156     187455
  35 1733-3722       : 0001           1  0/19:08:31 -   0/19:12:59     1
187456     190290
  36 G351.78-0.54    : 0001           1  0/19:13:01 -   0/19:32:59     1
190291     202890
  37 1733-3722       : 0001           1  0/19:33:01 -   0/19:36:29     1
202891     205095
  38 G351.78-0.54    : 0001           1  0/19:36:31 -   0/19:56:29     1
205096     217695
  39 1733-3722       : 0001           1  0/19:56:31 -   0/19:59:59     1
217696     219900
  40 G351.78-0.54    : 0001           1  0/20:00:01 -   0/20:19:59     1
219901     232500
  41 1733-3722       : 0001           1  0/20:20:01 -   0/20:23:29     1
232501     234705
  42 G351.78-0.54    : 0001           1  0/20:23:31 -   0/20:43:29     1
234706     247305
  43 1733-3722       : 0001           1  0/20:43:31 -   0/20:46:59     1
247306     249510
  44 1921-293        : 0001           1  0/20:47:01 -   0/20:56:59     1
249511     255810
  45 1733-3722       : 0001           1  0/20:57:01 -   0/21:01:29     1
255811     258645
  46 G351.78-0.54    : 0001           1  0/21:01:31 -   0/21:21:29     1
258646     271245
  47 1733-3722       : 0001           1  0/21:21:31 -   0/21:24:59     1
271246     273450
  48 G351.78-0.54    : 0001           1  0/21:25:01 -   0/21:44:59     1
273451     286050
  49 1733-3722       : 0001           1  0/21:45:01 -   0/21:48:29     1
286051     288255
  50 G351.78-0.54    : 0001           1  0/21:48:31 -   0/22:08:49     1
288256     301065
  51 1733-3722       : 0001           1  0/22:08:51 -   0/22:12:39     1
301066     303480
  52 G351.78-0.54    : 0001           1  0/22:12:41 -   0/22:32:59     1
303481     316290
  53 1733-3722       : 0001           1  0/22:33:01 -   0/22:36:49     1
316291     318705
  54 G351.78-0.54    : 0001           1  0/22:36:51 -   0/22:57:09     1
318706     331515
  55 1733-3722       : 0001           1  0/22:57:11 -   0/23:00:59     1
331516     333930
  56 G351.78-0.54    : 0001           1  0/23:01:01 -   0/23:21:19     1
333931     346740
  57 1733-3722       : 0001           1  0/23:21:21 -   0/23:25:09     1
346741     349155
  58 G351.78-0.54    : 0001           1  0/23:25:11 -   0/23:45:29     1
349156     361965
  59 1733-3722       : 0001           1  0/23:45:31 -   0/23:49:19     1
361966     364380
  60 G351.78-0.54    : 0001           1  0/23:49:21 -   1/00:09:39     1
364381     377190
  61 1733-3722       : 0001           1  1/00:09:41 -   1/00:13:29     1
377191     379605
  62 1921-293        : 0001           1  1/00:13:31 -   1/00:33:49     1
379606     392415
  63 1733-3722       : 0001           1  1/00:33:51 -   1/00:38:39     1
392416     395460
  64 G351.78-0.54    : 0001           1  1/00:38:41 -   1/00:58:59     1
395461     408270
  65 1733-3722       : 0001           1  1/00:59:01 -   1/01:02:49     1
408271     410685
  66 G351.78-0.54    : 0001           1  1/01:02:51 -   1/01:23:09     1
410686     423495
  67 1733-3722       : 0001           1  1/01:23:11 -   1/01:26:59     1
423496     425910
  68 G351.78-0.54    : 0001           1  1/01:27:01 -   1/01:47:19     1
425911     438720
  69 1733-3722       : 0001           1  1/01:47:21 -   1/01:51:09     1
438721     441135
Type Q to stop, just hit RETURN to
continue


 localhos  LISTR(31DEC12)      2     18-JUL-2012  08:22:30    Page    3
File = V215B       .UVDATA.   1 Vol = 1  Userid =    2
Scan      Source      Qual  Calcode Sub         Timerange          FrqID
START VIS  END VIS
  70 G351.78-0.54    : 0001           1  1/01:51:11 -   1/02:11:29     1
441136     453945
  71 1733-3722       : 0001           1  1/02:11:31 -   1/02:15:19     1
453946     456360
  72 G351.78-0.54    : 0001           1  1/02:15:21 -   1/02:35:39     1
456361     469170
  73 1733-3722       : 0001           1  1/02:35:41 -   1/02:39:29     1
469171     471585
  74 1921-293        : 0001           1  1/02:39:31 -   1/02:59:49     1
471586     484394

Source summary
Velocity type = '        '    Definition = '        '

  ID Source           Qual  Calcode RA(2000.0)     Dec(2000.0)   IFlux
QFlux   UFlux   VFlux  No. vis
   1 0637-752        : 0001         06:35:46.5082 -75:16:16.816   0.000
0.000   0.000   0.000    4500
   2 1733-3722       : 0001         17:33:15.1931 -37:22:32.398   0.000
0.000   0.000   0.000   78465
   3 G351.78-0.54    : 0001         17:26:42.5600 -36:09:17.500   0.000
0.000   0.000   0.000  356910
   4 1921-293        : 0001         19:24:51.0563 -29:14:30.117   0.000
0.000   0.000   0.000   44519

  ID Source            Freq(GHz) Velocity(Km/s) Rest freq (GHz)
   1 All Sources          6.6670         0.0000          0.0000

Frequency Table summary
FQID IF#      Freq(GHz)      BW(kHz)   Ch.Sep(kHz)  Sideband  Bandcode
   1   1       6.66700000    4000.9768      0.9766      1
AIPS 1: Resumes






__________________________________________________________________________________












Regards*
:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
*
 Maswanganye Jabulani Paul*
*HARTRAO, P.O.Box 443,Krugersdorp 1740, South Africa*
*Cell No: +27(0)72 541 0749 (H/W) *
*Phone: +27(12) 301-3225 (W)*
*Fax: +27(12) 301 3300 (w)*
*Email address: pop7paul at gmail.com or <pop7paul at gmail.com>
jabulani at hartrao.ac.za*
:::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
*



On 18 July 2012 01:11, Eric Greisen <egreisen at nrao.edu> wrote:

> jabulani maswanganye wrote:
>
>> Dear All,
>>
>> I loaded  my data wit 'ATLOD' and aparm(1)=-1, aparm(3)=1, aparm(7)=1,
>> the rest set to default. The visibilities are incorrect. The visibilities
>> are for the first scan and this has become a problem when I run 'CVEL'.
>> 'CVEL' only do run for the first scan.  My 'imh' and 'LISTR' are as follows:
>>
>>   AIPS 1: Image=0637-752  (UV)         Filename=0637-752    .UVDATA.   1
>> AIPS 1: Telescope=ATLBA              Receiver=
>> AIPS 1: Observer=                    User #=    2
>> AIPS 1: Observ. date=20-MAR-2007     Map date=05-JUL-2012
>> AIPS 1: # visibilities      4500     Sort order  TB
>>
>
> I was awfully slow to see this issue - and do not see any place obvious in
> ATLOD where it might come from.  Your data take 98356 bytes on disk for
> each visibility.  Is the UV file around 442601984 bytes in size or
>  47643058176 bytes in size?  (cd to your data area and do an ls -l UV*)
>
> Your split clearly used the NX table and found all the data - or thought
> that it did.  Perhaps a UVCOP would do that and fix the header.
>
> You do need to look at the data before CVEL to make sure that it is there.
>
> Eric Greisen
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listmgr.nrao.edu/pipermail/daip/attachments/20120718/9e869f34/attachment.html>


More information about the Daip mailing list