[daip] index problem in a SPLAT-ed uvdata

Hu Bo hubo at mpifr-bonn.mpg.de
Sun Mar 23 11:29:00 EDT 2014


Dear Eric,

I came across a confusing problem when trying to completely change the 
source information of a SPLAT-ed uvdata.
The original dataset has 15 sources with 7 of them are of interests.
So I used SPLAT to produce a new dataset containning only those 7 
sources.
Here is the input of SPLAT:

AIPS 1: SPLAT     Split/assemble the sources in single/multi source 
file
AIPS 1: Adverbs     Values                 Comments
AIPS 1: 
----------------------------------------------------------------
AIPS 1: INNAME     'N5_ALL_C'              Input UV file name (name)
AIPS 1: INCLASS    'UVDATA'                Input UV file name (class)
AIPS 1: INSEQ         1                    Input UV file name (seq. #)
AIPS 1: INDISK        1                    Input UV file disk unit #
AIPS 1: SOURCES    'F036.1638'             Source list
AIPS 1:            'G036.11+0.55'  'J1855.036'
AIPS 1:            'J1903.036'  'J1848.036'
AIPS 1:            'F036.1800'  'F036.0019'
AIPS 1:            *rest ' '
AIPS 1: QUAL         -1                    Source qualifier -1=>all
AIPS 1: CALCODE    ' '                     Calibrator code '    '=>all
AIPS 1: TIMERANG   *all 0                  Time range to copy
AIPS 1: STOKES     ' '                     Stokes type to pass.
AIPS 1:                                    Look HELP.
AIPS 1: SELBAND      -1                    Bandwidth to select (kHz)
AIPS 1: SELFREQ      -1                    Frequency to select (MHz)
AIPS 1: FREQID       -1                    Freq. ID to select.
AIPS 1: BIF           1                    Lowest IF number 0=>all
AIPS 1: EIF           0                    Highest IF number 0=>all
AIPS 1: BCHAN         0                    Lowest channel number 0=>all
AIPS 1: ECHAN         0                    Highest channel number
AIPS 1: SUBARRAY      0                    Subarray, 0=>all
AIPS 1: DOCALIB       0                    > 0 calibrate data & weights
AIPS 1:                                    > 99 do NOT calibrate 
weights
AIPS 1: GAINUSE      -1                    CL (or SN) table to apply
AIPS 1: DOPOL        -1                    If >0 correct polarization.
AIPS 1: PDVER         0                    PD table to apply (DOPOL>0)
AIPS 1: BLVER        -1                    BL table to apply.
AIPS 1: FLAGVER      -1                    Flag table version.
AIPS 1:                                    0 => highest numbered table
AIPS 1:                                    <0 => no flagging
AIPS 1: DOBAND       -1                    If >0 apply bandpass cal.
AIPS 1:                                    Method used depends on value
AIPS 1:                                    of DOBAND (see HELP file).
AIPS 1: BPVER        -1                    Bandpass table version
AIPS 1: SMOOTH     *all 0                  Smoothing function. See
AIPS 1:                                    HELP SMOOTH for details.
AIPS 1: OUTNAME    'N5_G036_C'             Output UV file name (name)
AIPS 1:                                       used in split option too
AIPS 1: OUTCLASS   'UVDATA'                Output UV file name (class)
AIPS 1: OUTSEQ        1                    Output UV file name (seq. #)
AIPS 1: OUTDISK       1                    Output UV file disk unit #.
AIPS 1: DOUVCOMP     -1                    1 (T) => compressed data
AIPS 1: APARM      *all 0                  Control information:
AIPS 1:                                      1 = 1 => avg. freq. in IF
AIPS 1:                                          Use ICHANSEL.
AIPS 1:                                          CHANNEL is not used
AIPS 1:                                        = 2 => avg IF's also
AIPS 1:                                          Use ICHANSEL.
AIPS 1:                                          CHANNEL is not used
AIPS 1:                                        = 3 => average each
AIPS 1:                                          CHANNEL channels.
AIPS 1:                                          ICHANSEL is not used.
AIPS 1:                                      2 = Input avg. time (sec)
AIPS 1:                                      3 > 0 => Drop subarrays
AIPS 1:                                      5 = 0 pass only xc data
AIPS 1:                                        = 1 pass xc and ac data
AIPS 1:                                        = 2 pass only ac data
AIPS 1:                                      6 > 0 add full source name
AIPS 1:                                            to header
AIPS 1:                                      7 = 0 assemble all 
selected
AIPS 1:                                            sources in one
AIPS 1:                                            multiple source 
file.
AIPS 1:                                        > 0 split for single
AIPS 1:                                            source files.
AIPS 1: ICHANSEL   *all 0                  Array of channel start, 
stop,
AIPS 1:                                    and increment numbers and IF
AIPS 1:                                    number to be used when
AIPS 1:                                    averaging in frequency.
AIPS 1:                                    It's used if APARM(1)=1 or 2
AIPS 1: CHANNEL       0                    Number of chans to average
AIPS 1:                                    together; if APARM(1) = 3
AIPS 1: CHINC         1                    Increment in input chans for
AIPS 1:                                    output 0 -> CHANNEL;
AIPS 1:                                    if APARM(1) = 3
AIPS 1: SOLINT        0                    Time of averaging in min.
AIPS 1:                                    0 => no averaging
AIPS 1: BADDISK    *all 0                  Disks to avoid for scratch

Then I started calibration with TECOR. But it returned me an error 
message of:

MCN4  > TECOR1: Task TECOR  (release of 31DEC14) begins
MCN4  > TECOR1: Reading from CL table version number    1
MCN4  > TECOR1: Searching for earliest and latest times in CL table
MCN4  > TECOR1: Done
MCN4  > TECOR1: Dispersive delay corrections will not be calculated
MCN4  > TECOR1: ZTXOP2: using translated file name =
MCN4  > TECOR1: ZTXOP2: /data/hubo/AIPSRUN/BR149N/epoch5/jplg3650.13i
MCN4  > TECOR1: Creating CL table version    2
MCN4  > TECOR1: GETSOU: COULD NOT FIND DATA FOR SOURCE NO.     2
MCN4  > TECOR1: TECCOR: ERROR  11 READING SOURCE   2 INFORMATION
MCN4  > TECOR1: GETSOU: COULD NOT FIND DATA FOR SOURCE NO.     7
MCN4  > TECOR1: TECCOR: ERROR  11 READING SOURCE   7 INFORMATION
MCN4  > TECOR1: GETSOU: COULD NOT FIND DATA FOR SOURCE NO.     8
MCN4  > TECOR1: TECCOR: ERROR  11 READING SOURCE   8 INFORMATION
MCN4  > TECOR1: GETSOU: COULD NOT FIND DATA FOR SOURCE NO.     7
MCN4  > TECOR1: TECCOR: ERROR  11 READING SOURCE   7 INFORMATION
MCN4  > TECOR1: GETSOU: COULD NOT FIND DATA FOR SOURCE NO.     9
MCN4  > TECOR1: TECCOR: ERROR  11 READING SOURCE   9 INFORMATION
MCN4  > TECOR1: GETSOU: COULD NOT FIND DATA FOR SOURCE NO.     7
MCN4  > TECOR1: TECCOR: ERROR  11 READING SOURCE   7 INFORMATION
MCN4  > TECOR1: GETSOU: COULD NOT FIND DATA FOR SOURCE NO.    10
MCN4  > TECOR1: TECCOR: ERROR  11 READING SOURCE  10 INFORMATION
...
...
...
MCN4  > TECOR1: TECCOR: ERROR  11 READING SOURCE   7 INFORMATION
MCN4  > TECOR1: GETSOU: COULD NOT FIND DATA FOR SOURCE NO.    11
MCN4  > TECOR1: TECCOR: ERROR  11 READING SOURCE  11 INFORMATION
MCN4  > TECOR1: GETSOU: COULD NOT FIND DATA FOR SOURCE NO.     7
MCN4  > TECOR1: TECCOR: ERROR  11 READING SOURCE   7 INFORMATION
MCN4  > TECOR1: GETSOU: COULD NOT FIND DATA FOR SOURCE NO.    15
MCN4  > TECOR1: TECCOR: ERROR  11 READING SOURCE  15 INFORMATION
MCN4  > TECOR1: Copied  83577 records to the output table
MCN4  > TECOR1:  83577 were modified
MCN4  > TECOR1: Appears to have ended successfully
MCN4  > TECOR1: mcn4 31DEC14 TST: Cpu=      0.6  Real=      1  IO=      
113

These not-found sources are the 8 sources that I discarded in SPLAT.
I guess this may cause further problems in calibration so I used TABED 
to correct the SOURCE-ID column in SU table,
from 1,3,4,5,6,12,14(the original source id in the big 15 sources 
dataset) to 1,2,3,4,5,6,7. And deleted NX and CL table,
using INDXR to produce new ones. But the NX and CL are still with the 
original source ids, like this(the NX table as an example):

N5_G036_C   .UVDATA.   1  Disk= 1    NX Table version   1
Title: AIPS UV DATA FILE SCAN INDEX TABLE
Created by      INDXR on 23-MAR-2014 16:22:14
Last written by INDXR on 23-MAR-2014 16:22:14
Ncol 7  Nrow 88    Sort cols:
    Table can be written as a FITS ASCII table

COL. NO.       1           2          3          4         5         6  
      7
      ROW  TIME        TIME INTER  SOURCE ID  SUBARRAY  START VIS  END 
VIS  FREQ ID
   NUMBER  D/HMS       D/HMS
        1  16:50:23.0  00:00:59.0       1         1            1      
2700     1
        2  17:03:42.5  00:00:30.0       3         1         2701      
4053     1
        3  17:04:29.5  00:00:46.0       4         1         4054      
6168     1
        4  17:05:24.5  00:00:46.0       3         1         6169      
8283     1
        5  17:06:21.5  00:00:42.0       5         1         8284     
10165     1
        6  17:07:16.5  00:00:42.0       3         1        10166     
12047     1
        7  17:08:10.5  00:00:44.0       6         1        12048     
14046     1
        8  17:09:05.5  00:00:44.0       3         1        14047     
16045     1
        9  17:26:06.5  00:00:30.0       3         1        16046     
17398     1
       10  17:26:53.5  00:00:46.0       4         1        17399     
19513     1
       11  17:27:48.5  00:00:46.0       3         1        19514     
21628     1
       12  17:28:45.5  00:00:42.0       5         1        21629     
23519     1
       13  17:29:40.5  00:00:42.0       3         1        23520     
25410     1
       14  17:30:34.5  00:00:44.0       6         1        25411     
27385     1
       15  17:31:29.5  00:00:44.0       3         1        27386     
29360     1
       16  17:48:30.5  00:00:30.0       3         1        29361     
30716     1
       17  17:49:17.5  00:00:46.0       4         1        30717     
32831     1
       18  17:50:12.5  00:00:46.0       3         1        32832     
34946     1
       19  17:51:09.0  00:00:43.0       5         1        34947     
36852     1
       20  17:52:04.0  00:00:43.0       3         1        36853     
38746     1
       21  17:52:58.5  00:00:44.0       6         1        38747     
40721     1
       22  17:53:53.5  00:00:44.0       3         1        40722     
42683     1
       23  18:10:54.5  00:00:30.0       3         1        42684     
44039     1
       24  18:11:41.5  00:00:46.0       4         1        44040     
46154     1
       25  18:12:36.5  00:00:46.0       3         1        46155     
48269     1
       26  18:13:33.0  00:00:43.0       5         1        48270     
50183     1
       27  18:14:28.0  00:00:43.0       3         1        50184     
52097     1
       28  18:15:22.5  00:00:44.0       6         1        52098     
54057     1
       29  18:16:17.5  00:00:44.0       3         1        54058     
56017     1
       30  19:05:46.0  00:00:59.0      12         1        56018     
58717     1
       31  19:18:50.0  00:00:31.0       3         1        58718     
60113     1
       32  19:19:37.5  00:00:46.0       4         1        60114     
62228     1
...
...
...

How can I completely change the source information?
I wonder where the INDXR read these original sources ids from?

Thanks a lot!

Bo

-- 
----------------------------------------------------------------
HU, Bo
Max-Planck-Institut fuer Radioastronomie  hubo at mpifr-bonn.mpg.de
Purple Mountain Observatory of CAS        hubo at pmo.ac.cn
----------------------------------------------------------------




More information about the Daip mailing list