[daip] FITLD problem
Lincoln Greenhill
lincoln at play.harvard.edu
Wed Apr 12 11:36:55 EDT 2000
Dear Aipsmail,
I am processing a 4 epoch VLBA experiment, correlated in 1995 and recorded
in a standard mode (128-4-2). No subarrays were used during observation.
In NEW & TST, both on Alpha and Solaris systems, we receive warnings from
FITLD about out-of-order data or detection of a subarray condition. Jim
Ulvestad has confirmed that this occurs. (He has used a copy of our
correlator tapes and loaded the data in Socorro. His MSGs are included
below.)
I believe strongly that the problem is a FITLD problem and not a
correlator problem. I obtain the FITLD warning messages when I read data
for an epoch that I loaded witout warning messages in spring 1999.
The processing used 15OCT98 or 15APR99 aips. I cannot be sure.
I have run USUBA on affected data and find no subarrays present.
We require high dynamic range imaging in this experiment. I cannot
ignore the FITLD warnings because in my experience with this experiment,
even subtle problems significantly degrade the imaging.
Please let me know what information I can forward to assist in your
diagnosis.
Regards,
Lincoln
Lincoln J. Greenhill Harvard-Smithsonian Center for Astrophysics
Radio & Geoastronomy Division, 60 Garden St, Cambridge, MA 02138, USA
Telephone: 1 617-495-7194 FAX: 1 617-495-7345
Internet: greenhill at cfa.harvard.edu http://cfa-www.harvard.edu/~lincoln
---------- Forwarded message ----------
Date: Wed, 12 Apr 2000 08:39:44 -0600 (MDT)
From: Jim Ulvestad <julvesta at cv3.cv.nrao.edu>
To: lincoln at cfa.harvard.edu
Subject: BG15D processing log
FITLD did detect out-of-order condition:
>FITLD1: FITLD Version 10.5.1
FITLD1: Last updated on November 17 1999
FITLD1: Recognize and handle OVLBI time filters
FITLD1: Fix duplicate SU entries, result of CALCODEs
FITLD1: Read multiple uv tables per FITS file
FITLD1: Deal correctly with weights as an array
FITLD1: Antenna numbers in MC table numbered correctly
FITLD1: Read FLAG and WEATHER tables
FITLD1: Reads a-priori information for VLBA
FITLD1: Adjusts AN table reference frequency
FITLD1: Can now do calibration transfer
FITLD1: Checks for invalid calibration tables
FITLD1: Does not round frequencies excessively
FITLD1: Now concatenates cal transfer tables
FITLD1: Now handles correct u,v,w labels
FITLD1: Now handles explicit subarrays
FITLD1: Tolerates data out of time order within days
FITLD1: Weights now proportional to integration time for VLBA
FITLD1: VLBA saturation correction now applied correctly
FITLD1: !!!!!!!!!!!
FITLD1: Digital corrections being performed
FITLD1: Total power corrected even if no zero-padding
FITLD1: !!!!!!!!!!!
FITLD1: UV data will be written in compressed format
FITLD1: Create MULTI .UVDATA. 1 (UV) on disk 3 cno 3
FITLD1: Sky frequencies (MHz) before re-ordering occurs:
FITLD1: Incoming FREQID # 1
FITLD1: 43117.06 43112.03 43122.10 42815.58
FITLD1: CL table interval set at 1.00 minutes
FITLD1: Current file has 28464 visibilities
FITLD1: File ref. freq: 42815.58 MHz
FITLD1: Found 0237+288 at 0/05:10:21 src # 1
FITLD1: fqid # 1
FITLD1: Found IRC2 at 0/05:20:12 src # 2
FITLD1: 10000 vis. written
FITLD1: 20000 vis. written
FITLD1: Found 0238+166 at 0/05:43:30 src # 3
FITLD1: UV table spanned time: 0/05:10:21 - 0/05:49:02
FITLD1: 28464 vis. written
FITLD1: **************************************************
FITLD1: Subarray or data out of order condition found.
FITLD1: NX/CL tables deleted.
FITLD1: Use USUBA to set up subarrays.
FITLD1: Rerun INDXR using CPARM(3) and (4)
FITLD1: **************************************************
FITLD1: Image=MULTI (UV) Filename=MULTI .UVDATA. 1
FITLD1: Telescope=VLBA Receiver=VLBA
FITLD1: Observer=BG015 User #= 145
FITLD1: Observ. date=14-NOV-1995 Map date=11-APR-2000
FITLD1: # visibilities 28464 Sort order TB
FITLD1: Rand axes: UU-L-SIN VV-L-SIN WW-L-SIN TIME1 BASELINE
FITLD1: SOURCE FREQSEL INTTIM CORR-ID WEIGHT SCALE
FITLD1: ----------------------------------------------------------------
FITLD1: Type Pixels Coord value at Pixel Coord incr Rotat
FITLD1: COMPLEX 1 1.0000000E+00 1.00 1.0000000E+00 0.00
FITLD1: STOKES 1 -2.0000000E+00 1.00 -1.0000000E+00 0.00
FITLD1: FREQ 256 4.2815580E+10 1.00 3.1250000E+04 0.00
FITLD1: IF 4 1.0000000E+00 1.00 1.0000000E+00 0.00
FITLD1: RA 1 00 00 00.000 1.00 0.000000 0.00
FITLD1: DEC 1 00 00 00.000 1.00 0.000000 0.00
FITLD1: ----------------------------------------------------------------
FITLD1: Coordinate equinox 2000.00
FITLD1: Maximum version number of extension files of type HI is 1
FITLD1: Maximum version number of extension files of type AT is 1
FITLD1: Maximum version number of extension files of type IM is 1
FITLD1: Maximum version number of extension files of type CT is 1
FITLD1: Maximum version number of extension files of type MC is 1
FITLD1: Maximum version number of extension files of type FQ is 1
FITLD1: Maximum version number of extension files of type AN is 1
FITLD1: Maximum version number of extension files of type SU is 1
FITLD1: Maximum version number of extension files of type CQ is 1
FITLD1: Appears to have ended successfully
Next, run USUBA with opcode='auto'
USUBA1: Task USUBA (release of 31DEC99) begins
USUBA1: You are using a non-standard program
USUBA1: Determining subarray assignments automatically
AIPS 1: Resumes
>USUBA1: Updating subarrays in uv-data
USUBA1: Updating AT table; version 1
USUBA1: Updating IM table; version 1
USUBA1: Updating MC table; version 1
USUBA1: Updating CQ table; version 1
USUBA1: Appears to have ended successfully
AIPS 1: INDXR Task to index a uv data base.
AIPS 1: Adverbs Values Comments
AIPS 1: ----------------------------------------------------------------
AIPS 1: INNAME 'BG15D ' Input UV file name (name)
AIPS 1: INCLASS 'UVDATA' Input UV file name (class)
AIPS 1: INSEQ 1 Input UV file name (seq. #)
AIPS 1: INDISK 3 Input UV file disk unit #
AIPS 1: INFILE *all ' ' Input file for forced scan
AIPS 1: breaks
AIPS 1: PRTLEV 0 Print level
AIPS 1: CPARM 0 0 1=> max. time gap (min).
AIPS 1: 0.25 1 0 => 10 min
AIPS 1: *rest 0 2=> max scan length (min).
AIPS 1: 0 => 60 min
AIPS 1: 3=> CL/CS entry interval in
AIPS 1: minutes. 0 => 5 min,
AIPS 1: < 0 => don't create a
AIPS 1: new table.
AIPS 1: 4=> VLBA only: recalculate
AIPS 1: CL entry group delays
AIPS 1: using IM table data.
AIPS 1: 0 => No recalculation,
AIPS 1: 1 => Recalculate delays.
INDXR1: Task INDXR (release of 31DEC99) begins
INDXR1: Creating CL table with version number 1
INDXR1: Will use geometric delays from IM table 1
INDXR1: Sorting IM table 1 into time order
AIPS 1: Resumes
>INDXR1: Appears to have ended successfully
Run PRTAN
File=BG15D .UVDATA. 1 An.ver= 1 Vol= 3 User= 145
Array= VLBA Freq= 43117.060000 MHz Ref.date= 14-NOV-1995
Array reference position in meters (Earth centered)
Array BX= 0.00000 BY= 0.00000 BZ= 0.00000
Polar X = 0.08640 Polar Y = 0.00000 meters
Earth rotation rate = 360.9856449733 degrees / IAT day
GST at UT=0 = 52.6259196284 degrees
UT1-UTC= -0.3225000 Data time(UTC )-UTC= -0.3225000 seconds
Solutions not yet determined for a particular FREQID
Ant 1 = BR BX= -2112064.8515 BY= 3705356.6129 BZ= 4726813.7587
Mount=ALAZ Axis offset= 2.1347 meters IFA IFB
Feed polarization type = R L
Ant 2 = FD BX= -1324009.0026 BY= 5332182.0834 BZ= 3231962.4355
Mount=ALAZ Axis offset= 2.1226 meters IFA IFB
Feed polarization type = R L
Ant 3 = HN BX= 1446375.2506 BY= 4447939.7520 BZ= 4322306.0648
Mount=ALAZ Axis offset= 2.1513 meters IFA IFB
Feed polarization type = R L
Ant 4 = KP BX= -1995678.4969 BY= 5037317.8209 BZ= 3357328.0825
Mount=ALAZ Axis offset= 2.1377 meters IFA IFB
Feed polarization type = R L
Ant 5 = LA BX= -1449752.2303 BY= 4975298.7034 BZ= 3709123.8860
Mount=ALAZ Axis offset= 2.1388 meters IFA IFB
Feed polarization type = R L
Ant 6 = MK BX= -5464074.8414 BY= 2495249.3104 BZ= 2148296.7183
Mount=ALAZ Axis offset= 2.1300 meters IFA IFB
Feed polarization type = R L
Ant 7 = NL BX= -130872.1216 BY= 4762317.2264 BZ= 4226850.9983
Mount=ALAZ Axis offset= 2.1298 meters IFA IFB
Feed polarization type = R L
Ant 8 = OV BX= -2409149.9782 BY= 4478573.3221 BZ= 3838617.3390
Mount=ALAZ Axis offset= 2.1259 meters IFA IFB
Feed polarization type = R L
Ant 9 = PT BX= -1640953.5776 BY= 5014816.1165 BZ= 3575411.8292
Mount=ALAZ Axis offset= 2.1362 meters IFA IFB
Feed polarization type = R L
Ant 10 = SC BX= 2607848.6047 BY= 5488069.8283 BZ= 1932739.4616
Mount=ALAZ Axis offset= 2.1300 meters IFA IFB
Feed polarization type = R L
Run LISTR
File = BG15D .UVDATA. 1 Vol = 3 Userid = 145
Freq = 42.815580000 GHz Ncor = 1 No. vis = 28464
Scan summary listing
Scan Source Qual Calcode Sub Timerange FrqID START VIS END VIS
1 0237+288 :00001 1 0/05:10:21 - 0/05:16:01 1 1 5612
2 IRC2 :00001 1 0/05:20:12 - 0/05:40:03 1 5613 23736
3 0238+166 :00001 1 0/05:43:30 - 0/05:49:02 1 23737 28464
Source summary
Velocity type = 'GEOCENTR' Definition = 'OPTICAL '
ID Source Qual Calcode RA(2000.0) Dec(2000.0) IFlux QFlux UFlux VFlux No. vis
1 0237+288 :00001 02:37:52.4057 28:48:08.992 0.000 0.000 0.000 0.000 5612
IF( 2) 0.000 0.000 0.000 0.000
IF( 3) 0.000 0.000 0.000 0.000
IF( 4) 0.000 0.000 0.000 0.000
2 IRC2 :00001 05:35:14.5050 -05:22:30.450 0.000 0.000 0.000 0.000 18124
IF( 2) 0.000 0.000 0.000 0.000
IF( 3) 0.000 0.000 0.000 0.000
IF( 4) 0.000 0.000 0.000 0.000
3 0238+166 :00001 02:38:38.9301 16:36:59.276 0.000 0.000 0.000 0.000 4728
IF( 2) 0.000 0.000 0.000 0.000
IF( 3) 0.000 0.000 0.000 0.000
IF( 4) 0.000 0.000 0.000 0.000
ID Source Freq(GHz) Velocity(Km/s) Rest freq (GHz)
1 All Sources 42.8156 0.0000 43.1171
IF( 2) 42.8156 0.0000 43.1171
IF( 3) 42.8156 0.0000 43.1171
IF( 4) 42.8156 0.0000 43.1171
Frequency Table summary
FQID IF# Freq(GHz) BW(kHz) Ch.Sep(kHz) Sideband
1 1 42.81558000 8000.0005 31.2500 1
2 43.11203000 8000.0005 31.2500 1
3 43.11706000 8000.0005 31.2500 1
4 43.12210000 8000.0005 31.2500 1
Can't find anything obvious wrong. POSSM doesn't show any
fringes on 0238+166 or 0237+288. Running FRING on 0238+166
with REFANT=5 (LA) and SOLINT=2.
Warning message about frequencies not lying on a regular
grid, because spacing is non-uniform. Nothing obvious
on first couple minutes of 0238+166, though it looks like
there may be very low SNR fringes on some baselines.
Try again on 0237+288, with SOLINT=2, with delay
window of 300 nsec and rate window of 100 mHz, and
SNR threshold 3.5.
Some of the baselines definitely are fringing.
4-5, 5-7, 1-4, 1-6, 3-4, 4-10. Looks like setting
antenna 4 (KP) as reference might be a good thing to try.
Don't see any fringes to PT (9), which is surprising.
Maybe something wrong with antenna or pointing?
FRING1 08:16:56 FREQUENCIES DO NOT LIE ON A UNIFORM GRID.
FRING1 08:16:56 THIS MAY DEGRADE DETERMINATION OF DELAYS.
FRING1 08:17:01 Time= 0/ 5 11 37, Polarization = 2
FRING1 08:17:04 B = Baseline R = Rate (mHz) D = Delay (nsec)
FRING1 08:17:04 B= 01 - 05 IF= 1 R= -0.7 D= -85.9 SNR= 2.3
FRING1 08:17:06 B= 03 - 05 IF= 1 R= -14.5 D= 132.8 SNR= 1.7
FRING1 08:17:08 B= 04 - 05 IF= 1 R= 2.8 D= 46.9 SNR= 4.9
FRING1 08:17:10 B= 05 - 06 IF= 1 R= 18.0 D= 117.2 SNR= 2.9
FRING1 08:17:12 B= 05 - 07 IF= 1 R= 0.0 D= -62.5 SNR= 5.0
FRING1 08:17:14 B= 05 - 08 IF= 1 R= -0.7 D= 117.2 SNR= 2.1
FRING1 08:17:16 B= 05 - 09 IF= 1 R= 26.2 D= 195.3 SNR= 2.2
FRING1 08:17:18 B= 05 - 10 IF= 1 R= -6.9 D= 39.1 SNR= 3.4
FRING1 08:17:20 B= 01 - 03 IF= 1 R= -0.7 D= -15.6 SNR= 2.4
FRING1 08:17:21 B= 01 - 04 IF= 1 R= -3.5 D= -132.8 SNR= 5.9
FRING1 08:17:22 B= 01 - 06 IF= 1 R= 0.0 D= -117.2 SNR= 4.1
FRING1 08:17:24 B= 01 - 08 IF= 1 R= -2.1 D= 46.9 SNR= 5.1
FRING1 08:17:26 B= 01 - 09 IF= 1 R= -25.6 D= 101.6 SNR= 1.8
FRING1 08:17:28 B= 01 - 10 IF= 1 R= 31.8 D= -7.8 SNR= 2.0
FRING1 08:17:30 B= 03 - 04 IF= 1 R= 2.8 D= -109.4 SNR= 7.5
FRING1 08:17:32 B= 03 - 09 IF= 1 R= -44.9 D= -164.1 SNR= 1.8
FRING1 08:17:34 B= 03 - 10 IF= 1 R= -4.1 D= 23.4 SNR= 2.8
FRING1 08:17:36 B= 04 - 09 IF= 1 R= 14.5 D= -101.6 SNR= 2.2
FRING1 08:17:37 B= 04 - 10 IF= 1 R= -3.5 D= 140.6 SNR= 4.6
FRING1 08:17:39 B= 06 - 09 IF= 1 R= -38.7 D= 109.4 SNR= 1.9
FRING1 08:17:41 B= 07 - 09 IF= 1 R= 45.6 D= -46.9 SNR= 2.3
FRING1 08:17:43 B= 08 - 09 IF= 1 R= 47.7 D= 156.3 SNR= 2.2
FRING1 08:17:45 B= 09 - 10 IF= 1 R= -41.4 D= -54.7 SNR= 2.1
FRING1 08:17:47 B= 01 - 05 IF= 2 R= -1.4 D= -85.9 SNR= 2.6
FRING1 08:17:49 B= 03 - 05 IF= 2 R= 2.8 D= 39.1 SNR= 2.3
FRING1 08:17:51 B= 04 - 05 IF= 2 R= 1.4 D= 31.3 SNR= 5.0
FRING1 08:17:53 B= 05 - 06 IF= 2 R= 2.8 D= -39.1 SNR= 3.3
FRING1 08:17:55 B= 05 - 07 IF= 2 R= 0.7 D= -101.6 SNR= 4.2
FRING1 08:17:57 B= 05 - 08 IF= 2 R= -21.4 D= 140.6 SNR= 2.6
FRING1 08:17:59 B= 05 - 09 IF= 2 R= -35.2 D= 15.6 SNR= 1.5
FRING1 08:18:01 B= 05 - 10 IF= 2 R= -6.2 D= 70.3 SNR= 2.7
FRING1 08:18:03 B= 01 - 03 IF= 2 R= -4.1 D= -23.4 SNR= 3.9
FRING1 08:18:04 B= 01 - 04 IF= 2 R= -4.1 D= -70.3 SNR= 3.8
FRING1 08:18:05 B= 01 - 06 IF= 2 R= -2.1 D= -117.2 SNR= 3.7
FRING1 08:18:07 B= 01 - 08 IF= 2 R= -1.4 D= 46.9 SNR= 3.9
FRING1 08:18:09 B= 01 - 09 IF= 2 R= -29.0 D= 195.3 SNR= 2.1
FRING1 08:18:11 B= 01 - 10 IF= 2 R= 39.4 D= 164.1 SNR= 2.0
FRING1 08:18:13 B= 03 - 09 IF= 2 R= -6.2 D= 31.3 SNR= 2.2
FRING1 08:18:15 B= 03 - 10 IF= 2 R= -0.7 D= 70.3 SNR= 2.9
FRING1 08:18:17 B= 04 - 09 IF= 2 R= -31.1 D= -156.3 SNR= 1.9
FRING1 08:18:19 B= 04 - 10 IF= 2 R= -5.5 D= 109.4 SNR= 7.0
FRING1 08:18:21 B= 06 - 09 IF= 2 R= -8.3 D= 195.3 SNR= 2.1
FRING1 08:18:23 B= 07 - 09 IF= 2 R= 0.0 D= -148.4 SNR= 2.4
FRING1 08:18:25 B= 08 - 09 IF= 2 R= 0.7 D= -195.3 SNR= 2.1
FRING1 08:18:27 B= 09 - 10 IF= 2 R= -6.9 D= 46.9 SNR= 2.1
FRING1 08:18:29 B= 01 - 05 IF= 3 R= -22.1 D= -78.1 SNR= 3.2
FRING1 08:18:31 B= 03 - 05 IF= 3 R= 33.8 D= 109.4 SNR= 2.0
FRING1 08:18:33 B= 04 - 05 IF= 3 R= 0.7 D= 31.3 SNR= 5.2
FRING1 08:18:35 B= 05 - 06 IF= 3 R= 2.8 D= -70.3 SNR= 4.8
FRING1 08:18:37 B= 05 - 07 IF= 3 R= 0.0 D= -54.7 SNR= 5.8
FRING1 08:18:39 B= 05 - 08 IF= 3 R= 4.1 D= 148.4 SNR= 3.4
FRING1 08:18:41 B= 05 - 09 IF= 3 R= 1.4 D= -85.9 SNR= 2.1
FRING1 08:18:43 B= 05 - 10 IF= 3 R= -7.6 D= 78.1 SNR= 2.8
FRING1 08:18:45 B= 01 - 03 IF= 3 R= -6.2 D= -78.1 SNR= 3.7
FRING1 08:18:46 B= 01 - 04 IF= 3 R= -3.5 D= -85.9 SNR= 3.8
FRING1 08:18:48 B= 01 - 08 IF= 3 R= -2.8 D= 78.1 SNR= 4.2
FRING1 08:18:50 B= 01 - 09 IF= 3 R= -13.8 D= -109.4 SNR= 2.1
FRING1 08:18:52 B= 01 - 10 IF= 3 R= -5.5 D= 62.5 SNR= 2.8
FRING1 08:18:54 B= 03 - 09 IF= 3 R= -18.0 D= -179.7 SNR= 2.1
FRING1 08:18:56 B= 03 - 10 IF= 3 R= -31.1 D= -140.6 SNR= 2.5
FRING1 08:18:58 B= 04 - 09 IF= 3 R= -6.9 D= 0.0 SNR= 2.3
FRING1 08:19:00 B= 04 - 10 IF= 3 R= -5.5 D= 125.0 SNR= 7.3
FRING1 08:19:02 B= 06 - 09 IF= 3 R= 28.3 D= 70.3 SNR= 2.8
FRING1 08:19:04 B= 07 - 09 IF= 3 R= -10.4 D= 46.9 SNR= 2.6
FRING1 08:19:07 B= 08 - 09 IF= 3 R= -24.2 D= -7.8 SNR= 1.7
Try again with REFANT=4, for the heck of it.
This works pretty well, apparently. There's no real sign of anything
being wrong with the data. The correlator jobs are backed up and
not immediately available to me, so I'm not going to look at them
unless there's more evidence of malfeasance.
FRING results--no data for FD (2) and no fringes to PT (9).
Everything else looks like it works. On the second 2-min
segment, FD (2) shows up and fringes. Still no fringes on PT (9).
Delay on antenna 8 (OV) looks like it might be a bit outside
the window at 170 nsec, probably need total window of 500 nsec or so.
Fringe rates are low--window of 50 mHz would suffice.
Try POSSM plots with all baselines to antenna 4. SC and HN are
noisy over 5 minute average, maybe because phase winds too much.
No fringes to PT. Everything else works, though SNR is a bit low.
See no reason at the moment to pursue this further.
More information about the Daip
mailing list