[daip] DBCON on many files
Walter Brisken
wbrisken at lbo.us
Tue Apr 10 10:14:00 EDT 2018
Hi Eric,
I tried the new DBAPP. I used it to append 3 databases to a fourth.
Execution went as expected, with three warnings about UT1-UTC (again, as
epected).
One issue found with the updated DBAPP: NX table after the operation is
not correct. Below is the original post-DBAPP LISTR output, and then one
after deleting the NX table and rerunning INDXR. My guess is this would
be a simple fix, or you could simply delete the NX table and request the
user to rerun INDXR.
-Walter
>go
LISTR1: Task LISTR (release of 31DEC18) begins
LISTR1: NO SOURCE TABLE, SCAN OUTPUT WILL OMIT
parallax LISTR(31DEC18) 388 10-APR-2018 07:33:33 Page 1
File = NEP0002 .V0.1 . 4 Vol = 5 Userid = 388
Freq = 4.704000000 GHz Ncor = 2 No. vis = 274581
Scan summary listing
Scan Source Qual Calcode Sub Timerange FrqID START VIS END VIS
1 NEP0002 : 0000 1 0/11:50:31 - 0/12:32:11 1 1 16921
2 NEP0002 : 0000 1 0/12:38:54 - 0/14:02:39 1 16922 50798
3 NEP0002 : 0000 1 0/14:09:29 - 0/14:51:08 1 50799 67733
4 NEP0002 : 0000 1 2/11:42:39 - 2/12:31:53 1 1 19781
5 NEP0002 : 0000 1 2/12:38:38 - 2/13:38:37 1 19782 43716
6 NEP0002 : 0000 1 2/13:38:41 - 2/14:17:31 1 43717 59116
7 NEP0002 : 0000 1 2/14:24:22 - 2/15:13:35 1 59117 78927
8 NEP0002 : 0000 1 3/11:38:43 - 3/12:38:41 1 1 12986
9 NEP0002 : 0000 1 3/12:38:45 - 3/13:08:27 1 12987 19431
10 NEP0002 : 0000 1 3/13:15:14 - 3/14:15:11 1 19432 32411
11 NEP0002 : 0000 1 3/14:15:15 - 3/15:15:13 1 32412 43710
12 NEP0002 : 0000 1 3/15:15:18 - 3/16:15:07 1 43711 58229
13 NEP0002 : 0000 1 3/16:21:50 - 3/17:21:48 1 58230 82375
14 NEP0002 : 0000 1 3/17:21:52 - 3/17:51:34 1 82376 94408
15 NEP0002 : 0000 1 4/11:37:19 - 4/12:31:31 1 1 16329
16 NEP0002 : 0000 1 4/12:38:15 - 4/13:34:59 1 16330 33513
delete NX, Run INDXR
>go
LISTR1: Task LISTR (release of 31DEC18) begins
LISTR1: NO SOURCE TABLE, SCAN OUTPUT WILL OMIT
parallax LISTR(31DEC18) 388 10-APR-2018 07:35:17 Page 1
File = NEP0002 .V0.1 . 4 Vol = 5 Userid = 388
Freq = 4.704000000 GHz Ncor = 2 No. vis = 274581
Scan summary listing
Scan Source Qual Calcode Sub Timerange FrqID START VIS END VIS
1 NEP0002 : 0000 1 0/11:50:31 - 0/12:32:11 1 1 16921
2 NEP0002 : 0000 1 0/12:38:54 - 0/13:38:52 1 16922 41207
3 NEP0002 : 0000 1 0/13:38:56 - 0/14:02:39 1 41208 50798
4 NEP0002 : 0000 1 0/14:09:29 - 0/14:51:08 1 50799 67733
5 NEP0002 : 0000 1 2/11:42:39 - 2/12:31:53 1 67734 87514
6 NEP0002 : 0000 1 2/12:38:38 - 2/13:38:37 1 87515 111449
7 NEP0002 : 0000 1 2/13:38:41 - 2/14:17:31 1 111450 126849
8 NEP0002 : 0000 1 2/14:24:22 - 2/15:13:35 1 126850 146660
9 NEP0002 : 0000 1 3/11:38:43 - 3/12:38:41 1 146661 159646
10 NEP0002 : 0000 1 3/12:38:45 - 3/13:08:27 1 159647 166091
11 NEP0002 : 0000 1 3/13:15:14 - 3/14:15:11 1 166092 179071
12 NEP0002 : 0000 1 3/14:15:15 - 3/15:15:13 1 179072 190370
13 NEP0002 : 0000 1 3/15:15:18 - 3/16:15:07 1 190371 204889
14 NEP0002 : 0000 1 3/16:21:50 - 3/17:21:48 1 204890 229035
15 NEP0002 : 0000 1 3/17:21:52 - 3/17:51:34 1 229036 241068
16 NEP0002 : 0000 1 4/11:37:19 - 4/12:31:31 1 241069 257397
17 NEP0002 : 0000 1 4/12:38:15 - 4/13:34:59 1 257398 274581
On Mon, 9 Apr 2018, Eric Greisen wrote:
> On 04/04/2018 07:21 PM, Walter Brisken wrote:
>>
>> Hi Eric,
>>
>> DBAPP seems not to be working. The error I get and the image headers are
>> shown below. Note that I've tried various FQTOL values (including -1),
>> and tried multiple inseq / in2seq values from a string of 13 such files on
>> disk. I've also experimented with outname/outclass/outseq being an
>> existing file or one that is to be created. Same error message occurs in
>> any case. The two data files in the example below can be found in:
>>
>> /home/parallax/BB388/testfiles
>>
>> Inputs and error message:
>>
>> > inp
>> AIPS 2: DBAPP appends one or more uv data sets to the output file
>> AIPS 2: Adverbs Values Comments
>> AIPS 2: ----------------------------------------------------------------
>> AIPS 2: INNAME 'NEP0002' Input UV file
>> name (name)
>> AIPS 2: INCLASS 'V0.1' Input UV
>> file name (class)
>> AIPS 2: INSEQ 10 Input
>> UV file name (seq. #)
>> AIPS 2: INDISK 5 Input
>> UV file disk unit #
>> AIPS 2: IN2SEQ 10 Upper
>> input file seq. #
>> AIPS 2: OUTNAME 'NEP0002' Output UV file
>> name (name)
>> AIPS 2: OUTCLASS 'V0.1' Output UV
>> file name (class)
>> AIPS 2: OUTSEQ 9
>> Output UV file name (seq. #)
>> AIPS 2: OUTDISK 5 Output
>> UV file disk unit #.
>> AIPS 2: FQTOL 100 > 0
>> tolerance to not renumber
>> AIPS
>> 2:
>> FQs of dataset 2 (in kHz)
>> AIPS
>> 2:
>> -1 => no renumbering.
>> > go
>> DBAPP2: Task DBAPP (release of 31DEC18) begins
>> DBAPP2: NUMBERS OF POINTS ON AXES DO NOT MATCH
>> DBAPP2: ERROR AROSE WITH INPUT FILE SEQUENCE NUMBER 10
>> DBAPP2: Purports to die of UNNATURAL causes
>> DBAPP2: parallax 31DEC18 TST: Cpu= 0.0
>> DBAPP2: Real= 0
>> AIPS 2: Resumes
>>
>
> i have found several issues:
>
> 1. UT1UTC changes between your 2 files - that was treated as a hard error.
> Changed it to a warning.
>
> 2. The check on times did not include a time offset, so concluded that the
> output file came after the input.
>
> 3. But worse - the UV header Common changed some long time ago and the
> parallel versions of it in DBAPP were not updated. This trashed the data and
> could (although not in the case I tested) lead to the error you got.
>
> Will be fixed in 31DEC17 this afternoon, and 31DEC18 after 10 pm tonight.
>
> Eric
>
--
-------------------------
Walter Brisken
Director
Long Baseline Observatory
(575)-835-7133 (office)
(505)-234-5912 (cell)
More information about the Daip
mailing list