[Difx-users] Question : difx2mark4 / fourfit problem

Fri Mar 2 03:30:10 EST 2018

Hi Stuart,

I may be speaking out of turn but it certainly looks like it's exactly the
"root_id problem" described and fixed by Jamie McCallum & Jakob Gruber
earlier on the DiFX mailing list.

The problem - "{" ending up in the file names and in your output I see this:

oper at ww-flexbuf-01:/raid0/etransfer/ws001$ ls ws001h/1234/No0001

1306-095.{aepql  L..{aepql  LL..{aepql  Lu..{aepql  u..{aepql  uu..{aepql

>From Jamie/Jakob's mail for an immediate fix:

"To work around the issue, we've recompiled difx2mark4 after editing the
root_id.c program to use 1999 as the reference epoch, rather than 1979.
This has reset the root_id codes to ~mmaaaa and will buy us ~18 years
before we run into the same problem again. The output data can be parsed by
fourfit without any apparent issues."

But according to Geoff an official fix is on its way.

Cheers,
h

On 2 March 2018 at 01:26, Stuart Weston <stuart.weston at aut.ac.nz> wrote:

> Ran the input file with mpifxcorr, watching errormon and all seemed good.
> Happily producing usual output about visibilities no errors.
>
>
>
> Run difx2mark4, it doesn’t look like previous experiments.
>
>
>
> Now in another experiment I ran the same way I can see the result thus:
>
>
>
> oper at ww-flexbuf-01:/raid0/etransfer/ws001$ ls ws001d/1234/No0001
>
> 1306-095.zyfcsr  LL..zyfcsr  Lu..zyfcsr  L..zyfcsr  uu..zyfcsr  u..zyfcsr
>
>
>
> But for this experiment I get very different :
>
>
>
> oper at ww-flexbuf-01:/raid0/etransfer/ws001$ ls ws001h/1234/No0001
>
> 1306-095.{aepql  L..{aepql  LL..{aepql  Lu..{aepql  u..{aepql  uu..{aepql
>
>
>
> I run fourfit on this new experiment and get :
>
>
>
> oper at ww-flexbuf-01 DiFX-2.4.0 1234> /home/oper/x86_64-3.17/bin/fourfit -m
> -3 -b Lu -P LR -c ../cf_1234 No0001
>
> fourfit: condensed string= max_parity 0.01 sb_win -256.0 256.0 mb_win -2.0
> 2.0 dr_win -300.e-4 300.e-5 if station L pc_mode manual pc_phases ghijklmn
> 0 0 0 0 0 0 0 0 if station u pc_mode manual pc_phases ghijklmn 0 0 0 0 0 0
> 0 0
>
> fourfit: token 0: <max_parity> line 4 category 2 symbol 15 value 0
>
> fourfit: token 1: <0.01> line 4 category 7 symbol 30 value 0
>
> fourfit: token 2: <sb_win> line 11 category 3 symbol 24 value 0
>
> fourfit: token 3: <-256.0> line 11 category 7 symbol 30 value 1
>
> fourfit: token 4: <256.0> line 11 category 7 symbol 30 value 2
>
> fourfit: token 5: <mb_win> line 11 category 3 symbol 25 value 1308542584
>
> fourfit: token 6: <-2.0> line 11 category 7 symbol 30 value 3
>
> fourfit: token 7: <2.0> line 11 category 7 symbol 30 value 4
>
> fourfit: token 8: <dr_win> line 11 category 3 symbol 26 value 1818326382
>
> fourfit: token 9: <-300.e-4> line 11 category 7 symbol 30 value 5
>
> fourfit: token 10: <300.e-5> line 11 category 7 symbol 30 value 6
>
> fourfit: token 11: <if> line 22 category 9 symbol 6 value 49
>
> fourfit: token 12: <station> line 22 category 15 symbol 1 value 32555
>
> fourfit: token 13: <L> line 22 category 11 symbol 32 value 0
>
> fourfit: token 14: <pc_mode> line 23 category 1 symbol 23 value 0
>
> fourfit: token 15: <manual> line 23 category 6 symbol 29 value 3
>
> fourfit: token 16: <pc_phases> line 24 category 22 symbol 22 value 0
>
> fourfit: token 17: <ghijklmn> line 24 category 13 symbol 34 value 2
>
> fourfit: token 18: <0> line 24 category 6 symbol 29 value 0
>
> fourfit: token 19: <0> line 24 category 6 symbol 29 value 0
>
> fourfit: token 20: <0> line 24 category 6 symbol 29 value 0
>
> fourfit: token 21: <0> line 24 category 6 symbol 29 value 0
>
> fourfit: token 22: <0> line 24 category 6 symbol 29 value 0
>
> fourfit: token 23: <0> line 24 category 6 symbol 29 value 0
>
> fourfit: token 24: <0> line 24 category 6 symbol 29 value 0
>
> fourfit: token 25: <0> line 24 category 6 symbol 29 value 0
>
> fourfit: token 26: <if> line 27 category 9 symbol 6 value 0
>
> fourfit: token 27: <station> line 27 category 15 symbol 1 value 110561
>
> fourfit: token 28: <u> line 27 category 11 symbol 32 value 11
>
> fourfit: token 29: <pc_mode> line 28 category 1 symbol 23 value 0
>
> fourfit: token 30: <manual> line 28 category 6 symbol 29 value 3
>
> fourfit: token 31: <pc_phases> line 29 category 22 symbol 22 value 110513
>
> fourfit: token 32: <ghijklmn> line 29 category 13 symbol 34 value 13
>
> fourfit: token 33: <0> line 29 category 6 symbol 29 value 0
>
> fourfit: token 34: <0> line 29 category 6 symbol 29 value 0
>
> fourfit: token 35: <0> line 29 category 6 symbol 29 value 0
>
> fourfit: token 36: <0> line 29 category 6 symbol 29 value 0
>
> fourfit: token 37: <0> line 29 category 6 symbol 29 value 0
>
> fourfit: token 38: <0> line 29 category 6 symbol 29 value 0
>
> fourfit: token 39: <0> line 29 category 6 symbol 29 value 0
>
> fourfit: token 40: <0> line 29 category 6 symbol 29 value 0
>
> fourfit: Following parser triples are token_number:state:category
>
>
>
> 0:1:2  1:3:7  2:1:3  3:4:7  4:5:7  5:1:3  6:4:7
>
> 7:5:7  8:1:3  9:4:7  10:5:7  11:1:9  12:8:15  13:11:11
>
> 14:8:1
>
> 14:1:1  15:2:6  16:1:22  17:16:13  18:7:6  19:7:6  20:7:6
>
> 21:7:6  22:7:6  23:7:6  24:7:6  25:7:6  26:7:9  26:1:9  27:8:15
>
> 28:11:11  29:8:1  29:1:1  30:2:6  31:1:22  32:16:13  33:7:6  34:7:6
>
> fourfit: condensed string=if if not baseline Lu skip true
>
> fourfit: token 0: <if> line 1 category 9 symbol 6 value 32555
>
> fourfit: token 1: <if> line 1 category 9 symbol 6 value 692797216
>
> fourfit: token 2: <not> line 1 category 20 symbol 10 value 0
>
> fourfit: token 3: <baseline> line 1 category 16 symbol 2 value -343597384
>
> fourfit: token 4: <Lu> line 1 category 12 symbol 33 value 0
>
> fourfit: token 5: <skip> line 1 category 1 symbol 27 value 1308543720
>
> fourfit: token 6: <true> line 1 category 6 symbol 29 value 1
>
> fourfit: Following parser triples are token_number:state:category
>
> 35:7:6  36:7:6  37:7:6  38:7:6  39:7:6  40:7:6  41:7:0  41:1:0
>
> 0:1:9  1:8:9  1:1:9  2:8:20  3:8:16  4:14:12  5:8:1  5:1:1  6:2:6
>
> fourfit: No valid root files specified
>
> fourfit:
>
> fourfit: SYNTAX:  fourfit [-a] [-b BB:F] [-c controlfile] [-d display
> device]
>
> fourfit:             [-f value] [-m value] [-n value] [-p] [-r afile] [-s
> naps]
>
> fourfit:             [-tux] [-P polar_pair] [-T trefoffs] [-X] data file
> list
>
> fourfit:             [set <control file syntax statements>]
>
> fourfit:          Where all arguments except the data file list are
> optional.
>
> fourfit:          The [-r afile] option replaces the data file list,
> however.
>
> fourfit:          The "set" argument and the commands which follow it must
>
> fourfit:          come last.  All option flags must appear before the data
> file
>
> fourfit:          list.  Option flags can come in any order.
>
> fourfit:
>
> fourfit:     Here are two examples of command-line invocations of fourfit,
> with
>
> fourfit:     an explanation of what they do:
>
> fourfit:
>
> fourfit: fourfit -txas -m 1 -c control 018-234505 set mb_win -0.0034 .004
> freqs a b
>
> fourfit:         Test mode, xwindow display, accounting switched on, cross
>
> fourfit:         power spectrum plot switched on, moderately verbose, use
>
> fourfit:         control file named "control" in current working directory,
>
> fourfit:         process all data in scan directory 018-234505, override
>
> fourfit:         multiband delay search window and select channels 'a' and
>
> fourfit:         'b' only.
>
> fourfit:
>
> fourfit: fourfit -r refr_list -c control -d hardcopy -b AT:S
>
> fourfit:         Process all data referenced by type 2 lines in the A-file
>
> fourfit:         named "refr_list", use control file "control", print the
>
> fourfit:         fringe plot on the default printer, process only baseline
>
> fourfit:         AT frequency subgroup S.
>
> fourfit:
>
> fourfit: Fatal error interpreting command line arguments
>
>
>
> I have never seen this before ?
>
>
>
> If I run fourfit on an earlier experiment it works with the same param’s.
>
>
>
> I am assuming the mpifxcorr must have gone wrong somehow ? I have several
> previous experiments using the same setup and I follow the same steps but
> still keep hitting this ?
>
> Stuart Weston Bsc (Hons), MPhil (Hons), MInstP
>
> Mobile: 021 713062
>
> Skype: stuart.d.weston
> Email:  stuart.weston at aut.ac.nz
>
> http://www.atnf.csiro.au/people/Stuart.Weston/index.html
>
> Software Engineer
> Institute for Radio Astronomy & Space Research (IRASR)
> School of Computing & Mathematical Sciences
> Faculty of Creative Technologies
> Auckland University of Technology, New Zealand.
>
> http://www.irasr.aut.ac.nz/
>
>
>
> [image: NewIRASRLogo]
>
>
>
>
>
> _______________________________________________
> Difx-users mailing list
> Difx-users at listmgr.nrao.edu
> https://listmgr.nrao.edu/mailman/listinfo/difx-users
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://listmgr.nrao.edu/pipermail/difx-users/attachments/20180302/0f738d28/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.jpg
Type: image/jpeg
Size: 11321 bytes
Desc: not available
URL: <http://listmgr.nrao.edu/pipermail/difx-users/attachments/20180302/0f738d28/attachment-0001.jpg>