[Difx-users] Question : difx2mark4 / fourfit problem

Geoff Crew gbc at haystack.mit.edu
Fri Mar 2 08:11:31 EST 2018


The current DiFX trunk is fixed, and (after some
testing) will be propagated to a stable DiFX 2.5.2.

-- 

		Geoff (gbc at haystack.mit.edu)

On Fri, Mar 02, 2018 at 09:30:10AM +0100, harro verkouter wrote:
>    Hi Stuart,
>    I may be speaking out of turn but it certainly looks like it's exactly the
>    "root_id problem" described and fixed by Jamie McCallum & Jakob Gruber
>    earlier on the DiFX mailing list.
>    The problem - "{" ending up in the file names and in your output I see
>    this:
> 
>    oper at ww-flexbuf-01:/raid0/etransfer/ws001$ ls ws001h/1234/No0001
> 
>    1306-095.{aepql  L..{aepql  LL..{aepql  Lu..{aepql  u..{aepql 
>    uu..{aepql
> 
>    From Jamie/Jakob's mail for an immediate fix:
>    "To work around the issue, we've recompiled difx2mark4 after editing the
>    root_id.c program to use 1999 as the reference epoch, rather than 1979.
>    This has reset the root_id codes to ~mmaaaa and will buy us ~18 years
>    before we run into the same problem again. The output data can be parsed
>    by fourfit without any apparent issues."
>    But according to Geoff an official fix is on its way.
>    Cheers,
>    h
>    On 2 March 2018 at 01:26, Stuart Weston <[1]stuart.weston at aut.ac.nz>
>    wrote:
> 
>      Ran the input file with mpifxcorr, watching errormon and all seemed
>      good. Happily producing usual output about visibilities no errors.
> 
>       
> 
>      Run difx2mark4, it doesn’t look like previous experiments.
> 
>       
> 
>      Now in another experiment I ran the same way I can see the result thus:
> 
>       
> 
>      oper at ww-flexbuf-01:/raid0/etransfer/ws001$ ls ws001d/1234/No0001
> 
>      1306-095.zyfcsr  LL..zyfcsr  Lu..zyfcsr  L..zyfcsr  uu..zyfcsr 
>      u..zyfcsr
> 
>       
> 
>      But for this experiment I get very different :
> 
>       
> 
>      oper at ww-flexbuf-01:/raid0/etransfer/ws001$ ls ws001h/1234/No0001
> 
>      1306-095.{aepql  L..{aepql  LL..{aepql  Lu..{aepql  u..{aepql 
>      uu..{aepql
> 
>       
> 
>      I run fourfit on this new experiment and get :
> 
>       
> 
>      oper at ww-flexbuf-01 DiFX-2.4.0 1234> /home/oper/x86_64-3.17/bin/fourfit
>      -m -3 -b Lu -P LR -c ../cf_1234 No0001
> 
>      fourfit: condensed string= max_parity 0.01 sb_win -256.0 256.0 mb_win
>      -2.0 2.0 dr_win -300.e-4 300.e-5 if station L pc_mode manual pc_phases
>      ghijklmn 0 0 0 0 0 0 0 0 if station u pc_mode manual pc_phases ghijklmn
>      0 0 0 0 0 0 0 0
> 
>      fourfit: token 0: <max_parity> line 4 category 2 symbol 15 value 0
> 
>      fourfit: token 1: <0.01> line 4 category 7 symbol 30 value 0
> 
>      fourfit: token 2: <sb_win> line 11 category 3 symbol 24 value 0
> 
>      fourfit: token 3: <-256.0> line 11 category 7 symbol 30 value 1
> 
>      fourfit: token 4: <256.0> line 11 category 7 symbol 30 value 2
> 
>      fourfit: token 5: <mb_win> line 11 category 3 symbol 25 value 1308542584
> 
>      fourfit: token 6: <-2.0> line 11 category 7 symbol 30 value 3
> 
>      fourfit: token 7: <2.0> line 11 category 7 symbol 30 value 4
> 
>      fourfit: token 8: <dr_win> line 11 category 3 symbol 26 value 1818326382
> 
>      fourfit: token 9: <-300.e-4> line 11 category 7 symbol 30 value 5
> 
>      fourfit: token 10: <300.e-5> line 11 category 7 symbol 30 value 6
> 
>      fourfit: token 11: <if> line 22 category 9 symbol 6 value 49
> 
>      fourfit: token 12: <station> line 22 category 15 symbol 1 value 32555
> 
>      fourfit: token 13: <L> line 22 category 11 symbol 32 value 0
> 
>      fourfit: token 14: <pc_mode> line 23 category 1 symbol 23 value 0
> 
>      fourfit: token 15: <manual> line 23 category 6 symbol 29 value 3
> 
>      fourfit: token 16: <pc_phases> line 24 category 22 symbol 22 value 0
> 
>      fourfit: token 17: <ghijklmn> line 24 category 13 symbol 34 value 2
> 
>      fourfit: token 18: <0> line 24 category 6 symbol 29 value 0
> 
>      fourfit: token 19: <0> line 24 category 6 symbol 29 value 0
> 
>      fourfit: token 20: <0> line 24 category 6 symbol 29 value 0
> 
>      fourfit: token 21: <0> line 24 category 6 symbol 29 value 0
> 
>      fourfit: token 22: <0> line 24 category 6 symbol 29 value 0
> 
>      fourfit: token 23: <0> line 24 category 6 symbol 29 value 0
> 
>      fourfit: token 24: <0> line 24 category 6 symbol 29 value 0
> 
>      fourfit: token 25: <0> line 24 category 6 symbol 29 value 0
> 
>      fourfit: token 26: <if> line 27 category 9 symbol 6 value 0
> 
>      fourfit: token 27: <station> line 27 category 15 symbol 1 value 110561
> 
>      fourfit: token 28: <u> line 27 category 11 symbol 32 value 11
> 
>      fourfit: token 29: <pc_mode> line 28 category 1 symbol 23 value 0
> 
>      fourfit: token 30: <manual> line 28 category 6 symbol 29 value 3
> 
>      fourfit: token 31: <pc_phases> line 29 category 22 symbol 22 value
>      110513
> 
>      fourfit: token 32: <ghijklmn> line 29 category 13 symbol 34 value 13
> 
>      fourfit: token 33: <0> line 29 category 6 symbol 29 value 0
> 
>      fourfit: token 34: <0> line 29 category 6 symbol 29 value 0
> 
>      fourfit: token 35: <0> line 29 category 6 symbol 29 value 0
> 
>      fourfit: token 36: <0> line 29 category 6 symbol 29 value 0
> 
>      fourfit: token 37: <0> line 29 category 6 symbol 29 value 0
> 
>      fourfit: token 38: <0> line 29 category 6 symbol 29 value 0
> 
>      fourfit: token 39: <0> line 29 category 6 symbol 29 value 0
> 
>      fourfit: token 40: <0> line 29 category 6 symbol 29 value 0
> 
>      fourfit: Following parser triples are token_number:state:category
> 
>       
> 
>      0:1:2  1:3:7  2:1:3  3:4:7  4:5:7  5:1:3  6:4:7
> 
>      7:5:7  8:1:3  9:4:7  10:5:7  11:1:9  12:8:15  13:11:11
> 
>      14:8:1
> 
>      14:1:1  15:2:6  16:1:22  17:16:13  18:7:6  19:7:6  20:7:6
> 
>      21:7:6  22:7:6  23:7:6  24:7:6  25:7:6  26:7:9  26:1:9  27:8:15
> 
>      28:11:11  29:8:1  29:1:1  30:2:6  31:1:22  32:16:13  33:7:6 
>      34:7:6
> 
>      fourfit: condensed string=if if not baseline Lu skip true
> 
>      fourfit: token 0: <if> line 1 category 9 symbol 6 value 32555
> 
>      fourfit: token 1: <if> line 1 category 9 symbol 6 value 692797216
> 
>      fourfit: token 2: <not> line 1 category 20 symbol 10 value 0
> 
>      fourfit: token 3: <baseline> line 1 category 16 symbol 2 value
>      -343597384
> 
>      fourfit: token 4: <Lu> line 1 category 12 symbol 33 value 0
> 
>      fourfit: token 5: <skip> line 1 category 1 symbol 27 value 1308543720
> 
>      fourfit: token 6: <true> line 1 category 6 symbol 29 value 1
> 
>      fourfit: Following parser triples are token_number:state:category
> 
>      35:7:6  36:7:6  37:7:6  38:7:6  39:7:6  40:7:6  41:7:0  41:1:0
> 
>      0:1:9  1:8:9  1:1:9  2:8:20  3:8:16  4:14:12  5:8:1  5:1:1 
>      6:2:6
> 
>      fourfit: No valid root files specified
> 
>      fourfit:
> 
>      fourfit: SYNTAX:  fourfit [-a] [-b BB:F] [-c controlfile] [-d display
>      device]
> 
>      fourfit:             [-f value] [-m value] [-n value] [-p]
>      [-r afile] [-s naps]
> 
>      fourfit:             [-tux] [-P polar_pair] [-T trefoffs]
>      [-X] data file list
> 
>      fourfit:             [set <control file syntax statements>]
> 
>      fourfit:          Where all arguments except the data file list
>      are optional.
> 
>      fourfit:          The [-r afile] option replaces the data file
>      list, however.
> 
>      fourfit:          The "set" argument and the commands which
>      follow it must
> 
>      fourfit:          come last.  All option flags must appear
>      before the data file
> 
>      fourfit:          list.  Option flags can come in any order.
> 
>      fourfit:
> 
>      fourfit:     Here are two examples of command-line invocations of
>      fourfit, with
> 
>      fourfit:     an explanation of what they do:
> 
>      fourfit:
> 
>      fourfit: fourfit -txas -m 1 -c control 018-234505 set mb_win -0.0034
>      .004 freqs a b
> 
>      fourfit:         Test mode, xwindow display, accounting switched
>      on, cross
> 
>      fourfit:         power spectrum plot switched on, moderately
>      verbose, use
> 
>      fourfit:         control file named "control" in current working
>      directory,
> 
>      fourfit:         process all data in scan directory 018-234505,
>      override
> 
>      fourfit:         multiband delay search window and select
>      channels 'a' and
> 
>      fourfit:         'b' only.
> 
>      fourfit:
> 
>      fourfit: fourfit -r refr_list -c control -d hardcopy -b AT:S
> 
>      fourfit:         Process all data referenced by type 2 lines in
>      the A-file
> 
>      fourfit:         named "refr_list", use control file "control",
>      print the
> 
>      fourfit:         fringe plot on the default printer, process
>      only baseline
> 
>      fourfit:         AT frequency subgroup S.
> 
>      fourfit:
> 
>      fourfit: Fatal error interpreting command line arguments
> 
>       
> 
>      I have never seen this before ?
> 
>       
> 
>      If I run fourfit on an earlier experiment it works with the same
>      param’s.
> 
>       
> 
>      I am assuming the mpifxcorr must have gone wrong somehow ? I have
>      several previous experiments using the same setup and I follow the same
>      steps but still keep hitting this ?
> 
>      Stuart Weston Bsc (Hons), MPhil (Hons), MInstP
> 
>      Mobile: 021 713062
> 
>      Skype: stuart.d.weston
>      Email:  [2]stuart.weston at aut.ac.nz
> 
>      [3]http://www.atnf.csiro.au/people/Stuart.Weston/index.html
> 
>      Software Engineer
>      Institute for Radio Astronomy & Space Research (IRASR)
>      School of Computing & Mathematical Sciences
>      Faculty of Creative Technologies
>      Auckland University of Technology, New Zealand.
> 
>      [4]http://www.irasr.aut.ac.nz/
> 
>       
> 
>      [5]NewIRASRLogo
> 
>       
> 
>       
> 
>      _______________________________________________
>      Difx-users mailing list
>      [6]Difx-users at listmgr.nrao.edu
>      [7]https://listmgr.nrao.edu/mailman/listinfo/difx-users
> 
>    !DSPAM:5a990bcf97423356217512!
> 
> References
> 
>    Visible links
>    1. mailto:stuart.weston at aut.ac.nz
>    2. mailto:stuart.weston at aut.ac.nz
>    3. http://www.atnf.csiro.au/people/Stuart.Weston/index.html
>    4. http://www.irasr.aut.ac.nz/
>    6. mailto:Difx-users at listmgr.nrao.edu
>    7. https://listmgr.nrao.edu/mailman/listinfo/difx-users



> _______________________________________________
> Difx-users mailing list
> Difx-users at listmgr.nrao.edu
> https://listmgr.nrao.edu/mailman/listinfo/difx-users
> 
> 
> !DSPAM:5a990bcf97423356217512!



More information about the Difx-users mailing list