[Difx-users] difx2mark4, PCAL and multiple datastreams

[Jamie McCallum]

Hello,

     I've encountered an issue with difx2mark4 when correlating data 
from multiple datastreams. Essentially, only the first named 
datastream's PCAL entries are being correctly parsed and added to the 
output mark4 files. The issue appears to be in the "createType3s.c" 
code, where there is a check against entries that are out of time order. 
When this is parsing the PCAL file created from multiple datastreams, 
all PCAL entries from additional datastreams are flagged as having 
duplicate time entries and quietly dropped from the output conversion.

     I have some data correlated with DiFX-2.5.2 which illustrates the 
problem which I can make available, and have included an extract of the 
output of difx2mark4 in the postscript.

     I've made a few crude attempts at trying to work around this issue 
but without success. Please let me know if there's a workaround to this 
problem, or if you would like access to the data to investigate the issue.

Regards,

Jamie


P.S - partial output of "difx2mark4 -e 4321  -v -v aum001_001". Please 
note that the HB data is comprised of three separate datastreams.

     Generating Type 3s
       created type 3 output file 4321/212-1730/L..0R36O1
       getting pcal data from file 
/home/observer/correlations/aum001/aum001_001.difx/PCAL_*HB
       pcal out of order  58330.729174< 58330.729174
       pcal out of order  58330.729174< 58330.729174
       pcal out of order  58330.729189< 58330.729189
       pcal out of order  58330.729189< 58330.729189
....

      pcal out of order  58330.730009< 58330.730009
       pcal out of order  58330.730009< 58330.730009
       pcal out of order  58330.730024< 58330.730024
       pcal out of order  58330.730024< 58330.730024
       pcal out of order  58330.730039< 58330.730039
       pcal out of order  58330.730039< 58330.730039
       created type 3 output file 4321/212-1730/i..0R36TO
       getting pcal data from file 
/home/observer/correlations/aum001/aum001_001.difx/PCAL_*KE
       pcal late    212.730130 ->  58330.730130 > 58330.730127
       created type 3 output file 4321/212-1730/e..0R36TO
       getting pcal data from file 
/home/observer/correlations/aum001/aum001_001.difx/PCAL_*YG
       pcal late    212.730130 ->  58330.730130 > 58330.730127
1 of 1 scans converted!
1 of 1 DiFX filesets converted to 1 Mark4 filesets