<div dir="ltr">Hi Eskil,<div><br></div><div>Thanks for the update. Glad to hear you got a resolution, and sorry I hadn't had a chance to try to reproduce the problem and go digging with you!</div><div><br></div><div>Cheers,</div><div>Adam</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, 2 Jun 2021 at 15:29, Eskil Varenius via Difx-users <<a href="mailto:difx-users@listmgr.nrao.edu">difx-users@listmgr.nrao.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<p>Hi all,</p>
<p>In case anyone is interested, here is a bried update on this
issue (missing baselines in mixed-pol setup when not using
zoombands): Since a while ago, I believe the problem is not the
mix of polarisations, but rather the mix of USB/LSB. The ON
station is recording USB BBCs while the OE and OW stations record
LSB BBCs. I have been told there is a bug/feature in difx2mark4
with mixed USB/LSB data, where difx supposedly writes two
frequency tables, but difx2mark4 only reads the baselines matching
one of them. This is a likely explanation for why I seem to lose
the OE-OW baseline; it is the only LSB-LSB configuration, while
the USB-LSB baselines (OE-ON and OW-ON) are kept. Using zoombands,
it seems the output is forced into one frequency table and thus no
problem for difx2mark4 et al. <br>
</p>
<p>Kind regards</p>
<p>Eskil<br>
</p>
<div>On 2021-02-04 18:09, Eskil Varenius
wrote:<br>
</div>
<blockquote type="cite">
<div>
<p class="MsoNormal"><span lang="SV">Hi Adam, all<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="SV"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Finally some data so I can return to the
mixed-pol issue again. To remind you, my problem is that
when correlating R-pol (1Gbps) data from ONSALA60 against
X/Y-pol (2Gbps) data from ONSA13NE and ONSA13SW, I must
define “zoom bands” to get visibilities on all baselines.
Not sure if the problem is in DiFX, or difx2mark4 (or
elsewhere). I have uploaded a tar.gz archive with
input/output files (excluding 18GB of VDIF data) at<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><a href="https://chalmersuniversity.box.com/s/9ed0t61bk04ag88is2ovhlm0er4qd00n" target="_blank">https://chalmersuniversity.box.com/s/9ed0t61bk04ag88is2ovhlm0er4qd00n</a><u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">There you can check logfiles, input files etc.
If you want the data, I can share it (no time right now to
remember how to split out a small chunk of data for testing,
so used one full 30 sec scan). I can also try various things
on my end if you have suggestions.<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Here are the steps to reproduce with DiFX
2.6.2:<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Unzip archive,<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Edit "*.files" with correct paths to "data"
directory<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">cd zoom<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Edit "on1028_1.machines" accordingly (e.g.
computer name)<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">vex2difx -v -v -v -d *v2d --force (need force
as this is mixed circular/linear data)<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">calcif2 *.calc<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">startdifx -n -f *.input -v<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">I now get messages, see logfile, like<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">"Thu Feb 4 17:56:58 2021 0 skirner WARNING
Baseline 0 frequency 0 points at two different frequencies
that are apparently identical - this is not wrong, but very
strange. Check the input file"<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">The message is correct, I have identical zoom
windows - otherwise I don't get all baselines. To see
result, I run<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">difx2mark4 -v -b X 2300 14000 *.difx -s
../station_code_file.txt<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">and check the output on screen. All baselines
are included:<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">[...]<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> n120[SX] 448<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> n120[ST] 896<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> n120[XT] 448<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> n120[SS] 448<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> n120[XX] 448<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> n120[TT] 448<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">[...]<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Same procedure without zoom-windows, I get a
different set of baselines<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">[...]<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> n120[SX] 448<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> n120[XT] 448<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> n120[SS] 448<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> n120[XX] 224<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"> n120[TT] 448<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">[...]<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Curiously, the "ST" (which is the ONSA13NE-SW
baseline) is missing, and the XX (ONSALA60) is half (224).<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Not sure the zoom-window version is correct,
but I need the ST-baseline, and it seems to work, so I use
zoom-windows. But, I'm curious: why does this happen?<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Kind regards<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Eskil<u></u><u></u></span></p>
<p class="MsoNormal"><span><u></u> <u></u></span></p>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb(181,196,223);padding:3pt 0cm 0cm">
<p class="MsoNormal"><b><span style="font-size:12pt;color:black">From: </span></b><span style="font-size:12pt;color:black">Difx-users
<a href="mailto:difx-users-bounces@listmgr.nrao.edu" target="_blank"><difx-users-bounces@listmgr.nrao.edu></a> on behalf of
Eskil Varenius via Difx-users
<a href="mailto:difx-users@listmgr.nrao.edu" target="_blank"><difx-users@listmgr.nrao.edu></a><br>
<b>Reply to: </b>Eskil Varenius
<a href="mailto:eskil.varenius@chalmers.se" target="_blank"><eskil.varenius@chalmers.se></a><br>
<b>Date: </b>Monday, 30 November 2020 at 11:51<br>
<b>To: </b>Adam Deller <a href="mailto:adeller@astro.swin.edu.au" target="_blank"><adeller@astro.swin.edu.au></a><br>
<b>Cc: </b><a href="mailto:difx-users@listmgr.nrao.edu" target="_blank">"difx-users@listmgr.nrao.edu"</a>
<a href="mailto:difx-users@listmgr.nrao.edu" target="_blank"><difx-users@listmgr.nrao.edu></a><br>
<b>Subject: </b>Re: [Difx-users] A few surprises<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p>Hi Adam,<u></u><u></u></p>
<p>Apologies, but I will have to defer sending additional
details as the data in question have already been removed
after correlation. (I would like to verify that the files I
send indeed produce the errors I claim, so I don't send files
with other typos). Also, I have too many other todo-items to
follow this up right now, but we regularly observe with
similar settings so I should get another data set to play with
in a few weeks. When I do, I will check the input-file
differences and let you know, and keep the data on disk for
additional tests. But I did experience the same thing for all
similar data so far. Will let you know once I have new data.<u></u><u></u></p>
<p>Cheers<u></u><u></u></p>
<p>Eskil<u></u><u></u></p>
<div>
<p class="MsoNormal">On 2020-11-30 11:43, Adam Deller wrote:<u></u><u></u></p>
</div>
<blockquote style="margin-top:5pt;margin-bottom:5pt">
<div>
<p class="MsoNormal">Hi Eskil, <u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Thanks for the heads up, the first
two are surprising (I'm never surprised by gaps in
documentation!) <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">I've got no experience with the intel
compilers, so will pass on that one. For the second,
what is the difference in the .input file produced by
vex2difx in the two cases? That might help shed some
light.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Cheers,<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Adam<u></u><u></u></p>
</div>
</div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<div>
<p class="MsoNormal">On Mon, 30 Nov 2020 at 21:18, Eskil
Varenius via Difx-users <<a href="mailto:difx-users@listmgr.nrao.edu" target="_blank">difx-users@listmgr.nrao.edu</a>>
wrote:<u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0cm 0cm 0cm 6pt;margin-left:4.8pt;margin-right:0cm">
<p class="MsoNormal">Dear difx developers,<br>
I have noted a few surprises which I would like to
report:<br>
<br>
- Compiling DiFX 2.6.1/2.6.2 with intel 2019 compiler,
mpifxcorr runs <br>
but refuses to actually read any data. It just sits
there, never <br>
starting the correlation. Using intel 2018 compiler
instead, everything <br>
works nicely.<br>
<br>
- Correlating mixed-polarisation data (antenna ON:
R-pol, OE and OW: X/Y <br>
pol) delivers correlation products on the mixed
circ/linear baselines <br>
(R-X and R-Y pol), but not on the linear/linear
baselines (XX,XY,YX,YY). <br>
However, if I add zoomwindows - describing the same
setup already in the <br>
VEX file, so no actual zooming - then I get also the
linear polarisation <br>
products. (I know mixed-pol support is limited, but
might as well note <br>
the behaviour.)<br>
<br>
- "difx2mark4 --help" v1.6 does not say it needs .calc
files, but seems <br>
it does. So documentation should be amended?<br>
<br>
Kind regards<br>
Eskil<br>
<br>
_______________________________________________<br>
Difx-users mailing list<br>
<a href="mailto:Difx-users@listmgr.nrao.edu" target="_blank">Difx-users@listmgr.nrao.edu</a><br>
<a href="https://listmgr.nrao.edu/mailman/listinfo/difx-users" target="_blank">https://listmgr.nrao.edu/mailman/listinfo/difx-users</a><u></u><u></u></p>
</blockquote>
</div>
<p class="MsoNormal"><br clear="all">
<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<p class="MsoNormal">-- <u></u><u></u></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">!=============================================================!<u></u><u></u></span></p>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">A/Prof.
Adam Deller <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">ARC
Future Fellow<u></u><u></u></span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">Centre
for Astrophysics &
Supercomputing <u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">Swinburne
University of Technology <br>
John St, Hawthorn VIC 3122
Australia<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">phone:
+61 3 9214 5307<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">fax:
+61 3 9214 8797<u></u><u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt"><u></u> <u></u></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">office
days (usually): Mon-Thu<br>
!=============================================================!<u></u><u></u></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</blockquote>
</div>
_______________________________________________<br>
Difx-users mailing list<br>
<a href="mailto:Difx-users@listmgr.nrao.edu" target="_blank">Difx-users@listmgr.nrao.edu</a><br>
<a href="https://listmgr.nrao.edu/mailman/listinfo/difx-users" rel="noreferrer" target="_blank">https://listmgr.nrao.edu/mailman/listinfo/difx-users</a><br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr" style="font-size:12.8px"><div dir="ltr" style="font-size:12.8px"><div dir="ltr" style="font-size:12.8px"><div dir="ltr" style="font-size:12.8px"><div dir="ltr" style="font-size:12.8px">!=============================================================!<br><div dir="ltr" style="font-size:12.8px">A/Prof. Adam Deller </div><div dir="ltr" style="font-size:12.8px">ARC Future Fellow</div></div><div style="font-size:12.8px">Centre for Astrophysics & Supercomputing </div><div dir="ltr" style="font-size:12.8px">Swinburne University of Technology <br>John St, Hawthorn VIC 3122 Australia</div><div style="font-size:12.8px">phone: +61 3 9214 5307</div><div style="font-size:12.8px">fax: +61 3 9214 8797</div><div style="font-size:12.8px"><br></div><div style="font-size:12.8px">office days (usually): Mon-Thu<br>!=============================================================!</div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>