<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p>startdifx has an "agent" option (-A) which can can be a script
that does "almost anything" as long as it exists on all machines.</p>
<p>We have an inhomogeneous installation at Haystack, and all the
various MPI options (which are different on a per-host basis) are
manipulated in the agent script. I can't speak to the mpich
implementation, but the openmpi one duplicates all the command
line options in environment variables.....<br>
</p>
<div class="moz-cite-prefix">On 5/18/23 19:19, Adam Deller via
Difx-users wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CAKPydqKGKW0BieyUfoOuR5Brp+FdX7U+9iAmYgHJs9DQF_nhcg@mail.gmail.com">
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<div dir="ltr">
<div dir="ltr">Hi De Wu,
<div><br>
</div>
<div>As Chris mentioned, the issue is probably one of argument
incompatibility between openmpi and mpich. Sadly, the
different MPI implementations (and even different versions
of the same implementation!) seem to take fiendish pleasure
in changing the options that are supported. There should be
an option (commented out by default) in the
setup.bash/setup.csh file you source before running DiFX
that allows you to set the MPI invocation parameters, e.g.:<br>
<br>
#DIFX_MPIRUNOPTIONS "--mca mpi_yield_when_idle 1 --mca rmaps
seq"<br>
</div>
<div><br>
</div>
<div>Unfortunately, I don't have personal experience with
mpich4.*, but I'd suggest just having a look for reference
material online about what options it supports compared to
openmpi. (As a first guess, you could always try just
setting DIFX_MPIRUNOPTIONS to not have --mca and see what
happens...)</div>
<div><br>
</div>
<div>Cheers,<br>
Adam</div>
<div><br>
</div>
</div>
<span>-- </span><br>
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr" style="font-size:12.8px">
<div dir="ltr" style="font-size:12.8px">
<div dir="ltr" style="font-size:12.8px">
<div dir="ltr" style="font-size:12.8px">
<div dir="ltr"
style="font-size:12.8px">
<div dir="ltr"
style="font-size:12.8px">!=============================================================!<br>
<div dir="ltr"
style="font-size:12.8px">Prof.
Adam Deller </div>
</div>
<div style="font-size:12.8px">Centre
for Astrophysics &
Supercomputing </div>
<div dir="ltr"
style="font-size:12.8px">Swinburne
University of Technology <br>
John St, Hawthorn VIC 3122
Australia</div>
<div style="font-size:12.8px">phone:
+61 3 9214 5307</div>
<div style="font-size:12.8px">fax:
+61 3 9214 8797</div>
<div style="font-size:12.8px">!=============================================================!</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
!DSPAM:6466b2d1127886707818138!
<br>
<fieldset class="moz-mime-attachment-header"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
Difx-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Difx-users@listmgr.nrao.edu">Difx-users@listmgr.nrao.edu</a>
<a class="moz-txt-link-freetext" href="https://listmgr.nrao.edu/mailman/listinfo/difx-users">https://listmgr.nrao.edu/mailman/listinfo/difx-users</a>
!DSPAM:6466b2d1127886707818138!
</pre>
</blockquote>
<pre class="moz-signature" cols="72">--
Geoff Crew
<a class="moz-txt-link-abbreviated" href="mailto:gbc@haystack.mit.edu">gbc@haystack.mit.edu</a></pre>
</body>
</html>