[Difx-users] Issue with generating .difx files using startdifx command {External} {External} {External}

[Reynolds, Cormac (S&A, Kensington WA)]

Hi De Wu,

just for reference, we use MPICH on the Pawsey systems and have not found a need to provide an equivalent to the mca options used with openmpi. It does the desired thing by default. As Adam notes, that might turn out to be implementation or version specific, but we've been using it over about 7 years and a  couple of upgrades without issue.

cheers,
Cormac.

________________________________________
From: Difx-users <difx-users-bounces at listmgr.nrao.edu> on behalf of Adam Deller via Difx-users <difx-users at listmgr.nrao.edu>
Sent: Friday, 19 May 2023 07:19
To: 深空探测
Cc: difx-users at nrao.edu
Subject: Re: [Difx-users] Issue with generating .difx files using startdifx command {External} {External}

Hi De Wu,

As Chris mentioned, the issue is probably one of argument incompatibility between openmpi and mpich.  Sadly, the different MPI implementations (and even different versions of the same implementation!) seem to take fiendish pleasure in changing the options that are supported.  There should be an option (commented out by default) in the setup.bash/setup.csh file you source before running DiFX that allows you to set the MPI invocation parameters, e.g.:

#DIFX_MPIRUNOPTIONS "--mca mpi_yield_when_idle 1 --mca rmaps seq"

Unfortunately, I don't have personal experience with mpich4.*, but I'd suggest just having a look for reference material online about what options it supports compared to openmpi.  (As a first guess, you could always try just setting DIFX_MPIRUNOPTIONS to not have --mca and see what happens...)

Cheers,
Adam

--
!=============================================================!
Prof. Adam Deller
Centre for Astrophysics & Supercomputing
Swinburne University of Technology
John St, Hawthorn VIC 3122 Australia
phone: +61 3 9214 5307
fax: +61 3 9214 8797
!=============================================================!