Authorization required, but no authorization protocol specified

Authorization required, but no authorization protocol specified

Authorization required, but no authorization protocol specified

Authorization required, but no authorization protocol specified

Authorization required, but no authorization protocol specified

Authorization required, but no authorization protocol specified

There are more MPI processes than the number of unique GPU devices. This is not necessarily a problem.
For example this could happen when a device such as MI300A is partitioned into multiple subdevices.!
amrex::Abort::1::Found while writing output: Cons (salt, temp, or tracer, etc) contains nan or inf !!!
SIGABRT
amrex::Abort::0::Found while writing output: Cons (salt, temp, or tracer, etc) contains nan or inf !!!
SIGABRT
amrex::Abort::2::Found while writing output: Cons (salt, temp, or tracer, etc) contains nan or inf !!!
SIGABRT
amrex::Abort::3::Found while writing output: Cons (salt, temp, or tracer, etc) contains nan or inf !!!
SIGABRT
See Backtrace.3 file for details
See Backtrace.0 file for details
See Backtrace.2 file for details
See Backtrace.1 file for details
--------------------------------------------------------------------------
MPI_ABORT was invoked on rank 3 in communicator MPI COMMUNICATOR 3 DUP FROM 0
with errorcode 6.

NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
You may or may not see output from other processes, depending on
exactly when Open MPI kills them.
--------------------------------------------------------------------------
[garuda:1429688] 1 more process has sent help message help-mpi-api.txt / mpi-abort
[garuda:1429688] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages