link mitgcmuv from dir ../build
[mpiexec@node3110] Error: Unable to run bstrap_proxy (pid 279670, exit code 256)
[mpiexec@node3110] poll_for_event (../../../../../src/pm/i_hydra/libhydra/demux/hydra_demux_poll.c:157): check exit codes error
[mpiexec@node3110] HYD_dmx_poll_wait_for_proxy_event (../../../../../src/pm/i_hydra/libhydra/demux/hydra_demux_poll.c:206): poll for event error
[mpiexec@node3110] HYD_bstrap_setup (../../../../../src/pm/i_hydra/libhydra/bstrap/src/intel/i_hydra_bstrap.c:1069): error waiting for event
[mpiexec@node3110] Error setting up the bootstrap proxies
[mpiexec@node3110] Possible reasons:
[mpiexec@node3110] 1. Host is unavailable. Please check that all hosts are available.
[mpiexec@node3110] 2. Cannot launch hydra_bstrap_proxy or it crashed on one of the hosts.
[mpiexec@node3110]    Make sure hydra_bstrap_proxy is available on all hosts and it has right permissions.
[mpiexec@node3110] 3. Firewall refused connection.
[mpiexec@node3110]    Check that enough ports are allowed in the firewall and specify them with the I_MPI_PORT_RANGE variable.
[mpiexec@node3110] 4. slurm bootstrap cannot launch processes on remote host.
[mpiexec@node3110]    You may try using -bootstrap option to select alternative launcher.
srun: error: Unable to create step for job 25892849: Memory required by task is not available