/orcd/scratch/orcd/001/jahn/testreport/rocky8/MITgcm_intel-mpi-fast/verification/MLAdjust/run
../../../tools/tst_2+2 -mpi All -command "mpirun -env I_MPI_DEBUG 2 -n 2 ./mitgcmuv"
 
cmdEXE='mpirun -env I_MPI_DEBUG 2 -n 2 ./mitgcmuv'
from previous run STDOUT.0000, lastPick='       12 ckptA' ; iter='12' ; sufx='ckptA'
prepare parameter file 'data.tst' :
prepare file 'data.tst' : done
 diff data.tst data
80,82c80
<  nIter0=12,
<  nTimeSteps=4,
< # nIter0=0,
---
>  nIter0=0,
85c83
< # nTimeSteps=12,
---
>  nTimeSteps=12,
 
 changes in data.pkg
3c3
< #  useMNC     = .TRUE.,
---
>   useMNC     = .TRUE.,
 
 link back: temp_tst/pickup*.ckptA*
 rename ckptA -> 0000000012 for all: pickup
  rnp_loc: pickup.ckptA pickup.0000000012
 start-end iter: 12 , 14 , 16
 sufix: '0000000012' '0000000014' '0000000016'
 cmdEXE=mpirun -env I_MPI_DEBUG 2 -n 2 ./mitgcmuv
==> START RUN 2 x 2 it
mv: cannot stat 'STDOUT.0000': No such file or directory
[mpiexec@node2704] Error: Unable to run bstrap_proxy on node2704 (pid 3339704, exit code 256)
[mpiexec@node2704] poll_for_event (../../../../../src/pm/i_hydra/libhydra/demux/hydra_demux_poll.c:157): check exit codes error
[mpiexec@node2704] HYD_dmx_poll_wait_for_proxy_event (../../../../../src/pm/i_hydra/libhydra/demux/hydra_demux_poll.c:206): poll for event error
[mpiexec@node2704] HYD_bstrap_setup (../../../../../src/pm/i_hydra/libhydra/bstrap/src/intel/i_hydra_bstrap.c:1069): error waiting for event
[mpiexec@node2704] Error setting up the bootstrap proxies
[mpiexec@node2704] Possible reasons:
[mpiexec@node2704] 1. Host is unavailable. Please check that all hosts are available.
[mpiexec@node2704] 2. Cannot launch hydra_bstrap_proxy or it crashed on one of the hosts.
[mpiexec@node2704]    Make sure hydra_bstrap_proxy is available on all hosts and it has right permissions.
[mpiexec@node2704] 3. Firewall refused connection.
[mpiexec@node2704]    Check that enough ports are allowed in the firewall and specify them with the I_MPI_PORT_RANGE variable.
[mpiexec@node2704] 4. slurm bootstrap cannot launch processes on remote host.
[mpiexec@node2704]    You may try using -bootstrap option to select alternative launcher.
srun: error: Unable to create step for job 26334315: Memory required by task is not available
empty or no output file: 'std_outp.2it' => exit