Skip to content

Investigate stall behavior in mww3_test_02 regtest using SCRIP #1385

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
MatthewMasarik-NOAA opened this issue Mar 5, 2025 · 0 comments
Open
Labels
bug Something isn't working

Comments

@MatthewMasarik-NOAA
Copy link
Contributor

Describe the bug
Regtest mww3_test_02 using switch PR3_UNO_MPI_SCRIP stalls during grid sweep. The execution will appear to hang, but at some point silently fail and move on to the next step of the regtest and is not caught by the matrix.comp.

To Reproduce
./bin/run_cmake_test -b slurm -o all -S -T -s PR3_UNO_MPI_SCRIP -w work_PR3_UNO_MPI_c_c -m grds\ et_c -g curv -f -p srun -n 24 ../model mww3_test_02

Expected behavior
The regtest will progress successfully into the SCRIP processing where the integration will then stall during a grid sweep.

Screenshots

 SI nbPlus=        7396  nbMinus=           0  nbZero=           0
 SI nbPlus=        7396  nbMinus=           0  nbZero=           0
  
 Grid 1 size        3721
 Grid 2 size        1849
 
 grid1 sweep
 grid2 sweep 
 integration stalled: num_subseg exceeded limit
 Cell         1625
 Edge            2
 Grid            1
 Fraction of segment left   0.599999988869029    
    .
    .
 Fraction of segment left   0.599999988869029     
 integration stalled: num_subseg exceeded limit
 Cell         1625
 Edge            2
 Grid            1
 Fraction of segment left   0.599999988869029     
 
+--------------------+
|   Gridded output   |
+--------------------+
 
 
+--------------------+
| NC Gridded output  |
+--------------------+
 
 
+--------------------+
|    Point output    |
+--------------------+
 
 
+--------------------+
| NC Point output    |
+--------------------+
 
 
+--------------------+
|    Track output    |
+--------------------+
 
 
+--------------------+
|    Track output    |
+--------------------+
 
 
 
Files in /scratch1/NCEPDEV/climate/Matthew.Masarik/projs/PRs/pr_1268/ww3-003/regtests/mww3_test_02/work_PR3_UNO_MPI_c_c :

Full test log: mww3_test_02.matrix03.out.txt

Additional context
Discovered while testing #1268.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant