CTests extended validation for C48_ATM and staged C48_S2SW for gfs_fcst and gfs_atmos#3256

Open

TerrenceMcGuinness-NOAA wants to merge 215 commits intoNOAA-EMC:developfrom TerrenceMcGuinness-NOAA:ctests_extended

+530-30

Commits on Dec 6, 2024

added ctest dir with cmake to create an experment
Terry McGUinness
committed
added CMakeLists for creating initial case EXPDIR usint ctest
Terry McGuinness
committed
ready to test getting the job names
Terry McGUinness
committed
move all operations of creating EXPDIR cases into configure phase
Terry McGUinness
committed
got cmake configure to work for EXPDIR

Terry.McGuinness
authored and
Terry.McGuinness
committed
can not do both file and variable save for execute_process
Terry McGUinness
committed
working cmake config up to output of job names

Terry.McGuinness
authored and
Terry.McGuinness
committed

Commits on Dec 9, 2024

Merge branch 'NOAA-EMC:develop' into ctest_jjobs_framework
TerrenceMcGuinness-NOAA
authored
loop over jobnames and create an experment for each
Terry McGuinness
committed
update JOB name update in loop
Terry McGUinness
committed
addded debug outputs
Terry McGUinness
committed
modifying plslot list to be only on a per case
Terry McGuinness
committed
filter pslot list for only relevent cases
Terry McGUinness
committed
refining get_job_names
Terry McGUinness
committed
modigied get_jobs_names to task and metatask names
Terry McGUinness
committed
got better jobname parcer working
Terry McGuinness
committed
Merge branch 'NOAA-EMC:develop' into ctest_jjobs_framework
TerrenceMcGuinness-NOAA
authored

Commits on Dec 10, 2024

replaced generate_workflows with create_experment
Terry McGUinness
committed
removed non-existing ENVIRONMENT setting to consolated COMMAND line
Terry McGUinness
committed
got cmake script to use creat_experiment
Terry McGuinness
committed

Commits on Dec 12, 2024

Merge branch 'NOAA-EMC:develop' into ctest_jjobs_framework
TerrenceMcGuinness-NOAA
authored
just getting started with addeding a ctest
Terry McGUinness
committed
add in test for configured project
Terry McGUinness
committed
added ctest and testing
Terry McGuinness
committed

Commits on Dec 13, 2024

Merge branch 'NOAA-EMC:develop' into ctest_jjobs_framework
TerrenceMcGuinness-NOAA
authored
moved ctests dir to top HOMEgfs/ci/ctests with its own scripts dir
Terry McGUinness
committed
added all jobs for tests for each case
Terry McGUinness
committed

Commits on Dec 14, 2024

added data stagging dependances and started it as a stub script
Terry McGUinness
committed

Commits on Dec 16, 2024

Merge branch 'NOAA-EMC:develop' into ctest_jjobs_framework
TerrenceMcGuinness-NOAA
authored

Commits on Dec 18, 2024

added driver for creating ctests from yaml files
Terry McGUinness
committed
added a driver to create ctests from defintions in yaml files
Terry McGUinness
committed
added final step to loop over yaml files for creating functiona ctests from configs
Terry McGUinness
committed

Commits on Dec 19, 2024

Merge branch 'NOAA-EMC:develop' into ctest_jjobs_framework
TerrenceMcGuinness-NOAA
authored
added second yaml case file for testing python driver
Terry McGUinness
committed
added a few comments for each section
TerrenceMcGuinness-NOAA
committed

Commits on Dec 20, 2024

Merge branch 'NOAA-EMC:develop' into ctest_jjobs_framework
TerrenceMcGuinness-NOAA
authored
made CMakeList.txt independent of python script

Terry McGuinness
authored and
Terry McGuinness
committed
simplified CMakeList to be compatible with manin build, consolated create exp into main test along with stage,run, and validate.
Terry McGuinness
committed
repurposed python script for generating args to man CMakeLists.txt
Terry McGuinness
committed
added lables to run tests in groups and added stubbed scripts

Terry McGuinness
authored and
Terry McGuinness
committed
created script and cases dir to isolate CMakeLists.txt

Terry McGuinness
authored and
Terry McGuinness
committed
renamed test to create_experiment

Terry McGuinness
authored and
Terry McGuinness
committed
missed update to name of test from test_ to create_experiment_

Terry McGuinness
authored and
Terry McGuinness
committed
forgot to save contents of the stubbed scripts

Terry McGuinness
authored and
Terry McGuinness
committed
spelling error on create_experiment

Terry McGuinness
authored and
Terry McGuinness
committed
got a few hints on using File Utils directly in case Yaml file

Terry McGuinness
authored and
Terry McGuinness
committed

Commits on Dec 23, 2024

updated adding functional test as line enteries in CMakeLists.txt directly that creats the three steps as tests

Terry McGuinness
authored and
Terry McGuinness
committed
Cleaned up names to have Case and job name first

Terry McGuinness
authored and
Terry McGuinness
committed
added file utils copy commands in gfs_fcst for C48_ATM

Terry McGuinness
authored and
Terry McGuinness
committed

Commits on Dec 24, 2024

started on stage data python script

Terry McGuinness
authored and
Terry McGuinness
committed
added exec line for python staging script

Terry McGuinness
authored and
Terry McGuinness
committed
deleted space in yaml file for copy commands

Terry McGuinness
authored and
Terry McGuinness
committed

Commits on Dec 26, 2024

Merge branch 'NOAA-EMC:develop' into ctest_jjobs_framework
TerrenceMcGuinness-NOAA
authored

Commits on Jan 2, 2025

removed extra $ on JOB var
Terry McGuinness
committed
idate needed for PDY
Terry McGuinness
committed
updated stage data with idate for PDY and HH and made sure paths where correct
Terry McGuinness
committed
added copy using FIleHandler
Terry McGuinness
committed
copy command needs quotes
Terry McGuinness
committed
added sync() on file handler
Terry McGuinness
committed
got FileUtil to work in stage data
Terry McGuinness
committed
got started on execute
Terry McGuinness
committed
execute needed shabang and exit 0
Terry McGuinness
committed
almost ready to launch execute.sh
Terry McGuinness
committed

Commits on Jan 3, 2025

Merge branch 'NOAA-EMC:develop' into ctest_jjobs_framework
TerrenceMcGuinness-NOAA
authored
added working skeleton bash script for execute using rocotoboot with dryrun
Terry McGuinness
committed
added a few ICs that where missed
Terry McGuinness
committed
removed extra scripts no longer used
Terry McGuinness
committed
added defulted values and over rides from command line
Terry McGuinness
committed
removed HOMEgfs for path to create expermient
Terry McGuinness
committed
removed another unused script
Terry McGuinness
committed
fixed a few path errors with HOMEgfs still hanging around
Terry McGuinness
committed

Commits on Jan 6, 2025

Merge branch 'NOAA-EMC:develop' into ctest_jjobs_framework
TerrenceMcGuinness-NOAA
authored
added cmake_parse_arguments with extras and used inline template for setup.sh
Terry McGuinness
committed
added template for cmake tests setup.sh
Terry McGuinness
committed
had to add ARG_ header to labels names for depenancies for setup worked
Terry McGuinness
committed
added bash wrapper to stage_data.py and made single job per yaml configuation
Terry McGuinness
committed
added the part to drop in templated inline script for stage.sh
Terry McGuinness
committed
getting stage.sh.in args to work for now
Terry McGuinness
committed
still getting args straintened out with staging
Terry McGuinness
committed

Commits on Jan 7, 2025

added args in bash wrapper to stage.py to pick up ARG_CASE and ARG_JOB
Terry McGuinness
committed
updated args to stage.py to simply take yaml input
Terry McGuinness
committed
had extra ) for updated add_test
Terry McGuinness
committed
removed reading of pr case file for getting idate
Terry McGuinness
committed
replaced JOB_CASE in path for inputs to TEST_NAME
Terry McGuinness
committed
updated path to yaml input to stage
Terry McGuinness
committed
ctest dir is ctests in path to YAML file for stage.py
Terry McGuinness
committed
finilized inputs to make stage.py to work without using CASE+JOB
Terry McGuinness
committed
mnissed a couple or ARGS_ again this time in execute
Terry McGuinness
committed
ARG are prefixes in execute add test
Terry McGuinness
committed
ARG are prefixes in execute add test 2
Terry McGuinness
committed
ARG are prefixes in execute add test 3
Terry McGuinness
committed
added MAKE_CURRENT_BINARY_DIR as templated VAR in stage
Terry McGuinness
committed
made execute bash sript a template too
Terry McGuinness
committed
forgot to save CMakeLists now has updated call to excute from script dir in build
Terry McGuinness
committed
last bug for working execute phase
Terry McGuinness
committed
ready to test x coders add for waiting for slurm job to complete
Terry McGuinness
committed
do not need link to wxflow anymore, added it to PYTHONPATH in bash wrappers
Terry McGuinness
committed

Commits on Jan 8, 2025

Merge branch 'NOAA-EMC:develop' into ctest_jjobs_framework
TerrenceMcGuinness-NOAA
authored
path to wxflow in PYTHONPATH was wrong in stage template
Terry McGuinness
committed
generlized ARG over-ride and added check for exectution success from log file output for when slurm job id is no longer available after job completes
Terry McGuinness
committed
should have checked for End not END for success
Terry McGuinness
committed
oops need done at then of loop in execute bash sript
Terry McGuinness
committed
removed C48_S2SW.yaml for functional test as it is not ready yet
Terry McGuinness
committed
working on shellnorms
Terry McGuinness
committed
working on more shellnorms
Terry McGuinness
committed
working on even more shellnorms
Terry McGuinness
committed
working couple more shellnorms
Terry McGuinness
committed

Commits on Jan 10, 2025

Merge branch 'NOAA-EMC:develop' into ctest_jjobs_framework
TerrenceMcGuinness-NOAA
authored
removed scripts used for getting system defaults and added top level CMakeLists.txt to use PROJECT_SOURCE_DIR for HOMEgfs in templiting bash wrapper sripts
Terry McGuinness
committed
added to yaml fun conf file to us jinja string modification TEST_DATE
Terry McGuinness
committed
typos in CMakeLists and module file for adding CMake on Orion
Terry McGuinness
committed
added TEST_DATE as an agrment to adding a test in CMake List file
Terry McGuinness
committed

Commits on Jan 11, 2025

needed idate in arg to exexcute
Terry McGuinness
committed
just use par_yaml
Terry McGuinness
committed
trying to get args into yaml
Terry McGuinness
committed
added TEST_DATA via data to template
Terry McGuinness
committed
added TEST_DATE into arg to bash stage
Terry McGuinness
committed

Commits on Jan 13, 2025

changed test_date argument to datetime object so it can be used with Jinja functions with in the templating class
Terry McGuinness
committed
MACHINE_ID is no longer used (removed from messae)
Terry McGuinness
committed
updated arg to stagy.py for test_date to a str
Terry McGuinness
committed
missed commit (adding test_date arg to stage.py)
Terry McGuinness
committed
added env vars to starge.py in wrapper via prefixed values to call
Terry McGuinness
committed
check if default is not used and needs to be set to valule for error message to occure
Terry McGuinness
committed
did not have updated var name for STAGED_TEST_DIR in yaml file
Terry McGuinness
committed
replaced scraping output file with status from sacct
Terry McGuinness
committed
added extra step for making sure the submitted job_id is in the sacct system
Terry McGuinness
committed
remove white spaces from job_status
Terry McGuinness
committed
update path to validate stub and reduce first wait on sacct to 30 seconds
Terry McGuinness
committed
update a few shellnorm suggestions
Terry McGuinness
committed
one more shellnorm for true on pipe
Terry McGuinness
committed
innocuous extra line at end of toplevel CMake file
Terry McGuinness
committed
consolated GFS ROOT path for staged data dir on orion
Terry McGuinness
committed
added some more notes for validate subs
Terry McGuinness
committed
remove extras from stage.py
Terry McGuinness
committed
still had path woring to valication stub (has no *.in file)
Terry McGuinness
committed
another shellnorm || true
Terry McGuinness
committed
pynomrs spaces
Terry McGuinness
committed
pynomrs line space two
Terry McGuinness
committed

Commits on Jan 14, 2025

Merge branch 'NOAA-EMC:develop' into ctest_jjobs_framework
TerrenceMcGuinness-NOAA
authored
added back missing submodels gsi_enkf and gsi_utils
Terry McGuinness
committed
updating to correct hash for submodule gsi_enkf
Terry McGuinness
committed
added inline documentation to the stage file python script
Terry McGuinness
committed
added simple README.md file in the ctest directory
Terry McGuinness
committed
Merge branch 'develop' into ctest_jjobs_framework
TerrenceMcGuinness-NOAA
authored
included instructions on how to add a new test in the README.md file
Terry McGuinness
committed
Update README.md
TerrenceMcGuinness-NOAA
authored
Update README.md
TerrenceMcGuinness-NOAA
authored
Update README.md
TerrenceMcGuinness-NOAA
authored
Update README.md
TerrenceMcGuinness-NOAA
authored
Update ctests/scripts/validate.sh

TerrenceMcGuinness-NOAA
and
aerorahul
authored
added validate.sh.in template bash wrapper script
Terry McGuinness
committed
added cmake to Hercules gwsetup modulefile
Terry McGuinness
committed
updated path to validate.sh
Terry McGuinness
committed

Commits on Jan 15, 2025

needed to remove bash from the COMMAND line for validate.sh
Terry McGuinness
committed
Merge branch 'NOAA-EMC:develop' into ctest_jjobs_framework
TerrenceMcGuinness-NOAA
authored
allow the build to continue whe ctests can not be created without the needed env vars set
Terry McGuinness
committed
added folder compair code to capture output of job
Terry McGuinness
committed
added to helper file util to copy files
Terry McGuinness
committed
removed full path and only save relative path
Terry McGuinness
committed
added pwd to folder where the files are
Terry McGuinness
committed
added shabang
Terry McGuinness
committed
use two args for copy files as relative paths
Terry McGuinness
committed
use two args for copy files as relative paths 2
Terry McGuinness
committed
added basic validation script
Terry McGuinness
committed
fixed bugs in validate.sh.in
Terry McGuinness
committed
extra / got in yaml
Terry McGuinness
committed
had to add underscores back in to yaml file
Terry McGuinness
committed
had to add more underscores back in to yaml file
Terry McGuinness
committed
mistakenly had input files in path for mkdir
Terry McGuinness
committed

Commits on Jan 16, 2025

Commits on Jan 17, 2025

merged develop into ctest_work

Terry McGuinness
authored and
Terry McGuinness
committed
used bash command to get rocotoboot_dryrun that is in the path

Terry McGuinness
authored and
Terry McGuinness
committed

Commits on Jan 22, 2025

Commits on Jan 23, 2025

fixed wrong path to ice restart and added tile6 atmos IC to input_files for C48_S2SW for JJOB gfs_fcst_seg0
Terry McGuinness
committed
Merge branch 'NOAA-EMC:develop' into ctest_work
TerrenceMcGuinness-NOAA
authored
first pass at adding ctest gfs_atmos_prod_f000
Terry McGuinness
committed
added C48_S2SW_gfs_atmos_prod_f000-f003 JJOB
Terry McGuinness
committed

Commits on Jan 24, 2025

Merge branch 'NOAA-EMC:develop' into ctest_work
TerrenceMcGuinness-NOAA
authored
tried to simplfy readablity of input paths by using CYC and PDY and the relative offsets as alias of TEST_DATE

Terry McGuinness
authored and
Terry McGuinness
committed
added CYC and PDY alias to C48_ATM for readablity

Terry McGuinness
authored and
Terry McGuinness
committed
missed alias for PYD on offset
Terry McGuinness
committed
fixed check for output files in validate to signlal non-fail subbed when not out_files is not present in functional ci case yaml file
Terry McGuinness
committed
update READMe with some finer explinations

Terry McGuinness
authored and
Terry McGuinness
committed
added some qulifying comments about validation in the yaml files

Terry McGuinness
authored and
Terry McGuinness
committed
added Numpydoc doc strings

Terry McGuinness
authored and
Terry McGuinness
committed
needed trailing lines at the end of a couple of files

Terry McGuinness
authored and
Terry McGuinness
committed
still needed trailing line on the CMakefile

Terry McGuinness
authored and
Terry McGuinness
committed

Commits on Jan 27, 2025

Commits on Jan 28, 2025

Merge branch 'NOAA-EMC:develop' into ctests_extended
TerrenceMcGuinness-NOAA
authored
updated staged python script to use to_datetime aswell
Terry McGuinness
committed
made CYC cyc in yaml case files
Terry McGuinness
committed
fixed main() indentation in the stage python script
Terry McGuinness
committed
pynomrs space needced in stage python script before main block
Terry McGuinness
committed
fixed bug introduced by suggested commit from reviewer regarding logger using end=
Terry McGuinness
committed

Commits on Jan 29, 2025

Merge branch 'NOAA-EMC:develop' into ctests_extended
TerrenceMcGuinness-NOAA
authored

Commits on Jan 30, 2025