Skip to content

Commit 6edabed

Browse files
ilianagenkovailianagenkova
committed
Shortened RN and moved them along with README.mc to /docs
1 parent 98ff827 commit 6edabed

File tree

3 files changed

+249
-2
lines changed

3 files changed

+249
-2
lines changed

‎CMakeLists.txt

-2
Original file line numberDiff line numberDiff line change
@@ -37,5 +37,3 @@ add_subdirectory(fix)
3737
# Install modulefile for this package.
3838
add_subdirectory(modulefiles)
3939

40-
# Install release_notes files.
41-
add_subdirectory(release_notes)

‎docs/README.md

+27
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,27 @@
1+
# bufr-dump
2+
Software necessary to read data from bufr tanks to generate bufr dump files.
3+
4+
To install:
5+
6+
Clone repository:
7+
```bash
8+
git clone https://github.com/noaa-emc/bufr-dump
9+
```
10+
11+
Move into desired branch and then run:
12+
13+
```bash
14+
INSTALL_PREFIX=/path/you/wish/to/install/bufr-dump ./ush/build.sh
15+
```
16+
17+
or install in local clone space:
18+
19+
```bash
20+
./ush/build.sh
21+
```
22+
23+
There is also the option to build and install in your local clone space but install the modulefile elsewhere:
24+
25+
```bash
26+
MODULEFILE_INSTALL_PREFIX=/path/you/wish/to/install/bufr-dump/module ./ush/build.sh
27+
```

‎docs/Release_Notes.txt

+222
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,222 @@
1+
bufr-dump v1.1.0 RELEASED AUG 17,2022
2+
v1.1.? IMPLEMENTED ??? ??,2022
3+
4+
FILE CHANGES
5+
6+
M CMakeLists.txt
7+
D README.md
8+
D VERSION
9+
D build.sh
10+
A docs/README.md
11+
A docs/Release_Notes.txt
12+
M fix/bufr_dumplist
13+
D release_notes/
14+
A ush/build.sh
15+
A versions/VERSION
16+
(M-modified; A-added; D-deleted)
17+
18+
DOCS CHANGES
19+
20+
docs/README.md
21+
Update build instructions
22+
23+
docs/Release_Notes.txt
24+
Moved here to adhere to NCO EE2 standards and shortenend notes
25+
26+
USH CHANGES
27+
28+
ush/build.sh
29+
Moved build.sh here to adhere to NCO EE2 standards (no files in top level dir)
30+
31+
ush/dumpjb
32+
Print out name of sdmedit file if LOUD is on
33+
34+
FIX CHANGES
35+
36+
fix/bufr_dumplist
37+
Introduce new dump groups (gmi1cr, snocvr, saldrn, subpfl)
38+
Update dump groups (satwnd, gpsro, nsstbufr)
39+
Set tamdarb observations to YEL (was RED)
40+
41+
VERSIONS CHANGES
42+
43+
Moved VERSION file in here
44+
45+
CHANGES TO OUTPUT AND FILE SIZES
46+
47+
Generate new dumps:
48+
*gmi1cr*, *snocvr*, *saldrn*, *subpfl*
49+
Update dumps:
50+
*gpsro*, *satwnd* and *nsstbufr (*nsstbufr is generatd only in global)
51+
52+
The newly generated dumps ( *gmi1cr*, *snocvr*, *saldrn*, *subpfl* ) vary in size from 1Mb to 200Mb
53+
depending on network, cycle time, time dump window. 0 size dumps are possible
54+
The updated dumps (*gpsro*, *satwnd* and *nsstbufr) are up to ~25% larger in size
55+
For examples, see: /lfs/h2/emc/stmp/iliana.genkova/CRON/RELv1.1.0/com
56+
57+
PRE-IMPLEMENTATION TESTING REQUIREMENTS
58+
59+
obsproc needs modules bufr-dump and prepobs in order to run
60+
See docs/README.md for build instructions
61+
See versions/build.ver and versions/run.ver for libaries
62+
Run jobs/JOBSPROC_networkname_DUMP and jobs/JOBSPROC_networkname_DUMP_POST
63+
for the following networkname values: GLOBAL, RAP, URMA, RTMA, CDAS
64+
65+
DISSEMINATION INFORMATION
66+
67+
No changes
68+
69+
SPECIAL INSTRUCTIONS
70+
71+
1.Implement release/obsproc.v1.1.0 and release/bufr-dump.v1.1.0 at the same time
72+
2.Implement release/obsproc.v1.1.0 and release/bufr-dump.v1.1.0 before or at the same time as GFS v16.3
73+
74+
75+
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
76+
obsproc v1.0.0 RELEASED DEC 20,2021
77+
v1.0.2 IMPLEMENTED JUN 28, 2021
78+
79+
Transition from WCOSS Cray and Phase3 to WCOSS2
80+
======================================
81+
https://docs.google.com/document/d/1U4pu4iSlLOnbNrcBqBlOU7bnNcTFfe_MpjV8uKN4S40/edit
82+
83+
Where is the release tag on subversion/git/vlab?
84+
git clone https://github.com/NOAA-EMC/obsproc
85+
git checkout release/obsproc.v1.0.0
86+
87+
List of external software used (anything outside of your vertical structure), including compilers and version numbers for everything.
88+
Software used must be a minimal list of modules/versions specified per job:
89+
hdf5_ver=1.10.6
90+
netcdf_ver=4.7.4
91+
bacio_ver=2.4.1
92+
93+
NOTE: this is to replace the bufr_dump that SPA Diane got put in place ahead of time to accelerate usage by non-obsproc users of dumpjb: bufr_dump.v2.0.0
94+
module use /apps/ops/test/nco/modulefiles/compiler/intel/19.1.3.304
95+
module load bufr_dump/2.0.0
96+
97+
Where is the release tag on subversion/git/vlab?
98+
git clone https://github.com/NOAA-EMC/bufr-dump
99+
git checkout release/bufr_dump.v1.0.0
100+
101+
List of external software used (anything outside of your vertical structure), including compilers and version numbers for everything
102+
Software used must be a minimal list of modules/versions specified per job
103+
bacio_ver=2.4.1
104+
w3emc_ver=2.9.1
105+
bufr_ver=11.5.0
106+
107+
List of all code/scripts modified with this release
108+
---------------------------------------------------
109+
A CMakeLists.txt
110+
A README.md
111+
A VERSION
112+
A build.sh
113+
A fix/CMakeLists.txt
114+
fix/bufr_bufrtab.sptrmm
115+
fix/bufr_bufrtab.windsat
116+
fix/bufr_dumplist
117+
fix/wave_bufrtab.ascat
118+
fix/wave_bufrtab.erscat
119+
fix/wave_bufrtab.quikscat
120+
A modulefiles/CMakeLists.txt
121+
A modulefiles/bufrdump.lua.tmpl
122+
A modulefiles/bufrdump_common.lua
123+
A modulefiles/bufrdump_hera.lua
124+
A modulefiles/bufrdump_orion.lua
125+
A modulefiles/bufrdump_wcoss2.lua
126+
A sorc/CMakeLists.txt
127+
A sorc/bufr_chkbfr.fd/CMakeLists.txt
128+
sorc/bufr_chkbfr.fd/chkbfr.f
129+
A sorc/bufr_combfr.fd/CMakeLists.txt
130+
sorc/bufr_combfr.fd/combfr.f
131+
A sorc/bufr_dcodwindsat.fd/CMakeLists.txt
132+
sorc/bufr_dcodwindsat.fd/dcodwindsat.f
133+
A sorc/bufr_dumpmd.fd/CMakeLists.txt
134+
sorc/bufr_dumpmd.fd/dumpmd.f
135+
A sorc/bufr_dupair.fd/CMakeLists.txt
136+
sorc/bufr_dupair.fd/dupair.f
137+
A sorc/bufr_dupcman.fd/CMakeLists.txt
138+
sorc/bufr_dupcman.fd/dupcman.f
139+
A sorc/bufr_dupcor.fd/CMakeLists.txt
140+
sorc/bufr_dupcor.fd/dupcor.f
141+
A sorc/bufr_dupmar.fd/CMakeLists.txt
142+
sorc/bufr_dupmar.fd/dupmar.f
143+
A sorc/bufr_dupmrg.fd/CMakeLists.txt
144+
sorc/bufr_dupmrg.fd/dupmrg.f
145+
A sorc/bufr_duprad.fd/CMakeLists.txt
146+
sorc/bufr_duprad.fd/duprad.f
147+
A sorc/bufr_dupsat.fd/CMakeLists.txt
148+
sorc/bufr_dupsat.fd/dupsat.f
149+
A sorc/bufr_dupshp.fd/CMakeLists.txt
150+
sorc/bufr_dupshp.fd/dupshp.f
151+
A sorc/bufr_dupsst.fd/CMakeLists.txt
152+
sorc/bufr_dupsst.fd/dupsst.f
153+
A sorc/bufr_dupsyp.fd/CMakeLists.txt
154+
sorc/bufr_dupsyp.fd/dupsyp.f
155+
A sorc/bufr_duptac.fd/CMakeLists.txt
156+
sorc/bufr_duptac.fd/duptac.f
157+
A sorc/bufr_edtbfr.fd/CMakeLists.txt
158+
sorc/bufr_edtbfr.fd/edtbfr.f
159+
A sorc/bufr_geofil.fd/CMakeLists.txt
160+
sorc/bufr_geofil.fd/geofil.f
161+
A sorc/bufr_quipc.fd/CMakeLists.txt
162+
sorc/bufr_quipc.fd/quipc.f
163+
A sorc/bufr_raddate.fd/CMakeLists.txt
164+
sorc/bufr_raddate.fd/raddate.f
165+
A sorc/bufr_supertmi.fd/CMakeLists.txt
166+
sorc/bufr_supertmi.fd/supertmi.f90
167+
A sorc/prepobs_prepssmi.fd/CMakeLists.txt
168+
sorc/prepobs_prepssmi.fd/prepssmi.f
169+
A sorc/wave_dcodquikscat.fd/CMakeLists.txt
170+
sorc/wave_dcodquikscat.fd/dcodquikscat.f
171+
A ush/CMakeLists.txt
172+
M ush/bufr_dump_obs.sh
173+
M ush/check_tanks.sh
174+
A ush/download_fix.sh
175+
M ush/dumpjb
176+
A versions/build.ver
177+
------------------------------
178+
M-modified; A-added; D-deleted
179+
180+
What changes were made to the above code/scripts to support the new architecture?
181+
bufr_dump has been removed from the obsproc software package to be a standalone application, installed on WCOSS2 as a module
182+
bufr_dump has been moved to github as its own repository. https://github.com/NOAA-EMC/bufr-dump
183+
bufr_dump utilizes cmake to build and install the code. build bufr-dump repo with cmake
184+
185+
Were any other changes made that aren’t directly related to the transition?
186+
No
187+
188+
Are there any changes to incoming data needs or outgoing products?
189+
No
190+
191+
If output filenames are changing, list the current and new filename
192+
N/A
193+
194+
Compute resource information, for every job:
195+
Please see https://github.com/NOAA-EMC/obsproc release branch release/obsproc.v1.0.0/triggers for various network j*dump.wc2.pbs trigger settings
196+
Total tasks
197+
Tasks per node
198+
Serial or parallel or mpmd
199+
Memory requirements (exclusive or shared)
200+
201+
List any other PBS resource information requirements or MPI tunables
202+
*** Providing PBS and/or ecFlow submission scripts as part of release tag is preferred; if they are provided then resource information is not needed in the release notes.
203+
204+
Runtime changes compared to current production (/gpfs/dell1/nco/ops/com/logs/runtime/daily/* for current stats)
205+
Optimization for network dump jobs was not performed prior to release because of the team reshuffling and resultant tight deadline.
206+
Obsproc developers will work with assigned SPA to meet optimization goals for network dump jobs.
207+
208+
Disk space required per day or per cycle; data retention on disk will remain the same unless otherwise requested.
209+
Same as WCOSS1
210+
211+
Dissemination will remain the same unless otherwise communicated to NCO and a PNS/SCN issued
212+
HPSS archive retention will remain the same unless approval granted by HPCRAC
213+
214+
What are your up and downstream dependencies?
215+
Upstream: decoders, satingest ($DCOMROOT)
216+
217+
Provide a pointer to your COMOUT, temp directory and pbspro output file that was used during testing:
218+
See obsproc.v1.0.0 Release Notes
219+
===========================================================================
220+
WCOSS1 RN:https://github.com/ShelleyMelchior-NOAA/smelchior/tree/main/RNs
221+
222+
END

0 commit comments

Comments
 (0)