Skip to content

Issues: hubverse-org/predevals

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

30 Open 7 Closed
30 Open 7 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

use human-readable target names rather than target_id
#44 opened Mar 26, 2025 by elray1
consider ways to indicate whether low or high scores are better
#42 opened Mar 24, 2025 by elray1
1
in the eval table, indicate which models are best
#41 opened Mar 24, 2025 by elray1
3
clean up code management for dev example code cleanup
#40 opened Mar 20, 2025 by elray1
convert N column to numeric to ensure correct sort behavior bug Something isn't working
#37 opened Jan 31, 2025 by elray1
@matthewcornell
change all references of predeval to predevals in predevals.js` code cleanup
#34 opened Jan 17, 2025 by elray1
update selected metric and disaggregate_by if necessary when selected target is updated
#31 opened Jan 14, 2025 by elray1
Reconsider approach to getting the full list of metrics, including relative metrics. code cleanup
#30 opened Jan 14, 2025 by elray1
Refactor code for rounding numeric values of metrics code cleanup
#28 opened Jan 14, 2025 by elray1
Refactor code for sorting scores into a helper function code cleanup
#27 opened Jan 14, 2025 by elray1
refactor data type conversion code cleanup
#26 opened Jan 14, 2025 by elray1
@matthewcornell
bundle all dependencies? code cleanup
#24 opened Jan 14, 2025 by elray1
Move utility functions into utility.js code cleanup
#23 opened Jan 14, 2025 by elray1
unit tests code cleanup
#22 opened Jan 14, 2025 by elray1
documentation
#21 opened Jan 14, 2025 by elray1
flag models with low submission counts
#19 opened Jan 14, 2025 by elray1
Add option to compute relative skill metrics without normalizing relative to a baseline
#18 opened Jan 14, 2025 by elray1
1
add horizontal reference lines
#17 opened Jan 14, 2025 by elray1
Fix ylimit of axes to [0,1] when plot metric is one of the coverage scores
#16 opened Jan 14, 2025 by elray1
supress menus with only 1 option
#15 opened Jan 14, 2025 by elray1
add definitions of target variables
#14 opened Jan 14, 2025 by elray1
Add [links to?] documentation/definitions of the different metrics
#13 opened Jan 14, 2025 by elray1
4
Ability to access past versions of scores enhancement New feature or request
#12 opened Jan 14, 2025 by elray1
1
Default sorting order for task id values on plot axes should be based on the order given in tasks.json config
#11 opened Jan 14, 2025 by elray1
Make rounding behavior configurable, on a per-metric basis
#9 opened Jan 14, 2025 by elray1
ProTip! Follow long discussions with comments:>50.