Skip to content

Within training run analysis #100

@adamimos

Description

@adamimos

The point of this issue is to create official simplexity classes/functionality in order to run a canonical set of analyses during validation steps.

List of possible analyses:

  • (Weighted?) Regression to beliefs, reporting RMSE and beautiful visualizations
  • PCA visualization (in plotly we can have a interactive toggle for the way the lims are scaled or not, whatever the word is)
  • CEV curves, maybe some metrics like num dims to get to 95% var and 99% var and 90% var.

For most of these we want some ground truth and/or randomish baselineish curve/visualization also.

I (adam) advocate for plotly (or whatever interactive thing) htmls for these.

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions