Releases · greynewell/matchspec

matchspec v0.1.0

Initial release of the matchspec evaluation framework.

Evaluation Suites: Define structured test suites for evaluating model outputs against expected results
Matchers: Built-in matching strategies including exact, contains, prefix, and suffix matchers
Runner: Execute evaluation suites and collect results programmatically
HTTP API: Serve evaluations over HTTP for integration with external tools and services
CLI Entrypoint: Command-line interface powered by mist-go for running evaluations directly from the terminal