Skip to content

TruLens Eval v0.6.0
Compare
Choose a tag to compare
@rshih32 rshih32 released this 24 Jul 14:03
· 964 commits to main since this release
trulens-eval-0.6.0
a3191d3
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Verified
Learn about vigilant mode.

Library containing evaluations of LLM Applications

Changelog

  • Added a feedback function (and notebook example) that checks against provided ground truths
  • Added a visibility framework into feedback function operations (what data is being used by the function, etc)
    • More feedback functions will add useful information in the future
  • Improved QS Relevance function and added human validated quality checks which will be added to documentation in the future
  • Added warning levels (yellow) for feedback functions

Examples

  • Added example interfacing with Pinecone DB
  • Added example using llama-index agents

Dependency Upgrades

  • Upgraded llama-index to version 0.7+

Bug Fixes

  • Add error handling around non-importable functions for deferred evaluation
Assets 2
Loading