Skip to content

docs: pages for chaos testing and resilience evaluators#2724

Open
ybdarrenwang wants to merge 1 commit into
strands-agents:mainfrom
ybdarrenwang:docs/chaos-page
Open

docs: pages for chaos testing and resilience evaluators#2724
ybdarrenwang wants to merge 1 commit into
strands-agents:mainfrom
ybdarrenwang:docs/chaos-page

Conversation

@ybdarrenwang

Copy link
Copy Markdown
Contributor

Description

Adds documentation pages for the chaos testing module and three new resilience evaluators in Strands Evals:

  • Chaos Testing page (chaos_testing.mdx): Overview and guide for the chaos testing framework, covering ChaosPlugin, ChaosCase, ChaosExperiment, chaos effects (pre-hook and post-hook), ChaosCase.expand() for Cartesian product generation, and integration with ToolSimulator
  • FailureCommunicationEvaluator page: Documents the evaluator that assesses how well an agent communicates tool failures to users, using a five-level scoring rubric (No Communication → Excellent Communication)
  • PartialCompletionEvaluator page: Documents the evaluator that scores what fraction of a user's goal was achieved despite failures, returning a continuous 0.0–1.0 score
  • RecoveryStrategyEvaluator page: Documents the evaluator that scores the quality of an agent's recovery actions (retries, fallbacks, tool switching) when tools fail

Also updates:

  • Evaluators index: Adds a new "Resilience Evaluators" subsection to the evaluators index page
  • navigation.yml: Wires the new pages into the evals-sdk sidebar

Related Issues

strands-agents/evals#114
#2697

Type of Change

Documentation update

Testing

How have you tested the change? Verify that the changes do not break functionality or introduce warnings in consuming repositories: agents-docs, agents-tools, agents-cli

  • I ran npm run dev

Checklist

  • I have read the CONTRIBUTING document
  • I have added any necessary tests that prove my fix is effective or my feature works
  • I have updated the documentation accordingly
  • I have added an appropriate example to the documentation to outline the feature, or no new docs are needed
  • My changes generate no new warnings
  • Any dependent changes have been merged and published

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

@github-actions github-actions Bot added enhancement New feature or request documentation Documentation changes, improvements, additions, content updates, site improvements, examples, guides labels Jun 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Documentation changes, improvements, additions, content updates, site improvements, examples, guides enhancement New feature or request size/xl

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant