Remove streamContent config

[jjroelofs]

Why are we doing this work

We are removing the streamContent configuration option from the AI Agent plugin because streaming should always be enabled for the best user experience. This simplifies the codebase by removing unnecessary conditional logic and configuration options, while ensuring consistent behavior across all implementations. The streaming functionality provides immediate feedback and better performance, making it the optimal default behavior.

Relevant links

• Original Implementation
• Performance Benchmarks

Requirements

1. Remove streamContent configuration option from all relevant files
2. Update code to always use streaming functionality
3. Remove conditional streaming checks from the codebase
4. Update documentation to reflect these changes
5. Ensure backward compatibility for existing implementations

Non-functional requirements

• Documentation:

  • Update README.md to remove streamContent option
  • Update API documentation
  • Add migration guide for users updating from previous versions

• Feature flag:

  • Not required as this is a removal of a configuration option

• Performance:

  • Verify that removing conditional checks doesn't impact performance
  • Ensure streaming performance remains optimal

• Testing:

  • Update existing tests to remove streamContent checks
  • Add tests to verify streaming behavior
  • Test backward compatibility

Implementation plan

• Remove configuration option

  • Remove streamContent from AiAgent default config
  • Remove from type definitions
  • Update interfaces

• Update core functionality

  • Modify AiAgentService to remove streaming checks
  • Update HtmlParser to remove streaming parameter
  • Clean up related utility functions

• Update documentation

  • Remove streamContent from README
  • Update API documentation
  • Add migration notes

• Testing

  • Update existing test cases
  • Add new tests for streaming behavior
  • Verify backward compatibility

• Code cleanup

  • Remove unused imports
  • Clean up empty lines and formatting
  • Remove deprecated code paths