Skip to content

Conversation

@pkulkark
Copy link
Member

@pkulkark pkulkark commented Nov 5, 2025

Description

This PR implements the Coaching AI XBlock as per the designs and discussions.

Supporting information

OpenCraft Internal Jira task: BB-9845

Testing instructions

  1. Deploy this branch of the XBlock.
  2. Add coach_ai_eval in the advanced modules list in Studio and create a new Coach AI XBlock component.
  3. Configure the xblock as required and test to confirm the functionalities work as expected.

@pkulkark pkulkark force-pushed the pooja/bb-9845-changes branch 6 times, most recently from 215bd87 to 3811ed0 Compare November 7, 2025 16:25
@pkulkark pkulkark changed the base branch from artur/shortanswer-with-coach to pooja/bb-9936-changes November 7, 2025 17:04
Copy link
Member

@samuelallan72 samuelallan72 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@pkulkark I left several comments - please see inline.

Also, please update the PR description to add testing instructions, link to the ticket, etc.

Thanks.

@pkulkark pkulkark force-pushed the pooja/bb-9845-changes branch 2 times, most recently from 0e2014f to 5004a17 Compare November 13, 2025 18:14
@pkulkark pkulkark changed the base branch from pooja/bb-9936-changes to artur/all-changes December 4, 2025 20:04
@pkulkark pkulkark changed the base branch from artur/all-changes to pooja/bb-9936-changes December 4, 2025 20:05
@pkulkark pkulkark force-pushed the pooja/bb-9845-changes branch 8 times, most recently from 2791b22 to f0b7eb0 Compare December 12, 2025 18:55
@pkulkark pkulkark changed the base branch from pooja/bb-9936-changes to artur/all-changes January 6, 2026 16:17
@pkulkark pkulkark changed the base branch from artur/all-changes to pooja/bb-9936-changes January 6, 2026 16:18
@pkulkark pkulkark changed the base branch from pooja/bb-9936-changes to artur/all-changes January 6, 2026 16:27
@pkulkark pkulkark changed the base branch from artur/all-changes to pooja/bb-9936-changes January 6, 2026 16:27
@pkulkark pkulkark force-pushed the pooja/bb-9845-changes branch from d593056 to 34a8a52 Compare January 6, 2026 17:17
@pkulkark pkulkark changed the base branch from pooja/bb-9936-changes to artur/all-changes January 6, 2026 17:17
@pkulkark pkulkark force-pushed the pooja/bb-9845-changes branch from e121a81 to b6bc8cb Compare January 6, 2026 19:14
Also remove normalization for evaluation_criteria
@pkulkark pkulkark force-pushed the pooja/bb-9845-changes branch from b6bc8cb to a33db98 Compare January 6, 2026 19:18
Copy link
Member

@samuelallan72 samuelallan72 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In general, this works fine, and I think ok to merge considering we're planning some follow up refactoring.

I left some suggestions and comments though, mostly focusing on documentation since the fields are complex. Please consider which can be addressed now, or which can be left for future refactoring; up to your discretion.

👍

  • I tested this: tested this on the sandbox
  • I read through the code
  • I checked for accessibility issues
  • Includes documentation

display_name=_("Main character prompt"),
help=_(
"Defines how the main character (left pane) behaves. "
"You can use Jinja variables: character_data, scenario_data."
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

character_data is not documented anywhere for the user. We should document the available fields and an example somewhere.

conversation_format = String(
display_name=_("Conversation format template"),
help=_(
"Template used to format the conversation, appended to all prompts"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please document this more. The format is confusing to me - it seems to be jinja templated xml?

default=SAMPLE_CHARACTER_PROMPT,
)

conversation_format = String(
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some settings like conversation_format and message_content_tag are not editable. Why are they settings then? Can we simplify the code by making them constants?

@pkulkark pkulkark merged commit 706fc2a into artur/all-changes Jan 7, 2026
5 checks passed
@pkulkark pkulkark deleted the pooja/bb-9845-changes branch January 8, 2026 14:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants