Skip to content

[Feature Request] Add a short "long-horizon reasoning & safety checklist" doc (docs only) #199

@onestardao

Description

@onestardao

Do you need to file a feature request?

  • I have searched the existing feature request and this feature request is not already filed.
  • I believe this is a legitimate feature request, not just a question or bug.

Feature Request Description

Hi DeepTutor team,

Thank you for building and releasing DeepTutor. A teaching oriented system that combines multi-turn dialogue, tools and retrieval is very exciting.

I have been working on failure-mode checklists for RAG and agent systems (recently contributing a robustness entry to Harvard MIMS Lab’s ToolUniverse). For tutoring scenarios like DeepTutor, I often see a few recurring issues:

  • long-horizon reasoning loses key assumptions from earlier turns
  • retrieval quietly drifts to off-topic or low-quality sources
  • the assistant becomes overconfident when evidence is missing or weak
  • feedback to the student is not clearly grounded in retrieved material

I would like to propose a small documentation-only feature.

Proposed feature

Add a short doc page under the docs (or any section you prefer) named something like:

deep_tutor_reasoning_and_safety_checklist.md

The page could include:

  1. Typical failure modes in tutoring scenarios:
    • forgetting earlier constraints or instructions
    • using unverified or low-quality sources
    • giving strong advice based on weak evidence
  2. For each mode:
    • symptom → likely causes → recommended checks (logs, retrieval results, prompts)
  3. A simple checklist for debugging and for opening issues:
    • which tools were used, retrieved snippets, anonymized conversation trace.

Motivation

  • DeepTutor is likely to be used with real students, where reliability and pedagogical safety matter.
  • A small checklist can help users and maintainers talk about failures more precisely and debug faster.
  • This is a docs-only addition and can evolve over time.

If this aligns with the project goals, I would be happy to open a PR with a concise initial draft.

Thank you for considering.

Related Module

Dashboard

Use Case

No response

Additional Context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions