-
Notifications
You must be signed in to change notification settings - Fork 1.4k
Description
Do you need to file a feature request?
- I have searched the existing feature request and this feature request is not already filed.
- I believe this is a legitimate feature request, not just a question or bug.
Feature Request Description
Hi DeepTutor team,
Thank you for building and releasing DeepTutor. A teaching oriented system that combines multi-turn dialogue, tools and retrieval is very exciting.
I have been working on failure-mode checklists for RAG and agent systems (recently contributing a robustness entry to Harvard MIMS Lab’s ToolUniverse). For tutoring scenarios like DeepTutor, I often see a few recurring issues:
- long-horizon reasoning loses key assumptions from earlier turns
- retrieval quietly drifts to off-topic or low-quality sources
- the assistant becomes overconfident when evidence is missing or weak
- feedback to the student is not clearly grounded in retrieved material
I would like to propose a small documentation-only feature.
Proposed feature
Add a short doc page under the docs (or any section you prefer) named something like:
deep_tutor_reasoning_and_safety_checklist.md
The page could include:
- Typical failure modes in tutoring scenarios:
- forgetting earlier constraints or instructions
- using unverified or low-quality sources
- giving strong advice based on weak evidence
- For each mode:
- symptom → likely causes → recommended checks (logs, retrieval results, prompts)
- A simple checklist for debugging and for opening issues:
- which tools were used, retrieved snippets, anonymized conversation trace.
Motivation
- DeepTutor is likely to be used with real students, where reliability and pedagogical safety matter.
- A small checklist can help users and maintainers talk about failures more precisely and debug faster.
- This is a docs-only addition and can evolve over time.
If this aligns with the project goals, I would be happy to open a PR with a concise initial draft.
Thank you for considering.
Related Module
Dashboard
Use Case
No response
Additional Context
No response