Skip to content

feat: Add historical rollout viewing with S3 storage support#118

Merged
soovittt merged 2 commits into
masterfrom
sovitn-7-right-tab-fix
Dec 14, 2025
Merged

feat: Add historical rollout viewing with S3 storage support#118
soovittt merged 2 commits into
masterfrom
sovitn-7-right-tab-fix

Conversation

@soovittt

Copy link
Copy Markdown
Owner

Changes

  • ✅ Add ability to view previous rollouts from history
  • ✅ Implement S3 storage for full rollout data
  • ✅ Add in-memory cache for recent rollouts (last 10)
  • ✅ Add backend endpoint to load rollouts from S3
  • ✅ Improve RL Analysis tab with better data visualization
  • ✅ Fix reward calculation in backend simulator (reach_goal, step, hit_trap, collect_key conditions)
  • ✅ Add validation for action space and dynamics
  • ✅ Clean up unnecessary files (dev.txt, prod.txt, check_aws_account.py, s3_bucket_setup.py)
  • ✅ Update .gitignore to exclude token files

Technical Details

  • Historical rollouts are saved with summary data to Convex (to avoid 1MB limit)

  • Full rollout data is stored in S3 with compression

  • When clicking a history item, the system:

    1. Checks in-memory cache first (fastest)
    2. Falls back to loading from S3 if available
    3. Shows helpful error if data is unavailable
  • All tabs (Reward Inspector, Event Log, RL Analysis) automatically use the selected rollout

  • New rollouts automatically clear history selection and switch to new data

- Add ability to view previous rollouts from history
- Implement S3 storage for full rollout data
- Add in-memory cache for recent rollouts
- Add backend endpoint to load rollouts from S3
- Improve RL Analysis tab with better data visualization
- Fix reward calculation in backend simulator
- Add validation for action space and dynamics
- Clean up unnecessary files (dev.txt, prod.txt, check_aws_account.py, s3_bucket_setup.py)
- Update .gitignore to exclude token files
@soovittt
soovittt merged commit f492b3c into master Dec 14, 2025
13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant