Skip to content

Reinforcement learning2 gabriel #22

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 16 commits into
base: copybara_push
Choose a base branch
from

Conversation

gabriel-trigo
Copy link
Contributor

Fixes #20 (along with other changes)

This PR should be merged AFTER #18 and #19, as it builds on top of them. Consequently, it has the commits from those PRs, as well as new commits on top

The new commits add:

  1. eval.py script to evaluate policies
  2. generate_gin_config_files.py script to generate variations of gin environment config files
  3. Added visualization module with features to save plots of evaluation runs to eval results
  4. Added implementation of td3 and ddpg agents
  5. Other qol changes (see commit descriptions)
  • Tests pass

…tory is to have all reinforcement learning related code, and scripts to train and evaluate agents
…gin config file, and generates variations changing imporant parameters like time step length, start date and number of days on episode. Also added .bash script to illustrate how to use it
…ntations that were added in previous commits. Changed some default argument values, same for populate_starter_buffer.py script
…visualization module, which this observer uses to plot the graphs
…r of steps instead of episode steps to calculate percentage, leading to > 100% values
… Added saved_model_policy.py file to policies directory -- this file has a class which is used to load and interact with policies saved during training
…eter was redundant with the base_building's time_step_sec
…fore, it was wrongly using the first checkpoint, which gave the untrained agent performance)
@s2t2 s2t2 force-pushed the copybara_push branch from cfad6e2 to da325d2 Compare May 16, 2025 16:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Ambiguity between BaseBuilding's time_step_sec property and Environment's step_interval values
2 participants