Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge latest main #1

Open
wants to merge 434 commits into
base: main
Choose a base branch
from
Open

Conversation

mukulkhanna
Copy link
Collaborator

Motivation and Context

How Has This Been Tested

Types of changes

  • Docs change / refactoring / dependency upgrade
  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)

Checklist

  • My code follows the code style of this project.
  • My change requires a change to the documentation.
  • I have updated the documentation accordingly.
  • I have read the CONTRIBUTING document.
  • I have completed my CLA (see CONTRIBUTING)
  • I have added tests to cover my changes.
  • All new and existing tests passed.

dhruvbatra and others added 30 commits November 17, 2023 20:56
Minor update to citation
* add social nav readme

* update format

* add FPS

* add comments

* fix typo

---------

Co-authored-by: Jimmy Yang <[email protected]>
* updates

* any motion with humanoids

* update

* update

* Update habitat-lab/habitat/articulated_agents/humanoids/README.md

Co-authored-by: Alexander Clegg <[email protected]>

* remove title without content

* Update habitat-lab/habitat/articulated_agents/humanoids/README.md

Co-authored-by: Alexander Clegg <[email protected]>

* Update habitat-lab/habitat/articulated_agents/humanoids/README.md

Co-authored-by: Alexander Clegg <[email protected]>

* added todo comment

---------

Co-authored-by: Alexander Clegg <[email protected]>
* add constraint if the robot is moving too far

* refine gaze

* fix placement issue

* fix placement issue

* fix rotation issue

* fix current agent issue

* clean up issue

* add constrain on the ee location

* select arm or base action

* add a check to the camera looking down angles

* address michael's comment

* address

* add pick spot as a training yanl

* remove spot training test

* add test

---------

Co-authored-by: Jimmy Yang <[email protected]>
* Port changes over from client-server-hitl to minimize the gap.

* Fix typo.

* Port hitl server code to main.

* Server clean-up pass.

* Fix old HSSD path.

* Port client-server fetch appstate and features from P0.

* Formatting pass and code clean-up.

* Code clean-up.

* Port VR-based humanoid animation from P0.

* Fix VR gaze direction.

* Code formatting pass.

* Add Unity dataset processing scripts.

* Unity dataset processing script clean-up and formatting.

* Fix typo.

* Remove dead code and fix typing.

* Add readme for running VR HITL evaluation.

* Fix launch command.

* Add link to README_VR.md.

* Add docstrings. Add reset code in gui_controller.

* Rename 'AppStateFetch' to 'AppStatePickThrowVr'.

* Rename README_VR.md to VR_HITL.md, and improve the documentation.

* Remove dead code and add doc.

* Doc changes.

* Update HITL README.md so that app states are better documented.

* Clarify the scope of pick_throw_vr.

* Move information from VR_HITL to siro_hitl_unity_client

* Documentation improvements.
* rename 'colabs/' to 'notebooks/' and refactor links

* refactor colabs to running Jupyter notebooks
* fix the env pause issue

* add comment

---------

Co-authored-by: Jimmy Yang <[email protected]>
* refactor sandbox_app.py; move arg-parsing, config-building, and __main__ code to separate files

* encapsulate tutorial app-state transition into AppStateRearrangeTutorialTransition class

* remove SandboxDriver logic to cycle through a list of AppStates (this is too inflexible as a state machine; see AppStateRearrangeTutorialTransition as an exaple of more freeform app-state transitions)

* move gui_agent_controller into SandboxService

* Make app_state_rearrange.py its own application (first pass)

* move app_state_rearrange.py outside siro_sandbox and rename to rearrange.py

* WIP: first pass to convert rearrange app to use hitl_rearrange.yaml hydra config; move --show-tutorial to config

* convert pick_throw_vr to standalone app

* remove deprecated app_state_socialnav.py (note: more recent version is at https://github.com/facebookresearch/habitat-lab/blob/eundersander/SIRo_hitl_Sep5_demo_refactored/examples/siro_sandbox/app_states/app_state_socialnav_study.py)

* convert free_camera app state to standalone app 'basic_viewer'

* add missing copyright headers

* add READMEs for each example HITL application and update framework README (pick_throw_vr README is ported from existing VR readme)

* add desktop system requirements

* add VR system requirements

* add documentation for AppStateRearrange
…l files (#1745)

* replace all command-line params with hydra config params
* improved documentation
* some minor improvements/bugfixes to HITL apps: (1) basic_viewer: pause and single-step hotkeys; display episode id and status, (2) pick_throw_vr: one-line bugfix for local/VR-control toggle, (3) rearrange: enable data-collection (session save files) via config
* examples/siro_sandbox/ migrated to habitat-hitl/.
* Lots of files and classes have been renamed and moved into subfolders for clarity.
* Some non-public classes have been moved into an _internal folder. See INTERNALS.md for details.
* Added a minimal HITL app.
Co-authored-by: Jimmy Yang <[email protected]>
…_agent_controllers, core, and config modules (#1736)

* Update completed class/function documentation in labdocsv1

* pre-commit passed

* Exposed class modules

* Exposed methods in Articulated_agents, articulated_agent_controllers, core, and config modules

* fix duplicate param causing doc build failure

---------

Co-authored-by: “Sam <“[email protected]”>
Co-authored-by: aclegg3 <[email protected]>
* working script

* add hand and fingers

* updated readme

* updates

* update script

* linting

* udpates addon humanoid

* typing

* typing

* typing
* add DebugVideoWriter

* fix for FrequencyLimiter

* polish for AverageRateTracker

* add headless mode with stub versions of DebugLineRender, GuiInput, and TextDrawer

* update README

* add docstrings for DebugVideoWriter and StubTextDrawer
…xed episodes_filter episode order not respected (#1772)
…) Fixed episodes_filter episode order not respected (3) added check for data folder in current working directory (#1774)

* (1) Fixed error when using config habitat_hitl.episodes_filter='4' (2) Fixed episodes_filter episode order not respected (3) added check for data folder in current working directory

* Update README.md

Updated README.md with reviewer rewording recommendation.

* Update README.md

Modified Installation Step #5 in README.md
This syntax should work with both the original API and the new one.

Also removed a comment that wasn't true -- the code doesn't perform any
modifications of the original instance, it just replaces the instance a
few times.
* Improve font rendering.

* Review pass.
* Refactor the DebugVisualizer for use with pdb and more predictable generic behavior in the wild
* Add remote_gui config.

* Rename 'remote_gui' to 'networking'
aclegg3 and others added 30 commits September 6, 2024 15:25
* Fix choppiness for continuous remote input.

* Reorganize continuous input reset.

* Change GuiInput.reset() docstring.
* Highlight the default receptacle.

* Support multiple contextual info labels. Add contextual info for default receptacles.

* Change highlighted receptacle contextal info text.

* Change highlighted receptacle contextal info text.
* add distance to receptacle and find closeset receptacle functions powered by triangle mesh to point distance util

* add the ui hook for the new function
* bugfix in support surface selection for rec matching

* logger error on KRM init with inactive or invalid object->rec map in episode
* clean up and rename the _load_navmesh function now that we have changed the behavior to recompute every time
* add humnaoid data to CI download to activate the test_humanoid.py pytest

* Fix the inconsistency between base_rot getter and setter. Add unit tests. Activate and fix skipped humanoid unit tests.

* remove the precise test for pi since that is the singularity wrap point and will often produce -pi
* fix numpy version

* remove conda cache
* add full testing github workflow
* add pypi deployment workflow on version release trigger
* Unpin protobuf and tensorboard requirements.

* Remove protobuf from requirements.txt.
* --fix issues with change from eigen to magnum vectors
* --DO NOT MERGE THIS COMMIT : test against sim PR branch instead of main.
* --remove unnecessary quaternion conversions
* --force positions to np arrays
* --remove reference to sim PR for testing
Until the sim PR is merged, the tests on this branch will fail.
* Remove unused variable in rearrange_sim.

* Remove unused draw_bb_objs.

* Fix typo.

* Add docstring to 'receptacles()'.

* Remove _additional_object_paths from rearrange_sim.

* Remove empty file.

* Fix typos.

* Remove dead code in utils.

* Fix typo in function name.
* add pure region matching to the object->rec mapping util and split out the point->rec matching logic

* add docstring return

* overwrite info_text instead of new info_string

* normalize gravity vector before size_along math

* convert horizontal distance to slightly large L2 distance for floor matching. Removes assumption of pre-snapped objects

---------

Co-authored-by: Priyam Parashar <[email protected]>
* fix bugs calling center() on Range3D

* missed numpy conversions
* Move BaselinesController to its own file.

* Fix typo.

* Fix import statements.
* Add config type annotations to rearrange_sim.

* Remove temporary code.

* Force import DictConfig.

* Change monkey-patched config field type.

* Remove uuid from SimulatorSensorConfig.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.