Include "Pop-up" windows in observation #30
Description
This is a migration copy of the original feature request here: facebookresearch#188
See the conversation there for historic discussion of this issue.
🚀 Feature
Include pop-up windows (such as "Things that are here:", or the spellcasting menu) in the observation space, either under "message", or under a new key.
Motivation
I'm developing a bot for the 2021 Nethack challenge. The prospect of having to figure out where in the raw terminal output pop-ups are drawn up is not pleasing. Currently, if I want to get the information in these pop-up windows, that is the only way.
Pitch
Copy over the information in the pop-ups under the observation key "message".
Alternatives
If the pop-up windows turn out to take more than 255 characters to convey in some cases, or if it's possible for a message and a pop-up window to appear simultaneously, you could instead add a new key for this purpose, and allot it a larger buffer than the normal message observation.