[BUG] Getting Environment `PongNoFrameskip` doesn't exist. error while running a2c_atari implementation.

[simeetnayan81]

Describe the bug

Getting Environment `PongNoFrameskip` doesn't exist. error while running the a2c_atari implementation

To Reproduce

1. Install the dependencies (for atari)
2. Run sh sota-check/run_a2c_atari.sh

Expected behavior

Gymnasium should recognise the environment. Training should start

Screenshots

If applicable, add screenshots to help explain your problem.

System info

Describe the characteristic of your environment:

• Installed from local using python setup.py develop
• Python version: 3.10
• Versions of any other relevant libraries: Gymnasium: 1.1.1, Gymnasium: 1.1.0 - All giving same error

Reason and Possible fixes

Adding import ale_py in the script a2c_atari.py fixes the error.
References: https://ale.farama.org/gymnasium-interface/ , https://stackoverflow.com/questions/76150278/getting-an-error-trying-to-import-environment-openai-gym

It seems with newer versions of gymnasium, we need to import ale_py separately for atari games.

Checklist

• I have checked that there is no similar issue in the repo (required)
• I have read the documentation (required)
• I have provided a minimal working example to reproduce the bug (required)

[simeetnayan81]

@vmoens Let me know if the solution looks fine. I can create a draft pr with proposed solution in all the atari based implementations.