dqn

• I have marked all applicable categories:
  • exception-raising bug
  • RL algorithm bug
  • documentation request (i.e. "X is missing from the documentation.")
  • new feature request
• I have visited the [source website], and in particular read the [known issues]
• I have searched through the [issue tracker] and [issue categories] for duplicates
• [ ]

The docstring for tf_py_environment.__getattr__ indicates that certain PyEnvironment methods might be incompatible with TF.

def __getattr__(self, name: Text) -> Any:
    """Enables access attributes of the wrapped PyEnvironment.
    Use with caution since methods of the PyEnvironment can be incompatible
    with TF.
    Args:
      name: Name of the attribute.
    Returns: