Hi Shim,

I understand your question! I would suggest using imageio https://imageio.github.io/ to make .gifs of episodes every once in awhile to inspect the agent behavior during training.