Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

The Gym envirment has bug so the training does't give good reward #36

Open
quhezheng opened this issue Jun 20, 2017 · 3 comments
Open

The Gym envirment has bug so the training does't give good reward #36

quhezheng opened this issue Jun 20, 2017 · 3 comments

Comments

@quhezheng
Copy link

The best reward would be 30, that all. But by replacing Gym with ROM directly, the output would be very different, very stable reward around 300~400

I dont' know exactly what's wrong with Gym
@isVoid
Copy link

isVoid commented Jul 17, 2017

Could you explain the steps on replacing Gym with ROM?

@hjchen2
Copy link

hjchen2 commented Jul 22, 2017

I have encountered the same problem that my best reward is only 45 with Gym. If you had find out what's wrong, please let me know. Thanks.

@JUZI1
Copy link

JUZI1 commented Mar 9, 2020

I seem to understand. The new gym environment is different. If you directly use 'Breakout-v0', you will skip four frames in the middle. You should use 'BreakoutNoFrameskip-v0'

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@quhezheng @isVoid @hjchen2 @JUZI1