Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Proximal Policy Optimization (PPO) algorithm for Super Mario Bros
| Date | Stars |
|---|---|
| 2026-07-24 | 1296 |
| 2026-07-25 | 1296 |
| 2026-07-28 | 1296 |
| 2026-07-30 | 1296 |
| 2026-08-06 | 1296 |
Today
— stars today
This week
— stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.00%/day
# [PYTORCH] Proximal Policy Optimization (PPO) for playing Super Mario Bros ## Introduction Here is my python source code for training an agent to play super mario bros. By using Proximal Policy Optimization (PPO) algorithm introduced in the paper **Proximal Policy Optimization Algorithms** [paper](https://arxiv.org/abs/1707.06347). Talking about performance, my PPO-trained agent could complete 31/32 levels, which is much better than what I expected at the beginning. For your information, PPO is the algorithm proposed by OpenAI and used for training OpenAI Five, which is the first AI to beat the world champions in an esports game. Specifically, The OpenAI Five dispatched a team of casters and ex-pros with MMR rankings in the 99.95th percentile of Dota 2 players in August 2018. <p align="left"> <img src="demo/video-1-1.gif" width="200"> <img src="demo/video-1-2.gif" width="200"> <img src="demo/video-1-3.gif" width="200"> <img src="demo/video-1-4.gif" width="200"><br/> <img src="demo/video-2-1.gif" width="200"> <img src="demo/video-2-2.gif" width="200"> <img src="demo/video-2-3.gif" width="200"> <img src="demo/video-2-4.gif" width="200"><br/> <img src="demo/video-3-1.gif" width="200"> <img src="demo/video-3-2.gif" width="200"> <img src="demo/video-3-3.gif" width="200"> <img src="demo/video-3-4.gif" width="200"><br/> <img src="demo/video-4-1.gif" width="200"> <img src="demo/video-4-2.gif" width="200"> <img src="demo/video-4-3.gif" width="200"> <img src="demo/video-4-4.gif" width="200"><br/> <img src="demo/video-5-1.gif" width="200"> <img src="demo/video-5-2.gif" width="200"> <img src="demo/video-5-3.gif" width="200"> <img src="demo/video-5-4.gif" width="200"><br/> <img src="demo/video-6-1.gif" width="200"> <img src="demo/video-6-2.gif" width="200"> <img src="demo/video-6-3.gif" width="200"> <img src="demo/video-6-4.gif" width="200"><br/> <img src="demo/video-7-1.gif" width="200"> <img src="demo/video-7-2.gif" width="200"> <img src="demo/video-7-3.gif" width="200"> <img src="demo/video-7-4.gif" width="200"><br/> <img src="demo/video-8-1.gif" width="200"> <img src="demo/video-8-2.gif" width="200"> <img src="demo/video-8-3.gif" width="200"><br/> <i>Sample results</i> </p> ## Motivation It has been a while since I have released my A3C implementation ([A3C code](https://github.com/uvipen/Super-mario-bros-A3C-pytorch)) for training an agent to play super mario bros. Although the trained agent could complete levels quite fast and quite well (at least faster and better than I played :sweat_smile:), it still did not totally satisfy me. The main reason is, agent trained with A3C could only complete 19/32 levels, no matter how much I fine-tuned and tested. It motivated me to look for a new approach. Before I decided to choose PPO as my next complete implementation, I had partially implemented a couple of other algorithms, including A2C and Rainbow. While the former did not show a big jump in performance, the latter is more suitable for more randomized environments/games, like ping-pong or space invaders. ## How to use my code With my code, you can: * **Train your model** by running `python train.py`. For example: `python train.py --world 5 --stage 2 --lr 1e-4` * **Test your trained model** by running `python test.py`. For example: `python test.py --world 5 --stage 2` **Note**: If you got stuck at any level, try training again with different **learning rates**. You could conquer 31/32 levels like what I did, by changing only **learning rate**. Normally I set **learning rate** as **1e-3**, **1e-4** or **1e-5**. However, there are some difficult levels, including level **1-3**, in which I finally trained successfully with **learning rate** of **7e-5** after failed for 70 times. ## Docker For being convenient, I provide Dockerfile which could be used for running training as well as test phases Assume that docker image's name is ppo. You only want to use the first g
Excerpt of 5,165 characters
Read on GitHub
Viet Nguyen · SPORTTOTAL.TV · Germany
9
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:971499b2203e94cc, topic:deep-learning, topic:pytorch
matched fp:971499b2203e94cc, name:ppo, desc:ppo, readme:ppo
matched fp:971499b2203e94cc, topic:reinforcement-learning, topic:openai-gym