Top AI Repos — open-source AI, indexed and scored
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
Top AI Repos tracks AI repositories on GitHub and answers two different questions about each one: is it moving right now, and would you bet a product on it.
PyTorch implementation of Asynchronous Advantage Actor Critic (A3C) from "Asynchronous Methods for Deep Reinforcement Learning".
| Date | Stars |
|---|---|
| 2026-07-24 | 1331 |
| 2026-07-25 | 1331 |
| 2026-07-28 | 1331 |
| 2026-07-30 | 1331 |
| 2026-07-31 | 1332 |
| 2026-08-02 | 1333 |
| 2026-08-06 | 1333 |
Today
— stars today
This week
+2 stars this week
This month
— stars this month
Momentum
0.0
growth rate 0.15%/day
# pytorch-a3c
This is a PyTorch implementation of Asynchronous Advantage Actor Critic (A3C) from ["Asynchronous Methods for Deep Reinforcement Learning"](https://arxiv.org/pdf/1602.01783v1.pdf).
This implementation is inspired by [Universe Starter Agent](https://github.com/openai/universe-starter-agent).
In contrast to the starter agent, it uses an optimizer with shared statistics as in the original paper.
Please use this bibtex if you want to cite this repository in your publications:
@misc{pytorchaaac,
author = {Kostrikov, Ilya},
title = {PyTorch Implementations of Asynchronous Advantage Actor Critic},
year = {2018},
publisher = {GitHub},
journal = {GitHub repository},
howpublished = {\url{https://github.com/ikostrikov/pytorch-a3c}},
}
## A2C
I **highly recommend** to check a sychronous version and other algorithms: [pytorch-a2c-ppo-acktr](https://github.com/ikostrikov/pytorch-a2c-ppo-acktr).
In my experience, A2C works better than A3C and ACKTR is better than both of them. Moreover, PPO is a great algorithm for continuous control. Thus, I recommend to try A2C/PPO/ACKTR first and use A3C only if you need it specifically for some reasons.
Also read [OpenAI blog](https://blog.openai.com/baselines-acktr-a2c/) for more information.
## Contributions
Contributions are very welcome. If you know how to make this code better, don't hesitate to send a pull request.
## Usage
```bash
# Works only wih Python 3.
python3 main.py --env-name "PongDeterministic-v4" --num-processes 16
```
This code runs evaluation in a separate thread in addition to 16 processes.
## Results
With 16 processes it converges for PongDeterministic-v4 in 15 minutes.
For BreakoutDeterministic-v4 it takes more than several hours.
Excerpt of 1,824 characters
Read on GitHub
38
2
Adam Paszke · @google · Germany
2
1
1
1
1
Would you bet a product on this? Bounded 0–100 and slow moving.
matched fp:ea7da4442c2b192b, topic:reinforcement-learning, topic:deep-reinforcement-learning, desc:reinforcement learning
matched fp:ea7da4442c2b192b, topic:deep-learning, topic:pytorch