Mar 1 2024 update: HILP added
July 2022 update: EDDICT added
Mar 2022 update: a few papers released in early 2022
Dec 2021 update: Unsupervised RL
September 17, 2026: Embodied RL research update, 12 new research notes, and the interactive atlas. Sources checked through September 17; preprints and adjacent VLA developments are labeled.
Reinforcement learning is the fundamental framework for building AGI. Therefore we share important contributions within this awesome drl project.
The field is converging around data-centric and hybrid RL, world models, foundation policies for robotics, tool-using agents, scalable multi-agent coordination, and evaluation that measures generalization and safety. Top-conference RL work is now concentrated at NeurIPS, ICML, ICLR, CoRL/RSS, AAAI/IJCAI/AAMAS, and UAI, while the canonical test-of-time foundations still remain DQN, PPO, SAC, AlphaGo, MuZero, and world models. The latest frontier is also deeply shaped by LLM-agent RL, preference optimization (RLHF/DPO/GRPO), and embodied AI systems that couple perception, control, and long-horizon planning.
Start with the 2026 frontier guide, or use the interactive homepage to filter themes and track your reading locally. Browse the research lab directory to discover leading LLM and RL groups by research focus, organization type, and region.
- NeurIPS, ICML, ICLR: RL, world models, policy optimization, uncertainty-aware control, and sequence modeling for decision-making.
- CoRL / RSS / ICRA / IROS: embodied AI, dexterous manipulation, sim-to-real transfer, and safe real-world control.
- AAAI / IJCAI / AAMAS / UAI: agentic decision-making, planning, Bayesian RL, and multi-agent coordination.
- Classic test-of-time anchors: DQN, PPO, SAC, AlphaGo, MuZero, World Models, and Inverse RL remain the core conceptual reference stack.
- LLM and agent RL: RLHF, DPO, GRPO, ReAct, WebArena, and foundation-model policies such as OpenVLA and Octo.
Latest curated notes, ordered by first public date. See the frontier guide for evaluation limits and artifact availability. Results are author-reported; dates do not imply peer review.
- FMAPPO: Multi-agent factory navigation — 13 Sep 2026. Sim-to-real coordination; physical arms disabled.
- HaWMPO: Hallucination-aware policy optimization — 9 Sep 2026. Reliability-weighted imagined rollouts.
- VLA-Precision: Online RL for precision manipulation — 3 Sep 2026. Human intervention, value calibration, and efficient updates.
- WorldSample: Real-robot RL with world modelling — 2 Jul 2026. Synthetic transitions grounded in real experience.
- Object-Centric Residual RL — 17 Jun 2026. Simulation-trained corrections to a frozen VLA.
- RL Token: Efficient online robot RL — 19 Mar 2026 official release. Compact representations for precision skills.
- RISE: Compositional world-model RL — 11 Feb 2026. Policy improvement through imagined dynamics and values.
- TwinRL: Digital twin-driven robot RL — 9 Feb 2026. Simulation warm-up and human-guided physical refinement.
- EnvACE: Environment rehearsal for agentic RL — 6 Aug 2026. Tool-agent RL; not a physical-robot result.
Benchmark and foundation-policy developments are relevant to RL without necessarily introducing an RL algorithm.
- Gemini Robotics 2: Whole-body intelligence — 30 Jul 2026 official announcement; RL recipe not established.
- Xiaomi-Robotics-1: VLA data scaling — 16 Jul 2026. Pretraining/adaptation context.
- WorldArena: Functional world-model evaluation — 9 Feb 2026. Benchmark, not an RL algorithm.
- Awesome Deep Reinforcement Learning
- Introduction to awesome drl
- Landscape of Deep RL
- The 2026 frontier
- 2026 · Embodied RL
- 2026 · Agent RL
- 2026 · Embodied context
- Content
- General guidances
- 2022
- Foundations and theory
- General benchmark frameworks
- Unsupervised
- Offline
- Value based
- Policy gradient
- Explorations
- Actor-Critic
- Model-based
- Model-free + Model-based
- Hierarchical
- Option
- Connection with other methods
- Connecting value and policy methods
- Reward design
- Unifying
- Faster DRL
- Multi-agent
- New design
- Multitask
- Observational Learning
- Meta Learning
- Distributional
- Planning
- Safety
- Inverse RL
- No reward RL
- Time
- Adversarial learning
- Use Natural Language
- Generative and contrastive representation learning
- Belief
- PAC
- Applications
Illustrations:
Recommendations and suggestions are welcome.
- Awesome Offline RL
- Reinforcement Learning Today
- Multiagent Reinforcement Learning by Marc Lanctot RLSS @ Lille 11 July 2019
- RLDM 2019 Notes by David Abel 11 July 2019
- A Survey of Reinforcement Learning Informed by Natural Language 10 Jun 2019 arxiv
- Challenges of Real-World Reinforcement Learning 29 Apr 2019 arxiv
- Ray Interference: a Source of Plateaus in Deep Reinforcement Learning 25 Apr 2019 arxiv
- Principles of Deep RL by David Silver
- University AI's General introduction to deep rl (in Chinese)
- OpenAI's spinningup
- The Promise of Hierarchical Reinforcement Learning 9 Mar 2019
- Deep Reinforcement Learning that Matters 30 Jan 2019 arxiv
- General non-linear Bellman equations 9 July 2019 arxiv
- Monte Carlo Gradient Estimation in Machine Learning 25 Jun 2019 arxiv
- Android-Env
- MuJoCo | MuJoCo Chinese version
- Unsupervised RL Benchmark
- Dataset for Offline RL
- Spriteworld: a flexible, configurable python-based reinforcement learning environment
- Chainerrl Visualizer
- Behaviour Suite for Reinforcement Learning 13 Aug 2019 arxiv | code
- Quantifying Generalization in Reinforcement Learning 20 Dec 2018 arxiv
- S-RL Toolbox: Environments, Datasets and Evaluation Metrics for State Representation Learning 25 Sept 2018
- dopamine
- StarCraft II
- tfrl
- chainerrl
- PARL
- DI-engine: a generalized decision intelligence engine. It supports various Deep RL algorithms
- PPO x Family: Course in Chinese for Deep RL
- URLB: Unsupervised Reinforcement Learning Benchmark 28 Oct 2021
- APS: Active Pretraining with Successor Feature 31 Aug 2021
- Behavior From the Void: Unsupervised Active Pre-Training 8 Mar 2021
- Reinforcement Learning with Prototypical Representations 22 Feb 2021
- Efficient Exploration via State Marginal Matching 12 Jun 2019
- Self-Supervised Exploration via Disagreement 10 Jun 2019
- Exploration by Random Network Distillation 30 Oct 2018
- Diversity is All You Need: Learning Skills without a Reward Function 16 Feb 2018
- Curiosity-driven Exploration by Self-supervised Prediction 15 May 2017
- PerSim: Data-efficient Offline Reinforcement Learning with Heterogeneous Agents via Personalized Simulators 10 Nov 2021
- A General Offline Reinforcement Learning Framework for Interactive Recommendation AAAI 2021
- Harnessing Structures for Value-Based Planning and Reinforcement Learning 5 Feb 2020 arxiv | code
- Recurrent Value Functions 23 May 2019 arxiv
- Stochastic Lipschitz Q-Learning 24 Apr 2019 arxiv
- TreeQN and ATreeC: Differentiable Tree-Structured Models for Deep Reinforcement Learning 8 Mar 2018
- DISTRIBUTED PRIORITIZED EXPERIENCE REPLAY 2 Mar 2018
- Rainbow: Combining Improvements in Deep Reinforcement Learning 6 Oct 2017
- Learning from Demonstrations for Real World Reinforcement Learning 12 Apr 2017
- Dueling Network Architecture
- Double DQN
- Prioritized Experience
- Deep Q-Networks
- Phasic Policy Gradient 9 Sep 2020 arxiv code
- An operator view of policy gradient methods 22 Jun 2020 arxiv
- Direct Policy Gradients: Direct Optimization of Policies in Discrete Action Spaces 14 Jun 2019 arxiv
- Policy Gradient Search: Online Planning and Expert Iteration without Search Trees 7 Apr 2019 arxiv
- SUPERVISED POLICY UPDATE FOR DEEP REINFORCEMENT LEARNING 24 Dec 2018 arxiv
- PPO-CMA: Proximal Policy Optimization with Covariance Matrix Adaptation 5 Oct 2018 arxiv
- Clipped Action Policy Gradient 22 June 2018
- Expected Policy Gradients for Reinforcement Learning 10 Jan 2018
- Proximal Policy Optimization Algorithms 20 July 2017
- Emergence of Locomotion Behaviours in Rich Environments 7 July 2017
- Interpolated Policy Gradient: Merging On-Policy and Off-Policy Gradient Estimation for Deep Reinforcement Learning 1 Jun 2017
- Equivalence Between Policy Gradients and Soft Q-Learning
- Trust Region Policy Optimization
- Reinforcement Learning with Deep Energy-Based Policies
- Q-PROP: SAMPLE-EFFICIENT POLICY GRADIENT WITH AN OFF-POLICY CRITIC
- Entropic Desired Dynamics for Intrinsic Control 2021 openreview
- Self-Supervised Exploration via Disagreement 10 Jun 2019 arxiv
- Approximate Exploration through State Abstraction 24 Jan 2019
- The Uncertainty Bellman Equation and Exploration 15 Sep 2017
- Noisy Networks for Exploration 30 Jun 2017 implementation
- Count-Based Exploration in Feature Space for Reinforcement Learning 25 Jun 2017
- Count-Based Exploration with Neural Density Models 14 Jun 2017
- UCB and InfoGain Exploration via Q-Ensembles 11 Jun 2017
- Minimax Regret Bounds for Reinforcement Learning 16 Mar 2017
- Incentivizing Exploration In Reinforcement Learning With Deep Predictive Models
- EX2: Exploration with Exemplar Models for Deep Reinforcement Learning
- Generalized Off-Policy Actor-Critic 27 Mar 2019
- Soft Actor-Critic Algorithms and Applications 29 Jan 2019
- The Reactor: A Sample-Efficient Actor-Critic Architecture 15 Apr 2017
- SAMPLE EFFICIENT ACTOR-CRITIC WITH EXPERIENCE REPLAY
- REINFORCEMENT LEARNING WITH UNSUPERVISED AUXILIARY TASKS
- Continuous control with deep reinforcement learning
- Self-Consistent Models and Values 25 Oct 2021 arxiv
- When to use parametric models in reinforcement learning? 12 Jun 2019 arxiv
- Model Based Reinforcement Learning for Atari 5 Mar 2019
- Model-Based Stabilisation of Deep Reinforcement Learning 6 Sep 2018
- Learning model-based planning from scratch 19 July 2017
- WHY DOES HIERARCHY (SOMETIMES) WORK SO WELL IN REINFORCEMENT LEARNING? 23 Sep 2019 arxiv
- Language as an Abstraction for Hierarchical Deep Reinforcement Learning 18 Jun 2019 arxiv
- Variational Option Discovery Algorithms 26 July 2018
- A Laplacian Framework for Option Discovery in Reinforcement Learning 16 Jun 2017
- Robust Imitation of Diverse Behaviors
- Learning human behaviors from motion capture by adversarial imitation
- Connecting Generative Adversarial Networks and Actor-Critic Methods
- Bridging the Gap Between Value and Policy Based Reinforcement Learning
- Policy gradient and Q-learning
- End-to-End Robotic Reinforcement Learning without Reward Engineering 16 Apr 2019 arxiv
- Reinforcement Learning with Corrupted Reward Channel 23 May 2017
- No Press Diplomacy: Modeling Multi-Agent Gameplay 4 Sep 2019 arxiv
- Options as responses: Grounding behavioural hierarchies in multi-agent RL 6 Jun 2019 arxiv
- Evolutionary Reinforcement Learning for Sample-Efficient Multiagent Coordination 18 Jun 2019 arxiv
- A Regularized Opponent Model with Maximum Entropy Objective 17 May 2019 arxiv
- Deep Q-Learning for Nash Equilibria: Nash-DQN 23 Apr 2019 arxiv
- Malthusian Reinforcement Learning 3 Mar 2019 arxiv
- Bayesian Action Decoder for Deep Multi-Agent Reinforcement Learning 4 Nov 2018
- INTRINSIC SOCIAL MOTIVATION VIA CAUSAL INFLUENCE IN MULTI-AGENT RL 19 Oct 2018
- QMIX: Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learning 30 Mar 2018
- Modeling Others using Oneself in Multi-Agent Reinforcement Learning 26 Feb 2018
- The Mechanics of n-Player Differentiable Games 15 Feb 2018
- Continuous Adaptation via Meta-Learning in Nonstationary and Competitive Environments 10 Oct 2017
- Learning with Opponent-Learning Awareness 13 Sep 2017
- Counterfactual Multi-Agent Policy Gradients
- Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments 7 Jun 2017
- Multiagent Bidirectionally-Coordinated Nets for Learning to Play StarCraft Combat Games 29 Mar 2017
- IMPALA: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures 9 Feb 2018
- Reverse Curriculum Generation for Reinforcement Learning
- Trial without Error: Towards Safe Reinforcement Learning via Human Intervention
- Learning to Design Games: Strategic Environments in Deep Reinforcement Learning 5 July 2017
- Kickstarting Deep Reinforcement Learning 10 Mar 2018
- Zero-Shot Task Generalization with Multi-Task Deep Reinforcement Learning 7 Nov 2017
- Distral: Robust Multitask Reinforcement Learning 13 July 2017
- Observational Learning by Reinforcement Learning 20 Jun 2017
- Discovery of Useful Questions as Auxiliary Tasks 10 Sep 2019 arxiv
- Meta-learning of Sequential Strategies 8 May 2019 arxiv
- Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variables 19 Mar 2019 arxiv
- Some Considerations on Learning to Explore via Meta-Reinforcement Learning 11 Jan 2019 arxiv
- Meta-Gradient Reinforcement Learning 24 May 2018 arxiv
- ProMP: Proximal Meta-Policy Search 16 Oct 2018 arxiv
- Unsupervised Meta-Learning for Reinforcement Learning 12 Jun 2018
- GAN Q-learning 20 July 2018
- Implicit Quantile Networks for Distributional Reinforcement Learning 14 Jun 2018
- Nonlinear Distributional Gradient Temporal-Difference Learning 20 May 2018
- DISTRIBUTED DISTRIBUTIONAL DETERMINISTIC POLICY GRADIENTS 23 Apr 2018
- An Analysis of Categorical Distributional Reinforcement Learning 22 Feb 2018
- Distributional Reinforcement Learning with Quantile Regression 27 Oct 2017
- A Distributional Perspective on Reinforcement Learning 21 July 2017
- Robust Reinforcement Learning for Continuous Control with Model Misspecification 18 Jun 2019 arxiv
- Verifiable Reinforcement Learning via Policy Extraction 22 May 2018 arxiv
- Fast Task Inference with Variational Intrinsic Successor Features 2 Jun 2019 arxiv
- Curiosity-driven Exploration by Self-supervised Prediction 15 May 2017
