Projects

If you're interested in submitting a project to us, you can read more here. If you'd like to get involved in contributing, the best way is to join our discord server.

Mature

Maintained projects that comply with our standards
Gymnasium
Gymnasium

A standard API for reinforcement learning and a diverse set of reference environments (formerly Gym)

PettingZoo
PettingZoo

Gymnasium for multi-agent environments

SuperSuit
SuperSuit

A collection of wrappers for Gymnasium and PettingZoo environments

Minigrid
Minigrid

Simple and easily configurable grid world environments for reinforcement learning

Gymnasium-Robotics
Gymnasium-Robotics

A collection of robotics simulation environments for reinforcement learning

Tinyscaler
Tinyscaler

A small and fast image rescaling library with SIMD support

AutoROM
AutoROM

A tool to automate installing Atari ROMs for the Arcade Learning Environment

Jumpy
Jumpy

On-the-fly conversions between Jax and NumPy tensors

Incubating

Projects we're still actively working to bring up to out standards, debug, and/or create
MAgent2
MAgent2

An engine for high performance multi-agent environments with very large numbers of agents, along with a set of reference environments

Procgen2
Procgen2

Fast and procedurally generated side-scroller-game-like graphical environments (formerly Procgen)

MicroRTS
MicroRTS

A simple and highly efficient RTS-game-inspired environment for reinforcement learning

Miniworld
Miniworld

Simple and easily configurable 3D FPS-game-like environments for reinforcement learning

D4RL
D4RL

A collection of reference environments for offline reinforcement learning

Minari
Minari

Gymnasium Based Offline RL Tooling

MiniWoB++
MiniWoB++

A collection of reinforcement learning environments for simple web interaction tasks

ViZDoom
ViZDoom

Doom-based AI Research Platform for Reinforcement Learning from Raw Visual Information

Shimmy
Shimmy

An API conversion tool for popular external reinforcement learning environments