Offline reinforcement learning has become popular for learning control policies from pre-collected data.
PyTupli, a Python-based tool, has been introduced to streamline the creation, storage, and sharing of benchmark environments and datasets for offline RL projects.
PyTupli includes a client library for uploading and retrieving benchmarks and data, along with support for fine-grained filtering at the episode and tuple level.
The tool aims to enhance collaborative, reproducible, and scalable offline RL research by addressing key barriers in dataset infrastructure.