The current convert_aloha_data_to_lerobot.py script has two major issues that makes it difficult to train openpi:
-
Outdated LeRobot format (v2 instead of v3.0)
- The script produces the old LeRobot v2 dataset format.
-
Extremely high memory usage
- The script loads too much data into RAM at once
- It does not support proper batching
Steps to Reproduce
- Prepare a folder with ALOHA-style
episode_*.hdf5 files
- Run
convert_aloha_data_to_lerobot.py.
- After conversion, the resulting dataset is in the old v2 format.
Expected Behavior
- The script should output a LeRobot v3.0 compatible dataset by default.
- It should support batching / low-memory mode (process episodes in small groups, compute running statistics, write Parquet chunks incrementally).
The current convert_aloha_data_to_lerobot.py script has two major issues that makes it difficult to train openpi:
Outdated LeRobot format (v2 instead of v3.0)
Extremely high memory usage
Steps to Reproduce
episode_*.hdf5filesconvert_aloha_data_to_lerobot.py.Expected Behavior