🐳 Docker#

Prerequisites#

Please make sure you have installed docker in the officially recommended way. Otherwise, please refer to the official guide.

Please install NVIDIA Container Toolkit following the official guide.

Please create and add the docker user information to .env file. To use the same user information as the host machine, run in project root:

printf "DOCKER_UID=$(id -u $USER)\nDOCKER_GID=$(id -g $USER)\nDOCKER_USER=$USER\n" > .env

Build the docker image#

Build the docker image and attach to the container bash:

docker compose up --build -d && docker exec -it metasim bash

This will automatically build docker image roboverse-metasim.

It may take ~10mins when the network speed is ~25MB/s. The docker image size would be 35~40GB.

Run the docker container in VSCode/Cursor#

Install the Dev Containers extension in VSCode/Cursor.

Then reopen the window, click the Reopen in Container option in the bottom left corner.

Setup GUI#

Before you run any command, you need to setup the GUI. On the host machine, run:

xhost +local:docker

In container, launch a xclock application to test the GUI:

xclock

If a clock successfully shown on the host machine, the GUI is working.

Tips#

Troubleshooting#

Please refer to Docker Troubleshooting for more details.

Run docker without sudo#

You may want to run docker without sudo. Run:

sudo groupadd docker
sudo gpasswd -a $USER docker

After re-login, you should be able to run docker without sudo:

docker run hello-world

Setup proxy for docker#

  1. Set up local Clash proxy and make sure it works on local IP address. For example, you need enable β€œAllow LAN” if you are using Clash.

    Turn on clash to allow LAN:

    # vim ~/Clash/config.yaml
    allow-lan: true
    

    Then test in your terminal

    export HOST_IP=192.168.61.221
    export all_proxy=socks5://${HOST_IP}:7890
    export all_proxy=socks5://${HOST_IP}:7890
    export https_proxy=http://${HOST_IP}:7890
    export http_proxy=http://${HOST_IP}:7890
    export no_proxy=localhost,${HOST_IP}/8,::1
    export ftp_proxy=http://${HOST_IP}:7890/
    
    # check env variables are set
    env | grep proxy
    
    # test connection
    curl -I https://www.google.com
    
  2. Set up docker proxy.

    # vim ~/.docker/config.json
    "proxies": {
        "default": {
            "httpProxy": "http://192.168.1.55:7890",
            "httpsProxy": "http://192.168.1.55:7890",
            "allProxy": "socks5://192.168.1.55:7890",
            "noProxy": "192.168.1.55/8"
        }
    }
    

    Note

    Do NOT set IP address to 127.0.0.1. Instead, change it to your local ipv4 address.

  3. Setup proxy mirros used when docker pull, etc

    # sudo vim /etc/docker/daemon.json
    {
        ...
        "registry-mirrors": [
            "https://mirror.ccs.tencentyun.com",
            "https://05f073ad3c0010ea0f4bc00b7105ec20.mirror.swr.myhuaweicloud.com",
            "https://registry.docker-cn.com",
            "http://hub-mirror.c.163.com",
            "http://f1361db2.m.daocloud.io"
        ]
    }
    
  4. Restart docker [and then build again]

    sudo systemctl daemon-reload
    sudo systemctl restart docker
    
  5. Add PROXY to .env file.

    DOCKER_USER=...
    DOCKER_UID=...
    DOCKER_GID=...
    PROXY=http://192.168.1.55:7890
    
  6. Uncomment the lines in dockerfile which changes ubuntu apt sources to aliyun if you encounter apt install failures.

    # Change apt source if you encouter connection issues
    RUN sed -i s@/archive.ubuntu.com/@/mirrors.aliyun.com/@g /etc/apt/sources.list && \
        sed -i s@/security.ubuntu.com/@/mirrors.aliyun.com/@g /etc/apt/sources.list
    
  7. Be patient. Sometimes you need run docker compose build multiple times.

Setup docker for NVIDIA RTX50 series GPUs#

For RTX50 series GPUs, the following environments are required.

Component

Version

Notes

🐧 OS

Ubuntu β‰₯ 22.04

Required by IsaacLab

🐍 Python

python == 3.10

Required by multiple simulators

πŸ”₯ PyTorch

torch β‰₯ 2.7.1

Required by RTX50 series GPUs

πŸš€ CUDA

CUDA β‰₯ 12.8

Required by RTX50 series GPUs

Note

Currently, the IsaacGym does not support the NVIDIA RTX50 series GPUs, as it is limited to python==3.8 or earlier.

  1. Pull the official NVIDIA image.

    To make sure the docker environment supports RTX50 series GPUs and cuda 12.8. Please pull the official Ubuntu 22.04 base image that supports cuda 12.8 from NVIDIA by running the following commands:

    docker pull nvidia/cuda:12.8.0-base-ubuntu22.04
    
  2. Setup docker environments.

    Please run the base image with GPU supporting and install necessary development tools (build-essential, CMake, git, etc.).

    docker run --gpus all -it nvidia/cuda:12.8.0-base-ubuntu22.04
    
    apt-get update && apt-get install -y --no-install-recommends build-essential cmake git curl wget ca-certificates pkg-config software-properties-common unzip nano sudo
    

    Then, setup the conda environment with python==3.10 for RoboVerse:

    conda create -n roboverse python=3.10
    
  3. Setup RoboVerse-IsaacLab environments.

    Please pull the RoboVerse official code repository:

    git clone https://github.com/RoboVerseOrg/RoboVerse.git
    
    cd RoboVerse
    

    The environment in the pyproject.toml is currently not compatible for NVIDIA RTX50 series GPUs. Please use pip to install isaacsim manually.

    pip install protobuf
    pip install pyglet
    pip install isaacsim==4.2.0.2
    pip install isaacsim-extscache-physics==4.2.0.2
    pip install isaacsim-extscache-kit==4.2.0.2
    pip install isaacsim-extscache-kit-sdk==4.2.0.2
    

    Please install the IsaacLab dependencies by running following commands:

    cd third_party
    
    wget https://codeload.github.com/isaac-sim/IsaacLab/zip/refs/tags/v1.4.1 -O IsaacLab-1.4.1.zip && unzip IsaacLab-1.4.1.zip
    
    cd IsaacLab-1.4.1
    
    sed -i '/^EXTRAS_REQUIRE = {$/,/^}$/c\EXTRAS_REQUIRE = {\n    "sb3": [],\n    "skrl": [],\n    "rl-games": [],\n    "rsl-rl": [],\n    "robomimic": [],\n}' source/extensions/omni.isaac.lab_tasks/setup.py
    
    ./isaaclab.sh -i
    

    After installing the IsaacLabv 1.4, the torch will be modified to 2.4.0, reinstall the torch to 2.7.1. The torch==2.4.0 will not be compatible with NVIDIA RTX50 series GPUs.

    pip install --force-reinstall torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu128
    

    Finally, please install the necessary libraries required by IsaacLab.

    pip install rootutils
    pip install tyro
    pip install loguru
    pip install open3d
    
  4. Setup RoboVerse-Mujoco environments.

    After setting up issaclab, mujoco can be easily installed with the following command:

    pip install mujoco
    pip install dm-control
    
  5. Setup RoboVerse-Reinforcement Learning environments.

    RoboVerse provides two reinforcement learning demos: PPO Reaching and FastTD3 Humanoid. To run these two demos, please follow the steps below to setup your environments.

    Setup the PPO environments.

    pip install stable-baselines3
    

    Setup the FastTD3 environments.

    pip install mujoco-mjx
    pip install dm-control
    pip install jax[cuda12]
    pip install wandb
    pip install tensordict