Keyboard shortcuts

Press or to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

// index //

declarative GPU containers. vast.ai. runpod. bare-metal. zero dockerfile cope.


// start here //


// high-level //

  1. declare containers under perSystem.nix2gpu.<n>
  2. each container config is a nix module (like nixos modules)
  3. nix2gpu assembles:
    • root filesystem with nix store + your packages
    • startup script for runtime environment
    • service graph via Nimi
  4. helper commands:
    • nix build .#<n> — build image
    • nix run .#<n>.copy-to-container-runtime — load into docker/podman
    • nix run .#<n>.copy-to-github — push to ghcr
    • nix run .#<n>.copy-to-runpod — push to runpod

// cloud targets //

platformstatusnotes
vast.ai✅ stablenvidia libs at /lib/x86_64-linux-gnu
runpod✅ stablenetwork volumes, template support
lambda labs✅ worksstandard docker
bare-metal✅ worksjust run the container
kubernetes🚧 wipgpu operator integration

// where to go //