Containerfile for portable deployment #5

New issue

Closed

opened 2026-09-01 20:37:56 +00:00 by Mark · 0 comments

Mark commented

2026-09-01 20:37:56 +00:00

Owner

Rootless Podman + NVIDIA GPU passthrough. Should run identically on any host with an NVIDIA GPU.

Stack:

Base: docker.io/nvidia/cuda:12.8.0-runtime-ubuntu24.04 (matches torch 2.8+cu128)
System deps: ffmpeg, git, python3, pip
Python deps: whisperx (matches what's known to work on blackhole), yt-dlp
WORKDIR: /app
Volume mounts: /mnt/audio (input), /mnt/output (transcripts), ~/.cache/huggingface (model cache, share with host)
GPU passthrough via CDI: --device nvidia.com/gpu=all works in rootless Podman with CDI configured

Smoke test: build, run on Jobs Stanford speech, verify identical output to host run.

Rootless Podman + NVIDIA GPU passthrough. Should run identically on any host with an NVIDIA GPU. **Stack:** - Base: `docker.io/nvidia/cuda:12.8.0-runtime-ubuntu24.04` (matches torch 2.8+cu128) - System deps: ffmpeg, git, python3, pip - Python deps: whisperx (matches what's known to work on blackhole), yt-dlp - WORKDIR: `/app` - Volume mounts: `/mnt/audio` (input), `/mnt/output` (transcripts), `~/.cache/huggingface` (model cache, share with host) - GPU passthrough via CDI: `--device nvidia.com/gpu=all` works in rootless Podman with CDI configured **Smoke test:** build, run on Jobs Stanford speech, verify identical output to host run.