llama-swap-rocm (rocm7-nightlies-b8753-gemma4fix2-slim)

Published 2026-05-02 20:01:55 +00:00 by dan

Pull the image from the command line:

docker pull gitea.coffee-anon.com/dan/llama-swap-rocm:rocm7-nightlies-b8753-gemma4fix2-slim

Digest

sha256:ade700ce4b659c3eb719ef5ca18f9df856e294581fd73dc83b616507c3e762c0

For more information on the Container registry, see the documentation.

Image Layers

ARG RELEASE

ARG LAUNCHPAD_BUILD_ARCH

LABEL org.opencontainers.image.version=24.04

ADD file:8ce1caf246e7c778bca84c516d02fd4e83766bb2c530a0fffa8a351b560a2728 in /

CMD ["/bin/bash"]

ARG DEBIAN_FRONTEND=noninteractive

LABEL maintainer=citizendaniel

LABEL description=llama-swap + llama-server (slim, ROCm 7 nightlies HIP, gfx1151, PR #21760 Gemma 4 fix)

LABEL backend=rocm7-nightlies-hip-slim

LABEL gpu.target=gfx1151

LABEL gemma4fix.source=https://github.com/ggml-org/llama.cpp/pull/21760

LABEL gemma4fix.revisit=Rebuild from clean upstream release once PR #21760 merges

RUN |1 DEBIAN_FRONTEND=noninteractive /bin/sh -c apt-get update && apt-get install -y --no-install-recommends ca-certificates curl libcurl4 libgomp1 libnuma1 libelf1 libdrm2 libdrm-amdgpu1 libatomic1 pciutils libtinfo6 libncurses6 zlib1g libzstd1 && rm -rf /var/lib/apt/lists/* # buildkit

COPY /opt/rocm-runtime/ /opt/rocm/ # buildkit

COPY /usr/local/ /usr/local/ # buildkit

COPY /tmp/llama-swap /usr/bin/llama-swap # buildkit

RUN |1 DEBIAN_FRONTEND=noninteractive /bin/sh -c mkdir -p /opt/rocm/amdgcn && ln -sf /opt/rocm/lib/llvm/amdgcn/bitcode /opt/rocm/amdgcn/bitcode # buildkit

RUN |1 DEBIAN_FRONTEND=noninteractive /bin/sh -c printf '%s\n' /usr/local/lib /opt/rocm/lib /opt/rocm/lib/rocm_sysdeps/lib /opt/rocm/lib/llvm/lib > /etc/ld.so.conf.d/llama-rocm.conf && ldconfig # buildkit

RUN |1 DEBIAN_FRONTEND=noninteractive /bin/sh -c ln -sf /usr/local/bin/llama-server /usr/bin/llama-server && ln -sf /usr/local/bin/llama-cli /usr/bin/llama-cli && ln -sf /usr/local/bin/llama-quantize /usr/bin/llama-quantize # buildkit

RUN |1 DEBIAN_FRONTEND=noninteractive /bin/sh -c echo "=== ldd llama-server (must show no 'not found' lines) ===" && ldd /usr/local/bin/llama-server | tee /tmp/ldd-server.txt && ! grep -q "not found" /tmp/ldd-server.txt && echo "=== binaries ===" && ls -la /usr/bin/llama-swap /usr/bin/llama-server && env -u LD_LIBRARY_PATH /usr/local/bin/llama-server --version && llama-swap --help 2>&1 | head -3 || true && echo "=== ROCm footprint ===" && du -sh /opt/rocm # buildkit

ENV ROCM_PATH=/opt/rocm HIP_PATH=/opt/rocm HIP_PLATFORM=amd HIP_DEVICE_LIB_PATH=/opt/rocm/amdgcn/bitcode PATH=/opt/rocm/bin:/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin HSA_OVERRIDE_GFX_VERSION=11.5.1 HIP_VISIBLE_DEVICES=0 GPU_DEVICE_ORDINAL=0 ROCBLAS_USE_HIPBLASLT=1 HSA_ENABLE_SDMA=0 OCL_SET_SVM_SIZE=262144

EXPOSE [8080/tcp]

ENTRYPOINT ["/usr/bin/llama-swap"]

CMD ["--config" "/config/llama-swap/config.yaml" "--listen" "0.0.0.0:8080"]

Key	Value
backend	rocm7-nightlies-hip-slim
description	llama-swap + llama-server (slim, ROCm 7 nightlies HIP, gfx1151, PR #21760 Gemma 4 fix)
gemma4fix.revisit	Rebuild from clean upstream release once PR #21760 merges
gemma4fix.source	https://github.com/ggml-org/llama.cpp/pull/21760
gpu.target	gfx1151
maintainer	citizendaniel
org.opencontainers.image.version	24.04

Details

Container

2026-05-02 20:01:55 +00:00

OCI / Docker

linux/amd64

271 MiB

Versions (1) View all

rocm7-nightlies-b8753-gemma4fix2-slim

2026-05-02

llama-swap-rocm (rocm7-nightlies-b8753-gemma4fix2-slim)

Installation

Image Layers

Labels