- Docker must be installed and running on your system.
- For CUDA:
- The NVIDIA container toolkit must be installed.
The following image flavors are available for this project:
- full: This image provides the main tools cli and server and test binaries in one image. When running the container, the first argument selects the tool to execute.
Build with the default CUDA 12.x version. See .devops/cuda.Dockerfile.
docker build -f .devops/cuda.Dockerfile -t local/audiocpp:full-cuda .Build with a specific CUDA version, for example 13.2.0:
docker build -f .devops/cuda.Dockerfile -t local/audiocpp:full-cuda --build-arg CUDA_VERSION=13.2.0 .docker build -f .devops/cpu.Dockerfile -t local/audiocpp:full-cpu .The model directory <models-dir> must be mounted into the container.
An additional <output-dir> should be mounted for TTS tasks.
docker run --rm --gpus all -v "<models-dir>:/models:ro" local/audiocpp:full-cuda <cli|server> <...>docker run --rm -v "<models-dir>:/models:ro" local/audiocpp:full-cpu <cli|server> <...>See the fully working examples below.
Examples for Docker, including CUDA and CPU, are available in examples/docker.
Generate speech through the audio.cpp CLI running in Docker.
See EXAMPLE.md in examples/docker/cli.
Generate speech through the audio.cpp server running in Docker Compose.
See EXAMPLE.md in examples/docker/server.