Docker Compose Configuration

[avnigashi]

• 1. Create a docker-compose.yml file
• 2. Define services
• 3. Configure networks and volumes
• 4. Set environment variables
• 5. Update Package.json

[iimez]

node-llama-cpp released v3 including some new docs. this might be useful here https://node-llama-cpp.withcat.ai/guide/docker

i think we primarily need a dockerfile, but i see how a docker-compose config might be useful for development. could also publish that image to the hub, i'll create a repo for that sometime.

on the dockerfile:

• it should take an ARG that can be used to pass some JSON config into a default server implementation, which may be script that just picks it up and starts the model http server.
• users of the image should be able to either pass config into the arg or extend the docker image to override the implementation altogether