mirror of
https://github.com/nickyeoman/docker-compose-cookbooks.git
synced 2026-09-04 10:56:23 +00:00
16 lines
399 B
Markdown
16 lines
399 B
Markdown
# Ollama
|
|
|
|
Dockerhub: https://hub.docker.com/r/ollama/ollama
|
|
|
|
## Preperation
|
|
|
|
You need to have nvidia-drivers, cuda and nvidia-container-toolkit
|
|
installed before proceeding.
|
|
|
|
docker run for refrence:
|
|
```
|
|
docker run -d --runtime=nvidia --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama
|
|
|
|
podman exec -it ollama ollama pull llama3
|
|
podman exec -it ollama ollama run llama3
|
|
``` |