4lt/docker-compose-cookbooks
1
0
Fork 0
mirror of https://github.com/nickyeoman/docker-compose-cookbooks.git synced 2026-09-03 18:36:22 +00:00
Code Issues Packages Projects Releases Wiki Activity

updated ollama

Browse Source
This commit is contained in:
nick
2024-08-06 18:11:55 -07:00
parent 0e0730f7af
commit 407594cadc
2 changed files with 18 additions and 14 deletions
Download Patch File Download Diff File Expand all files Collapse all files
ollama/README.md
+9 -6
View File
@@ -1,13 +1,16 @@
# Ollama
**WORK IN PROGRESS**
Dockerhub: https://hub.docker.com/r/ollama/ollama
## Preperation
```
sudo yum install -y nvidia-container-toolkit
```
You need to have nvidia-drivers, cuda and nvidia-container-toolkit
installed before proceeding.
docker run -d --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama
docker run for refrence:
```
docker run -d --runtime=nvidia --gpus=all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollama
podman exec -it ollama ollama pull llama3
podman exec -it ollama ollama run llama3
```