所有应用程序
人工智能与模型

Ollama

GPU recommended · Self-hosted only

使用持久模型库和私有推理 API 在您自己的服务器上运行语言模型。

CPU 或 NVIDIA

选择 CPU 模式或请求一个 NVIDIA GPU。

持久模型

在重新部署过程中保留下载的模型。

私有API

连接应用程序而无需发布未经身份验证的 API。

Run models on your server

Ollama provides a model API and stores downloads in a persistent volume. Choose CPU mode or one NVIDIA GPU during installation. GPU mode requires a compatible host driver and NVIDIA Container Toolkit; Openship does not install either or reserve GPU memory.

The model API stays private because Ollama does not authenticate requests. Use Open in localhost for a local client or Use in a project to connect another application. The template does not expose the API on a public domain.

Download a model

Open the service Terminal and run ollama pull qwen3:0.6b. Then use ollama run qwen3:0.6b or call the API. The template does not download a large model automatically or block deployment on that download. Check Logs while a model is loading; API readiness and model availability are different states.

Sizing depends on the model, context length and concurrent requests. The catalog's CPU/RAM guidance is a starting point, not a guarantee that every model fits. Models persist across container replacement; back up the volume if you need to preserve custom models.

This template is self-hosted only. CPU mode works without GPU access; the GPU request path is tested, but this template's GPU inference has not been independently tested on physical hardware.

Official Docker setup · Model library

包含在此模板中

由目录配置的服务作为一个项目一起部署。

ollama

ollama/ollama:0.40.4