Home Manager Manual

services.ollama.enable

Whether to enable ollama server for local large language models.

Type: boolean

Default:

false

Example:

true

Declared by:

• <home-manager/modules/services/ollama.nix>

services.ollama.package

The ollama package to use.

Type: package

Default:

pkgs.ollama

Declared by:

• <home-manager/modules/services/ollama.nix>

services.ollama.acceleration

What interface to use for hardware acceleration.

• null: default behavior

  • if nixpkgs.config.rocmSupport is enabled, uses "rocm"
  • if nixpkgs.config.cudaSupport is enabled, uses "cuda"
  • otherwise defaults to false

• false: disable GPU, only use CPU

• "rocm": supported by most modern AMD GPUs

  • may require overriding gpu type with services.ollama.rocmOverrideGfx if rocm doesn’t detect your AMD gpu

• "cuda": supported by most modern NVIDIA GPUs

Type: null or one of false, “rocm”, “cuda”

Default:

null

Example:

"rocm"

Declared by:

• <home-manager/modules/services/ollama.nix>

services.ollama.environmentVariables

Set arbitrary environment variables for the ollama service.

Be aware that these are only seen by the ollama server (systemd service), not normal invocations like ollama run. Since ollama run is mostly a shell around the ollama server, this is usually sufficient.

Type: attribute set of string

Default:

{ }

Example:

{
  HIP_VISIBLE_DEVICES = "0,1";
  OLLAMA_LLM_LIBRARY = "cpu";
}

Declared by:

• <home-manager/modules/services/ollama.nix>

services.ollama.host

The host address which the ollama server HTTP interface listens to.

Type: string

Default:

"127.0.0.1"

Example:

"[::]"

Declared by:

• <home-manager/modules/services/ollama.nix>

services.ollama.port

Which port the ollama server listens to.

Type: 16 bit unsigned integer; between 0 and 65535 (both inclusive)

Default:

11434

Example:

11111

Declared by:

• <home-manager/modules/services/ollama.nix>