4 Installing applications from AI Library #

affinity

object

{}

Affinity for pod assignment

autoscaling.enabled

bool

false

Enable autoscaling

autoscaling.maxReplicas

int

100

Number of maximum replicas

autoscaling.minReplicas

int

1

Number of minimum replicas

autoscaling.targetCPUUtilizationPercentage

int

80

CPU usage to target replica

extraArgs

list

[]

Additional arguments on the output Deployment definition.

extraEnv

list

[]

Additional environment variables on the output Deployment definition.

fullnameOverride

string

""

String to fully override template

global.imagePullSecrets

list

[]

Global override for container image registry pull secrets

global.imageRegistry

string

""

Global override for container image registry

hostIPC

bool

false

Use the host’s IPC namespace

hostNetwork

bool

false

Use the host’s network namespace

hostPID

bool

false

Use the host’s PID namespace.

image.pullPolicy

string

"IfNotPresent"

Image pull policy to use for the Ollama container

image.registry

string

"dp.apps.rancher.io"

Image registry to use for the Ollama container

image.repository

string

"containers/ollama"

Image repository to use for the Ollama container

image.tag

string

"0.3.6"

Image tag to use for the Ollama container

imagePullSecrets

list

[]

Docker registry secret names as an array

ingress.annotations

object

{}

Additional annotations for the Ingress resource

ingress.className

string

""

IngressClass that is used to implement the Ingress (Kubernetes 1.18+)

ingress.enabled

bool

false

Enable Ingress controller resource

ingress.hosts[0].host

string

"ollama.local"

ingress.hosts[0].paths[0].path

string

"/"

ingress.hosts[0].paths[0].pathType

string

"Prefix"

ingress.tls

list

[]

The TLS configuration for host names to be covered with this Ingress record

initContainers

list

[]

Init containers to add to the pod

knative.containerConcurrency

int

0

Knative service container concurrency

knative.enabled

bool

false

Enable Knative integration

knative.idleTimeoutSeconds

int

300

Knative service idle timeout seconds

knative.responseStartTimeoutSeconds

int

300

Knative service response start timeout seconds

knative.timeoutSeconds

int

300

Knative service timeout seconds

livenessProbe.enabled

bool

true

Enable livenessProbe

livenessProbe.failureThreshold

int

6

Failure threshold for livenessProbe

livenessProbe.initialDelaySeconds

int

60

Initial delay seconds for livenessProbe

livenessProbe.path

string

"/"

Request path for livenessProbe

livenessProbe.periodSeconds

int

10

Period seconds for livenessProbe

livenessProbe.successThreshold

int

1

Success threshold for livenessProbe

livenessProbe.timeoutSeconds

int

5

Timeout seconds for livenessProbe

nameOverride

string

""

String to partially override template (maintains the release name)

nodeSelector

object

{}

Node labels for pod assignment

ollama.gpu.enabled

bool

false

Enable GPU integration

ollama.gpu.number

int

1

Specify the number of GPUs

ollama.gpu.nvidiaResource

string

"nvidia.com/gpu"

Only for NVIDIA cards; change to nvidia.com/mig-1g.10gb to use MIG slice

ollama.gpu.type

string

"nvidia"

GPU type: 'nvidia' or 'amd.' If 'ollama.gpu.enabled' is enabled, the default value is 'nvidia.' If set to 'amd,' this adds the 'rocm' suffix to the image tag if 'image.tag' is not override. This is because AMD and CPU/CUDA are different images.

ollama.insecure

bool

false

Add insecure flag for pulling at container startup

ollama.models

list

[]

List of models to pull at container startup. The more you add, the longer the container takes to start if models are not present models: - llama2 - mistral

ollama.mountPath

string

""

Override ollama-data volume mount path, default: "/root/.ollama"

persistentVolume.accessModes

list

["ReadWriteOnce"]

Ollama server data Persistent Volume access modes. Must match those of existing PV or dynamic provisioner, see https://kubernetes.io/docs/concepts/storage/persistent-volumes/.

persistentVolume.annotations

object

{}

Ollama server data Persistent Volume annotations

persistentVolume.enabled

bool

false

Enable persistence using PVC

persistentVolume.existingClaim

string

""

If you want to bring your own PVC for persisting Ollama state, pass the name of the created + ready PVC here. If set, this Chart does not create the default PVC. Requires server.persistentVolume.enabled: true

persistentVolume.size

string

"30Gi"

Ollama server data Persistent Volume size

persistentVolume.storageClass

string

""

If persistentVolume.storageClass is present, and is set to either a dash ('-') or empty string (''), dynamic provisioning is disabled. Otherwise, the storageClassName for persistent volume claim is set to the given value specified by persistentVolume.storageClass. If persistentVolume.storageClass is absent, the default storage class is used for dynamic provisioning whenever possible. See https://kubernetes.io/docs/concepts/storage/storage-classes/ for more details.

persistentVolume.subPath

string

""

Subdirectory of Ollama server data Persistent Volume to mount. Useful if the volume’s root directory is not empty.

persistentVolume.volumeMode

string

""

Ollama server data Persistent Volume Binding Mode. If empty (the default) or set to null, no volumeBindingMode specification is set, choosing the default mode.

persistentVolume.volumeName

string

""

Ollama server Persistent Volume name. It can be used to force-attach the created PVC to a specific PV.

podAnnotations

object

{}

Map of annotations to add to the pods

podLabels

object

{}

Map of labels to add to the pods

podSecurityContext

object

{}

Pod Security Context

readinessProbe.enabled

bool

true

Enable readinessProbe

readinessProbe.failureThreshold

int

6

Failure threshold for readinessProbe

readinessProbe.initialDelaySeconds

int

30

Initial delay seconds for readinessProbe

readinessProbe.path

string

"/"

Request path for readinessProbe

readinessProbe.periodSeconds

int

5

Period seconds for readinessProbe

readinessProbe.successThreshold

int

1

Success threshold for readinessProbe

readinessProbe.timeoutSeconds

int

3

Timeout seconds for readinessProbe

replicaCount

int

1

Number of replicas

resources.limits

object

{}

Pod limit

resources.requests

object

{}

Pod requests

runtimeClassName

string

""

Specify runtime class

securityContext

object

{}

Container Security Context

service.annotations

object

{}

Annotations to add to the service

service.nodePort

int

31434

Service node port when service type is 'NodePort'

service.port

int

11434

Service port

service.type

string

"ClusterIP"

Service type

serviceAccount.annotations

object

{}

Annotations to add to the service account

serviceAccount.automount

bool

true

Whether to automatically mount a ServiceAccount’s API credentials

serviceAccount.create

bool

true

Whether a service account should be created

serviceAccount.name

string

""

The name of the service account to use. If not set and 'create' is 'true', a name is generated using the full name template.

tolerations

list

[]

Tolerations for pod assignment

topologySpreadConstraints

object

{}

Topology Spread Constraints for pod assignment

updateStrategy

object

{"type":""}

How to replace existing pods.

updateStrategy.type

string

""

Can be 'Recreate' or 'RollingUpdate'; default is 'RollingUpdate'

volumeMounts

list

[]

Additional volumeMounts on the output Deployment definition

volumes

list

[]

Additional volumes on the output Deployment definition

affinity

object

{}

Affinity for pod assignment

annotations

object

{}

cert-manager.enabled

bool

true

clusterDomain

string

"cluster.local"

Value of cluster domain

containerSecurityContext

object

{}

Configure container security context, see https://kubernetes.io/docs/tasks/configure-pod-container/security-context/#set-the-security-context-for-a-containe.

extraEnvVars

list

[{"name":"OPENAI_API_KEY", "value":"0p3n-w3bu!"}]

Environment variables added to the Open WebUI deployment. Most up-to-date environment variables can be found in Environment Variable Configuration.

extraEnvVars[0]

object

{"name":"OPENAI_API_KEY","value":"0p3n-w3bu!"}

Default API key value for Pipelines. It should be updated in a production deployment and changed to the required API key if not using Pipelines.

global.imagePullSecrets

list

[]

Global override for container image registry pull secrets

global.imageRegistry

string

""

Global override for container image registry

global.tls.additionalTrustedCAs

bool

false

global.tls.issuerName

string

"suse-private-ai"

global.tls.letsEncrypt.email

string

"none@example.com"

global.tls.letsEncrypt.environment

string

"staging"

global.tls.letsEncrypt.ingress.class

string

""

global.tls.source

string

"suse-private-ai"

The source of Open WebUI TLS keys, see Section 4.8.6.1, “TLS sources”.

image.pullPolicy

string

"IfNotPresent"

Image pull policy to use for the Open WebUI container

image.registry

string

"dp.apps.rancher.io"

Image registry to use for the Open WebUI container

image.repository

string

"containers/open-webui"

Image repository to use for the Open WebUI container

image.tag

string

"0.3.32"

Image tag to use for the Open WebUI container

imagePullSecrets

list

[]

Configure imagePullSecrets to use private registry, see https://kubernetes.io/docs/tasks/configure-pod-container/pull-image-private-registry/.

ingress.annotations

object

{"nginx.ingress.kubernetes.io/ssl-redirect":"true"}

Use appropriate annotations for your Ingress controller, such as nginx.ingress.kubernetes.io/rewrite-target: / for NGINX.

ingress.class

string

""

ingress.enabled

bool

true

ingress.existingSecret

string

""

ingress.host

string

""

ingress.tls

bool

true

nameOverride

string

""

nodeSelector

object

{}

Node labels for pod assignment

ollama.enabled

bool

true

Automatically install Ollama Helm chart from \oci://dp.apps.rancher.io/charts/ollama. Configure the following Helm values.

ollama.fullnameOverride

string

"open-webui-ollama"

If enabling embedded Ollama, update fullnameOverride to your desired Ollama name value, or else it will use the default ollama.name value from the Ollama chart.

ollamaUrls

list

[]

A list of Ollama API endpoints. These can be added instead of automatically installing the Ollama Helm chart, or in addition to it.

openaiBaseApiUrl

string

""

OpenAI base API URL to use. Defaults to the Pipelines service endpoint when Pipelines are enabled, or to https://api.openai.com/v1 if Pipelines are not enabled and this value is blank.

persistence.accessModes

list

["ReadWriteOnce"]

If using multiple replicas, you must update accessModes to ReadWriteMany.

persistence.annotations

object

{}

persistence.enabled

bool

true

persistence.existingClaim

string

""

Use existingClaim to reuse an existing Open WebUI PVC instead of creating a new one.

persistence.selector

object

{}

persistence.size

string

"2Gi"

persistence.storageClass

string

""

pipelines.enabled

bool

false

Automatically install Pipelines chart to extend Open WebUI functionality using Pipelines.

pipelines.extraEnvVars

list

[]

This section can be used to pass the required environment variables to your pipelines (such as the Langfuse host name).

podAnnotations

object

{}

podSecurityContext

object

{}

Configure pod security context, see https://kubernetes.io/docs/tasks/configure-pod-container/security-context/#set-the-security-context-for-a-containe.

replicaCount

int

1

resources

object

{}

service

object

{"annotations":{},"containerPort":8080, "labels":{},"loadBalancerClass":"", "nodePort":"","port":80,"type":"ClusterIP"}

Service values to expose Open WebUI pods to cluster

tolerations

list

[]

Tolerations for pod assignment

topologySpreadConstraints

list

[]

Topology Spread Constraints for pod assignment

global.imageRegistry

string

""

Global override for the container-image registry used by all chart images.

global.imagePullSecrets

list(string)

[]

Global list of image-pull secrets to attach to all pods.

image.registry

string

dp.apps.rancher.io

Registry that hosts the PyTorch container image.

image.repository

string

containers/pytorch

Repository name (path) of the PyTorch container image.

image.tag

string

"2.5.0-nvidia"

Image tag to deploy (CUDA/NVIDIA build by default).

image.pullPolicy

string

IfNotPresent

Kubernetes pull policy for the PyTorch image.

imagePullSecrets

list(string)

[]

Additional pull secrets (overrides global.imagePullSecrets).

nameOverride

string

""

Replace the chart name in resource names.

fullnameOverride

string

""

Fully override the generated release name.

gpu.enabled

bool

false

Enable GPU scheduling and automatically add device requests/limits.

gpu.type

string

"nvidia"

GPU vendor: 'nvidia' or 'amd'. If set to 'amd', a rocm image tag is inferred.

gpu.number

int

1

Number of full GPUs requested (ignored when MIG is used).

gpu.nvidiaResource

string

http://nvidia.com/gpu

Requested resource name; change to a MIG slice (e.g. http://nvidia.com/mig-1g.10gb) to schedule MIG devices.

gpu.mig.enabled

bool

false

Enable explicit specification of multiple MIG device types.

gpu.mig.devices

map

{}

Map of MIG-slice-name → count pairs (e.g. 1g.10gb: 1).

podAnnotations

map

{}

Custom annotations added to the PyTorch pod.

podLabels

map

{}

Additional labels added to the PyTorch pod.

podSecurityContext

map

{}

Pod-level security context (e.g. fsGroup).

securityContext

map

{}

Container-level security context (capabilities, runAsUser, etc.).

service.enabled

bool

false

Create a ClusterIP/NodePort/LoadBalancer service for the PyTorch container.

service.type

string

ClusterIP

Service type when service.enabled is true.

service.port

int

(unset)

External service port.

service.containerPort

int

(unset)

Target container port inside the pod.

service.nodePort

int/string

""

Fixed nodePort value (for type: NodePort).

service.loadBalancerIP

string

(unset)

Requested load-balancer IP.

service.loadBalancerClass

string

(unset)

Load-balancer implementation class.

service.annotations

map

{}

Extra annotations applied to the Service object.

serviceAccount.create

bool

false

Whether to create a dedicated ServiceAccount.

serviceAccount.automount

bool

true

Auto-mount ServiceAccount token in the pod.

serviceAccount.annotations

map

{}

Annotations added to the ServiceAccount.

http://serviceAccount.name

string

""

Explicit ServiceAccount name (otherwise auto-generated).

ingress.enabled

bool

false

Create an Ingress exposing the service.

ingress.className

string

""

Explicit IngressClass to use.

ingress.annotations

map

{}

Extra annotations for the Ingress.

ingress.hosts

list

[{host: chart-example.local, paths:[{/ , ImplementationSpecific}]}]

Default host and path definitions.

ingress.tls

list

[]

TLS blocks for the Ingress resource.

resources.requests

map

{}

Pod resource requests (CPU / memory / GPU).

resources.limits

map

{}

Pod resource limits (CPU / memory / GPU).

livenessProbe.enabled

bool

false

Enable liveness probe.

livenessProbe.initialDelaySeconds

int

5

Delay before first liveness probe.

livenessProbe.periodSeconds

int

5

Interval between liveness probes.

livenessProbe.timeoutSeconds

int

20

Probe timeout.

livenessProbe.failureThreshold

int

6

Consecutive failures before restart.

livenessProbe.successThreshold

int

1

Successes needed to mark pod healthy.

readinessProbe.enabled

bool

false

Enable readiness probe.

readinessProbe.initialDelaySeconds

int

5

Delay before first readiness probe.

readinessProbe.periodSeconds

int

5

Interval between readiness probes.

readinessProbe.timeoutSeconds

int

20

Probe timeout.

readinessProbe.failureThreshold

int

6

Consecutive failures before marking pod unready.

readinessProbe.successThreshold

int

1

Successes required to mark pod ready.

volumes

list

[]

Extra Kubernetes volumes attached to the deployment.

volumeMounts

list

[]

Extra volumeMounts in the container spec.

nodeSelector

map

{}

Node-selector labels for pod scheduling.

tolerations

list

[]

Tolerations added to the pod spec.

affinity

map

{}

Affinity/anti-affinity rules for the pod.

entrypointscript.filename

string

""

Name (and path) of a startup script inside the container.

entrypointscript.arguments

list(string)

[]

CLI arguments passed to the entry point script.

persistence.enabled

bool

false

Provision a PVC to persist data (e.g. checkpoints).

persistence.accessModes

list(string)

["ReadWriteOnce"]

Access modes for the PVC.

persistence.annotations

map

{}

Annotations applied to the PVC.

persistence.existingClaim

string

""

Use an existing PVC instead of creating a new one.

persistence.size

string

30Gi

Requested storage size for the PVC.

persistence.storageClass

string

""

StorageClass used for dynamic provisioning ("" → default).

persistence.volumeMode

string

""

Optional PV volumeMode.

persistence.subPath

string

""

Subdirectory within the PV to mount.

persistence.volumeName

string

""

Bind the PVC to a pre-existing PV by name.

gitClone.enabled

bool

false

Clone a Git repository into the container at startup.

gitClone.repository

string

""

Repository to clone (http://github.com/org/REPO, no protocol).

gitClone.revision

string

""

Branch, tag, or commit to checkout.

gitClone.secretName

string

""

Name of a Secret containing Git credentials (username/password or token).

configMapExtFiles

string

""

Name of the ConfigMap whose files will be mounted into the container.

Name

Description

Value

global.imagePullSecrets

Global override for container image registry pull secrets

[]

global.imageRegistry

Global override for container image registry

""

replicaCount

The number of LiteLLM Proxy pods to be deployed

1

masterkeySecretName

The name of the Kubernetes Secret that contains the Master API Key for LiteLLM. If not specified, use the generated secret name.

N/A

masterkeySecretKey

The key within the Kubernetes Secret that contains the Master API Key for LiteLLM. If not specified, use masterkey as the key.

N/A

masterkey

The Master API Key for LiteLLM. If not specified, a random key in the sk-…​ format is generated.

N/A

environmentSecrets

An optional array of Secret object names. The keys and values in these secrets will be presented to the LiteLLM proxy pod as environment variables. See below for an example Secret object.

[]

image.registry

LiteLLM Proxy image registry

registry.suse.com

image.repository

LiteLLM Proxy image repository

ai/containers/litellm

image.pullPolicy

LiteLLM Proxy image pull policy

IfNotPresent

image.tag

Overrides the image tag whose default is the latest version of LiteLLM at the time this chart was published.

""

imagePullSecrets

Registry credentials for the LiteLLM and initContainer images.

[]

serviceAccount.create

Whether or not to create a Kubernetes Service Account for this deployment. The default is false because LiteLLM has no need to access the Kubernetes API.

false

service.type

Kubernetes Service type (e.g. LoadBalancer, ClusterIP, etc.)

ClusterIP

service.port

TCP port on which the Kubernetes Service will listen. Also, the TCP port within the Pod on which the proxy will listen.

4000

service.loadBalancerClass

Optional LoadBalancer implementation class (only used when service.type is LoadBalancer)

""

ingress.labels

Additional labels for the Ingress resource

{}

ingress.*

See values.yaml for example settings

N/A

proxyConfigMap.create

When true, render a ConfigMap from .Values.proxy_config and mount it.

true

proxyConfigMap.name

When create=false, the name of the existing ConfigMap to mount.

""

proxyConfigMap.key

Key in the ConfigMap that contains the proxy config file.

"config.yaml"

proxy_config.*

See values.yaml for default settings. Rendered into the ConfigMap’s config.yaml only when proxyConfigMap.create=true. See example_config_yaml for configuration examples.

N/A

extraContainers[]

An array of additional containers to be deployed as sidecars alongside the LiteLLM Proxy.

pdb.enabled

Enable a PodDisruptionBudget for the LiteLLM proxy Deployment

false

pdb.minAvailable

Minimum number/percentage of pods that must be available during voluntary disruptions (choose one of minAvailable/maxUnavailable)

null

pdb.maxUnavailable

Maximum number/percentage of pods that can be unavailable during voluntary disruptions (choose one of minAvailable/maxUnavailable)

null

pdb.annotations

Extra metadata annotations to add to the PDB

{}

pdb.labels

Extra metadata labels to add to the PDB

{}