Local LLMs: Running Ollama and Open WebUI in Docker on Ubuntu

2025-10-08 8 min read Tutorial AI Ollama Open WebUI Docker

Ollama is a popular tool for running large language models (LLMs) locally on your machine. It provides a simple interface to interact with various models without needing an internet connection. Open WebUI is a web-based user interface that allows you to interact with LLMs through a browser.

I am working on an Ubuntu 24.04.3 LTS Desktop machine with decent hardware to run models locally, so my preference is to run Ollama as a local service rather than confining it to a container. This way, Ollama can take full advantage of my machine’s capabilities, especially the GPU.

Deploying ARM64 workloads to AKS

2022-11-02 6 min read Tutorial

You might have heard by now that Azure has partnered with Ampere to bring ARM-based processors for virtual machines on Azure. This is super exciting as it gives you an opportunity to deploy workloads on highly performant and power efficient virtual machines and these characteristics ultimately result in excellent price-performance (lower costs 🥳)

So… are you ready to deploy your workloads to ARM64 node pools on AKS? I sure wasn’t when attempting to deploy the azure-voting-app-redis application to my cluster.

Local LLMs: Running Ollama and Open WebUI in Docker on Ubuntu

Deploying ARM64 workloads to AKS

Local LLMs: Running Ollama and Open WebUI in Docker on Ubuntu