Skip to content

Lemonade environment (Ubuntu 24.04) ​

This page installs Lemonade Server on Ubuntu 24.04: OpenAI-compatible API plus Web UI. GPU uses llama.cpp; NPU uses FastFlowLM. Model pull lives in 01-Deploy.

Official docs: Ubuntu install · Linux NPU / FLM

Driver and IOMMU details: FastFlowLM environment. Lemonade only calls an already-installed flm.


Validated baseline (2026-09-16) ​

ItemValue
Packagelemonade-server 11.9.0~24.04
CLIlemonade version 11.9.0
Server/usr/bin/lemond, default 13305
OpenAIhttp://127.0.0.1:13305/api/v1 (some clients also try /v1)
GPU backendllamacpp:vulkan (on kernel 6.17, llamacpp:rocm reported Linux kernel missing support)
NPU backendthis tutorial recommends native FastFlowLM on 8219 (see below)
systemdlemond.service, working directory /var/lib/lemonade

1. Install the server ​

bash
sudo add-apt-repository -y ppa:lemonade-team/stable
sudo apt update
sudo apt install -y lemonade-server
bash
lemonade --version
lemonade status

You should see lemonade version 11.9.0 (or newer). When the server is up: Server is running on port 13305. Open http://127.0.0.1:13305.

APT usually enables lemond.service (user lemonade, ProtectHome=yes). To stop:

bash
sudo systemctl stop lemond
sudo systemctl disable --now lemond   # optional: no autostart

⚠️ The unit name is lemond, not lemonade-server.


2. Install inference backends ​

bash
lemonade backends
lemonade backends install llamacpp:vulkan   # skip if already installed
lemonade backends

llamacpp:rocm needs a kernel that meets gfx1151 Linux. Otherwise use Vulkan.

About flm:npu:

  • lemonade backends install flm:npu downloads FLM from GitHub and often times out in mainland China.
  • Even with a system flm, lemond.service runs as lemonade with ProtectHome=yes, so it cannot read ~/.config/flm.
  • This tutorial therefore runs NPU via FastFlowLM + flm serve on 8219.
  • If you run lemond in the foreground as your login user (no ProtectHome) and successfully install flm:npu, you can try lemonade load <flm-tag>.

Do not source /opt/rocm on Lemonade’s NPU path.


3. Health check ​

bash
lemonade --version
lemonade status
lemonade backends
ss -tlnp | grep 13305

Optional: bash src/npu/scripts/check_lemonade.sh. For NPU also run bash src/npu/scripts/check_flm_npu.sh after unsetting ROCm paths.


4. Common commands ​

CommandRole
lemonade backendsinstalled / available backends
lemonade statusserver on 13305, loaded model
lemonade listcatalog; --downloaded for local only
lemonade pull NAMEdownload (--source modelscope in China)
lemonade load NAMEload into the server
lemonade unloadunload
lemonade run NAMEload + open Web UI
lemonade chatterminal REPL

GPU backend pin:

bash
lemonade load Gemma-4-E4B-it-GGUF --llamacpp vulkan

5. Ports in this tutorial ​

PortUse
13305Lemonade Server
8219native flm serve (exclusive with Lemonade NPU)

Next: Gemma 4 Lemonade GPU · Gemma 4 Lemonade NPU · NPU troubleshooting