Portainer Templates logo

Portainer Templates

Redpanda

Stack

Streaming Messaging

3-broker Redpanda cluster (Kafka-compatible, no ZooKeeper/JVM) with Redpanda Console, deployable locally with plain Docker Compose or to Miget as a compose stack.

Configuration

Type
Compose
Platform
linux
Source
Repo

Template by deployable-sh·Source

Report issue

Services

rp-1

Configuration

Image
docker.redpanda.com/redpandadata/redpanda:v24.3.1
Command
redpanda,start,--mode=dev-container,--smp=1,--memory=1G,--reserve-memory=0M,--seeds=rp-1:33145,rp-2:33145,rp-3:33145,--kafka-addr=0.0.0.0:9092,--advertise-kafka-addr=rp-1:9092,--rpc-addr=0.0.0.0:33145,--advertise-rpc-addr=rp-1:33145,--pandaproxy-addr=0.0.0.0:8082,--advertise-pandaproxy-addr=rp-1:8082,--schema-registry-addr=0.0.0.0:8081
Ports
90923314580818082
Volumes
/var/lib/redpanda/data : rpdata-1
Restart
unless-stopped

rp-2

Configuration

Image
docker.redpanda.com/redpandadata/redpanda:v24.3.1
Command
redpanda,start,--mode=dev-container,--smp=1,--memory=1G,--reserve-memory=0M,--seeds=rp-1:33145,rp-2:33145,rp-3:33145,--kafka-addr=0.0.0.0:9092,--advertise-kafka-addr=rp-2:9092,--rpc-addr=0.0.0.0:33145,--advertise-rpc-addr=rp-2:33145,--pandaproxy-addr=0.0.0.0:8082,--advertise-pandaproxy-addr=rp-2:8082,--schema-registry-addr=0.0.0.0:8081
Ports
90923314580818082
Volumes
/var/lib/redpanda/data : rpdata-2
Restart
unless-stopped

rp-3

Configuration

Image
docker.redpanda.com/redpandadata/redpanda:v24.3.1
Command
redpanda,start,--mode=dev-container,--smp=1,--memory=1G,--reserve-memory=0M,--seeds=rp-1:33145,rp-2:33145,rp-3:33145,--kafka-addr=0.0.0.0:9092,--advertise-kafka-addr=rp-3:9092,--rpc-addr=0.0.0.0:33145,--advertise-rpc-addr=rp-3:33145,--pandaproxy-addr=0.0.0.0:8082,--advertise-pandaproxy-addr=rp-3:8082,--schema-registry-addr=0.0.0.0:8081
Ports
90923314580818082
Volumes
/var/lib/redpanda/data : rpdata-3
Restart
unless-stopped

redpanda-console

Configuration

Image
docker.redpanda.com/redpandadata/console:v2.8.0
Ports
5000:5000
Env vars
KAFKA_BROKERS=rp-1:9092,rp-2:9092,rp-3:9092SERVER_LISTENPORT=5000
Restart
unless-stopped

Standalone Install

Select an install method, to see config/commands for deploying Redpanda

Installation method

Install on Portainer

Import all app templates into your Portainer instance, for easy 1-click deploys

  1. Ensure both Docker and Portainer are installed, and up-to-date
  2. Log into your Portainer web UI
  3. Under Settings → App Templates, paste the below URL
  4. Head to Home → App Templates, and the list of apps will show up
  5. Select Redpanda, fill in any config options, and hit Deploy

Template Import URL

https://raw.githubusercontent.com/Lissy93/portainer-templates/main/templates.json
Show Me demo
Original stackfile

The compose file this template deploys, straight from its repo:

name: redpanda

x-rp: &rp
  image: docker.redpanda.com/redpandadata/redpanda:v24.3.1
  restart: unless-stopped

services:
  rp-1:
    <<: *rp
    command:
      - redpanda
      - start
      - --mode=dev-container
      - --smp=1
      - --memory=1G
      - --reserve-memory=0M
      - --seeds=rp-1:33145,rp-2:33145,rp-3:33145
      - --kafka-addr=0.0.0.0:9092
      - --advertise-kafka-addr=rp-1:9092
      - --rpc-addr=0.0.0.0:33145
      - --advertise-rpc-addr=rp-1:33145
      - --pandaproxy-addr=0.0.0.0:8082
      - --advertise-pandaproxy-addr=rp-1:8082
      - --schema-registry-addr=0.0.0.0:8081
    ports:
      - "9092"
      - "33145"
      - "8081"
      - "8082"
    volumes:
      - rpdata-1:/var/lib/redpanda/data

  rp-2:
    <<: *rp
    command:
      - redpanda
      - start
      - --mode=dev-container
      - --smp=1
      - --memory=1G
      - --reserve-memory=0M
      - --seeds=rp-1:33145,rp-2:33145,rp-3:33145
      - --kafka-addr=0.0.0.0:9092
      - --advertise-kafka-addr=rp-2:9092
      - --rpc-addr=0.0.0.0:33145
      - --advertise-rpc-addr=rp-2:33145
      - --pandaproxy-addr=0.0.0.0:8082
      - --advertise-pandaproxy-addr=rp-2:8082
      - --schema-registry-addr=0.0.0.0:8081
    ports:
      - "9092"
      - "33145"
      - "8081"
      - "8082"
    volumes:
      - rpdata-2:/var/lib/redpanda/data

  rp-3:
    <<: *rp
    command:
      - redpanda
      - start
      - --mode=dev-container
      - --smp=1
      - --memory=1G
      - --reserve-memory=0M
      - --seeds=rp-1:33145,rp-2:33145,rp-3:33145
      - --kafka-addr=0.0.0.0:9092
      - --advertise-kafka-addr=rp-3:9092
      - --rpc-addr=0.0.0.0:33145
      - --advertise-rpc-addr=rp-3:33145
      - --pandaproxy-addr=0.0.0.0:8082
      - --advertise-pandaproxy-addr=rp-3:8082
      - --schema-registry-addr=0.0.0.0:8081
    ports:
      - "9092"
      - "33145"
      - "8081"
      - "8082"
    volumes:
      - rpdata-3:/var/lib/redpanda/data

  redpanda-console:
    image: docker.redpanda.com/redpandadata/console:v2.8.0
    restart: unless-stopped
    environment:
      KAFKA_BROKERS: rp-1:9092,rp-2:9092,rp-3:9092
      SERVER_LISTENPORT: "5000"
    ports:
      - "5000:5000"
    depends_on:
      - rp-1
      - rp-2
      - rp-3

volumes:
  rpdata-1:
  rpdata-2:
  rpdata-3:

Or deploy it directly from the source:

git clone https://github.com/deployable-sh/stacks
cd stacks
docker compose -f redpanda/compose.yaml up -d

More install options in our documentation.

Serve Redpanda on your own domain behind Caddy, Nginx or Traefik. Fill in your domain and copy the result. It's a starting point, some apps need their own base URL or extra headers set too.

Proxying redpanda.example.com to http://rp-1:9092

Add this to your Caddyfile

redpanda.example.com {
	reverse_proxy http://rp-1:9092
}

Check the logs first

Nine times out of ten the logs tell you exactly what went wrong.

  • In Portainer, go to Containers, click the container, then Logs. Or run docker logs <container>
  • Exit codes help too: 137 means killed, usually out of memory. 126 or 127 means the command inside the image is broken.

Port already in use

If deployment fails with "Bind for 0.0.0.0:5000 failed: port is already allocated", something else on your server is using that port.

  • Find what's using it: sudo ss -tlnp | grep :5000
  • Stop the other service, or pick a different host port. In 5000:5000 only the left number is yours to change, the right one belongs to the app.

Published on a random port

This template exposes 9092 without setting a host port, so Docker picks a random free one on every deploy.

  • Find it in the Ports column of Portainer's container list, or with docker port <container>

Running but the page won't load

The container is up but nothing appears in your browser.

  • Use your server's real IP: http://your-server-ip:5000. The 0.0.0.0 link Portainer shows isn't a real address.
  • Give it a minute after first deploy, redpanda can take a while to initialise.
  • Make sure your firewall allows the port, e.g. sudo ufw allow 5000

Image won't pull

Test the pull directly on the host: docker pull docker.redpanda.com/redpandadata/redpanda:v24.3.1

  • "manifest unknown" means the tag no longer exists.
  • "toomanyrequests" is the Docker Hub rate limit. Log in with docker login to raise it.
  • "no space left on device" means a full disk. Reclaim space with docker system prune

"exec format error"

This means the image was built for a different CPU architecture than your server.

  • Check yours with uname -m: x86_64 is amd64, aarch64 is arm64. Raspberry Pi and other ARM boards are the usual culprits.

Container keeps restarting

The unless-stopped restart policy relaunches the app after every crash, so the real error can scroll past.

  • Check the logs right after a restart, the last few lines before it died are the useful ones.
  • Get the exit code with docker inspect <container> --format '{{.State.ExitCode}}'
  • Still stuck? Redeploy once with the restart policy set to no so the failure stays visible.

Stack won't deploy

Compose stacks fail fast on small mistakes, and Portainer shows the reason just above the editor.

  • YAML only accepts spaces for indentation, a single tab breaks the whole file.

Raise an issue

Found something which isn't working as it should? Here's how to report it.

A Compose stack

Redpanda is a Compose stack, a set of containers (4 of them) defined in one file and brought up together by Portainer, then started and stopped as a single app.

The services

This stack is built from 4 containers that run side by side. Here's each one, with the image it runs and anything it waits for first:

  • rp-1 runs docker.redpanda.com/redpandadata/redpanda:v24.3.1
  • rp-2 runs docker.redpanda.com/redpandadata/redpanda:v24.3.1
  • rp-3 runs docker.redpanda.com/redpandadata/redpanda:v24.3.1
  • redpanda-console runs docker.redpanda.com/redpandadata/console:v2.8.0, starts after rp-1, rp-2, rp-3

Ports

A port is the door the app answers on. A mapping like 5000:5000 means it's reachable on port 5000 of your server, where the left number is yours to change and the right one belongs to the app. It opens:

  • 9092, published on a random host port
  • 33145, published on a random host port
  • 8081, published on a random host port
  • 8082, published on a random host port
  • 9092, published on a random host port
  • 33145, published on a random host port
  • 8081, published on a random host port
  • 8082, published on a random host port
  • 9092, published on a random host port
  • 33145, published on a random host port
  • 8081, published on a random host port
  • 8082, published on a random host port
  • 5000:5000

Volumes

A volume is where Redpanda keeps its files so they survive an update or a restart. Without one, anything it saves would sit inside the container and vanish the moment it's recreated. This template mounts:

  • /var/lib/redpanda/data kept in the rpdata-1 volume Docker manages
  • /var/lib/redpanda/data kept in the rpdata-2 volume Docker manages
  • /var/lib/redpanda/data kept in the rpdata-3 volume Docker manages

Environment variables

Environment variables are the settings you hand over when you deploy, things like a password or a timezone. Redpanda takes 2 of them, all with defaults you can leave alone or tweak:

  • KAFKA_BROKERS, defaults to rp-1:9092,rp-2:9092,rp-3:9092
  • SERVER_LISTENPORT, defaults to 5000

Restart policy

The restart policy here is unless-stopped, so Docker restarts Redpanda after a crash or reboot, but leaves it off when you stop it on purpose. You can change this on the deploy screen. The choices are no (never restart), on-failure (only after a crash), unless-stopped (restart unless you stop it), and always (bring it back no matter what).

Networking

Portainer puts these services on one shared private network, so they can find each other by name (like rp-1) while only the ports above are open to you.

Platform

The platform is linux, the kind of system the container is built to run on. Docker and Portainer handle this on a normal Linux server.

Portainer app templates

Zooming out, this whole page comes from a Portainer app template: a short recipe telling Portainer how to set Redpanda up. Add the template list to Portainer once, then deploying Redpanda is a click rather than a wall of config.