Advanced Platform Development

SERIES · 28 NOTES · 2026

In 2020, Apress published my book Advanced Platform Development with Kubernetes, about five hundred pages that assembled a complete data platform out of open source on Kubernetes. The ideas held up. The specific technology did not. Weave Net is gone, ingress-nginx is retired, the Docker shim was removed from the kubelet, Kafka no longer needs ZooKeeper, and Elasticsearch changed its license in 2021. This series rebuilds the entire platform on what I would actually deploy now.

Every note is a complete build rather than a survey: the manifests, each configuration option that matters and the reason it is set that way, and what the component replaced. Read in order they assemble one platform, starting from generic VMs and running up through storage, ingress, databases, streaming, the lakehouse, observability, on-prem GPUs, and an MCP endpoint that gives agents grounded access to all of it. Any one of them also works on its own if you only need that piece.

The other thing that changed is who does the operating. The reason most teams rent a data warehouse was never that building one is hard. It is that running one is a full-time job, and that is the part agents now take on. The opening note makes that case, and it runs underneath everything that follows.

Advanced Platform Development
1

Build a Better Platform Than You're Renting

Cloud-grade data platforms from FOSS on Kubernetes, now that agents run the hard part
KUBERNETESDATAAIFOSS
2026-06-14
2

Build a Kubernetes Cluster You Own

The vendor-neutral substrate for a self-hosted platform: kubeadm, containerd, and Cilium on generic VMs
KUBERNETESFOSSPLATFORMDEVOPS
2026-06-21
3

Storage the Cluster Owns: Rook and Ceph

Portable block and shared-filesystem persistence for stateful services, no managed disks required
KUBERNETESFOSSPLATFORMSTORAGE
2026-06-23
4

Ingress-Nginx Retired. Meet the Gateway API.

Exposing services and automating TLS in 2026, with Cilium and cert-manager
KUBERNETESFOSSPLATFORMNETWORKING
2026-06-25
5

A Database You Own: Postgres with CloudNativePG

High-availability PostgreSQL on your own storage, without the managed bill
KUBERNETESFOSSPLATFORMPOSTGRESQL
2026-06-27
6

Kafka Without ZooKeeper: KRaft on Kubernetes with Strimzi

A real-time event backbone, without the separate ZooKeeper ensemble to operate
KUBERNETESFOSSPLATFORMKAFKA
2026-06-29
7

A Search Layer You Own: OpenSearch on Kubernetes

The index for the platform, on the Apache-licensed fork of Elasticsearch
KUBERNETESFOSSPLATFORMOPENSEARCH
2026-07-01
8

Self-Hosted S3 with SeaweedFS

S3-compatible object storage for the data lake, backups, and the lakehouse
KUBERNETESFOSSPLATFORMSTORAGE
2026-07-03
9

Your Own Snowflake: A Trino and Iceberg Lakehouse

SQL analytics over open table formats on the object storage you own
KUBERNETESFOSSPLATFORMTRINO
2026-07-05
10

Self-Hosted SSO with Keycloak

One login for every user-facing tool on the platform, instead of renting Okta or Auth0
KUBERNETESFOSSPLATFORMKEYCLOAK
2026-07-07
11

Self-Hosted Integration with Apache NiFi

Visual dataflow and ETL on your own cluster, instead of Workato and the iPaaS vendors
KUBERNETESFOSSPLATFORMAPACHE NIFI
2026-07-09
12

Self-Hosted BI with Apache Superset

Dashboards and SQL exploration over the lakehouse and Postgres, a Tableau replacement on the platform's SSO
KUBERNETESFOSSPLATFORMSUPERSET
2026-07-11
13

A Data Catalog Your Agents Can Read: DataHub

Metadata, lineage, and a business glossary over the whole platform
KUBERNETESFOSSPLATFORMDATAHUB
2026-07-13
14

The Agent Gateway to Your Platform: mcp-data-platform

An Apache-2.0 MCP server that gives frontier models access and grounded context to everything you built
KUBERNETESFOSSPLATFORMMCP
2026-07-15
15

Your Git Forge Belongs on Your Cluster: Forgejo

Self-hosted source, CI/CD, and a registry, on the lightweight fork that left its for-profit parent
KUBERNETESFOSSPLATFORMDEVOPS
2026-07-17
16

Build Images Inside Your Cluster, Without the Docker Socket

Rootless container builds in CI with BuildKit, and where supply-chain guardrails belong
KUBERNETESFOSSPLATFORMBUILDKIT
2026-07-19
17

GitOps: Git as the Source of Truth for Your Cluster

Argo CD and Flux, the deployment half the 2020 book left out, with manifests reconciled from a repo you own
KUBERNETESFOSSPLATFORMGITOPS
2026-07-21
18

containerd Without Docker: the Runtime Under Your Cluster

The container runtime the kubelet actually uses, and how to configure and debug it now that the Docker shim is gone
KUBERNETESFOSSPLATFORMCONTAINERD
2026-07-23
19

Cilium: One eBPF Data Plane for Networking, Security, and Encryption

The CNI that replaced Weave Net, kube-proxy, and a hand-rolled WireGuard overlay with a single component
KUBERNETESFOSSPLATFORMNETWORKING
2026-07-25
20

See the Whole Platform: Prometheus, Grafana, Loki, and OpenTelemetry

Self-hosted observability for everything you built, on the open standard instead of a per-host APM bill
KUBERNETESFOSSPLATFORMOBSERVABILITY
2026-07-27
21

IoT Ingest You Own: MQTT With Mosquitto on Kubernetes

Lightweight device messaging into the platform, bridged to Kafka, with the Mosquitto 2.0 change the old guides miss
KUBERNETESFOSSPLATFORMMQTT
2026-07-29
22

A Multi-User Data Lab: JupyterHub on Your Platform

Self-hosted notebooks for the whole team, on Keycloak SSO, wired to the lakehouse and every data source you own
KUBERNETESFOSSPLATFORMJUPYTERHUB
2026-07-31
23

Event-Driven Object Processing: Bucket Events to Jobs

Object storage that triggers work, a self-hosted answer to S3 plus Lambda on your own cluster
KUBERNETESFOSSPLATFORMSEAWEEDFS
2026-08-02
24

Write-Heavy and Always On: Cassandra and Scylla on Kubernetes

Running Cassandra and Scylla on K8ssandra and the Scylla Operator after Rook dropped its own
KUBERNETESFOSSPLATFORMCASSANDRA
2026-08-04
25

Serverless Without the Cloud: Knative on Your Cluster

Scale-to-zero functions you own, after OpenFaaS moved the good parts behind a paywall
KUBERNETESFOSSPLATFORMKNATIVE
2026-08-06
26

What Happened to the Blockchain Chapter

Why the chapter is cut from this rebuild, and where tamper-evidence lives in 2026
KUBERNETESFOSSPLATFORMBLOCKCHAIN
2026-08-08
27

One Cluster Across Clouds and Your Garage: Hybrid k3s With WireGuard

A single Kubernetes cluster spanning cloud regions and your own hardware, encrypted over the public internet
KUBERNETESFOSSPLATFORMK3S
2026-08-10
28

On-Prem GPUs in a Boring Kubernetes Cluster

Adding your own GPUs to the platform with the NVIDIA GPU Operator
KUBERNETESFOSSPLATFORMGPU
2026-08-12