IMTI

Architecting, Developing, SRE, DevOps, AI/ML

The Two Failure Modes That Break Your AI Data Agent

A Case Study in Agent Psychology

What building an MCP-powered data platform taught me about why LLMs ignore the instructions you spent months writing.

Posted by Craig Johnston Thursday, February 26, 2026

PostgreSQL to OpenSearch with PySpark on Kubernetes

Date-windowed ETL, idempotent upserts, and CronJob scheduling

Moving analytics data from a Zalando-managed PostgreSQL cluster into OpenSearch for full-text search and dashboarding looks simple on paper. In practice, it requires date-windowed reads over JDBC, deterministic document IDs, CronJob scheduling, and Kubernetes secret injection. This article documents the full pattern.

Posted by Craig Johnston Wednesday, February 25, 2026

Apache NiFi: Production Kubernetes Deployment

Apache NiFi Part 1

This article covers deploying Apache NiFi on Kubernetes for production workloads: a clustered deployment with ZooKeeper, persistent storage, and proper ingress handling.

Posted by Craig Johnston Saturday, July 30, 2022

FEATURED TAGS
ai apache nifi blockchain claude data data engineering data science development devops docker elasticsearch go golang ingress iot json kubectl kubefwd kubernetes linear algebra linear algebra: golang linear algebra: python machine learning math matrices mcp microservices python raspberry pi security testing utils
ABOUT ME

I lead a talented team of software development and creative engineers, covering many industries looking to collect, analyze, move, buffer, queue, process and present data in significant ways. My expertise and that of my team revolve around microservices, artificial intelligence, algorithms, and machine learning.

BOOKMARKS
PROJECTS
STACK