System Design / Cloud / Code
Real-world system design, backend patterns, and practical guides for engineers who build at scale.
Browse all postsHow to design systems that reliably execute tasks taking seconds to hours -- covering async job queues, progress tracking, retry strategies, sagas, checkpointing, dead letter queues, idempotency, and distributed task orchestration with production code examples.
How to build real-time systems that handle millions of concurrent connections — covering WebSockets, SSE, pub/sub fan-out, presence tracking, backpressure, and reconnection strategies with production code examples.
How to design systems that efficiently upload, store, process, and serve large binary objects (images, videos, documents) at scale -- covering presigned URLs, chunked uploads, content pipelines, storage tiering, CDN delivery, and deduplication strategies.
A deep dive into the SAGA pattern for managing distributed transactions — covering orchestration vs choreography, compensation flows, state machines, and production-ready code examples in Node.js and Python.
A practical guide to scaling write-heavy systems — covering sharding strategies, write-ahead logs, async queues, event sourcing, LSM trees, and batching with architecture diagrams and production code.
A practical guide to choosing between AWS Lambda and containers (ECS/Kubernetes) for production workloads. Covers cold starts, cost modeling, architecture patterns, and the real tradeoffs I've learned shipping both.
A practical guide to scaling read-heavy systems — covering caching strategies, read replicas, CQRS, materialized views, and CDN edge caching with architecture diagrams and real code examples.
A practical, end-to-end guide to building a Retrieval-Augmented Generation (RAG) pipeline using LangChain, OpenAI embeddings, and a vector database. Covers chunking strategies, embedding models, retrieval tuning, prompt engineering, and evaluation.
Six battle-tested prompt engineering patterns for production LLM systems — system prompt layering, chain-of-thought, few-shot examples, output guardrails, prompt chaining, and eval-driven iteration. With real code, real failure modes, and the stuff nobody puts in tutorials.
How to create Jenkins pipeline using Jenkinsfile, and schedule job on cron schedule, not on code commit.
How to run Automation on Different Environment (Dev/Stage/Prod) by Jenkinsfile and Overriding Environment Variables. Also taking credentials.
Learn how to Git Clone Another Repository from Jenkin Pipeline in Jenkinsfile.
Learn how to Fetch Multiple Credentials and Expose them in Environment using Jenkinsfile pipeline
How to Create UI Form Text fields, Drop-down and Run for Different Conditions or different environments
How to programmatically initialize a Log4j JSON logger in Java with custom global and dynamic key-value pairs in log output.
How to solve HTTP 504 Gateway Timeout errors in Kubernetes caused by Ingress proxy timeout settings.
A guide to creating an admin subdomain in Cloudflare with Nginx reverse proxy running in Docker with SSL.
Learn Why it is important to implement Exponential Backoff in Rabbitmq or In Event-Driven Systems
Learn how to implement exponential backoff in rabbitmq by using amqp in node.js
Learn how to send HTML Email from Python Code with Authentication at SMTP server end.
In Python code to send email, we encounter error as Sender Address Rejected Not Owned By User. See, how we to solve this error.
While connecting to MongoDB from Nodejs code with Mongoose, the number of connections keep on increasing on MongoDB. They needs to be explicitly closed.
Learn how to build docker image for Django project and run it on Apache with Python 3.9
How to enforce code quality in Python projects by using pylint scores and unittest coverage thresholds in the build process.
Example of a Jenkin Groovy Pipeline Script for Building Python Projects with Git Events and Push to Artifactory after building it.
How to implement timed-function in python which gets timeout after specified maximum timeout value.
How to set a default Kubernetes namespace in your kubectl context so you do not need to specify it with every command.
How to configure Kubernetes to pull Docker images from a private repository by setting up an image pull secret.
How to fix the Spring SAML/Okta error where the SAML message intended destination endpoint does not match the recipient endpoint.
How to transfer a Docker image to another host without using a registry — using docker save, scp, and docker load.
How to resolve circular import errors in Python when two modules need to import from each other.
Curl command to fetch credentials from Cyberark with certificate based authentication
Fixing loading external images and see how to fix the issue of url parameter not allowed when you load the images
