One of the principal features used in analytic databases is table partitioning. This feature is so frequently used because of its ability to significantly reduce query latency by allowing the execution engine to skip reading data that is not necessary for…

This blog post explains techniques for development teams who strive for high velocity continuous delivery using Kubernetes and Docker. When we say “high velocity” we mean that every product team can safely ship updates many times a day — deploy instantly…

Explaining the way, auto-configuration works in my Home Lab. Driven by Docker, generated by Python tools, fully automated (almost).

In this newest episode of The New Stack Makers podcast, we spoke with Dianne Marsh, director of engineering for engineering tools at Netflix. Her team is responsible for building the tools, including Spinnaker, that the other teams use for deploying their…

Containers and Kubernetes were not here when we started doing agile. But they change what used to be the hardest part: Applying agile beyond a small group, to the whole organization.

In this blog post we show how to record SSH sessions with OpenSSH sshd using Teleport as a recording proxy

If you are in the job market, and started your career 25 years ago, and your main expertise is data warehousing, a data warehouse engineer…

To get straight to the point: nobody wants to have large grain snapshots of data for any dataset that is actually comprised of a continuous stream of data

Kubernetes is one of the hottest open-source projects these days. It’s a production-grade container orchestration system, inspired by Google’s own <a href="http://blog.kubernetes.io/2015/04/borg-predecessor-to-kubernetes.html" target="_blank">Borg</a> and…

The engineering team for social media service LinkedIn first launched Gobblin in 2014 as a universal data ingestion framework for offline big data, running on Hadoop in MapReduce mode. As new capabilities were added to enable the framework to support a spectrum…

Posts and writings by Amit Saha

With preconnect hints, you can reduce request latency and make your site faster.

Meltdown breaks the fundamental isolation between user applications and the OS. In this post, we run MongoDB Meltdown tests on AWS, Azure and DigitalOcean.

When I started writing pg_chameleon I had in mind a tool making simple to migrate from different dbms engines to PostgreSQL.
The name was inspired by the Culture Club’s Karma chameleon song which suggested me the idea of a tool capable to move data between…

I’ve been talking about scalability for servers and other cloud resources for a very long time! Back in 2006, I wrote “This is the new world of scalable, on-demand web services. Pay for what you need and use, and not a byte more.” Shortly after we launched…

Recently, we’ve been working with clients on setting up highly available (HA) Kubernetes clusters. More specifically, we’ve been working on constructing automated installers for HA Kubernetes clusters, basically providing an automated “single-click” path…

In this guide, we will talk about the components of monitoring systems and how to use them to implement your monitoring strategy. We will the basic responsib…

I've recently become obsessed with the sheer amount of development activity happening on sites like GitHub. As a first project on working with this data, I thought it would be fun to rank all the programming languages by counting how many people on GitHub…

We’re grateful for this guest post from Tim Wilde! You can find the source code for the examples he uses in his github repo. Strings are where data go to die There you go; I said it. How often have you found yourself contemplating some hair-brained regex…

Streaming architectures for data sets that never end.

Intro My previous post took off far more than I expected, so I thought I’d write another piece on less well-known bash features. As I said before, because I felt bash is an often-used (and un…