June 2023: This post was reviewed and updated for accuracy. In recent evolution in data lake technologies, it became popular to bring ACID (atomicity, consistency, isolation, and durability) transactions on Amazon Simple Storage Service (Amazon S3). You can…

dbt now includes first-class Python support for modeling and transformation. Learn how Python works with ELT and Jinja workflows.

Subscribe to our weekly system design newsletter: https://bit.ly/3tfAlYD

Checkout our bestselling System Design Interview books:
Volume 1: https://amzn.to/3Ou7gkd
Volume 2: https://amzn.to/3HqGozy
Digital version of System Design Interview books: https…

The LinkedIn infrastructure has thousands of services serving millions of queries per second. At this scale, having tools that provide observability into the LinkedIn infrastructure is imperative to ensure that issues in our infrastructure are quickly detected…

In December, we introduced the preview of Amazon Managed Grafana, a fully managed service developed in collaboration with Grafana Labs that makes it easy to use the open-source and the enterprise versions of Grafana to visualize and analyze your data from…

Are you interested in your most popular products, the top contributions to your KPI or answering similar questions about your data? Probably so, as it’s very common to want insights like this in analytics, reports and dashboards. Answering questions like…

 
Kusto team has been busy working with our customers over the last few months to bring exciting new GA & Preview features at Ignite 2022, with a raft of..

Rust meets Data Engineering!

Learn how dbt’s Python support expands data transformation capabilities. Use Python and SQL together for more flexible analytics workflows.

Python is not the most suitable for Data Engineering. Let's explore why Rust has potential, what it does well and why it has become the most loved programming language for a while.

Enable near real-time insights on operational data with Datastream for BigQuery.