Data Engineering Zoomcamp is a free 9-week course on building production-ready data pipelines. The next cohort starts in January 2026. Join the course here 👇🏼 - DataTalksClub/data-engineering-zoomcamp

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class perf...

Interview with a Boomer CTO in 2023

Interview with a Boomer CTO in 2023 with Azuros Cloudapi - aired on © The CTO.

Programmer humor
SDLC humor
Requirements engineering
Systems Requirements
User acceptance testing
Cloud services
Programming jokes
tech humor…

Today, we are excited to announce the capability to run Apache Airflow DAGs (Directed Acyclic Graph) within Azure Data Factory, adding a key Open-Source..

Learn how the decoupled storage and compute architecture helps BigQuery scale seamlessly.

This VS Code extension lets developers write code locally, leveraging the powerful authoring capabilities of IDEs while connecting to Azure Databricks to run..

We are thrilled to announce the much-anticipated General Availability of ADX Dashboards!

Weekly system design newsletter: https://bit.ly/3tfAlYD

Checkout our bestselling System Design Interview books:
Volume 1: https://amzn.to/3Ou7gkd
Volume 2: https://amzn.to/3HqGozy

LSM tree video: https://www.youtube.com/watch?v=I6jB0nM9SKU

Other things…

The 2024 MAD (ML/AI/Data) Landscape is the definitive market map of companies and products in machine learning, artificial intelligence and data, compiled by FirstMark.

This article reviews three approaches to building a streaming data pipeline on Google Cloud, using Pub/Sub and BigQuery.

Save money, save money!! Hear Hear! Someone on Linkedin recently brought up the point that companies could save gobs of money by swapping out AWS Python lambdas for Rust ones. While it raised the ire of many a Python Data Engineer, I thought it sounded like…

Get to Know how Spark chooses the number of partitions implicitly while reading a set of data files into an RDD or a Dataset.

Use DuckDB, Python, and Dagster to build a lightweight data lake with SQL transforms and Parquet file support.

The Republic of Armenia’s Ministry of High-Tech Industry and AWS have signed a Memorandum of Understanding (MoU) with the aim of modernizing the technological infrastructure of the state and accelerating the adoption of cloud services in the public and the…

Dive deeper into the power of Pandas and how leveraging it can benefit your organization. Explore a new way to work with data and unlock powerful insights!

Apache Doris is an open-source database based on MPP architecture,with easier use and higher performance. As a modern data warehouse, apache doris empowers your Olap query and database analytics.

Integrate cutting-edge LLM technology quickly and easily into your apps - microsoft/semantic-kernel

Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format. - MaterializeInc/datagen