Recently Microsoft introduced a new platform called the Microsoft Intelligent Data Platform that fully integrates their database, analytics, and governance offerings. The new platform encompasses everything already available in the Azure Data space (Azure…

We’re making GitHub Copilot, an AI pair programmer that suggests code in your editor, generally available to all developers for $10 USD/month or $100 USD/year. It will also be free to use for verified students and maintainers of popular open source projects.

Discover the latest tools and trends in data engineering for 2022. Get insights on advancements in Git for Data and how to stay ahead in the industry.

Learn more about Project Lightspeed, a set of new features and functionalities designed to take Spark Structured Streaming into the next generation.

Releasing 2.0.0rc1

Background & context https://blog.getdbt.com/why-doesn-t-dbt-support-python/ https://roundup.getdbt.com/p/disjointed-lineage Since the dawn of time, dbt has been SQL first and SQL only. We beli...

This is the first part of a series where we explore Kafka client’s internals. This post focuses on the Kafka Producer.

Discover the open-sourcing of Delta Lake 2.0, enabling reliable, production-ready data lakehouses with enhanced data sharing and performance.

Kotlin Server and Client Framework for microservices, HTTP APIs, and RESTful services

Amazon EMR is a cloud big data platform for running large-scale distributed data processing jobs, interactive SQL queries, and machine learning (ML) applications using open-source analytics frameworks such as Apache Spark, Apache Hive, and Presto. Apache…

Earn swag with the Google Cloud #LearnToEarn challenge.

The focus of this blog is to show you how to build an open lakehouse leveraging incremental data processing and performing field-level updates. We are excited to announce that you can now use Apache Hudi + dbt for building open data lakehouses.

Learn Data Science & AI from the comfort of your browser, at your own pace with DataCamp's video tutorials & coding challenges on R, Python, Statistics & more.

Carbon Language's main repository: documents, design, implementation, and related tools. (NOTE: Carbon Language is experimental; see README) - carbon-language/carbon-lang

BigLake, a storage engine that extends innovations in BigQuery storage to open file formats running on cloud object stores, is generally available.

Learn about Delta Sharing, an open protocol for secure data sharing, enabling seamless data exchange across organizations.