Материалы всех наших митапов: https://deordie.com
Наш чат в Telegram: https://news.1rj.ru/str/deordie_chat
Новые события сообщества DE or DIE: https://deordie.timepad.ru/events/

Автор доклада: Артем Селезнев, Senior Data Engineer, Сбербанк.

Отличные коробочные решения…

Во время лекции мы поговорим о том, что такое данные, какие базы данных бывают и чем они отличаются. Вы узнаете, какие особенности работы с базами данных нужно иметь в виду разработчику.Обсудим, как характеризовать, структурировать и хранить данные — с расчетом…

Stream processing differs from batch; one needs to be mindful of the system’s memory, event order, and system recovery in case of failures. However, understanding the fundamental concepts of time attributes, cluster memory, time-bounded joins, and system…

Welcome in Getting started with XComs in Apache Airflow

My name is Marc Lamberti and I'm super excited to see you there.
Indeed, you are going to discover how to get started with XComs in Apache Airflow.
As you can see from the curriculum below, you are…

CMU Database Group - Quarantine Tech Talks (2020)
Speaker: Wes McKinney (Ursa Labs)
Apache Arrow Flight: Accelerating Columnar Dataset Transport
October 5, 2020

https://db.cs.cmu.edu/seminar2020/#db21

Sponsored by the Steven Moy Foundation for Keeping it…

The walkthrough of the one of the world’s fastest databases in a human-friendly format

By Priyanka Vergadia Every application generates data, but what do those data mean? This is a question all data scientists are hired to answer. There is no doubt that this information is the most precious commodity for a business. But making sense o...

Playrix uses AWS to produce a 10-times increase in analytic querying speed and store and process 5 TB of data with zero bottlenecks to garner strong data insights that improve the end user experience.

Apache Beam is a popular parallel processing framework. In this video, Alexandra will give you an overview of Apache Beam and by the end of the video you will hopefully have the skills that you need to write a simple pipeline.

Source code - https://gith…

Get to know the highlights of Apache Airflow 2.0 and see hundreds of new features it includes. Have a look at how Airflow 2.0 compares to Airflow 1.10.

People sometimes ask us — should I use Dagster, or should I use dbt? We view Dagster and dbt as complementary technologies, not competing technologies.

Build, monitor, and manage real-time data pipelines to create data engineering infrastructure efficiently using open-source Apache projects

This is an updated version of a post we originally published in 2020. You can read the original version here. The growth of the data infrastructure industry has continued unabated since we published a set of reference architectures in …

Redshift Python Connector. It supports Python Database API Specification v2.0. - aws/amazon-redshift-python-driver

Snowplow empowers organizations to unlock the value of its customer behavioral data in their cloud data warehouse to fuel next-gen AI, analytics, and marketing.

Learn How to Pass the Exam from the author of the Official Certification Guide for Google

Learn How to Pass the Exam from the author of the Official Certification Guide for Google

Data versioning is one of the keys to automating a team's machine learning model development. While it can be very complicated if your team attempts to develop its own system to manage the process, this doesn’t need to be the case.