Learn more about the latest release of Apache Spark, version 3.0.0, including new features like AQE and how to begin using it through Databricks Runtime 7.0.

Amazon Kinesis makes it easy to collect, process, and analyze real-time, streaming data so you can get timely insights and react quickly to new information. With Amazon Kinesis, you can ingest real-time data such as video, audio, application logs, website…

Learn more about the latest release of Koalas, version 1.0.0, including new features, and how you begin using it.

#вакансия #Remote #работаScala #удаленка
Компания: IDG
Формат работы: удаленка
Занятость: полная
Зарплатная вилка: $2500 до $3500

👋Всем привет.
Мы занимаемся разработкой собственных образовательных проектов, а также проектов для клиентов - технологических…

AWS is happy to announce the release of Amazon EMR Managed Scaling—a new feature that automatically resizes your cluster for best performance at the lowest possible cost. With EMR Managed Scaling you specify the minimum and maximum compute limits for your…

On this page, you’ll find info regarding the different ways to get in touch with AWS support, including Sales, Technical, Compliance, and Login support.

Find a remote job in engineering, product, design, management, sales, or customer service, and work from anywhere.

https://www.infoq.com/presentations/distributed-systems-complexity-human-factor/

Theoretical & practical introduction to Arrow file format

I have been working with AWS Kinesis Data Streams for several years now, dealing with over 0.5TB of streaming data per day. Rather than telling you about all the reasons why you should use Kinesis Data Streams (plenty is written on that subject), I'll talk…

В сети стали доступны доклады с прошедшего Airflow Summit 2020.
Безусловно все докладчики выступали удалённо (мы этот год запомним навсегда)
Из докладов, которые хотелось бы отметить:

- Advanced Apache Superset for Data Engineers
- Data engineering hierarchy…

Have you ever wondered whether your AWS Lambda could be faster if you used a different runtime?

CAP theorem helps to handle your distributed database systems when a few database servers refuse to communicate with each other.

A guide to become the next AWS Certified Data Analytics expert.

In order to scale the use of data across an organization there are a number of challenges related to discovery, governance, and integration that need to be solved. The key to those solutions is a robust and flexible metadata management system. LinkedIn has…

Data warehouse technology has been around for decades and has gone through several generational shifts in that time. The current trends in data warehousing are oriented around cloud native architectures that take advantage of dynamic scaling and the separation…

Roadmap to becoming a data engineer in 2021. Contribute to datastacktv/data-engineer-roadmap development by creating an account on GitHub.