Презентация - Principal Engineers - Who Needs Them? Интересные bullet points. Сама презентация про SDE, но для DE тоже подойдет.

Для меня это идеальная карьерная цель стать Principal Data Engineer в Microsoft или Amazon, не знаю насколько она реальная, но точно хорошая альтернатива менеджера и по $ не обижают😎

Tweet from Santiago (@svpino)
https://twitter.com/svpino/status/1399652343688347651?s=20

AWS Activate Founders for Startups
https://aws.amazon.com/activate/founders/

Запустили pet-проект? AWS дарит $1350 на его развитие

AWS Activate Founders tier — программа поддержки для небольших проектов. Оставьте заявку, чтобы получить
🔹 грант на использование сервисов AWS и техническую поддержку,
🔹 консультации экспертов по построению облачной инфраструктуры.

AWS — бессменный мировой лидер в облачной инфраструктуре уже 10 лет по мнению Gartner.

Забрать AWS Грант↩️

Amazon Timestream - Time series is the new black
https://www.allthingsdistributed.com/2021/06/amazon-timestream-time-series-is-the-new-black.html

The exabyte club: LinkedIn’s journey of scaling the Hadoop Distributed File System | LinkedIn Engineering
https://engineering.linkedin.com/blog/2021/the-exabyte-club--linkedin-s-journey-of-scaling-the-hadoop-distr

У нас готов новый выпуск того самого дайджеста, о котором мало кто слышал:
https://digest.deordie.org/04_A_spark_of_the_summer_sun/
_____
Напомню, что у нас есть issue tracker: https://github.com/deordie/deordie-digest/issues

Top 10 Announcements from Databricks Data + AI Summit 2021 - The Databricks Blog
https://databricks.com/blog/2021/06/04/dont-miss-these-top-10-announcements-from-data-ai-summit.html

5 Reasons Why Rust Is The Future | Rust Functional Programming
https://scalac.io/blog/5-reasons-why-rust-is-the-future-rust-functional-programming/

A good reference for partitioning in Kafka.
https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/event-hubs/partitioning-in-event-hubs-and-kafka

Сказка про Apache Kafka: https://www.gentlydownthe.stream/

Old but good blog post.
https://azure.microsoft.com/en-us/blog/individually-great-collectively-unmatched-announcing-updates-to-3-great-azure-data-services/

Data Engineering Manifesto:

📌We are Engineers
📌Data is a Product
📌Enable by providing self-service solutions
📌Embrace Cloud & Managed services
📌Batch processing is easier than stream
📌Aim for simplicity through consistency
📌Notebooks are for research, not for development
📌Data scientists are colleagues, not enemies
📌SQL is the lowest common denominator

New free course on Azure Data Explorer (Kusto).

The Definitive Guide to Delta Lake by O’Reilly- Free digital book - Download Now in Early Release - The Databricks Blog
https://databricks.com/blog/2021/06/22/get-your-free-copy-of-delta-lake-the-definitive-guide-early-release.html

Announcing GitHub Copilot
https://www.linkedin.com/pulse/announcing-github-copilot-kevin-scott

Codespaces · GitHub
https://github.com/features/codespaces

GitHub is introducing a lot of new features. I think this is the future, to have easy and safe setup accessible from any device.

It is seems future ia close. I personally believe one person needs one device for both work and home use, and anything else. And that device should only be light, have good screen and battery life. (I currently suffer from opposite situation 😁) Gaming industry is moving in thay direction and now it is time for the rest. I mean anyway we backup most important things to a cloud. So why not to have whole PC or Mac in the cloud. At least the one needed for work. The only question remains is price.

Neat guide for Azure services with good "when to use what" comparisons .