So, I decided to start non professional channel about everything that is interesting for me.
https://news.1rj.ru/str/losrecommendados
https://news.1rj.ru/str/losrecommendados
Telegram
Los recommendados
My recommendations for books, music, movies, podcast and anything else that I would like to share.
Contact: @gorros
Contact: @gorros
Forwarded from Инжиниринг Данных (Dmitry Anoshin)
Principal Engineer.pdf
563.1 KB
Презентация - Principal Engineers - Who Needs Them? Интересные bullet points. Сама презентация про SDE, но для DE тоже подойдет.
Для меня это идеальная карьерная цель стать Principal Data Engineer в Microsoft или Amazon, не знаю насколько она реальная, но точно хорошая альтернатива менеджера и по $ не обижают😎
Для меня это идеальная карьерная цель стать Principal Data Engineer в Microsoft или Amazon, не знаю насколько она реальная, но точно хорошая альтернатива менеджера и по $ не обижают😎
Forwarded from Рабы галерные
Запустили pet-проект? AWS дарит $1350 на его развитие
AWS Activate Founders tier — программа поддержки для небольших проектов. Оставьте заявку, чтобы получить
🔹 грант на использование сервисов AWS и техническую поддержку,
🔹 консультации экспертов по построению облачной инфраструктуры.
AWS — бессменный мировой лидер в облачной инфраструктуре уже 10 лет по мнению Gartner.
Забрать AWS Грант↩️
AWS Activate Founders tier — программа поддержки для небольших проектов. Оставьте заявку, чтобы получить
🔹 грант на использование сервисов AWS и техническую поддержку,
🔹 консультации экспертов по построению облачной инфраструктуры.
AWS — бессменный мировой лидер в облачной инфраструктуре уже 10 лет по мнению Gartner.
Забрать AWS Грант↩️
Amazon Timestream - Time series is the new black
https://www.allthingsdistributed.com/2021/06/amazon-timestream-time-series-is-the-new-black.html
https://www.allthingsdistributed.com/2021/06/amazon-timestream-time-series-is-the-new-black.html
Allthingsdistributed
Amazon Timestream - Time series is the new black
We dive into the world of time series data with a look at the design of Amazon Timestream
The exabyte club: LinkedIn’s journey of scaling the Hadoop Distributed File System | LinkedIn Engineering
https://engineering.linkedin.com/blog/2021/the-exabyte-club--linkedin-s-journey-of-scaling-the-hadoop-distr
https://engineering.linkedin.com/blog/2021/the-exabyte-club--linkedin-s-journey-of-scaling-the-hadoop-distr
Linkedin
The exabyte club: LinkedIn’s journey of scaling the Hadoop Distributed File System
Forwarded from Kseniia Tomak
У нас готов новый выпуск того самого дайджеста, о котором мало кто слышал:
https://digest.deordie.org/04_A_spark_of_the_summer_sun/
_____
Напомню, что у нас есть issue tracker: https://github.com/deordie/deordie-digest/issues
https://digest.deordie.org/04_A_spark_of_the_summer_sun/
_____
Напомню, что у нас есть issue tracker: https://github.com/deordie/deordie-digest/issues
Top 10 Announcements from Databricks Data + AI Summit 2021 - The Databricks Blog
https://databricks.com/blog/2021/06/04/dont-miss-these-top-10-announcements-from-data-ai-summit.html
https://databricks.com/blog/2021/06/04/dont-miss-these-top-10-announcements-from-data-ai-summit.html
Databricks
Top 10 Announcements from Databricks Data + AI Summit 2021
Couldn’t make it to this year’s event or missed some sessions? No worries, we’ve got the TL;DR for you in one place. Continue to the blog for 10 key announcements from the event, including the latest updates to Apache Spark, Delta Lake, MLflow and Databricks.
5 Reasons Why Rust Is The Future | Rust Functional Programming
https://scalac.io/blog/5-reasons-why-rust-is-the-future-rust-functional-programming/
https://scalac.io/blog/5-reasons-why-rust-is-the-future-rust-functional-programming/
Scalac - Software Development Company - Akka, Kafka, Spark, ZIO
5 Reasons Why Rust Is The Future
Rust functional programming. In the Stack overflow 2020 survey, Rust was picked as #1 most loved programming language, thanks to 86% of devs
A good reference for partitioning in Kafka.
https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/event-hubs/partitioning-in-event-hubs-and-kafka
https://docs.microsoft.com/en-us/azure/architecture/reference-architectures/event-hubs/partitioning-in-event-hubs-and-kafka
Docs
Partitioning in Event Hubs and Kafka - Azure Architecture Center
Learn about partitioning in Kafka and Event Hubs with Kafka, see how many partitions to use in ingestion pipelines, and also see how to assign events to partitions.
Forwarded from DataEng
Сказка про Apache Kafka: https://www.gentlydownthe.stream/
Old but good blog post.
https://azure.microsoft.com/en-us/blog/individually-great-collectively-unmatched-announcing-updates-to-3-great-azure-data-services/
https://azure.microsoft.com/en-us/blog/individually-great-collectively-unmatched-announcing-updates-to-3-great-azure-data-services/
Microsoft
Individually great, collectively unmatched: Announcing updates to 3...
As Julia White mentioned in her blog today, we’re pleased to announce the general availability of Azure Data Lake Storage Gen2 and Azure Data Explorer. We also announced the preview of Azure Data F...
Forwarded from Инжиниринг Данных (Dmitry Anoshin)
Data Engineering Manifesto:
📌We are Engineers
📌Data is a Product
📌Enable by providing self-service solutions
📌Embrace Cloud & Managed services
📌Batch processing is easier than stream
📌Aim for simplicity through consistency
📌Notebooks are for research, not for development
📌Data scientists are colleagues, not enemies
📌SQL is the lowest common denominator
📌We are Engineers
📌Data is a Product
📌Enable by providing self-service solutions
📌Embrace Cloud & Managed services
📌Batch processing is easier than stream
📌Aim for simplicity through consistency
📌Notebooks are for research, not for development
📌Data scientists are colleagues, not enemies
📌SQL is the lowest common denominator
New free course on Azure Data Explorer (Kusto).
Docs
Introduction to Azure Data Explorer - Learn
Evaluate whether Azure Data Explorer is appropriate to process and analyze your big data.
The Definitive Guide to Delta Lake by O’Reilly- Free digital book - Download Now in Early Release - The Databricks Blog
https://databricks.com/blog/2021/06/22/get-your-free-copy-of-delta-lake-the-definitive-guide-early-release.html
https://databricks.com/blog/2021/06/22/get-your-free-copy-of-delta-lake-the-definitive-guide-early-release.html
Databricks
The Definitive Guide to Delta Lake by O’Reilly-- Free digital book - Download Now in Early Release
Download the FREE definitive guide book published by O’Reilly and from the creators of the popular open-source project now taking the data community by storm, and get the help and guidance needed to build or optimize your own lakehouse architecture.
👍1
Announcing GitHub Copilot
https://www.linkedin.com/pulse/announcing-github-copilot-kevin-scott
https://www.linkedin.com/pulse/announcing-github-copilot-kevin-scott
LinkedIn
Announcing GitHub Copilot
Today, GitHub, OpenAI and Microsoft launched a technical preview of GitHub Copilot, a collaboratively developed new AI pair programmer that helps you write better code. You can learn more about it here and sign up for the preview today—spots are limited,…