Data1984 – Telegram
Data1984
786 subscribers
44 photos
1 video
17 files
762 links
This channel is mostly about data related stuff, some of the main topics are #DataEngineering #SQL #Python #cloud .

Contact: @gorros
Download Telegram
According to the news, Tesla engineers visit Twitter for code reviews.
Useful Python library for data validation that has Rust based core.
https://pydantic-docs.helpmanual.io/
👍1
Currently I am reading Harari's Sapiens where he explains how the current economic system depends on growth and trust in the future. I think in IT it is really vivid. There are some good points in this analysis.
👍4
😁1
Data1984
I wrote a summary where I compare Azure Synapse, Databricks and Azure Data Explorer focusing on the features that I find important. https://medium.com/@gorros/azure-synapse-databricks-and-azure-data-explorer-kusto-73a3a0339cf2
I decided to ask a ChatGPT following questions "What are the differences between Azure Synapse, Databricks, and Azure Data Explorer (Kusto)?" to compare with the review I wrote a while ago. Here is what I've got as an answer:

Azure Synapse, Databricks, and Azure Data Explorer (Kusto) are all Microsoft Azure services that are focused on data analytics and big data processing. While they have some similarities, there are also some key differences between the three.

Azure Synapse is a cloud-based data integration and analytics platform that combines enterprise data warehousing, big data integration and processing, and data integration and orchestration into a single platform. It is designed to help organizations quickly and easily integrate, process, and analyze large volumes of data from a wide range of sources.

Databricks is a cloud-based platform for data engineering, data science, and analytics. It is based on the open-source Apache Spark project, and it provides a managed environment for running Spark jobs, as well as tools for collaboration, data management, and machine learning.

Azure Data Explorer (Kusto) is a fast, highly scalable data exploration service that is optimized for log and time-series data. It is designed to help organizations quickly and easily analyze large volumes of data to gain insights and understand patterns and trends in their data.

Overall, each of these services has its own strengths and is suited to different use cases. Azure Synapse is a good choice for organizations that need a comprehensive data integration and analytics platform, while Databricks is a good choice for data engineering and data science workloads, and Azure Data Explorer is a good choice for analyzing log and time-series data.
👍2