#pandas #vaex #dask #polars
Top 3 Alternative Python Packages for Pandas | by Cornellius Yudha Wijaya | Towards Data Science
https://towardsdatascience.com/top-3-alternative-python-packages-for-pandas-d125627ce349?gi=3e25591d0cdf
Top 3 Alternative Python Packages for Pandas | by Cornellius Yudha Wijaya | Towards Data Science
https://towardsdatascience.com/top-3-alternative-python-packages-for-pandas-d125627ce349?gi=3e25591d0cdf
Medium
Top 3 Alternative Python Packages for Pandas
For many modern data scientists, Python is the programming language that was used for their everyday work — as a consequence, the data analysis would be done using one of the most data packages…
Forwarded from Инжиниринг Данных (Dmitry Anoshin)
SQL with Squid Games.pdf
424.7 KB
Базовый SQL на примере Squid Games. Хороший подход, сразу понятно для тех, кто смотрел сериал.
Now Azure data explorer engineer is available in Azure Synapse.
TECHCOMMUNITY.MICROSOFT.COM
Introducing Azure Synapse data explorer for log and telemetry analytics
Digital transformation is a key aspect of the new programming model of intelligent devices across the cloud. One of the key types of data that's arisen from this new application paradigm is telemetry. Telemetry data is everywhere: IoT sensors, app logs, web…
Data Analyst Certificate & Training - Grow with Google
https://grow.google/dataanalytics/#?modal_active=none
https://grow.google/dataanalytics/#?modal_active=none
Microsoft Releases Azure Open AI Service Including Access to Powerful GPT-3 Models
https://www.infoq.com/news/2021/11/azure-openai-service-gpt3/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=AI%2C+ML+%26+Data+Engineering
https://www.infoq.com/news/2021/11/azure-openai-service-gpt3/?utm_campaign=infoq_content&utm_source=infoq&utm_medium=feed&utm_term=AI%2C+ML+%26+Data+Engineering
InfoQ
Microsoft Releases Azure Open AI Service Including Access to Powerful GPT-3 Models
At its recent Ignite conference, Microsoft announced the new Azure OpenAI Service in preview, allowing access to OpenAI’s API through the Azure platform. This new Azure Cognitive Service will give customers access to OpenAI’s powerful GPT-3 models, along…
Introducing Amazon S3 shuffle in AWS Glue | AWS Big Data Blog
https://aws.amazon.com/blogs/big-data/introducing-amazon-s3-shuffle-in-aws-glue/
https://aws.amazon.com/blogs/big-data/introducing-amazon-s3-shuffle-in-aws-glue/
Amazon
Introducing Amazon S3 shuffle in AWS Glue | Amazon Web Services
Nov 2022: Newer version of the product is now available to be used for this post. AWS Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning (ML), and application development.…
Implement a slowly changing dimension in Amazon Redshift | AWS Big Data Blog
https://aws.amazon.com/blogs/big-data/implement-a-slowly-changing-dimension-in-amazon-redshift/
https://aws.amazon.com/blogs/big-data/implement-a-slowly-changing-dimension-in-amazon-redshift/
Amazon
Implement a slowly changing dimension in Amazon Redshift | Amazon Web Services
Amazon Redshift is a fully managed, petabyte-scale data warehouse service in the cloud. A star schema is a database organization structure optimized for use in a data warehouse. In a star schema, a dimension is a structure that categorizes the facts and measures…
Apache Spark Brings Pandas API with Version 3.2
InfoQ
Apache Spark Brings Pandas API with Version 3.2
The Apache Spark team has integrated the Pandas API in the product's latest 3.2 release. With this change, dataframe processing can be scaled to multiple clusters or multiple processors in a single machine using the PySpark execution engine.
Amazing website if you are looking for functional programming job and not only. For some reason it is like a candy store but for programmers 😁
https://functional.works-hub.com/
https://functional.works-hub.com/
Works-Hub
Jobs - December 2025 | Functional Works
Browse functional programming jobs, salaries, blogs and learning resources! Scala jobs, Haskell jobs, Clojure jobs and more.
I think you can ve analytics engineer even without using dbt. It is really more about problems. I prefer DE end of the spectrum 😎
https://youtu.be/uEPCxBaRf6A
https://youtu.be/uEPCxBaRf6A
YouTube
Data Engineer Vs Analytics Engineer Vs Analyst - Which Position Is Right For You?
There are so many data roles out there. Data engineer, analytics engineer, analyst, BI Developer, ETL Developer, Data modeler and so many more.
But what is the difference.
What do all of these data roles do?
In this video we will focus on three roles and…
But what is the difference.
What do all of these data roles do?
In this video we will focus on three roles and…
Forwarded from DataEng
Amazon бесплатно курсы по AWS раздаёт: https://amzn.to/31XqYC8, правда для моей страны нет возможности посмотреть их. Пишет что только Kindle noscripts могу брать, но возможно для вас ситуация будет другой.
Something is definitely going to change.
https://www.youtube.com/watch?v=MoB9Plh1tck
https://www.youtube.com/watch?v=MoB9Plh1tck
YouTube
The Great Tech Resignation
Sapphire Partners' Cathy Gao talks to Emily Chang about how the Great Resignation is affecting the tech industry, and how can companies use technology to have a recruiting edge in this tight market and to retain talent.
Сегодня вечером в 7 (МСК) я расскажу про Кусто
YouTube
ADX(KUSTO): INTERACTIVE BIG DATA ANALYTICS / GOR HAYRAPETYAN
📌 Описание:
Мы рассмотрим как устроен Кусто и где его можно применить. Поговорим о том к какой категории баз данный относиться Кусто и как он отличается от других решений в своей категории. Также за счет каких решений Кусто эффективнее и быстрее. Напишем…
Мы рассмотрим как устроен Кусто и где его можно применить. Поговорим о том к какой категории баз данный относиться Кусто и как он отличается от других решений в своей категории. Также за счет каких решений Кусто эффективнее и быстрее. Напишем…
New serverless analytics and data engineering services from AWS:
1. Amazon EMR Serverless
2. Amazon Redshift Serverless (preview)
3. Amazon MSK Serverless
1. Amazon EMR Serverless
2. Amazon Redshift Serverless (preview)
3. Amazon MSK Serverless
Amazon
Open Source Big Data Analytics | Amazon EMR Serverless | Amazon Web Services
With Amazon EMR Serverless, you can run big data analytics applications using open-source frameworks such as Apache Spark, Hive, and Presto without configuring, managing, and scaling clusters or servers.
Now, the native streaming ingestion feature in Amazon Redshift lets you ingest data directly from Kinesis Data Streams. The new feature enables you to ingest hundreds of megabytes of data per second and query it at exceptionally low latency—in many cases only 10 seconds after entering the data stream.
Amazon
Integrate Etleap with Amazon Redshift Streaming Ingestion (preview) to make data available in seconds | Amazon Web Services
Amazon Redshift is a fully managed cloud data warehouse that makes it simple and cost-effective to analyze all your data using SQL and your extract, transform, and load (ETL), business intelligence (BI), and reporting tools. Tens of thousands of customers…