Introducing Amazon S3 shuffle in AWS Glue | AWS Big Data Blog
https://aws.amazon.com/blogs/big-data/introducing-amazon-s3-shuffle-in-aws-glue/
https://aws.amazon.com/blogs/big-data/introducing-amazon-s3-shuffle-in-aws-glue/
Amazon
Introducing Amazon S3 shuffle in AWS Glue | Amazon Web Services
Nov 2022: Newer version of the product is now available to be used for this post. AWS Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning (ML), and application development.…
Implement a slowly changing dimension in Amazon Redshift | AWS Big Data Blog
https://aws.amazon.com/blogs/big-data/implement-a-slowly-changing-dimension-in-amazon-redshift/
https://aws.amazon.com/blogs/big-data/implement-a-slowly-changing-dimension-in-amazon-redshift/
Amazon
Implement a slowly changing dimension in Amazon Redshift | Amazon Web Services
Amazon Redshift is a fully managed, petabyte-scale data warehouse service in the cloud. A star schema is a database organization structure optimized for use in a data warehouse. In a star schema, a dimension is a structure that categorizes the facts and measures…
Apache Spark Brings Pandas API with Version 3.2
InfoQ
Apache Spark Brings Pandas API with Version 3.2
The Apache Spark team has integrated the Pandas API in the product's latest 3.2 release. With this change, dataframe processing can be scaled to multiple clusters or multiple processors in a single machine using the PySpark execution engine.
Amazing website if you are looking for functional programming job and not only. For some reason it is like a candy store but for programmers 😁
https://functional.works-hub.com/
https://functional.works-hub.com/
Works-Hub
Jobs - December 2025 | Functional Works
Browse functional programming jobs, salaries, blogs and learning resources! Scala jobs, Haskell jobs, Clojure jobs and more.
I think you can ve analytics engineer even without using dbt. It is really more about problems. I prefer DE end of the spectrum 😎
https://youtu.be/uEPCxBaRf6A
https://youtu.be/uEPCxBaRf6A
YouTube
Data Engineer Vs Analytics Engineer Vs Analyst - Which Position Is Right For You?
There are so many data roles out there. Data engineer, analytics engineer, analyst, BI Developer, ETL Developer, Data modeler and so many more.
But what is the difference.
What do all of these data roles do?
In this video we will focus on three roles and…
But what is the difference.
What do all of these data roles do?
In this video we will focus on three roles and…
Forwarded from DataEng
Amazon бесплатно курсы по AWS раздаёт: https://amzn.to/31XqYC8, правда для моей страны нет возможности посмотреть их. Пишет что только Kindle noscripts могу брать, но возможно для вас ситуация будет другой.
Something is definitely going to change.
https://www.youtube.com/watch?v=MoB9Plh1tck
https://www.youtube.com/watch?v=MoB9Plh1tck
YouTube
The Great Tech Resignation
Sapphire Partners' Cathy Gao talks to Emily Chang about how the Great Resignation is affecting the tech industry, and how can companies use technology to have a recruiting edge in this tight market and to retain talent.
Сегодня вечером в 7 (МСК) я расскажу про Кусто
YouTube
ADX(KUSTO): INTERACTIVE BIG DATA ANALYTICS / GOR HAYRAPETYAN
📌 Описание:
Мы рассмотрим как устроен Кусто и где его можно применить. Поговорим о том к какой категории баз данный относиться Кусто и как он отличается от других решений в своей категории. Также за счет каких решений Кусто эффективнее и быстрее. Напишем…
Мы рассмотрим как устроен Кусто и где его можно применить. Поговорим о том к какой категории баз данный относиться Кусто и как он отличается от других решений в своей категории. Также за счет каких решений Кусто эффективнее и быстрее. Напишем…
New serverless analytics and data engineering services from AWS:
1. Amazon EMR Serverless
2. Amazon Redshift Serverless (preview)
3. Amazon MSK Serverless
1. Amazon EMR Serverless
2. Amazon Redshift Serverless (preview)
3. Amazon MSK Serverless
Amazon
Open Source Big Data Analytics | Amazon EMR Serverless | Amazon Web Services
With Amazon EMR Serverless, you can run big data analytics applications using open-source frameworks such as Apache Spark, Hive, and Presto without configuring, managing, and scaling clusters or servers.
Now, the native streaming ingestion feature in Amazon Redshift lets you ingest data directly from Kinesis Data Streams. The new feature enables you to ingest hundreds of megabytes of data per second and query it at exceptionally low latency—in many cases only 10 seconds after entering the data stream.
Amazon
Integrate Etleap with Amazon Redshift Streaming Ingestion (preview) to make data available in seconds | Amazon Web Services
Amazon Redshift is a fully managed cloud data warehouse that makes it simple and cost-effective to analyze all your data using SQL and your extract, transform, and load (ETL), business intelligence (BI), and reporting tools. Tens of thousands of customers…
More on EMR Serverless.
Amazon
Announcing Amazon EMR Serverless (Preview): Run big data applications without managing servers | Amazon Web Services
Today we’re happy to announce Amazon EMR Serverless, a new option in Amazon EMR that makes it easy and cost-effective for data engineers and analysts to run petabyte-scale data analytics in the cloud. With EMR Serverless, you can run applications built using…
#privacy
https://www.cnet.com/tech/mobile/pegasus-spyware-on-state-department-phones-what-you-need-to-know/
https://www.cnet.com/tech/mobile/pegasus-spyware-on-state-department-phones-what-you-need-to-know/
CNET
Pegasus spyware on State Department phones: What you need to know
Software that targeted activists, journalists and executives was reportedly found on US government phones, too. Apple sued NSO Group, its Israeli maker.
What’s new in Amazon Redshift – 2021, a year in review | AWS Big Data Blog
https://aws.amazon.com/blogs/big-data/whats-new-in-amazon-redshift-2021-a-year-in-review/
https://aws.amazon.com/blogs/big-data/whats-new-in-amazon-redshift-2021-a-year-in-review/
Amazon
What’s new in Amazon Redshift – 2021, a year in review | Amazon Web Services
Amazon Redshift is the cloud data warehouse of choice for tens of thousands of customers who use it to analyze exabytes of data to gain business insights. Customers have asked for more capabilities in Redshift to make it easier, faster, and secure to store…