The Future of Data Engineering: AI, LLMs, and Automation
https://www.dataengineeringpodcast.com/episodepage/the-future-of-data-engineering-ai-llms-and-automation
https://www.dataengineeringpodcast.com/episodepage/the-future-of-data-engineering-ai-llms-and-automation
Data Engineering Podcast
The Future of Data Engineering: AI, LLMs, and Automation
Summary
In this episode of the Data Engineering Podcast Gleb Mezhanskiy, CEO and co-founder of DataFold, talks about the intersection of AI and data…
In this episode of the Data Engineering Podcast Gleb Mezhanskiy, CEO and co-founder of DataFold, talks about the intersection of AI and data…
🔥1
Looks like most common technologies already integrated Iceberg. In other words, it became a new standard for open table formats.
https://youtu.be/O2l5SB-camQ?si=C2JR2xayOT6aD7jJ
https://youtu.be/O2l5SB-camQ?si=C2JR2xayOT6aD7jJ
YouTube
Tableflow: Materialize Apache Kafka® Topics as Apache Iceberg™ and Delta Lake Tables With Zero ETL
Blog post: https://cnfl.io/4hNOPFn | Tim Berglund is back at the lightboard to show you the most exciting thing he’s seen in analytics in the last 40 years (nope, that’s not an exaggeration): Tableflow, a new feature in Confluent Cloud that lets you completely…
👍2❤1
v2.0.0 of the Snowflake Terraform provider, which is the officially supported Snowflake product, reached GA. Here is a tutorial.
GitHub
terraform-provider-snowflake/ROADMAP.md at main · snowflakedb/terraform-provider-snowflake
Terraform provider for managing Snowflake accounts - snowflakedb/terraform-provider-snowflake
A great article to catch up with the recent industry developments related to Iceberg and its adoption.
Getdbt
Iceberg?? Give it a REST!
The new abstraction that changes nothing... and everything
❤2
The evolution of databases (w/ Wolfram Schulte)
https://roundup.getdbt.com/p/the-evolution-of-databases-w-wolfram
https://roundup.getdbt.com/p/the-evolution-of-databases-w-wolfram
Getdbt
The evolution of databases (w/ Wolfram Schulte)
In the first episode of our season on developer experience, the cofounder and CTO of SDF Labs, now a part of dbt Labs, discusses databases, compilers, and dev tools.
dbt announced faster engine, but I am really curious about their cost reduction rather than speed of development
https://www.getdbt.com/product/fusion
https://www.getdbt.com/product/fusion
dbt Labs
Accelerate data workflows with the dbt Fusion engine | dbt Labs
Experience lightning-fast performance and intelligent SQL validation with the dbt Fusion engine, the next-generation engine for modern analytics.
Introducing Apache Spark 4.0 | Databricks Blog
https://www.databricks.com/blog/introducing-apache-spark-40
https://www.databricks.com/blog/introducing-apache-spark-40
❤2👍2
This episode is 6 hours long, but it is like a good book that you prefer to actually last.
YouTube
DHH: Future of Programming, AI, Ruby on Rails, Productivity & Parenting | Lex Fridman Podcast #474
David Heinemeier Hansson (aka DHH) is a legendary programmer, creator of Ruby on Rails, co-owner & CTO of 37signals that created Basecamp, HEY, & ONCE, and is a NYT-best-selling author (with Jason Fried) of 4 books: REWORK, REMOTE, Getting Real, and It Doesn't…
👍6
I assume you came across these lists from Microsoft, if not here is the link. In summary, we can interpret it as AI "replicability" and "resiliency". I personally think we will be surprised in 5 years. With regards to data engineering I was wondering if DE will get replaced first or DS as mentioned in the list. We kinda do "plumbing" for data 😉
🤔1
Azuros is back, check this one as well if you missed it https://m.youtube.com/watch?v=xIk0_uFV-rU&t=1s&pp=2AEBkAIB
YouTube
Interview with Cloud Architect in 2025
Cloud Architects
https://linkgraph.net
All lines soon printed on merch... https://posix.store/
https://www.patreon.com/ProgrammersAreAlsoHuman
Interview with a Cloud Architects in 2025 with Azuros Cloudapi - aired on © The CTO.
Scripts inspired by X account…
https://linkgraph.net
All lines soon printed on merch... https://posix.store/
https://www.patreon.com/ProgrammersAreAlsoHuman
Interview with a Cloud Architects in 2025 with Azuros Cloudapi - aired on © The CTO.
Scripts inspired by X account…
AWS introduced the AWS Data Processing MCP Server, an open-source tool that uses the Model Context Protocol (MCP) to simplify analytics environment setup on AWS.
Amazon
Accelerating development with the AWS Data Processing MCP Server and Agent | Amazon Web Services
We're excited to introduce the AWS Data Processing MCP Server, an open-source tool that uses the Model Context Protocol (MCP) to simplify analytics environment setup on AWS. In this post, we explore how the AWS Data Processing MCP Server accelerates analytics…
How To Keep AI From Making Your Employees Stupid
https://www.bigdatawire.com/2025/07/09/how-to-keep-ai-from-making-your-employees-stupid/
https://www.bigdatawire.com/2025/07/09/how-to-keep-ai-from-making-your-employees-stupid/
BigDATAwire
How To Keep AI From Making Your Employees Stupid
Where I live in Bend, Oregon, the biggest challenge often used to be deciding which hiking trail to conquer. These days, a new, more existential question
❤1🔥1