DE – Telegram
DE
@data_engi
523 subscribers
313 photos
81 videos
15 files
407 links
Data Engineering Technologies.
SQL, Python, Kafka, Spark, Pandas, Airflow, Clickhouse, Greenplum, Postgres, dbt, LLM agentic systems, AI, robots, drones etc.

Boost channel - https://news.1rj.ru/str/boost/data_engi
Download Telegram
About
Blog
Apps
Platform
Join
DE
523 subscribers
DE
🔥5
499 views
DE
Happy programmer's day! 👨‍💻🧑‍💻👩‍💻
Please open Telegram to view this post
VIEW IN TELEGRAM
🎉7👍1😁1👨‍💻1
642 views
DE
https://www.postgresql.org/about/news/postgresql-16-released-2715/
PostgreSQL News
PostgreSQL 16 Released!
September 14, 2023 - The PostgreSQL Global Development Group today announced the release of PostgreSQL 16, the latest version of …
❤‍🔥1👏1
353 views
DE
https://pythonspeed.com/articles/pandas-sql-chunking/
Python⇒Speed
Loading SQL data into Pandas without running out of memory
Pandas can load data from a SQL query, but the result may use too much memory. Learn how to process data in batches, and reduce memory usage even further.
🆒2
469 views
DE
https://github.com/reflex-dev/reflex
GitHub
GitHub - reflex-dev/reflex: 🕸️ Web apps in pure Python 🐍
🕸️ Web apps in pure Python 🐍. Contribute to reflex-dev/reflex development by creating an account on GitHub.
🤔3
417 views
DE
https://www.paradedb.com/
ParadeDB
ParadeDB — The Transactional Elasticsearch Alternative
ParadeDB is an open source, ACID-compliant search and analytics database. Built on Postgres for update-heavy workloads.
❤‍🔥1🤩1
453 views
DE
DE
https://www.postgresql.org/about/news/postgresql-16-released-2715/
https://news.1rj.ru/str/dataeng/544
Telegram
DataEng
Обзор новых фич в новой версии PostgreSQL 16: https://www.youtube.com/watch?v=M7m3A68CTJg
❤‍🔥1🔥1
499 views
DE
❤‍🔥3🤡3
523 views
DE
❤‍🔥6
607 views
DE
https://pythoninsider.blogspot.com/2023/10/python-3120-final-now-available.html
Blogspot
Python Insider: Python 3.12.0 (final) now available
❤‍🔥2
373 views
DE
❤‍🔥3
383 views
DE
Airflow Summit 2023

https://www.youtube.com/playlist?list=PLGudixcDaxY29qXIXhd90htHp_BFk-Bqf
356 viewsedited  
DE
Superset 2.1.1 LTS

While that new (3.0.0) major release has been tested fairly extensively, 2.1.1 is officially our “stable” release and will continue to receive patches alongside 3.0. Superset 2.X will continue to receive such patches at least until the release of Superset 3.1.0 or 4.0.0 in the future.

https://preset.io/blog/superset-2-1-1-a-more-secure-and-stable-patch-release/
421 views
DE
❤‍🔥4
553 views
DE
https://mad.firstmark.com/
Firstmark
FirstMark | 2025 MAD (ML/AI/Data) Landscape
The 2025 MAD (ML/AI/Data) Landscape is the definitive market map of companies and products in machine learning, artificial intelligence and data, compiled by FirstMark.
326 views
DE
❤‍🔥2
334 views
DE
This media is not supported in your browser
VIEW IN TELEGRAM
298 views
DE
306 views
DE
https://youtu.be/ujXKnUZKrNM?si=hyi-23efWYE-mmyo
YouTube
GPT-3 / ChatGPT: your AI assistant in DBeaver
GPT-3 has taken a huge step forward and quickly gained popularity around the world. One of its more popular uses is to help you write code in various languages. And now, ChatGPT can become your assistant in writing SQL queries in DBeaver.
--
Text version:…
344 views
DE
Forwarded from DataEng
Run periodic jobs in PostgreSQL

Недавно открыл для себя интересное расширение для БД PostgreSQL: pg_cron. Балалайка позволяет запускать периодические задачи внутри базы данных: SQL запросы, процедуры и т.д. Удобно, вдруг кому пригодится 💡
GitHub
GitHub - citusdata/pg_cron: Run periodic jobs in PostgreSQL
Run periodic jobs in PostgreSQL. Contribute to citusdata/pg_cron development by creating an account on GitHub.
223 views
DE
Forwarded from DataEng
На Хабре вышла статья про Airflow в Kubernetes. Статья мне понравилась, целевая аудитория это новички в кубах, которые хотят развернуть Airflow. Сам я такой деплой не использую, но мне было полезно знать как оно там работает. Напомню, что у Airflow есть официальный helm chart: https://airflow.apache.org/docs/helm-chart/stable/index.html, если вдруг вы решите копнуть эту тему чуть глубже.
Хабр
Airflow в Kubernetes. Часть 1
Приветствую! На пути инженера данных часто встречаются задачи связанные с DevOps. Одна из таких - развернуть Airflow в Kubernetes кластере. Если до этого похожего опыта работы не было, то эта задача...
❤‍🔥2
208 views