How to structure a data team to climb the pyramid of Data Science | Airbyte
https://airbyte.com/blog/structure-a-data-team-to-climb-the-pyramid-of-data-science

Getting Started w/ Airbyte! | Open Source Data Integration

Airbyte is a data integration tool like Fivetran or Stitch, but completely open source!

In today's video I want to show you how you can easily get started using it.

While there are some limitations compared to the other products, in general Airbyte is incredibly powerful and will be sufficient for most use cases.

They also have a cloud-hosted option that you can pay for if you don’t want to deal with the hassle of setting it up yourself.

But by the end of this video, you'll be able to add this great product to your data engineering toolbox.

https://youtu.be/oeshl0H1JcU

Airbyte Open-Source ELT data pipelines. Docker Compose Install
https://ivan-shamaev.ru/airbyte-open-source-elt-data-pipelines-docker-compose-install/

airflow.providers.airbyte.operators.airbyte — apache-airflow-providers-airbyte Documentation
https://airflow.apache.org/docs/apache-airflow-providers-airbyte/2.1.0/_api/airflow/providers/airbyte/operators/airbyte/index.html

GitHub - airbytehq/airflow-summit-airbyte-2022: git push your data stack with Airbyte, Airflow, and dbt - 2022 Airflow Summit
https://github.com/airbytehq/airflow-summit-airbyte-2022

The Open Source Data Platform - Airbyte

In Part 2: We are going to build on top of the best orchestration tool on the market, in my opinion, Prefect; while using Airbyte to perform lifts and shifts of data around our databases to ensure data parity and consistency in our Data Platform.

https://kjhealey.medium.com/the-open-source-data-platform-33ff5da0b2db

Airbyte — Promising Integration tool

https://medium.com/geekculture/airbyte-promising-integration-tool-6682f34f7711

https://movedata.airbyte.com/

Есть такие ребята Airbyte (https://airbyte.com), конкуренты Airflow, запускатор по расписанию, опенсорсный бесплатный и платный у них в облаке.
Так вот они решили организовать конференцию по Data Engineering.
Есть только даты (8-10 Ноября) и ссылка на Slack, программы пока нет.

Возможно, будет что-то интересное. А может и нет. Just FYI.

P.S. Аудитория подсказывает, что ближайшие конкуренты это Fivetran, Stitch или Hevo. Спасибо @nikbeesti


@ohmydataengineer

Automate your Data Scraping with Apache Airflow and Beautiful Soup

With this tutorial, learn how to easily automate LinkedIn web scraping

👉 @airbyte

https://airbyte.com/tutorials/data-scraping-with-airflow-and-beautiful-soup

The Data Practitioner Conference 7,8 December 2022

move(data) - The data engineering conference

👉 @airbyte

https://movedata.airbyte.com/

Catalog of Data Integration Connectors | Airbyte

With over 170+ connectors in our catalog Airbyte is addressing the long tail of connectors so your team doesn’t have to.

https://airbyte.com/connectors

Через 30 минут начнётся move data конференция (в 21 по мск)

https://movedata.airbyte.com/

Data Warehouse vs. Operational Database! What? How? Which One? | Airbyte
https://airbyte.com/blog/data-warehouse-vs-operational-database

Version control Airbyte configurations with Octavia CLI

https://airbyte.com/tutorials/version-control-airbyte-configurations

How to create your own Airbyte connector and pull data from Discord API

In this tutorial, we are going to explain how to create an Airbyte source connector for 3 endpoints of the Discord API using Airbyte’s CDK framework.

Among the advantages provided by the cdk system we can mention:
▫️Abstract ourselves from the code handling the connection.
▫️A vast number of pre-designed connectors.
▫️A series of tools to create both a source and a destination with ease.

https://www.fortisoft.io/how-to-create-your-own-airbyte-connector-and-pull-data-from-discord-api/

How to Create an Airbyte Python Destination: DuckDB
https://airbyte.com/tutorials/creating-duckdb-destination-with-python

Understanding OLAP: Online Analytical Processing in Data Engineering | Airbyte
https://airbyte.com/data-engineering-resources/olap