airflow.providers.airbyte.operators.airbyte — apache-airflow-providers-airbyte Documentation
https://airflow.apache.org/docs/apache-airflow-providers-airbyte/2.1.0/_api/airflow/providers/airbyte/operators/airbyte/index.html
https://airflow.apache.org/docs/apache-airflow-providers-airbyte/2.1.0/_api/airflow/providers/airbyte/operators/airbyte/index.html
GitHub - airbytehq/airflow-summit-airbyte-2022: git push your data stack with Airbyte, Airflow, and dbt - 2022 Airflow Summit
https://github.com/airbytehq/airflow-summit-airbyte-2022
https://github.com/airbytehq/airflow-summit-airbyte-2022
GitHub
GitHub - airbytehq/airflow-summit-airbyte-2022: git push your data stack with Airbyte, Airflow, and dbt - 2022 Airflow Summit
git push your data stack with Airbyte, Airflow, and dbt - 2022 Airflow Summit - airbytehq/airflow-summit-airbyte-2022
The Open Source Data Platform - Airbyte
In Part 2: We are going to build on top of the best orchestration tool on the market, in my opinion, Prefect; while using Airbyte to perform lifts and shifts of data around our databases to ensure data parity and consistency in our Data Platform.
https://kjhealey.medium.com/the-open-source-data-platform-33ff5da0b2db
In Part 2: We are going to build on top of the best orchestration tool on the market, in my opinion, Prefect; while using Airbyte to perform lifts and shifts of data around our databases to ensure data parity and consistency in our Data Platform.
https://kjhealey.medium.com/the-open-source-data-platform-33ff5da0b2db
Medium
The Open Source Data Platform
Part 2 — Extract and Load: Airbyte
Forwarded from 🔋 Труба данных
https://movedata.airbyte.com/
Есть такие ребята Airbyte (https://airbyte.com), конкуренты Airflow, запускатор по расписанию, опенсорсный бесплатный и платный у них в облаке.
Так вот они решили организовать конференцию по Data Engineering.
Есть только даты (8-10 Ноября) и ссылка на Slack, программы пока нет.
Возможно, будет что-то интересное. А может и нет. Just FYI.
P.S. Аудитория подсказывает, что ближайшие конкуренты это Fivetran, Stitch или Hevo. Спасибо @nikbeesti
@ohmydataengineer
Есть такие ребята Airbyte (https://airbyte.com), конкуренты Airflow, запускатор по расписанию, опенсорсный бесплатный и платный у них в облаке.
Так вот они решили организовать конференцию по Data Engineering.
Есть только даты (8-10 Ноября) и ссылка на Slack, программы пока нет.
Возможно, будет что-то интересное. А может и нет. Just FYI.
P.S. Аудитория подсказывает, что ближайшие конкуренты это Fivetran, Stitch или Hevo. Спасибо @nikbeesti
@ohmydataengineer
Airbyte
move(data) - The data engineering conference
move(data) is celebrating the hard work and dedication of data engineers and practitioners worldwide! We’re hosting talks with speakers who have spent countless hours working on data movement.
Automate your Data Scraping with Apache Airflow and Beautiful Soup
With this tutorial, learn how to easily automate LinkedIn web scraping
👉 @airbyte
https://airbyte.com/tutorials/data-scraping-with-airflow-and-beautiful-soup
With this tutorial, learn how to easily automate LinkedIn web scraping
👉 @airbyte
https://airbyte.com/tutorials/data-scraping-with-airflow-and-beautiful-soup
Airbyte
How to Scrape LinkedIn Profiles Using Airflow & BeautifulSoup | Airbyte
Learn how to easily automate your LinkedIn Scraping with Airflow and Beautiful Soup in this recipe.
The Data Practitioner Conference 7,8 December 2022
move(data) - The data engineering conference
👉 @airbyte
https://movedata.airbyte.com/
move(data) - The data engineering conference
👉 @airbyte
https://movedata.airbyte.com/
Airbyte
move(data) - The data engineering conference
move(data) is celebrating the hard work and dedication of data engineers and practitioners worldwide! We’re hosting talks with speakers who have spent countless hours working on data movement.
👍1
Catalog of Data Integration Connectors | Airbyte
With over 170+ connectors in our catalog Airbyte is addressing the long tail of connectors so your team doesn’t have to.
https://airbyte.com/connectors
With over 170+ connectors in our catalog Airbyte is addressing the long tail of connectors so your team doesn’t have to.
https://airbyte.com/connectors
Airbyte
Catalog of Data Integration Connectors | Airbyte
Here's the list of data sources and destinations that Airbyte supports: APIs, files, databases, APIs, data warehouses, data lakes, etc.
❤1
Airbyte - move(data) '22
Видео с конференции
https://youtube.com/playlist?list=PLgyvStszwUHjko19Z3PxkBxApbxgVjWp8
Видео с конференции
https://youtube.com/playlist?list=PLgyvStszwUHjko19Z3PxkBxApbxgVjWp8
Data Warehouse vs. Operational Database! What? How? Which One? | Airbyte
https://airbyte.com/blog/data-warehouse-vs-operational-database
https://airbyte.com/blog/data-warehouse-vs-operational-database
Airbyte
Data Warehouse vs. Operational Database! What? How? Which One? | Airbyte
Learn about the fundamental difference between a data warehouse and an operational database!
Version control Airbyte configurations with Octavia CLI
https://airbyte.com/tutorials/version-control-airbyte-configurations
https://airbyte.com/tutorials/version-control-airbyte-configurations
Airbyte
Version control Airbyte configurations with Octavia CLI | Airbyte
Use Octavia CLI to import, edit, and apply Airbyte application configurations.
👍1
How to create your own Airbyte connector and pull data from Discord API
In this tutorial, we are going to explain how to create an Airbyte source connector for 3 endpoints of the Discord API using Airbyte’s CDK framework.
Among the advantages provided by the cdk system we can mention:
▫️Abstract ourselves from the code handling the connection.
▫️A vast number of pre-designed connectors.
▫️A series of tools to create both a source and a destination with ease.
https://www.fortisoft.io/how-to-create-your-own-airbyte-connector-and-pull-data-from-discord-api/
In this tutorial, we are going to explain how to create an Airbyte source connector for 3 endpoints of the Discord API using Airbyte’s CDK framework.
Among the advantages provided by the cdk system we can mention:
▫️Abstract ourselves from the code handling the connection.
▫️A vast number of pre-designed connectors.
▫️A series of tools to create both a source and a destination with ease.
https://www.fortisoft.io/how-to-create-your-own-airbyte-connector-and-pull-data-from-discord-api/
Fortisoft
How to create your own Airbyte connector and pull data from Discord API - Fortisoft
If you have already completed the official tutorial and the PokeAPI tutorial, and are looking to level up your connector development skills, then you are in
❤1
How to Create an Airbyte Python Destination: DuckDB
https://airbyte.com/tutorials/creating-duckdb-destination-with-python
https://airbyte.com/tutorials/creating-duckdb-destination-with-python
Airbyte
How to Create an Airbyte Python Destination: DuckDB | Airbyte
A walk-through on how to create an Airbyte DuckDB destination. All code changes are within a single PR for reference.
Understanding OLAP: Online Analytical Processing in Data Engineering | Airbyte
https://airbyte.com/data-engineering-resources/olap
https://airbyte.com/data-engineering-resources/olap
Airbyte
Understanding OLAP Data: A Guide to Enhanced Analytical Insights | Airbyte
Discover how OLAP data can transform your analytical processes and enhance insights. Learn practical applications and improve your data strategy today.
👍4