Great work on the projects!

Here is the feedback: https://docs.google.com/spreadsheets/d/e/2PACX-1vQuMt9m1XlPrCACqnsFTXTV_KGiSnsl9UjL7kdTMsLJ8DLu3jNJlPzoUKG6baxc8APeEQ8RaSP1U2VX/pubhtml?gid=27207346&single=true

The updated leaderboard: https://docs.google.com/spreadsheets/d/e/2PACX-1vTbL00GcdQp0bJt9wf1ROltMq7s3qyxl-NYF7Pvk79Jfxgwfn9dNWmPD_yJHTDq_Wzvps8EIr6cOKWm/pubhtml

Dave recorded the solution to the PipeRider homework. You can check it here: https://www.youtube.com/watch?v=inNrUys7W8U&list=PL3MmuxUbc_hJjEePXIdE-LVUx_1ZZjYGW

We have two announcements

First, the deadline for the project is extended by one week. The new due date is the 4th of May

Also, we have generated the certificates for those who completed the first project. Here's an example: https://certificate.datatalks.club/dezoomcamp/2023/fe629854d45c559e9c10b3b8458ea392fdeb68a9.pdf

Instructions how to get a certificate: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cerficates.md

Later (hopefully not too late) you will receive an email with your personal link, but for now you can generate this link yourself. Pay attention to the hash - it's not the same as in the leaderboard

Great work on the projects!

Here's the peer review assignments: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2023/project.md#project-attempt-2

Find your hash in the table and submit 3 reviews in the form for submissions.

Have fun learning from your peers!

Great work on the projects!

Now the scores are available in the updated leaderboard: https://docs.google.com/spreadsheets/d/e/2PACX-1vTbL00GcdQp0bJt9wf1ROltMq7s3qyxl-NYF7Pvk79Jfxgwfn9dNWmPD_yJHTDq_Wzvps8EIr6cOKWm/pubhtml

You can see the feedback here: https://docs.google.com/spreadsheets/d/e/2PACX-1vQuMt9m1XlPrCACqnsFTXTV_KGiSnsl9UjL7kdTMsLJ8DLu3jNJlPzoUKG6baxc8APeEQ8RaSP1U2VX/pubhtml?gid=246029638&single=true

You can access your certificates using these instructions: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cerficates.md

Hi everyone!

If you have finished among the top-100 participants (according to the leaderboard), please check your email. You will find a link to a form there, which you need to fill out if you want to be on a public leaderboard of the course. Please do it within one week.

If you don't want to be on the public leaderboard, just ignore the email.

If you think you should have received an email but you didn't, please let Alexey know.

We will have two interesting workshops pretty soon:

- Identity resolution - we will see how to recognize that two different accounts belong to the same user. This is often a very important task when merging multiple datasets. Sign up here: https://www.eventbrite.com/e/identity-resolution-essentials-from-a-data-scientist-tickets-654866582577

- Mage - a workflow orchestration tool, a nice alternative to Airflow and Prefect. We will see how to set up a simple pipeline with Mage. Sign up here: https://eventbrite.com/e/647017044397

Here's the public top-100 leaderboard!

https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2023/leaderboard.md

Thanks everyone for taking part in the course

We're starting a workshop about Mage, you can join it here or watch it later in recording:

https://www.youtube.com/watch?v=nUfAqM2Sguc

Hey everyone!

We're about to start another workshop about Mage, it might be relevant to some of you

here's a link to the stream: https://www.youtube.com/watch?v=JKALtxziBG0

(As always you can watch it later)

Hi everyone!

The next iteration of the course is starting soon (in 1.5 months). In the meantime, you probably have a ton of questions

That's why we organize a Q&A stream on December 18 (Monday) at 17:00 CET where we will answer all your questions

Sign up here: https://lu.ma/1u1jlz4x

Also, on Monday (tomorrow) we will have a workshop that many of you will find relevant. We will talk about using Terraform for setting up a data warehouse (ClickHouse)

Sign up here: https://lu.ma/5fil21de

We're starting the workshop about Terraform and ClickHouse

Join now or watch later in replay

https://www.youtube.com/watch?v=YFr_5NTjv0Q

We're starting the Q&A stream in 30 minutes

In the meantime, you can already ask your questions here: https://app.sli.do/event/su9wCLiM9nHnCwtGBfgicX

Live stream: https://www.youtube.com/watch?v=91b8u9GmqB4

(Available for replay later)

Ask your questions here: https://app.sli.do/event/su9wCLiM9nHnCwtGBfgicX

If you're wondering what you should do to prepare the environment for the course, check these two videos

- Using GitHub Codespaces: https://www.youtube.com/watch?v=XOSUt8Ih3zA&list=PL3MmuxUbc_hJed7dXYoJw8DoCuVHhGEQb (Thanks Luis for recording it!)
- Using a GCP VM: https://www.youtube.com/watch?v=ae-CV2KfoN0&list=PL3MmuxUbc_hJed7dXYoJw8DoCuVHhGEQb

Many of you ask how much time you should devote to the course. The answer we have previously given was "it depends".

But actually we collected some data in the past editions of the course that can give a more accurate answer

Here's the dataset: https://github.com/DataTalksClub/zoomcamp-analytics/tree/main/data/de-zoomcamp-2023 (it also contains data from other courses)

You can do some analytics and then share the results with us

In this repo you can also find a notebook from Timur, our past student and teaching assistant, who did the analysis for the first edition of ML Zoomcamp. Half of his notebook is devoted to data cleaning, but actually DE Zoomcamp 2023 data is much cleaner, so most of it is not needed anymore

Have fun!

We're starting today at 17:00 CET! (In approximately 7 hours from now)

You can ask your questions in advance using this link:

https://app.sli.do/event/su9wCLiM9nHnCwtGBfgicX

See you soon!

We're starting!

Watch here: https://www.youtube.com/watch?v=AtRhA-NfS24 (or later in replay)

Ask questions here: https://app.sli.do/event/su9wCLiM9nHnCwtGBfgicX

We're starting working on module 1 today

Content: https://github.com/DataTalksClub/data-engineering-zoomcamp/tree/main/01-docker-terraform

Homework: https://github.com/DataTalksClub/data-engineering-zoomcamp/blob/main/cohorts/2024/01-docker-terraform/homework.md (due in 2 weeks)

We will share the link to the homework form soon

Happy learning!

The form for submitting homework 1: https://courses.datatalks.club/de-zoomcamp-2024/homework/hw01

(Please ignore the "This homework is already scored. You didn't submit your answers." part - it's a bug which we'll fix later)

This platform is under active development, but hopefully you won't have any problems.

If you come across a problem, you can report it in the #course-management-platform channel

If you're interested in how it works, the code is here: https://github.com/DataTalksClub/course-management-platform