Nubank is a popular bank that is based in Brazil. Nubank has more than 20 million customers, and has accumulated a high volume of data over the six years since it was started. Mobile computing and cloud computing have given rise to “challenger banks” that…

Apache Spark 4.1.0 documentation homepage

Download slides: https://www.datacouncil.ai/talks/functional-data-engineering-a-set-of-best-practices?utm_source=youtube&utm_medium=social&utm_campaign=%20-%20DEC-SF-18%20Slides%20Download

ABOUT THE TALK:

Batch data processing (also known as ETL)  is time…

In this article, we discuss how to set up a local Apache Spark development environment on Windows 10.

Changing the world, one data model at a time. How can I help you?

Data infrastructure has been transformed over the last fifteen years. The open source Hadoop project led to the creation of multiple companies based around commercializing the MapReduce algorithm and Hadoop distributed file system. Cheap cloud storage popularized…

Looking to hire a data or machine learning engineer? You’re not alone, as those two positions are among the fastest growing jobs in the country, according

Secure and fast microVMs for serverless computing. - firecracker-microvm/firecracker

Apache Superset is a Data Visualization and Data Exploration Platform - apache/superset

Materialize helps you transform, deliver, and act on fast-changing data, just using SQL.

Easily build auto-scaling, low-overhead applications on AWS Lambda, API Gateway, DynamoDB, and other managed services with the Serverless Framework.

The Metadata Platform for your Data and AI Stack. Contribute to datahub-project/datahub development by creating an account on GitHub.

Learn to run Apache Hudi on Amazon EMR. Hudi provides upsert and delete capability for large datasets stored in Amazon S3. Hudi allows data to be ingested and updated in near real time.

There’s been a lot of activity in the data engineering world lately, and a ton of really interesting projects and ideas have come on the…

Find files with SQL-like queries. Contribute to jhspetersson/fselect development by creating an account on GitHub.

Zhamak Dehghani introduces Data Mesh, the next generation data platform, that shifts to a paradigm drawing from modern distributed architecture considering domains as the first class concern, applying platform thinking to create self-serve data infrastructure…