The Metadata Platform for your Data and AI Stack. Contribute to datahub-project/datahub development by creating an account on GitHub.

Learn to run Apache Hudi on Amazon EMR. Hudi provides upsert and delete capability for large datasets stored in Amazon S3. Hudi allows data to be ingested and updated in near real time.

There’s been a lot of activity in the data engineering world lately, and a ton of really interesting projects and ideas have come on the…

Find files with SQL-like queries. Contribute to jhspetersson/fselect development by creating an account on GitHub.

Zhamak Dehghani introduces Data Mesh, the next generation data platform, that shifts to a paradigm drawing from modern distributed architecture considering domains as the first class concern, applying platform thinking to create self-serve data infrastructure…

An operating system designed for hosting containers - bottlerocket-os/bottlerocket

Today’s analytics workloads typically require a data warehouse to be available 24 hours a day, 7 days a week. However, there may be times when you need an Amazon Redshift cluster for a short duration of time at frequent (or infrequent) intervals. For example…

With all this talk of Big Data, we got Rebecca Tickle to explain just what makes data into Big Data.

MapReduce: https://youtu.be/cvhKoniK5Uo

https://www.facebook.com/computerphile
https://twitter.com/computer_phile

This video was filmed and edited by…

Novel Coronavirus (COVID-19) Cases, provided by JHU CSSE - CSSEGISandData/COVID-19

Image: GitHub Microsoft-owned GitHub released its new mobile app today as a free download for iOS and Android. The app for the popular code repository service is primarily designed to help developers manage projects while away from their PC, letting them…

The theoretical bases for Machine Learning have existed for decades yet it wasn’t until the early 2000’s that the last AI winter came to an end.  Since then, interest in and use of machine learning has exploded and its development has been largely democratized…

Visit http://TED.com to get our entire library of TED Talks, trannoscripts, translations, personalized Talk recommendations and more.

The world's most valuable tech companies profit from the personal data you generate. So why aren't you getting paid for it?…

Visit the post for more.

Stay Home🏡, Stay Safe ❤️ #Airflow #DAG #CoronaVirus

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform. - san089/goodreads_etl_pipeline

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems - binhnguyennus/awesome-scalability

This post demonstrates how to install Dr. Elephant and Sparklens on an Amazon EMR cluster and run workloads to demonstrate these tools’ capabilities. Amazon EMR is a managed Hadoop service offered by AWS to easily and cost-effectively run Hadoop and other…