According to the news, Tesla engineers visit Twitter for code reviews.
Bloomberg.com
Tesla Engineers Visit Twitter Office to Review Code for Musk
Useful Python library for data validation that has Rust based core.
https://pydantic-docs.helpmanual.io/
https://pydantic-docs.helpmanual.io/
👍1
EP31: Super High-performance NoSQL and MQ - by Alex Xu
https://blog.bytebytego.com/p/ep31-super-high-performance-nosql
https://blog.bytebytego.com/p/ep31-super-high-performance-nosql
ByteByteGo Newsletter
EP31: Super High-performance NoSQL and MQ
This week’s system design refresher: ByteByteGo talent collective Data Platform What is an API gateway Super high-performance NoSQL and MQ How to scale from 0 to millions of users - spooky edition ByteByteGo talent collective This week has been rough. Lots…
👍1
End-to-end Machine Learning for Everyone - PostgresML
https://postgresml.org/
https://postgresml.org/
GitHub
GitHub - postgresml/postgresml: Postgres with GPUs for ML/AI apps.
Postgres with GPUs for ML/AI apps. Contribute to postgresml/postgresml development by creating an account on GitHub.
Currently I am reading Harari's Sapiens where he explains how the current economic system depends on growth and trust in the future. I think in IT it is really vivid. There are some good points in this analysis.
YouTube
What's Going On With Big Tech...? (tech recession)
With so many big tech stocks cratering, including FAANG stocks, and tech companies shutting down, laying off software engineers, or going through hiring freezes, it's easy to panic and to wonder if the tech bubble has completely burst and if the tech industry…
👍4
2003–2023: A Brief History of Big Data | by Furcy Pin | Nov, 2022 | Towards Data Science
https://towardsdatascience.com/2003-2023-a-brief-history-of-big-data-25712351a6bc
https://towardsdatascience.com/2003-2023-a-brief-history-of-big-data-25712351a6bc
Medium
2003–2023: A Brief History of Big Data
Summing up 20 years of history of Hadoop and everything related
👍2
The Distributed Computing Manifesto | All Things Distributed
https://www.allthingsdistributed.com/2022/11/amazon-1998-distributed-computing-manifesto.html
https://www.allthingsdistributed.com/2022/11/amazon-1998-distributed-computing-manifesto.html
All Things Distributed
The Distributed Computing Manifesto
Today, I am publishing the Distributed Computing Manifesto, a canonical document from the early days of Amazon that transformed the architecture of Amazon's ecommerce platform. It highlights the challenges we were facing at the end of the 20th century, and…
👍1
Announcing the latest version of the AWS Well-Architected Data Analytics Lens | AWS Big Data Blog
https://aws.amazon.com/blogs/big-data/announcing-the-latest-version-of-the-aws-well-architected-data-analytics-lens/
https://aws.amazon.com/blogs/big-data/announcing-the-latest-version-of-the-aws-well-architected-data-analytics-lens/
Amazon
Announcing the AWS Well-Architected Data Analytics Lens | Amazon Web Services
We are delighted to announce the latest version of the Data Analytics Lens, an AWS Well-Architected whitepaper. AWS Well-Architected provides a consistent approach to evaluate architectures and implement scalable designs. The AWS Well-Architected Framework…
Second Lex Fridman podcast with the creator of Python.
YouTube
Guido van Rossum: Python and the Future of Programming | Lex Fridman Podcast #341
Guido van Rossum is the creator of Python programming language. Please support this podcast by checking out our sponsors:
- GiveDirectly: https://givedirectly.org/lex to get gift matched up to $1000
- Eight Sleep: https://www.eightsleep.com/lex to get special…
- GiveDirectly: https://givedirectly.org/lex to get gift matched up to $1000
- Eight Sleep: https://www.eightsleep.com/lex to get special…
👍5🔥1
Take your first steps with Rust - Training | Microsoft Learn
https://learn.microsoft.com/en-us/training/paths/rust-first-steps/
https://learn.microsoft.com/en-us/training/paths/rust-first-steps/
Docs
Browse all training - Training
Learn new skills and discover the power of Microsoft products with step-by-step guidance. Start your journey today by exploring our learning paths and modules.
👍3
AWS Glue announces AWS Glue Data Quality (Preview)
https://aws.amazon.com/about-aws/whats-new/2022/11/aws-glue-data-quality-preview/
https://aws.amazon.com/about-aws/whats-new/2022/11/aws-glue-data-quality-preview/
Amazon
AWS Glue announces AWS Glue Data Quality (Preview)
Amazon Redshift now supports auto-copy from Amazon S3
https://aws.amazon.com/about-aws/whats-new/2022/11/amazon-redshift-supports-auto-copy-amazon-s3/
https://aws.amazon.com/about-aws/whats-new/2022/11/amazon-redshift-supports-auto-copy-amazon-s3/
Blockchain is becoming quite a popular dataset type.
Functional Works
How to export a full Ethereum history into S3, efficiently
Blockchain technologies are not a geeky thing anymore and many companies run their business around crypto assets. A popular scenario is to build a Data Platform operating blockchain data and launch analytical and realtime services on top of it. This is what…
Data1984
I wrote a summary where I compare Azure Synapse, Databricks and Azure Data Explorer focusing on the features that I find important. https://medium.com/@gorros/azure-synapse-databricks-and-azure-data-explorer-kusto-73a3a0339cf2
I decided to ask a ChatGPT following questions "What are the differences between Azure Synapse, Databricks, and Azure Data Explorer (Kusto)?" to compare with the review I wrote a while ago. Here is what I've got as an answer:
Azure Synapse, Databricks, and Azure Data Explorer (Kusto) are all Microsoft Azure services that are focused on data analytics and big data processing. While they have some similarities, there are also some key differences between the three.
Azure Synapse is a cloud-based data integration and analytics platform that combines enterprise data warehousing, big data integration and processing, and data integration and orchestration into a single platform. It is designed to help organizations quickly and easily integrate, process, and analyze large volumes of data from a wide range of sources.
Databricks is a cloud-based platform for data engineering, data science, and analytics. It is based on the open-source Apache Spark project, and it provides a managed environment for running Spark jobs, as well as tools for collaboration, data management, and machine learning.
Azure Data Explorer (Kusto) is a fast, highly scalable data exploration service that is optimized for log and time-series data. It is designed to help organizations quickly and easily analyze large volumes of data to gain insights and understand patterns and trends in their data.
Overall, each of these services has its own strengths and is suited to different use cases. Azure Synapse is a good choice for organizations that need a comprehensive data integration and analytics platform, while Databricks is a good choice for data engineering and data science workloads, and Azure Data Explorer is a good choice for analyzing log and time-series data.
Azure Synapse, Databricks, and Azure Data Explorer (Kusto) are all Microsoft Azure services that are focused on data analytics and big data processing. While they have some similarities, there are also some key differences between the three.
Azure Synapse is a cloud-based data integration and analytics platform that combines enterprise data warehousing, big data integration and processing, and data integration and orchestration into a single platform. It is designed to help organizations quickly and easily integrate, process, and analyze large volumes of data from a wide range of sources.
Databricks is a cloud-based platform for data engineering, data science, and analytics. It is based on the open-source Apache Spark project, and it provides a managed environment for running Spark jobs, as well as tools for collaboration, data management, and machine learning.
Azure Data Explorer (Kusto) is a fast, highly scalable data exploration service that is optimized for log and time-series data. It is designed to help organizations quickly and easily analyze large volumes of data to gain insights and understand patterns and trends in their data.
Overall, each of these services has its own strengths and is suited to different use cases. Azure Synapse is a good choice for organizations that need a comprehensive data integration and analytics platform, while Databricks is a good choice for data engineering and data science workloads, and Azure Data Explorer is a good choice for analyzing log and time-series data.
👍2
https://aws.amazon.com/blogs/big-data/introducing-the-cloud-shuffle-storage-plugin-for-apache-spark/
Amazon
Introducing the Cloud Shuffle Storage Plugin for Apache Spark | Amazon Web Services
AWS Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning (ML), and application development. In AWS Glue, you can use Apache Spark, an open-source, distributed processing system…