Demystifying attention, the key mechanism inside transformers and LLMs.
Instead of sponsored ad reads, these lessons are funded directly by viewers: https://3b1b.co/support
Special thanks to these supporters: https://www.3blue1brown.com/lessons/attention#thanks…

Some screaming was involved

High in the Alps, two Swiss companies are repurposing obsolete satellite antennas into giant solar panels, taking advantage of Switzerland's mountainous terrain to generate much-needed green energy.

Regulations that evoke civilian protection measures are needed when autonomous weapons systems are deployed.

The untold story of Lore Harp McGovern

Reverse Tunnels in Go over HTTP/3 and QUIC. Contribute to flipt-io/reverst development by creating an account on GitHub.

Former employees report being unceremoniously laid off by their stores, reports 404 Media.

We’re sharing a few ways to use the new Find My Device experience on Android.

Watch a telescope feed of a total solar eclipse moving across North America on April 8, 2024, traveling through Mexico, across the United States from Texas to Maine, and exiting North America along Canada’s coast. Weather permitting, we will provide live…

A pluggable and configurable linter tool for identifying and reporting on patterns in JavaScript. Maintain your code quality with ease.

Just four months after a complete power outage at a critical data center we were hit with the exact same scenario. Here’s how we did this time, and what’s next.

Single-molecule device embraces electrons’ weirdness to improve performance

For many decades, it seemed professional Go players had reached a hard limit on how well it is possible to play. Then AI beat them.

Their groundbreaking learning bridge technology increased LAN performance

Daniel shares with us some of the fruits of research into computer keyboard history conducted over recent years. In this case, the surprising variety of methods by which keyboards determined which keys are being pressed.

LLM training in simple, raw C/CUDA. Contribute to karpathy/llm.c development by creating an account on GitHub.

UPDATE, 2024-04-09: I’ve found out that I didn’t filter out the dead and deleted stories and comments from my analysis. I’ve updated the analysis accordingly. While there are changes in the numbers and figures, the patterns and observations stand. I’ve also…

I am deep in the rabbit hole of looking into an apparently deeply scammy looking zsh plugin manager called "zi".

I think it's an extremely bad idea to use "z-shell/zi" or anything else from the same "creators". There's an entire field of red flags here.

Fully cross platform dotfile manager and dev environment bootstrapper written in Rust.