Day 24 of llm.c: we now do multi-GPU training, in bfloat16, with flash attention, directly in ~3000 lines of C/CUDA, and it is FAST! 🚀

We're running ~7% faster than PyTorch nightly, with no asterisks, i.e. this baseline includes all modern & standard bells…

It was the 28th of June, 2020; the perfect summer day. I remember it distinctly because of two important events that took place on that day. The first was the unfortunate discovery that I am highly sensitive to the venomous hairs of the Oak processionary…

A new consensus emerges.

Figma's team recently converted one of its codebases from a custom programming language to TypeScript without disrupting a single day of development.

Reflections on a philosopher who believed we can solve the problem of consciousness.

PHP Isn't dead, PHP is now better than ever. It has a greate ecosystem, with the best frameworks out there and being already used by big companies like Facebook, among others.

Study of fairy story origins traces some back thousands of years, with one tale dating back as far as bronze age

This is why people say the open source ecosystem sucks.

Structured data sources, such as tables, graphs, and databases, are ubiquitous knowledge sources. Despite the demonstrated capabilities of large language models (LLMs) on plain text, their...

Plant engineered to counter a debilitating vitamin A deficiency in developing countries has faced fierce opposition

A portable Common Lisp toolkit for building inspectors [MOVED TO CODEBERG] - aartaka/trivial-inspect

Lessons learned here hold solutions that can cross borders.

Inadvertent poisoning of scavengers across Indian subcontinent is forcing some communities to give up ancient custom

A decade-long effort to build a machine to unlock the promise of nuclear fusion fell victim to budget constraints and competing science, and was shut down the day it was dedicated. It was never turned on.

You know that mildly jarring experience whenever that well-known celebrity shows up in an entirely different context -- e.g. a musician making a horror