Links for 2025-05-05

AI

1. On the generalization of language models from in-context learning and finetuning: a controlled study https://arxiv.org/abs/2505.00661

2. Novel AI model inspired by neural dynamics from the brain https://news.mit.edu/2025/novel-ai-model-inspired-neural-dynamics-from-brain-0502

3. Physics of Language Models: Part 4.1, Architecture Design and the Magic of Canon Layers https://physics.allen-zhu.com/part-4-architecture-design/part-4-1

4. Nikolay Savinov predicts that the industry is going to achieve near perfect retrieval across 1-2M context length 'quite soon', and that soon afterwards a 10M token context window will become the norm. https://www.youtube.com/watch?v=NHMJ9mqKeMQ

5. What's going on with AI progress and trends? (As of 5/2025) https://www.lesswrong.com/posts/v7LtZx6Qk5e9s7zj3/what-s-going-on-with-ai-progress-and-trends-as-of-5-2025

6. Waymo robotaxis are safer than human drivers https://growsf.org/news/2025-05-02-waymo-safety/

7. Around 60% of students reported using AI themselves, while they estimated that nearly 90% of their peers use AI. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5232910

8. “I Recorded Everything I Said for Three Months. AI Has Replaced My Memory.” https://www.wsj.com/tech/personal-tech/ai-personal-assistant-wearable-tech-impressions-28156b57 [no paywall: https://archive.is/xac6J]

9. This Chart Might Keep You From Worrying About AI’s Energy Use https://spectrum.ieee.org/ai-energy

10. Will nuclear energy power the AI boom? https://thebaffler.com/latest/project-ludicrous-northwood [no paywall: https://archive.is/m8KCB]

11. Jensen: "First thing to understand: 50% of the world's AI researchers are Chinese." https://www.youtube.com/live/E2o9O0EVouA?si=RZdkLpin-k5C8kGZ&t=594

12. What if AI just keeps getting smarter? https://www.lesswrong.com/posts/MCaqKAfSn345MCz7o/ra-x-controlai-video-what-if-ai-just-keeps-getting-smarter

13. Where’s my ten minute AGI? – if AIs are actually able to perform most tasks on 1-hour task horizons, why don’t we see more real-world task automation? https://epochai.substack.com/p/wheres-my-ten-minute-agi

14. T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT https://arxiv.org/abs/2505.00703

15. Beyond the Last Answer: Your Reasoning Trace Uncovers More than You Think https://arxiv.org/abs/2504.20708

Miscellaneous

1. Novel High Resolution 3D Printing Method for Metals and Ceramics https://www.youtube.com/watch?v=kLgPW2672s4

2. Non-linear Ethnic Niches: The emerging Western caste system https://substack.com/home/post/p-162313414

3. Mathematician solves algebra’s oldest problem using intriguing new number sequences: “This is a dramatic revision of a basic chapter in algebra.” https://www.unsw.edu.au/newsroom/news/2025/05/mathematician-solves-algebras-oldest-problem-using-intriguing-new-number-sequences

Replacing Kubernetes with systemd (2024)
Article, Comments

Somewhat agree but they won't process the payment to Shiloh, just to let everyone know of this speculation.

And that's the optimistic outlook.

Extending a Language – Writing Powerful Macros in Scheme
Article, Comments

old voice clip from placeholder alt before he deleted it

trvthnvke
https://niggerx.com/danfaggella/status/1920653151864078544

The article gives the following explanation for this graph:

On that score, the big AI companies seem to think they are close to AGI. One giveaway is reflected in their own hiring practices. According to Zeki Data, the top 15 US AI companies had been frantically hiring software engineers at a rate of up to 3,000 a month, recruiting a total of 500,000 between 2011 and 2024. But lately their net monthly hiring rate has dropped to zero as these companies anticipate that AI agents can perform many of the same tasks.

I have my doubts about this, and I'm confident that we'll be able to replace at least 90% of all software engineers within the next decade. However, I can't think of any other plausible explanations. Progress in AI definitely looks more promising than it did in 2011, so a new AI winter cannot be the explanation.

Source: https://www.ft.com/content/49ad6c69-9b67-48da-a274-8408dfdaa7cb

No paywall: https://archive.is/c4lT0

https://youtu.be/5diqqtrIG4c

>Buy the org-mode reference manual
>Look inside
>Hitler's Table Talk book

o7 to the legend

What did I ever do to this guy

Buy your GPUs now

Never let your job prevent you from acting unemployed

Sry had to further annotate because it's easy to miss from my POV

Ask HN: What will tech employment look like in 10 years?
Article, Comments