Links for 2023-12-29

1. “AGI will be made of heterogeneous components, Transformer and Selective SSM blocks will be among them” https://www.lesswrong.com/posts/Btom6dX5swTuteKce/agi-will-be-made-of-heterogeneous-components-transformer-and

2. Synaptic transistor models higher-level thinking mimics human intelligence https://interestingengineering.com/science/synaptic-transistor-models-higher-level-thinking-mimics-human-intelligence

3. “I believe games (and simulation in general) will provide the next trillion high-quality tokens to train our foundation models. What's cool is that these tokens are actively selected by the agent itself through exploration. It can choose to experiment with things that maximally reduce its internal uncertainties - kind of like how human curiosity works.” https://twitter.com/DrJimFan/status/1740422792695382067

4. AI Robot Outmaneuvers Humans in Maze Run Breakthrough https://www.bloomberg.com/news/articles/2023-12-19/ai-masters-simple-physical-game-in-breakthrough-researchers-say [https://archive.is/0EsCD]

5. Chips to Compute With Encrypted Data Are Coming https://spectrum.ieee.org/homomorphic-encryption

6. Can Flow Batteries Finally Beat Lithium? https://spectrum.ieee.org/flow-battery-2666672335

7. The Economics of Time Travel https://www.theseedsofscience.pub/p/the-economics-of-time-travel

8. “…fungi are an underestimated threat and that our actions are causing an increase in invasive and deadly fungal epidemics. We explore what is at stake, why this is happening now, and what we can do to prevent future outbreaks.” https://youarenotsosmart.com/2023/12/11/yanss-275-could-a-fungus-that-takes-over-the-minds-of-living-creatures-really-cause-a-deadly-pandemic-in-humans-like-in-the-last-of-us/

9. The case for race realism https://www.aporiamagazine.com/p/the-case-for-race-realism

Links for 2023-12-30

1. Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations. — With Math-Shepherd, Mistral-7B fine-tuned on MetaMATH achieves accuracy rates of 89.1% and 43.5% on GSM8K and MATH, respectively. https://arxiv.org/abs/2312.08935

2. Generative AI for Math: MathPile — Presents a diverse and high-quality math-centric corpus comprising about 9.5B tokens https://gair-nlp.github.io/MathPile/

3. Autonomous chemical research with large language models https://www.nature.com/articles/s41586-023-06792-0

4. Pangu-Agent: A Fine-Tunable Generalist Agent with Structured Reasoning https://arxiv.org/abs/2312.14878

5. The Truth is in There: Improving Reasoning in Language Models with Layer-Selective Rank Reduction https://arxiv.org/abs/2312.13558

6. 3D Reconstruction in Plato's Cave via Single-View Two-Bounce Lidar https://platonerf.github.io/

7. Amazing AI depth estimation from a single image https://twitter.com/Enuriru/status/1739289099540816339

8. VCoder: Versatile Vision Encoders for Multimodal Large Language Models https://praeclarumjj3.github.io/vcoder/

Static fire of Super Heavy’s 33 Raptor engines ahead of Flight 3

MonadGPT is a chatbot trained on 11,000 early modern texts in English, French, and Latin — up to the 17th century.

Chat now: https://huggingface.co/spaces/Pclanglais/MonadGPT

"It's not just time zones and leap seconds. SI seconds on Earth are slower because of relativity, so there are time standards for space stuff (TCB, TGC) that use faster SI seconds than UTC/Unix time. T2 - T1 = [God doesn't know and the Devil isn't telling.]"

https://xkcd.com/2867/

Links for 2023-12-31

AI:

1. TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones — “Our work fosters further developments for designing cost-effective, efficient, and high-performing MLLMs, expanding their applicability in a broad array of real-world scenarios.” https://arxiv.org/abs/2312.16862

2. Humanoids from Agility Robotics and seven other companies vie for jobs https://spectrum.ieee.org/humanoid-robots

3. Forget $40,000 Teslas. You can set up autonomous driving on cars with a 150$ smartphone using Flowpilot. https://github.com/flowdriveai/flowpilot

4. Apple’s iPhone Design Chief Enlisted by Jony Ive, Sam Altman to Work on AI Devices https://www.bloomberg.com/news/articles/2023-12-26/apple-iphone-design-head-tang-tan-to-work-with-jony-ive-sam-altman-on-ai-tech [https://archive.is/se4MM]

5. Meta: “To close out 2023, here are 10 of the most interesting AI research advancements we shared on our feed this year — and where you can find more details on the work.” https://twitter.com/AIatMeta/status/1741159501494165979

Miscellaneous:

1. E.T. Jaynes Probability Theory: The logic of Science I https://www.lesswrong.com/posts/KN3BYDkWei9ADXnBy/e-t-jaynes-probability-theory-the-logic-of-science-i

2. Cosine: The exact moment Jeff Bezos decided not to become a physicist https://www.youtube.com/watch?v=eFnV6EM-wzY

Genetics and Psychology:

1. "We show personality as less important than intelligence in predicting life outcomes... For pay the predictive validity of intelligence [was] twice as high as that of personality... For educational attainment and grades it was 4.4 and 5.2 as high." https://www.sciencedirect.com/science/article/abs/pii/S0160289622000125

The most popular programming languages since 1965 to 2022

🇰🇷 Ever wonder how a missile defense kill vehicle behave in the near-vaccum, where air is too thin to use fins (typically above 30 or 40 km) ? Here is a demonstration of South Korean L-SAM ABM kill vehicle during ground tests in a cage.

More: https://twitter.com/mason_8718/status/1741061585865670878

Pilot's view from the cockpit landing at night.

Earthquake in Japan. Footage of the Shinkansen station in Ishikawa.

Links for 2024-01-01

AI:

1. LARP: Language-Agent Role Play for Open-World Games — “…includes a cognitive architecture that encompasses memory processing and a decision-making assistant, an environment interaction module with a feedback-driven learnable action space, and a postprocessing method that promotes the alignment of various personalities.” https://miao-ai-lab.github.io/LARP/

2. Unified-IO 2: the first autoregressive multimodal model that is capable of understanding and generating images, text, audio, and action https://unified-io-2.allenai.org/

3. InsActor: Instruction-driven Physics-based Characters https://jiawei-ren.github.io/projects/insactor/

4. Unsupervised Universal Image Segmentation https://github.com/u2seg/U2Seg

5. Compact Neural Graphics Primitives with Learned Hash Probing https://research.nvidia.com/labs/toronto-ai/compact-ngp/

6. NYT calls for the total destruction of all extant major LLMs https://twitter.com/Dan_Jeffries1/status/1741053592335733196

Miscellaneous:

1. In defense of science fiction https://www.noahpinion.blog/p/in-defense-of-science-fiction

Psychology:

1. “Contrary to hysteria around dating apps driving young male sexlessness, we actually see that the men who remain virgins both abstain from dating app use and from pornography use.” https://twitter.com/datepsych/status/1740580436810531167

2. “In Israel, the Ethiopian Jews score lower in cognitive tests than Arabs, despite them being part of the Jewish majority and therefore privileged, despite no history of slavery, Jim Crow, etc.” — Richard Hanania https://www.cremieux.xyz/p/updated-estimates-of-iqs-within-israel

Politics:

1. The Swiss newspaper-of-record Neue Zürcher Zeitung reports that in Germany ~1000 women per year are raped or sexually assaulted by asylum-seekers. https://www.nzz.ch/international/asyl-und-sexualverbrechen-tausende-frauen-opfer-von-fluechtlingen-ld.1769909

I expect AI to conquer the physical world within this decade. Robots that can do useful work.

Video source: https://twitter.com/zipengfu/status/1740793345923051811

Two Male Bears fight to compete for a female.