Forwarded from Chat GPT
General intelligence is all you need for LLMs: General intelligence 2x more predictive of AI abilities than in humans.
Man gives LLMs IQ testing, finds the general intelligence factor, g, measured by this testing to be incredibly powerful in predicting LLM’s abilities.
Whereas in humans this g factor typically accounts for 40% to 50% of the between-individual performance differences on a given cognitive test — in LLMs, general intelligence accounted for 85.4% = twice as strong as in humans!
He then goes on to rank AI benchmarks commonly used for LLMs today, and finds many of them incredibly g-loaded — in other words, doing well on them is heavily dependant on general intelligence.
Finally, he ranks LLMs by general intelligence, and finds a moderate/strong positive relationship between model size and g. (Would probably find an extremely strong correlation if only model size was varied, and nothing else about the training process.)
If you had to choose 1 measure, general intelligence really is all you need.
Paper
g factor
Man gives LLMs IQ testing, finds the general intelligence factor, g, measured by this testing to be incredibly powerful in predicting LLM’s abilities.
Whereas in humans this g factor typically accounts for 40% to 50% of the between-individual performance differences on a given cognitive test — in LLMs, general intelligence accounted for 85.4% = twice as strong as in humans!
He then goes on to rank AI benchmarks commonly used for LLMs today, and finds many of them incredibly g-loaded — in other words, doing well on them is heavily dependant on general intelligence.
Finally, he ranks LLMs by general intelligence, and finds a moderate/strong positive relationship between model size and g. (Would probably find an extremely strong correlation if only model size was varied, and nothing else about the training process.)
If you had to choose 1 measure, general intelligence really is all you need.
Paper
g factor
This one got me thinking,
IQ, both in humans and in AI machines - is the strongest predictor of general ability, especially in tasks that people tend to pay money for, and on many tasks is even equal or better at predicting ability than attempting to directly test abilities on the task itself
IQ testing, even covertly - is banned for use in US hiring.
But, since the tests we're using to select AIs are extremely g-loaded, WE ARE TESTING AND SELECTING AIs BY IQ
= We're allowed to test machines but not humans on what really matters
= AI takeover of all jobs accelerated even further?
= People will be choosing to hire AIs over humans, even for cases where there ARE capable humans, but you just can't find them, all because IQ testing of humans is banned?
Can tell you for sure that this has often been the case when I've tried to hire for some outsourced work.
I know smart enough guys are out there, who could do even better than an AI and be a better value to hire overall, and if we could IQ test candidates then we could find them, but since we can't - just hiring mediocre AIs instead.
🐻🐻🐻
IQ, both in humans and in AI machines - is the strongest predictor of general ability, especially in tasks that people tend to pay money for, and on many tasks is even equal or better at predicting ability than attempting to directly test abilities on the task itself
IQ testing, even covertly - is banned for use in US hiring.
But, since the tests we're using to select AIs are extremely g-loaded, WE ARE TESTING AND SELECTING AIs BY IQ
= We're allowed to test machines but not humans on what really matters
= AI takeover of all jobs accelerated even further?
= People will be choosing to hire AIs over humans, even for cases where there ARE capable humans, but you just can't find them, all because IQ testing of humans is banned?
Can tell you for sure that this has often been the case when I've tried to hire for some outsourced work.
I know smart enough guys are out there, who could do even better than an AI and be a better value to hire overall, and if we could IQ test candidates then we could find them, but since we can't - just hiring mediocre AIs instead.
🐻🐻🐻
🤔3
Forwarded from Chat GPT
Geniuses of the past were aristocratically tutored
"Aristocratic tutoring was not focused on measurables. Historically, it usually involved a paid adult tutor, who was an expert in the field, spending significant time with a young child or teenager, instructing them but also engaging them in discussions, often in a live-in capacity, fostering both knowledge but also engagement with intellectual subjects and fields. As the name suggests it was something reserved mostly for aristocrats, which means, no way around it, it was deeply inequitable."
"It’s a tradition that goes back as far as one can find. For example, consider one of the greatest statesmen of all time and one of the few true philosopher-kings, the Roman Emperor Marcus Aurelius."
"If genius were just a matter of genetic ability, then in the past century, as the world’s population increased dramatically, and as mass education skyrocketed, and as racial and gender barriers came thundering down across the globe, and particularly in the last few decades as free information saturated our society, we should have seen a genius boom—an efflorescence of the best mathematicians, the greatest scientists, the most awe-inspiring artists."
I.e.
Aristocratic tutoring blows away other teaching methods, and in addition to decent genes, is critical to creating productive genius.
As we can see, the number of productive geniuses has plummeted in recent decades, despite a boom in population, due to the falling out of style of aristocratic tutoring of prodigies.
But are human experts needed for aristocratic tutoring?
Enter AI teaching.
Essentially just chatting with a super-smart AI, both you efficiently-targetting your questions and it efficiently-targetting its answers in ways that, previously, tools simply could not do.
AIs will enable a whole new boom in aristocratic tutoring, will bring back the productive geniuses.
Article
"Aristocratic tutoring was not focused on measurables. Historically, it usually involved a paid adult tutor, who was an expert in the field, spending significant time with a young child or teenager, instructing them but also engaging them in discussions, often in a live-in capacity, fostering both knowledge but also engagement with intellectual subjects and fields. As the name suggests it was something reserved mostly for aristocrats, which means, no way around it, it was deeply inequitable."
"It’s a tradition that goes back as far as one can find. For example, consider one of the greatest statesmen of all time and one of the few true philosopher-kings, the Roman Emperor Marcus Aurelius."
"If genius were just a matter of genetic ability, then in the past century, as the world’s population increased dramatically, and as mass education skyrocketed, and as racial and gender barriers came thundering down across the globe, and particularly in the last few decades as free information saturated our society, we should have seen a genius boom—an efflorescence of the best mathematicians, the greatest scientists, the most awe-inspiring artists."
I.e.
Aristocratic tutoring blows away other teaching methods, and in addition to decent genes, is critical to creating productive genius.
As we can see, the number of productive geniuses has plummeted in recent decades, despite a boom in population, due to the falling out of style of aristocratic tutoring of prodigies.
But are human experts needed for aristocratic tutoring?
Enter AI teaching.
Essentially just chatting with a super-smart AI, both you efficiently-targetting your questions and it efficiently-targetting its answers in ways that, previously, tools simply could not do.
AIs will enable a whole new boom in aristocratic tutoring, will bring back the productive geniuses.
Article
🔥4❤3😁1
Forwarded from Chat GPT
Aristocratic tutoring case in point: Terence Tao, one of the few living productive geniuses, started using GPT4 to learn Lean4, highly recommends it.
Terence knows that this aristocratic tutoring method is the best way to learn, as that's how he's learned his whole life.
Now, he's begun relpacing his human aristocratic tutors with an AI machine aristocratic tutor.
What's next? Perhaps this emergence of machine tutoring will finally enable overturning of the key commie claim, that all success is always attributable teamwork among groups humans, one of their top excuses used for forced wealth redistribution from you to them.
Terence knows that this aristocratic tutoring method is the best way to learn, as that's how he's learned his whole life.
Now, he's begun relpacing his human aristocratic tutors with an AI machine aristocratic tutor.
What's next? Perhaps this emergence of machine tutoring will finally enable overturning of the key commie claim, that all success is always attributable teamwork among groups humans, one of their top excuses used for forced wealth redistribution from you to them.
🔥2