Tech Office : Updates & Tech News ~1
Photo
Meta Under Fire for Manipulating Llama 4 Benchmark, But It Isn’t the First Time
Meta's latest Llama 4 release faces scrutiny amidst mixed user reviews.
On 1Point3Acres, a popular forum for Chinese people in North America, a user claiming to be a former Meta employee posted a bombshell. According to the post, which has been translated into English on Reddit, the Meta leadership allegedly mixed “the test sets of various benchmarks in the post-training process” to inflate the benchmark score and meet internal targets.
Meta's GenAI Head , Ahmad Al-Dahle , strongly denies training on test sets, attributing variability to implementation stabilization.
However, this isn't unprecedented. Research previously showed significant benchmark data contamination in Llama 1's pre-training corpus.
Adding to concerns, LMSys Arena noted Meta lacked clarity about an experimental "Llama-4-Maverick" model, prompting leaderboard policy updates for transparency.
Meta's latest Llama 4 release faces scrutiny amidst mixed user reviews.
On 1Point3Acres, a popular forum for Chinese people in North America, a user claiming to be a former Meta employee posted a bombshell. According to the post, which has been translated into English on Reddit, the Meta leadership allegedly mixed “the test sets of various benchmarks in the post-training process” to inflate the benchmark score and meet internal targets.
Meta's GenAI Head , Ahmad Al-Dahle , strongly denies training on test sets, attributing variability to implementation stabilization.
However, this isn't unprecedented. Research previously showed significant benchmark data contamination in Llama 1's pre-training corpus.
Adding to concerns, LMSys Arena noted Meta lacked clarity about an experimental "Llama-4-Maverick" model, prompting leaderboard policy updates for transparency.
😱2
Snapdragon 8s Gen4 is more efficient than Snapdragon 8Gen3 and Dimensity 8400 Ultra
#Qualcomm #Snapdragon8sGen4
#Qualcomm #Snapdragon8sGen4
🗿10
Snapdragon 8s Gen 4
Geekbench Scores
📊Single Core ~ 2200+
📊Multi Core ~ 7300+
#Qualcomm #Snapdragon8sGen4
Geekbench Scores
📊Single Core ~ 2200+
📊Multi Core ~ 7300+
#Qualcomm #Snapdragon8sGen4
🔥6🗿3👍1
Snapdragon 8s Gen4
📊2.16 million+ AnTuTu
📊5100 ~ 3D Mark WildLife Extreme
📊8755 ~ 3D Mark Solar Bay
📊2.16 million+ AnTuTu
📊5100 ~ 3D Mark WildLife Extreme
📊8755 ~ 3D Mark Solar Bay
😱12
In terms of AI, the new #4th-generation Snapdragon 8s# is a well-deserved powerhouse. Its AI performance has been greatly improved compared to the previous generation. With the help of multimodal generative AI, users can also interact with AI smart assistants to open up a new world of inspiration. A variety of large language models such as DeepSeek, Tongyi Qianwen, Mianbi Intelligent MiniCPM, Tencent Hunyuan and Wenxin Large Model can all be deployed on the fourth-generation Snapdragon 8s. The fourth-generation Snapdragon 8s also has master-level imaging capabilities: AI-enabled infinite semantic segmentation technology makes photos and videos lifelike; Night Vision night scene shooting 2.0 takes low-light video shooting to a new level, which is great![Send flowers]
👍2