-
Paper on The Illusion of Diminishing Returns [of scaling]
Read more: Paper on The Illusion of Diminishing Returns [of scaling]Fascinating research paper refuting the notion that scaling of datasets has diminishing returns in the performance of large language models. While that might be true for simple “single-step” tasks, it is not for more complex “long horizon” tasks, according to the following researchers (Akshit Sinha, Arvindh Arun, Shashwat Goel, Steffen Staab, Jonas Geiping), who posted…
-
Research: Did Apple researchers overstate “The Illusion of Thinking” in reasoning models. Opus, Lawsen think so.
Read more: Research: Did Apple researchers overstate “The Illusion of Thinking” in reasoning models. Opus, Lawsen think so.In “The Illusion of the Illusion of Thinking,” Alex Lawsen of Open Philanthropy and “C. Opus” of Antrhopic–which may refer to Claude Opus, the model of Anthropic–try to debunk the paper recently posted by Apple researchers titled “The Illusion of Thinking.” The Apple paper concluded: ““We show that state-of-the-art LRMs (e.g., o3-mini, DeepSeek-R1, Claude-3.7-Sonnet-Thinking) still…
-
Ilya Sutskever speech on receiving honorary degree from University of Toronto
Read more: Ilya Sutskever speech on receiving honorary degree from University of Toronto“At the University of Toronto when I was a student here, we were doing the best AI research [with Geoffrey Hinton] out of anywhere. The most revolutionary ideas, the most exciting work.” Ilya Sutskever. Here’s Sutskever talking about living in the most unusual time ever, with the advent of AI: The day will come that…
-
LLMs learn more when given incorrect answers to MC questions
Read more: LLMs learn more when given incorrect answers to MC questionsShadi Hamdan and Deniz Yuret posted a preprint paper titled “How much do LLMs learn from negative examples?“ Abstract: Large language models (LLMs) undergo a three-phase training process: unsupervised pre-training, supervised fine-tuning (SFT), and learning from human feedback (RLHF/DPO). Notably, it is during the final phase that these models are exposed to negative examples —…
-
Apple researchers cast doubt on AI reasoning models of other companies
Read more: Apple researchers cast doubt on AI reasoning models of other companiesAs Apple struggles to integrate AI into Siri and its other software, Apple researchers posted a controversial paper provocatively titled: “The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexity.” The researchers are: Parshin Shojaee*†, Iman Mirzadeh*, Keivan Alizadeh, Maxwell Horton, Samy Bengio, and Mehrdad Farajtabar. First…
-
70% of graduate students in AI research in US are international students
Read more: 70% of graduate students in AI research in US are international studentsFrom today’s Wall Street Journal editorial on the Trump Administration’s battle against Harvard University, an astonishing statistic: “The National Foundation for American Policy finds that “immigrants have founded or cofounded nearly two-thirds (65% or 28 of 43) of the top AI companies in the United States, and 70% of full-time graduate students in fields related…