Tag: model evaluation
-
Hacker News: LLMs don’t do formal reasoning – and that is a HUGE problem
Source URL: https://garymarcus.substack.com/p/llms-dont-do-formal-reasoning-and Source: Hacker News Title: LLMs don’t do formal reasoning – and that is a HUGE problem Feedly Summary: Comments AI Summary and Description: Yes Summary: The text discusses insights from a new article on large language models (LLMs) authored by researchers at Apple, which critically examines the limitations in reasoning capabilities of…
-
Scott Logic: Evolving with AI from Traditional Testing to Model Evaluation I
Source URL: https://blog.scottlogic.com/2024/09/13/Evolving-with-AI-From-Traditional-Testing-to-Model-Evaluation-I.html Source: Scott Logic Title: Evolving with AI from Traditional Testing to Model Evaluation I Feedly Summary: Having worked on developing Machine Learning skill definitions and L&D pathway recently, in this blog post I have tried to explore the evolving role of test engineers in the era of machine learning, highlighting the key…