Tag: scoring methods
-
Hacker News: Tao: Using test-time compute to train efficient LLMs without labeled data
Source URL: https://www.databricks.com/blog/tao-using-test-time-compute-train-efficient-llms-without-labeled-data Source: Hacker News Title: Tao: Using test-time compute to train efficient LLMs without labeled data Feedly Summary: Comments AI Summary and Description: Yes Summary: The text introduces a new model tuning method for large language models (LLMs) called Test-time Adaptive Optimization (TAO) that enhances model quality without requiring large amounts of labeled…
-
Hacker News: Evals are not all you need
Source URL: https://www.marble.onl/posts/evals_are_not_all_you_need.html Source: Hacker News Title: Evals are not all you need Feedly Summary: Comments AI Summary and Description: Yes Summary: The text critiques the use of evaluations (evals) for assessing AI systems, particularly large language models (LLMs), arguing that they are inadequate for guaranteeing performance or reliability. It highlights various limitations of evals,…