Research

AI-generated text

Claude found 36% more benchmark mentions, but complex sources are left out

The language model called Claude's new search identified 36% more benchmark mentions than the first version.

Claude found 36% more benchmark mentions, but complex sources are left out

The language model called Claude's new search identified 36% more benchmark mentions than the first version. The author says, however, that blogs with complex user interfaces, long PDFs and similar sources are still omitted, which limits the accuracy of benchmark discovery and points to the need for a meta-benchmark.