BBOWP-Bench: Evaluating LLMs on Black-Box Optimization Word Problems
arXiv 收录了一篇题为 BBOWP-Bench 的论文更新(编号 2608.02612v2),提出一个用于评估大语言模型在黑箱优化文字题上表现的基准。该文指出,优化问题的建模方式会强烈影响最终解的质量,而好的建模通常需要大量专业投入。同一批 arXiv 更新中另有两篇语言模型评测论文,分别是面向女性健康主题的 WHBench(2604.00024v3)和面向荷兰语字谜的 The Shared Word(2611.22935v1)。目前只有各篇摘要,BBOWP-Bench 的具体评测方法与结果尚未披露。
How this story unfolded
Key points8 items Model summary · ordered by when the evidence was published
- Point 01 11/16, 13:00
BBOWP-Bench 论文以 arXiv 编号 2608.02612v2 发布更新版,属替换提交。
Based on 1 - Point 02 11/16, 13:00
该基准评估大语言模型在黑箱优化文字题上的表现。
Based on 1 - Point 03 11/16, 13:00
论文指出,优化问题的建模方式会强烈影响最终解的质量。
Based on 1 - Point 05 11/18, 13:00
WHBench 以专家参与验证的方式评估前沿大模型在女性健康话题上的表现。
Based on 1 - Point 06 11/18, 13:00
WHBench 指出,女性健康在大模型基准设计中仍评估不足。
Based on 1 - Point 07 11/19, 13:00
The Shared Word 用荷兰语字谜评估语言模型,属新提交。
Based on 1 - Point 08 11/19, 13:00
该文批评非英语基准多为翻译题、选择题或难以自动评分。
Based on 1
ReportsBy publish time · newer further down
- November 16, 2026 · Mon
- Start
BBOWP-Bench: Evaluating LLMs on Black-Box Optimization Word Problems
Original summary arXiv:2608.02612v2 Announce Type: replace Abstract: Formulating an optimization problem strongly affects final solution quality, yet good formulations usually require substantial e
arXiv cs.CL Original ↗ - November 18, 2026 · Wed
- +2d 0h
WHBench: Evaluating Frontier LLMs with Expert-in-the-Loop Validation on Women's Health Topics
Original summary arXiv:2604.00024v3 Announce Type: replace Abstract: Large language models are increasingly used for medical guidance, but women's health remains under-evaluated in benchmark design
arXiv cs.CL Original ↗ - November 19, 2026 · Thu
- +3d 0h
The Shared Word: Evaluating Language Models on Dutch Word Puzzles
Original summary arXiv:2611.22935v1 Announce Type: new Abstract: Many LLM benchmarks for languages other than English are translated, multiple-choice, or difficult to score automatically. We introd
arXiv cs.CL Original ↗ - Still developing · later reports will keep extending this axis