OCTAVE: A Capability-Resolved Benchmark for End-to-End HTML5 Game Generation
arXiv 发布新基准 OCTAVE,用于评估 AI 智能体能否端到端生成完整的 HTML5 游戏。该基准要求智能体在长时间开发过程中协调规则、交互、状态与呈现,而不仅仅是生成孤立代码片段。同一批 arXiv 公告中另有 TransitLM(无地图公交路线生成数据集与基准)和 InfiHall-Bench(自回归文本到图像生成的幻觉评估基准)两项独立工作,它们与 OCTAVE 分属不同任务,彼此没有关联。目前 OCTAVE 以预印本形式公开,尚无后续评测结果或采用情况的报道。
How this story unfolded
Key points8 items Model summary · ordered by when the evidence was published
- Point 01 11/16, 13:00
OCTAVE 被定位为端到端 HTML5 游戏生成的基准,论文编号为 arXiv:2611.17681v1。
Based on 1 - Point 02 11/16, 13:00
该基准考察智能体在长开发流程中协调规则、交互、状态与呈现的能力。
Based on 1 - Point 03 11/16, 13:00
OCTAVE 以 arXiv 新公告(Announce Type: new)形式首次发布。
Based on 1 - Point 04 11/16, 13:00
同一批公告中的 TransitLM(arXiv:2605.22355v2)聚焦无地图公交路线生成的数据集与基准。
Based on 1 - Point 05 11/16, 13:00
TransitLM 的摘要指出,传统公交路线规划依赖结构化地图基础设施与复杂路由引擎。
Based on 1 - Point 06 11/16, 13:00
InfiHall-Bench(arXiv:2611.18053v1)是面向自回归文本到图像生成的幻觉评估基准。
Based on 1 - Point 07 11/16, 13:00
InfiHall-Bench 指出,现有文本到图像幻觉基准多围绕扩散模型设计,诊断范围受限。
Based on 1 - Point 08 11/16, 13:00
InfiHall-Bench 同样以 arXiv 新公告形式发布。
Based on 1
ReportsBy publish time · newer further down
- November 16, 2026 · Mon
- Start
OCTAVE: A Capability-Resolved Benchmark for End-to-End HTML5 Game Generation
Original summary arXiv:2611.17681v1 Announce Type: new Abstract: Complete game generation requires agents to coordinate rules, interactions, states, and presentation over a long development process
- Start
TransitLM: A Large-Scale Dataset and Benchmark for Map-Free Transit Route Generation
Original summary arXiv:2605.22355v2 Announce Type: replace Abstract: Public transit route planning traditionally depends on structured map infrastructure and complex routing engines, and no existin
- Start
InfiHall-Bench: A Benchmark for Hallucination Evaluation in Autoregressive Text-to-Image Generation
Original summary arXiv:2611.18053v1 Announce Type: new Abstract: Hallucination benchmarks for text-to-image generation are predominantly designed around diffusion models, limiting their diagnostic
- Still developing · later reports will keep extending this axis