Newshot
Science & Research Still developing Event #01M7J491JP1TXVS1H0A48FNYWG

WebArena-Pro: A Heterogeneous, Multimodal, Reproducible Benchmark for Web Agents

Event overview(model summary, not the source's own text)

arXiv 于 2026 年 11 月发布编号 2611.17955v1 的新论文《WebArena-Pro: A Heterogeneous, Multimodal, Reproducible Benchmark for Web Agents》。该论文针对由大语言模型和视觉语言模型驱动的网页智能体,提出一个面向真实浏览器工作的异构、多模态、可复现基准 WebArena-Pro。目前公开的仅有标题与摘要条目,具体实验结果与数据尚未在材料中披露。

This summary was distilled by a model from the 3 reports below; it is not the source text. Treat the reports themselves as the facts.

How this story unfolded

Left: what it concluded — the key points the model distilled from the reports below, each one listing the reports it rests on. Right: what happened — ordered by time, each with a short summary so you can follow the thread without clicking through. The numbered links work both ways: tap a source under a point to jump to that report, tap the cited-by chip on a report to jump back to the point.

Key points3 items Model summary · ordered by when the evidence was published

  1. Point 01 11/16, 13:00

    arXiv 新发布编号 2611.17955v1 的论文《WebArena-Pro》,提出面向网页智能体的基准。

  2. Point 02 11/16, 13:00

    WebArena-Pro 定位为异构、多模态、可复现的基准,面向真实浏览器工作任务。

  3. Point 03 11/16, 13:00

    该基准的目标对象是由大语言模型和视觉语言模型驱动的网页智能体。

ReportsBy publish time · newer further down

  1. November 16, 2026 · Mon
  2. Start

    WebArena-Pro: A Heterogeneous, Multimodal, Reproducible Benchmark for Web Agents

    Original summary arXiv:2611.17955v1 Announce Type: new Abstract: Web agents powered by large language and vision-language models are increasingly applied to realistic browser work that spans hetero

    arXiv cs.AI Original ↗
  3. Start

    Aligned, Conflicting, or Unspecified? A Diagnostic Benchmark for Multimodal Time Series Forecasting

    Original summary arXiv:2611.17680v1 Announce Type: new Abstract: Artificial Intelligence of Things (AIoT) systems increasingly combine sensed time series with external text such as expert reports a

    arXiv cs.AI Original ↗
  4. November 18, 2026 · Wed
  5. +2d 0h

    PURE: A Diagnostic Benchmark for Multi-Granularity Multimodal Identity Matching

    Original summary arXiv:2611.22343v1 Announce Type: new Abstract: Identity matching asks whether two records denote the same identity, yet the answer depends on the target granularity. Two records m

    arXiv cs.CV Original ↗
  6. Still developing · later reports will keep extending this axis

Related reading

MM-ReportBench: A Comprehensive Benchmark for Multimodal Report Generation from Tables
arXiv:2611.22514v1 Announce Type: new Abstract: The ability to generate multimodal reports integrating fluent narratives
arXiv cs.CL 11/18/2026 Full text here
72pts
SciWorkBench: A Benchmark for Real Scientific Workflows
arXiv:2611.22490v1 Announce Type: new Abstract: Language models are increasingly being used as agents capable of plannin
arXiv cs.AI 11/18/2026 Full text here
82pts
MInfoVisQA: A Multilingual Benchmark for Information-Rich Visual Question Answering
arXiv:2611.21644v1 Announce Type: new Abstract: Multimodal large language models (MLLMs) excel in vision-language tasks;
arXiv cs.CL 11/18/2026 Full text here
72pts
BLiMP-RO: A Benchmark of Linguistic Minimal Pairs for Romanian
arXiv:2611.17836v1 Announce Type: new Abstract: Evaluating grammatical knowledge in language models requires benchmarks
arXiv cs.CL 11/16/2026 Full text here
67pts
Talk to Act: A Synthetic Multi-Turn Dialogue Benchmark for Human Intent Extraction and Action Planning in Robotics
arXiv:2611.17549v1 Announce Type: new Abstract: Multi-turn conversational human-robot interaction (HRI) continues to be
arXiv cs.RO 11/16/2026 Full text here
62pts
AscendGYM: A Cost-Aware Kernel Optimization Benchmark for Real-World Workloads on Ascend NPUs
arXiv:2611.17621v1 Announce Type: new Abstract: Kernel optimization is essential for efficient large language model (LLM
arXiv cs.AI 11/16/2026 Full text here
62pts