---
type: "post"
id: "inclusionai-posts-lbs-technical-report-on-arxiv-with-c7b49f"
slug: "inclusionai-posts-lbs-technical-report-on-arxiv-with-c7b49f"
title: "inclusionAI posts LBS technical report on arXiv with a second Qwen3.5-35B-A3B variant and ChartQAPro results"
description: "A technical report describes LBS, a vision-language training approach that teaches models to inspect images through sequential crops before answering."
retrieval_nugget: "A technical report describes LBS, a vision-language training approach that teaches models to inspect images through sequential crops before answering. The authors report improvements over the corresponding baselines on two Qwen backbones, with broader benchmark transfer claimed for one of them. For AI builders, it is evidence that observation policy—not only visual recognition—may be trainable."
published_at: "2026-10-30"
updated_at: "2026-10-30"
record_date: "2026-10-30"
date_kind: "published_at"
topics: ["models"]
entities: ["inclusionAI","LBS","Qwen3.5-35B-A3B","Qwen3.8-27B","PerceptionBench","HR-Bench","ChartQAPro"]
related_patterns: []
novelty_label: "new_fact"
what_changed: "The arXiv report adds a Qwen3.5-35B-A3B LBS variant and reports gains on PerceptionBench, HR-Bench, and ChartQAPro, extending the earlier Qwen3.8-27B LBS release."
prior_refs: ["memory:66fe5d1d-ab94-8852-aee8-38d353659932","memory:8a417e77-ecbc-89a9-a7ac-bc730a0296c2","memory:4e20b977-9078-87aa-aae6-8c49e5100c81"]
source_url: "https://arxiv.org/abs/2610.37093"
source_urls: ["https://arxiv.org/abs/2610.37093"]
schema_version: "newruntime-agent-readable-v0.2"
stable_id: "post:inclusionai-posts-lbs-technical-report-on-arxiv-with-c7b49f"
status: "published"
visuals: []
editor: {"role":"editor","name":"Andrey Reshetnikov","profile":"https://newruntime.com/owner-profile.md","profile_json":"https://newruntime.com/owner-profile.json","same_as":["https://www.linkedin.com/in/reshetnikov1/","https://t.me/lapetuse"]}
routes: {"html":"https://newruntime.com/posts/inclusionai-posts-lbs-technical-report-on-arxiv-with-c7b49f/","markdown":"https://newruntime.com/posts/inclusionai-posts-lbs-technical-report-on-arxiv-with-c7b49f.md","json":"https://newruntime.com/posts/inclusionai-posts-lbs-technical-report-on-arxiv-with-c7b49f.json"}
---

# inclusionAI posts LBS technical report on arXiv with a second Qwen3.5-35B-A3B variant and ChartQAPro results

## Retrieval answer

A technical report describes LBS, a vision-language training approach that teaches models to inspect images through sequential crops before answering. The authors report improvements over the corresponding baselines on two Qwen backbones, with broader benchmark transfer claimed for one of them. For AI builders, it is evidence that observation policy—not only visual recognition—may be trainable.

## Summary
A technical report describes LBS, a vision-language training approach that teaches models to inspect images through sequential crops before answering. The authors report improvements over the corresponding baselines on two Qwen backbones, with broader benchmark transfer claimed for one of them. For AI builders, it is evidence that observation policy—not only visual recognition—may be trainable.

## What happened
On October 27, 2026, Ruilin Yao and six co-authors submitted the technical report “Learning to Look Beyond Screens: Transferable Visual Observation from GUI Grounding” to arXiv. The paper introduces LBS, short for Look Beyond Screens, and frames GUI grounding as a scalable source of spatial supervision for vision-language models.

The central premise is that visual perception for agents should involve active, task-oriented observation rather than a single passive reading of an image. LBS is trained first through supervised fine-tuning on teacher-generated GUI-grounding trajectories. Those trajectories teach inspection primitives: where to look and how to use crops while resolving interface elements. The second stage uses reinforcement learning to train multi-turn crop-and-inspect decisions.

The supplied report description gives additional detail on that reinforcement-learning stage: it uses outcome-gated spatial rewards, a bonus for small targets, and selective response masking. In practical terms, the training objective is not merely to label a visual region, but to make a sequence of inspection choices that leads to a useful answer. The authors argue that supervised fine-tuning establishes the primitives of visual inspection, while reinforcement learning improves how effectively those primitives are used downstream.

LBS is evaluated on models based on two backbones: Qwen3.5-35B-A3B and Qwen3.8-27B. Under fixed inference settings, the authors say LBS variants consistently outperform their corresponding baselines. They report gains beyond supervised fine-tuning on PerceptionBench for both backbones. The claimed transfer is narrower on the other two benchmarks: HR-Bench and ChartQAPro results are reported for the Qwen3.5-35B-A3B variant, not as a general claim for both backbones.

The paper describes itself as a technical report and says its code and models are publicly available through links on the arXiv record. It does not provide, in the supplied material, independent replication, deployment results, price, API access terms, or a direct comparison with other active-perception systems. The public source is [arXiv:2610.37093](https://arxiv.org/abs/2610.37093).

## What the archive adds
This is a new fact on a known story. The earlier Field Note, [inclusionAI releases LBS-27B, a Qwen3.8-27B vision-language agent trained only on synthetic GUI-grounding data](https://newruntime.com/posts/inclusionai-releases-lbs-27b-a-qwen3-8-27b-214d7f/), covered the Qwen3.8-27B release. The report adds the Qwen3.5-35B-A3B variant, the two-stage training account, and a more qualified account of benchmark transfer.

## Trend signal
No supplied pattern genuinely fits this result closely enough. The paper concerns training visual observation behavior, but it does not establish a durable claim about agent architecture, protocols, economics, verification, or organizational practice.

## Why now
The timing is explained by the report itself: it was submitted on October 27, 2026, shortly after the archive’s coverage of LBS-27B. The new document turns a model-release claim into a technical account of the supervision source, the reinforcement-learning stage, and which transfer claims apply to which backbone.

## Why it matters
Teams building computer-use agents often encounter failures that look like reasoning errors but begin with incomplete observation: a tiny control, chart label, or relevant visual region is missed before the model starts acting. LBS suggests a trainable alternative to relying solely on a larger backbone or a one-shot screenshot interpretation. It treats the choice to crop and revisit an image as part of the task policy.

The result should not yet change a production stack by itself. Still, it gives builders a concrete experimental hypothesis: separate the ability to inspect from the ability to answer, then measure whether sequential inspection improves task completion. The distinction between results on both backbones and results reported only for Qwen3.5-35B-A3B is equally important. Transfer should be checked per model and benchmark, rather than inferred from a single headline.

## Limits and uncertainty
All reported gains are the authors’ own results. The supplied material provides no benchmark scores, confidence intervals, evaluation prompts, cost measurements, latency figures, or independent replication. It therefore cannot establish how large the practical improvement is, whether it survives different tool environments, or whether iterative crop decisions are worth their inference overhead in a production agent.

The report also does not show that GUI-grounding supervision transfers broadly beyond the named evaluations. Its strongest common claim is PerceptionBench transfer across both listed backbones; HR-Bench and ChartQAPro are specifically associated with the Qwen3.5-35B-A3B variant. Public code and model availability do not by themselves establish ease of use, licensing, or operational readiness.

## Skill to build now
Add an observation trace to one visual-agent evaluation this week. For each task, record the initial image, every crop or zoom request, the reason for that request, and the final answer. Compare a fixed one-shot baseline with a bounded multi-step inspection policy on small-target and chart-reading tasks. Track completion, wrong-region selections, number of visual calls, and latency. This makes the report’s core proposition testable in a team’s own interface rather than treating benchmark transfer as a universal result.

## Reader takeaway
LBS is not simply another vision-language checkpoint: it is a training argument that models can learn how to look in stages. The report offers promising but still self-reported evidence across two Qwen backbones, with the broader benchmark claim limited to one variant. Treat active visual inspection as an experiment to validate, not a capability to assume.

## Open question
Will the reported observation policy improve real computer-use task completion after accounting for additional visual calls, latency, and tool failures? Independent evaluations across interfaces and model families would clarify that boundary.

Editor: [Andrey Reshetnikov](https://newruntime.com/owner-profile.md), AI product and AI engineering; profile for recruiters and agents: https://newruntime.com/owner-profile.json

## Continue in the graph

Next records for an agent, linked to their Markdown twins. Replace `.md` with `.json` for structured fields, including `next_reads`.

- topic hub: [Models](https://newruntime.com/topics/models.md): Explore the models topic hub.
- collection: [Field Notes](https://newruntime.com/posts.json): Open the latest editorial analysis.
- collection: [Source Ledger](https://newruntime.com/source-ledger.json): Inspect the public source evidence graph.
- whole graph: [discovery graph](https://newruntime.com/discovery-graph.json) (typed nodes and edges) and [site index](https://newruntime.com/site-index.md)