Domain alignment recovers cell-type structure
Adaptation moves the language-model backbone into the range of purpose-built ranked-gene representations while preserving a reusable model state.
single-cell Agentic Context ORchestration Network
Context-engineered agent orchestration of specialized small language models for single-cell transcriptomic interpretation
01 · The approach
Single-cell atlases now exceed 66 million cells, but a ranked expression profile is not yet a reliable biological answer.
scACORN separates the acquisition of domain expertise from the policy used to select and integrate it. Compact experts learn tissue-specific transcriptomic structure and grounded biological completions. A fixed language-model agent then selects and combines those experts using a natural-language playbook optimized from textual feedback.
Domain alignment
Contrastive LoRA adaptation organizes the cell-to-text backbone around a target tissue while keeping the base model frozen.
Expert specialization
Question-conditioned completions are trained with pointwise, distributional, and relational preservation objectives.
Textual orchestration
A fixed orchestrator selects one or more experts and improves its inference policy through a textual playbook, without gradient updates.
02 · Key results
Across ten Tabula Sapiens tissues, each stage improves the part of the system it is designed to control: representation, expert reasoning, and evidence use.
Adaptation moves the language-model backbone into the range of purpose-built ranked-gene representations while preserving a reusable model state.
Tissue-specialized scSLMs outperform much larger general-purpose and transcriptomic models, particularly on evidence and exclusionary markers.
The largest optimization effect is on whether cited genes are actually supported by the input. The pattern holds under both GPT-5.4-mini and Claude Sonnet 4.5 orchestrators.
Unsupported support-gene citation rate, GPT-5.4-mini
Figure 4 Playbook optimization trajectories under two fixed orchestrators.
03 · Table 1
Performance across orchestrators, question types, and playbook conditions. Values are means across held-out questions; higher is better.
held-out questions
| Category | Model | Ontology ↑ | Evidence align. ↑ | Marker cov. ↑ | Nuanced ↑ |
|---|---|---|---|---|---|
| a Single-expert questions n = 38 | |||||
| Open-source | Mistral-Small-3.2-24B-Instruct | 0.593 | 0.311 | 0.506 | 0.435 |
| Qwen3-14B | 0.460 | 0.200 | 0.342 | 0.371 | |
| Llama-3.1-8B-Instruct | 0.216 | 0.135 | 0.296 | 0.273 | |
| Closed-source | GPT-4o-mini | 0.480 | 0.308 | 0.388 | 0.400 |
| GPT-5 | 0.633 | 0.290 | 0.865 | 0.486 | |
| Specialized | Cell-o1 | 0.411 | 0.259 | 0.556 | 0.476 |
| scACORN GPT-5.4-mini; empty | 0.780 | 0.537 | 0.902 | 0.699 | |
| scACORN GPT-5.4-mini; optimized | 0.832 | 0.632 | 0.904 | 0.747 | |
| scACORN Claude Sonnet 4.5; empty | 0.751 | 0.543 | 0.914 | 0.709 | |
| scACORN Claude Sonnet 4.5; optimized | 0.841 | 0.678 | 0.922 | 0.753 | |
| b Compositional questions n = 42 | |||||
| Open-source | Mistral-Small-3.2-24B-Instruct | 0.491 | 0.301 | 0.461 | 0.377 |
| Qwen3-14B | 0.569 | 0.193 | 0.375 | 0.381 | |
| Llama-3.1-8B-Instruct | 0.338 | 0.113 | 0.209 | 0.280 | |
| Closed-source | GPT-4o-mini | 0.543 | 0.257 | 0.334 | 0.384 |
| GPT-5 | 0.773 | 0.364 | 0.807 | 0.520 | |
| Specialized | Cell-o1 | 0.499 | 0.305 | 0.544 | 0.482 |
| scACORN GPT-5.4-mini; empty | 0.614 | 0.019 | 0.793 | 0.513 | |
| scACORN GPT-5.4-mini; optimized | 0.853 | 0.508 | 0.702 | 0.741 | |
| scACORN Claude Sonnet 4.5; empty | 0.622 | 0.139 | 0.808 | 0.553 | |
| scACORN Claude Sonnet 4.5; optimized | 0.858 | 0.535 | 0.716 | 0.744 | |
04 · Qualitative interactions
Held-out examples from the paper appendix. Ranked-gene lists are omitted here, as in the manuscript, to focus on the question, scACORN response, and reference answer.
05 · Abstract
Single-cell atlases now exceed 66 million cells, but turning a ranked expression profile and a free-form biological question into a reliable, evidence-grounded answer remains unsolved.
scACORN combines specialized small language models with context-engineered agent orchestration for their selection and composition at inference time. Domain-aligned contrastive adaptation fits a pretrained cell-to-text backbone to target transcriptomic geometry; geometry-preserving specialization learns biological completions without eroding that geometry; and a fixed orchestrator selects and combines experts under a playbook optimized from textual feedback.
The results support specialization and orchestration as complementary responses to the heterogeneity and evidentiary demands of single-cell analysis.
06 · Paper & code
The public repository includes domain alignment, expert specialization, textual orchestration, benchmark evaluation, dataset preparation, and manuscript figure generation.
@article{rasti-meymandi_scacorn,
title = {scACORN: Context-engineered agent orchestration of specialized small language models for single-cell transcriptomic interpretation},
author = {Rasti-Meymandi, Arash and Nahali, Sepideh and Paramithiotis, Eustache and Cheung, Angela M. and Dolatabadi, Elham},
note = {Preprint}
}
Publication details will be updated with the preprint record.