Keiji AI LogoKeiji AI

TrialPanorama by Keiji AI

Clinical trial intelligence, linked to the source

Search trials from 15 global registries, map competing programs and their readouts, benchmark a design, compare posted safety, and ask questions answered with registry citations. Built on the TrialPanorama database and benchmark, published in npj Digital Medicine.

Clinical trial records in the published database
1,060K+
Clinical trial records in the published database
Global trial registries and sources
15
Global trial registries and sources
Research tasks where the 8B model outperforms 70B models
8 of 8
Research tasks where the 8B model outperforms 70B models

A four-minute breast cancer walkthrough, from the trial landscape to DESTINY-Breast03 and DESTINY-Breast04. More TrialPanorama demos ›

What you can do in TrialPanorama

One breast cancer question, followed from the landscape to individual trials. Screens from the November 2026 build.

TrialPanorama Explore view listing 1,413 Phase 3 trials linked to Breast Neoplasms, with breakdowns by status, registry, study type, allocation, masking, sex, age group, and country
1,413 Phase 3 trials linked to Breast Neoplasms, broken down by status, registry, design, and country.
When it is used
Start from a condition, a drug, a sponsor, or a trial identifier.
What it produces
Every linked trial, filtered by phase, status, and design, with a breakdown by registry, recruitment status, and study design. Save the view or export the rows.

Also in the product

Evidence network
Which treatments randomized trials have compared head to head, with the studies behind each comparison. A starting point for a network meta-analysis.
Sponsor programs
A sponsor's portfolio and expected milestones, with each program linked to its drug record.
Drug profiles
A drug's pipeline, linked trials, targets, and safety reports on one page.
Workspaces
Save a filtered trial list to a named workspace. It keeps a live link to the filters, so the list updates with the data.
Export and hand-off
Download the selected rows, continue the analysis in the TrialMind Data Science Assistant, or start a systematic review with a suggested topic.
Source coverage
A coverage page shows the build and the registries and evidence types behind every view.

More walkthroughs

Two shorter recordings: from a drug's trial landscape to a review question, and from an indication to the investigators who run its trials.

From a trial landscape to a review questionRuntime 2:09

Start from osimertinib, search its 282 trials, map the non-small cell lung cancer landscape, check conference intelligence, and land on the FLAURA2 trial.

Find investigators for your next studyRuntime 1:34

Rank the investigators linked to the most obesity trials, open one investigator's trial history, and follow it to the registry record.

All TrialPanorama demos ›

The research behind TrialPanorama

TrialPanorama began as a public database and benchmark for training and evaluating language models on clinical research tasks. The paper, data, and code are open.

Zifeng Wang1,*,†, Jiacheng Lin2,*, Qiao Jin3,*, Junyi Gao4,5, Jathurshan Pradeepkumar2, Pengcheng Jiang2, Zhiyong Lu3, Jimeng Sun1,2,†

1Keiji AI Inc. 2University of Illinois Urbana-Champaign 3National Institutes of Health 4University of Edinburgh 5Health Data Research UK
*Equal contribution †Correspondence: zifeng@keiji.ai, jimeng@keiji.ai

What TrialPanorama contains

Records from fifteen sources, normalized and linked to biomedical ontologies and the literature.

TrialPanorama overview and end-to-end processing workflow
Figure 1. a, Data collected from fifteen global sources, including PubMed, ClinicalTrials.gov, and international registries; LLM-based extraction, hybrid rules, and ontology-grounded normalization derive unified study attributes, matched to DrugBank, MedDRA, RxNorm, MeSH and others, and stored as a relational schema and a knowledge graph. b, Distribution of data sources, with a country-level breakdown of non-US registries. c, Most frequent drug entities. d, Most frequent disease and condition entities after harmonization.
Abstract

Developing artificial intelligence (AI) for clinical research requires a comprehensive data foundation that supports model training and rigorous evaluation. Here, we introduce TrialPanorama, a large-scale structured resource that aggregates 1,060K+ clinical trials from fifteen global registries and links them with biomedical ontologies and associated literature. To demonstrate its utility, we build a pipeline that constructs 152K training and testing samples for eight key clinical research tasks. Three tasks support systematic review workflows, including study search, study screening, and evidence summarization. Five tasks focus on trial design and optimization, including arm design, eligibility criteria design, endpoint selection, sample size estimation, and trial completion assessment and rationalization. Benchmarking cutting-edge large language models (LLMs) reveals that generic LLMs have limited capability in clinical reasoning. In contrast, an 8B LLM we developed on TrialPanorama using supervised finetuning and reinforcement learning wins over the 70B generic counterparts in all eight tasks, with a relative improvement of 73.7%, 67.6%, 38.4%, 37.8%, 26.5%, 20.7%, 20.0%, 18.1%, and 5.2%, respectively. We envision TrialPanorama provides a solid foundation for future scaling of AI for clinical research.

Database structure: ten tables in four groups

Studies, conditions, drugs, endpoints, disposition, relations, biomarkers, outcomes, adverse events, and results.

Trial attributes
Core metadata: title, brief summary, sponsor, start year, recruitment status. Table: studies.
Trial protocols
Setup and design: tested drugs, targeted conditions, patient group allocations. Tables: conditions, drugs, endpoints, disposition, biomarkers.
Trial results
Reported findings: outcomes, adverse events, efficacy results. Tables: outcomes, adverse events, results.
Study-level links
Registry records mapped to publications, and reviews mapped to the studies they aggregate. Table: relations.
Browse the database

Benchmark tasks

Eight tasks across two workflows, systematic review and trial design, built from real trial records and review corpora to test clinical reasoning rather than general language ability.

Systematic review

  • Study search

    Retrieve relevant clinical trials for a research question.

  • Study screening

    Decide whether a study meets specific inclusion criteria.

  • Evidence summarization

    Synthesize findings across related studies.

Trial design

  • Arm design

    Intervention and control arms with appropriate dosages.

  • Eligibility criteria

    Inclusion and exclusion criteria for participants.

  • Endpoint selection

    Appropriate primary and secondary endpoints.

  • Sample size estimation

    Participant numbers required for statistical power.

  • Trial completion

    Likelihood of successful completion, with a rationale.

Workflow turning clinical trial records into supervised training examples
Figure 2. Structured and semi-structured trial records become standardized instruction–input–answer triples for tasks such as sample size estimation, criteria design, and endpoint design.
Browse the benchmark

Results

General-purpose models of up to 70 billion parameters struggle on clinically grounded tasks. An 8-billion-parameter model adapted on TrialPanorama outperforms them on all eight.

Benchmark overview and evaluation results across review and trial design tasks
Figure 3. b, Systematic review tasks and dataset scale. c, Overall performance of representative LLMs across review and trial design benchmarks. d, Trial design tasks with training and evaluation set sizes.
What the results show

Across all eight tasks, generic large language models show limited clinical reasoning. Even models up to 70B parameters struggle with tasks that need domain knowledge, structured trial reasoning, or several clinical constraints at once — scale alone is not enough.

Qwen3-8B-TP*, adapted on TrialPanorama with supervised fine-tuning and reinforcement learning with verifiable reward, outperforms every generic counterpart on every task, with relative improvements of 73.7%, 67.6%, 38.4%, 37.8%, 26.5%, 20.7%, 20.0%, 18.1%, and 5.2%.

Domain-aligned post-training on high-quality, task-aligned trial data matters more than brute-force scaling for clinical research.

Cite this work
@article{wang2025trialpanorama,
  title     = {Developing Large Language Models for Clinical Research Using One Million Clinical Trials},
  author    = {Wang, Zifeng and Lin, Jiacheng and Jin, Qiao and Gao, Junyi and Pradeepkumar, Jathurshan and Jiang, Pengcheng and Lu, Zhiyong and Sun, Jimeng},
  year      = {2025},
}

See TrialPanorama on your research question

Book a session to see TrialPanorama on your own indication, drug, or competitor. The database, benchmark, and code behind it are public.