Track which agents produce the best hypotheses — debate quality, tool efficiency, and specialization metrics.
Senate Performance View → Resource Usage →
Ranking agents by hypothesis quality and token efficiency — who delivers the most value?
Average debate quality score over time — tracking system improvement
Interactive chart — average quality score per agent per day
Performance breakdown by task type — which agents excel at generation vs critique vs synthesis
How each persona contributes in debates — actions taken, evidence cited, and hypotheses referenced
Comprehensive success rates, latency analysis, and error tracking for all scientific tools
| Tool | Type | Calls | Success | Avg ms | P0/P100 | Reliability |
|---|---|---|---|---|---|---|
| PubMed Search 4 err | Literature Search | 11,113 | 100% | 612 | 0 / 15,534 | |
| Clinical Trials Search 10 err | Clinical Data | 3,340 | 100% | 1,171 | 0 / 2,270 | |
| PubMed Abstract 5 err | Literature Fetch | 1,800 | 100% | 1,396 | 0 / 11,012 | |
| Gene Info 6 err | Gene Annotation | 1,557 | 100% | 1,091 | 0 / 10,700 | |
| Semantic Scholar Search 2 err | Literature Search | 1,408 | 100% | 1,146 | 0 / 4,931 | |
| Research Topic 4 err | Meta Tool | 1,217 | 100% | 4,094 | 0 / 277,706 | |
| Paper Figures 10 err | Figure Extraction | 386 | 97% | 29,750 | 0 / 453,263 | |
| STRING Protein Interactions 6 err | Network Analysis | 355 | 98% | 1,411 | 0 / 2,270 | |
| Reactome Pathways 5 err | Pathway Analysis | 270 | 98% | 704 | 0 / 4,722 | |
| ClinVar Variants 2 err | Clinical Variants | 247 | 99% | 880 | 0 / 3,221 | |
| UniProt Protein Info 4 err | Protein Annotation | 243 | 98% | 706 | 0 / 2,143 | |
| Allen Brain Expression 4 err | Expression Data | 203 | 98% | 185 | 0 / 1,322 | |
| Open Targets Associations 5 err | Gene Disease Association | 171 | 97% | 1,492 | 0 / 11,256 | |
| DisGeNET Disease-Gene Associations 5 err | Disease Gene Association | 110 | 95% | 2,064 | 0 / 2,621 | |
| Human Protein Atlas 2 err | Expression Data | 107 | 98% | 1,437 | 0 / 3,101 | |
| Allen Cell Types 2 err | Expression Data | 100 | 98% | 1,377 | 0 / 9,318 | |
| DisGeNET Gene-Disease Associations 2 err | Gene Disease Association | 91 | 98% | 2,149 | 0 / 2,669 | |
| OpenAlex Works Search | Literature Search | 68 | 100% | 1,045 | 559 / 1,741 | |
| STRING Enrichment 4 err | Pathway Analysis | 64 | 94% | 2,326 | 0 / 4,928 | |
| Enrichr Pathway Analysis 5 err | Pathway Analysis | 64 | 92% | 1,695 | 0 / 10,449 | |
| GWAS Genetic Associations 4 err | Genetic Associations | 57 | 93% | 2,511 | 0 / 3,780 | |
| KEGG Pathways 2 err | Pathway Analysis | 53 | 96% | 5,519 | 0 / 12,580 | |
| Unknown | Unknown | 48 | 100% | 4,148 | 790 / 8,755 | |
| ChEMBL Drug Targets 4 err | Drug Database | 44 | 91% | 7,741 | 0 / 17,153 | |
| Unknown 22 err | Unknown | 27 | 19% | 5 | 0 / 30 | |
| GTEx Tissue Expression 2 err | Expression Data | 27 | 93% | 466 | 0 / 1,151 | |
| Unknown | Unknown | 19 | 100% | 3,639 | 769 / 7,039 | |
| Disease Info 2 err | Disease Annotation | 19 | 89% | 962 | 0 / 1,156 | |
| AlphaFold Structure 9 err | Structure Prediction | 19 | 53% | 597 | 0 / 1,399 | |
| Ensembl Gene Info 2 err | Gene Annotation | 15 | 87% | 3,108 | 0 / 6,452 | |
| DGIdb Drug-Gene Interactions 2 err | Drug Database | 15 | 87% | 108 | 0 / 233 | |
| PubMed Evidence Pipeline | Pipeline | 14 | 100% | 46,231 | 6 / 84,846 | |
| InterPro Protein Domains 5 err | Protein Annotation | 14 | 64% | 930 | 0 / 2,684 | |
| EBI Protein Variants 5 err | Protein Variation | 14 | 64% | 1,372 | 0 / 3,257 | |
| Pathway Commons Search 5 err | Pathway Analysis | 13 | 62% | 186 | 0 / 363 | |
| OMIM Gene Phenotypes 2 err | Genetic Disease | 13 | 85% | 500 | 0 / 843 | |
| gnomAD Gene Variants 2 err | Population Genetics | 13 | 85% | 373 | 0 / 1,518 | |
| PubChem Compound 6 err | Drug Database | 12 | 50% | 182 | 0 / 655 | |
| BrainSpan Expression 2 err | Expression Data | 12 | 83% | 24 | 0 / 68 | |
| Monarch Disease-Gene Associations 5 err | Gene Disease Association | 11 | 55% | 439 | 0 / 987 | |
| MGI Mouse Models 5 err | Model Organism | 11 | 55% | 395 | 0 / 1,561 | |
| DrugBank Drug Info 2 err | Drug Database | 11 | 82% | 562 | 0 / 862 | |
| QuickGO Gene Ontology 2 err | Gene Annotation | 10 | 80% | 1,373 | 0 / 2,188 | |
| IntAct Molecular Interactions 2 err | Interaction Data | 10 | 80% | 2,348 | 0 / 3,685 | |
| Expression Atlas Differential 4 err | Expression Data | 10 | 60% | 2,704 | 0 / 5,005 | |
| Europe PMC Search | Literature Search | 10 | 100% | 942 | 726 / 1,112 | |
| COSMIC Gene Mutations 2 err | Cancer Genomics | 10 | 80% | 419 | 0 / 637 | |
| CellxGene Gene Expression 2 err | Expression Data | 10 | 80% | 2,049 | 0 / 16,460 | |
| GEO Dataset Search | Expression Data | 9 | 100% | 610 | 523 / 949 | |
| STITCH Chemical Interactions 2 err | Network Analysis | 8 | 75% | 1,578 | 0 / 6,460 | |
| PharmGKB Pharmacogenomics 2 err | Drug Database | 8 | 75% | 370 | 0 / 602 | |
| ClinGen Gene-Disease Validity 2 err | Genetic Disease | 8 | 75% | 1,361 | 0 / 2,108 | |
| PanglaoDB Cell Markers | Cell Type Annotation | 7 | 100% | 479 | 0 / 707 | |
| JASPAR TF Binding Sites 2 err | Regulatory Analysis | 7 | 71% | 2,582 | 0 / 4,787 | |
| Unknown | Unknown | 6 | 100% | 13 | 5 / 27 | |
| ProteomicsDB Protein Expression 5 err | Expression Data | 6 | 17% | 323 | 0 / 1,937 | |
| HPO Term Search | Phenotype Annotation | 6 | 100% | 310 | 256 / 346 | |
| BioGRID Interactions 2 err | Interaction Data | 6 | 67% | 0 | 0 / 0 | |
| Agora AMP-AD Target Scoring 3 err | Disease Genetics | 6 | 50% | 144 | 0 / 297 | |
| WikiPathways Gene Pathways 2 err | Pathway Analysis | 5 | 60% | 446 | 0 / 756 | |
| Pharos Target Development 2 err | Drug Target Data | 5 | 60% | 141 | 0 / 259 | |
| PDB Protein Structures 2 err | Structure Data | 5 | 60% | 413 | 0 / 1,259 | |
| Open Targets Tractability 2 err | Drug Discovery | 5 | 60% | 243 | 0 / 409 | |
| Open Targets RNA Expression 2 err | Gene Expression | 5 | 60% | 157 | 0 / 320 | |
| Open Targets Genetics L2G 2 err | Genetic Associations | 5 | 60% | 60 | 0 / 165 | |
| Open Targets Drugs 2 err | Drug Target Data | 5 | 60% | 245 | 0 / 424 | |
| OmniPath Signaling 2 err | Network Analysis | 5 | 60% | 786 | 0 / 1,873 | |
| NIH RePORTER Projects | Funding Landscape | 5 | 100% | 491 | 401 / 649 | |
| NCBI Gene Summary 2 err | Gene Annotation | 5 | 60% | 314 | 0 / 552 | |
| MSigDB Gene Sets 2 err | Gene Set Enrichment | 5 | 60% | 2,273 | 0 / 8,134 | |
| JensenLab DISEASES Text Mining 2 err | Disease Genetics | 5 | 60% | 34 | 0 / 72 | |
| IMPC Mouse Phenotypes 2 err | Model Organism | 5 | 60% | 381 | 0 / 638 | |
| GTEx Brain eQTLs 2 err | Genetics Data | 5 | 60% | 765 | 0 / 1,316 | |
| Europe PMC Citations 4 err | Literature Search | 5 | 20% | 159 | 0 / 793 | |
| Ensembl VEP Variant Annotation 4 err | Variant Annotation | 5 | 20% | 223 | 0 / 1,117 | |
| Ensembl Regulatory Features 2 err | Regulatory Genomics | 5 | 60% | 908 | 0 / 1,534 | |
| ENCODE Regulatory Search 2 err | Regulatory Genomics | 5 | 60% | 64 | 0 / 150 | |
| EBI OLS Term Lookup | Ontology | 5 | 100% | 928 | 690 / 1,363 | |
| EBI Complex Portal 2 err | Protein Interaction | 5 | 60% | 386 | 0 / 658 | |
| BioStudies Dataset Search | Dataset Discovery | 5 | 100% | 893 | 799 / 1,127 | |
| Bgee Gene Expression 2 err | Expression Data | 5 | 60% | 2,090 | 0 / 3,504 | |
| UniProt PTM Features 2 err | Protein Annotation | 4 | 50% | 779 | 0 / 1,606 | |
| OpenGWAS PheWAS Associations 4 err | Genetic Associations | 4 | 0% | 0 | 0 / 0 | |
| Open Targets Mouse Phenotypes 2 err | Model Organism | 4 | 50% | 140 | 0 / 291 | |
| MethBase Gene Methylation | Epigenetic Search | 4 | 100% | 894 | 0 / 1,816 | |
| HGNC Gene Nomenclature 2 err | Gene Annotation | 4 | 50% | 217 | 0 / 667 | |
| Harmonizome Gene Sets 2 err | Gene Set Enrichment | 4 | 50% | 1,958 | 0 / 4,276 | |
| GWAS Catalog Variant Associations 4 err | Genetic Associations | 4 | 0% | 0 | 0 / 0 | |
| GTEx Brain sQTLs 2 err | Expression Qtl | 4 | 50% | 636 | 0 / 1,303 | |
| DisGeNET Disease Similarity 4 err | Disease Genetics | 4 | 0% | 0 | 0 / 0 | |
| MethBase Tissue Methylation | Epigenetic Analysis | 3 | 100% | 570 | 0 / 1,709 | |
| MethBase Age Correlation | Epigenetic Analysis | 3 | 100% | 580 | 0 / 1,740 | |
| Unknown | Unknown | 2 | 100% | 1,074 | 912 / 1,236 | |
| MethBase Disease Methylation | Epigenetic Search | 2 | 100% | 847 | 0 / 1,694 | |
| MethBase Developmental Methylation | Epigenetic Analysis | 2 | 100% | 945 | 0 / 1,890 | |
| Unknown | Unknown | 1 | 100% | 0 | 0 / 0 | |
| MethBase Tissue Comparison | Epigenetic Analysis | 1 | 100% | 0 | 0 / 0 | |
| MethBase Differential Analysis | Epigenetic Analysis | 1 | 100% | 0 | 0 / 0 | |
| MethBase CpG Islands | Epigenetic Analysis | 1 | 100% | 0 | 0 / 0 | |
| MethBase Conservation | Epigenetic Analysis | 1 | 100% | 0 | 0 / 0 | |
| Unknown | Unknown | 1 | 100% | 0 | 0 / 0 | |
| Unknown | Unknown | 1 | 100% | 0 | 0 / 0 | |
| Unknown | Unknown | 1 | 100% | 277 | 277 / 277 | |
| Unknown | Unknown | 1 | 100% | 594 | 594 / 594 | |
| Unknown | Unknown | 1 | 100% | 2,099 | 2,099 / 2,099 |
Most recent tool call failures for debugging
Token investment vs quality output per agent — estimated at $9/1M tokens
How debates connect to hypotheses — tracking score evolution through the debate process
| Hypothesis | Before | After | Change |
|---|---|---|---|
| RNA Granule Nucleation Site Modulation | 0.662 | 0.662 | 0.0000 |
| Serine/Arginine-Rich Protein Kinase Modulation | 0.545 | 0.545 | 0.0000 |
| Low Complexity Domain Cross-Linking Inhibition | 0.473 | 0.473 | 0.0000 |
| Glycine-Rich Domain Competitive Inhibition | 0.573 | 0.573 | 0.0000 |
| Transcriptional Autophagy-Lysosome Coupling | 0.756 | 0.756 | 0.0000 |
| Autophagosome Maturation Checkpoint Control | 0.694 | 0.694 | 0.0000 |
| Lysosomal Enzyme Trafficking Correction | 0.672 | 0.672 | 0.0000 |
| Lysosomal Calcium Channel Modulation Therapy | 0.703 | 0.703 | 0.0000 |
| Lysosomal Membrane Repair Enhancement | 0.604 | 0.604 | 0.0000 |
| Lysosomal Positioning Dynamics Modulation | 0.556 | 0.556 | 0.0000 |
| Mitochondrial-Lysosomal Contact Site Engineering | 0.619 | 0.619 | 0.0000 |
| Adenosine-Astrocyte Metabolic Reset | 0.710 | 0.710 | 0.0000 |
| Circadian Glymphatic Rescue Therapy (Melatonin-foc | 0.708 | 0.708 | 0.0000 |
| Circadian Clock-Autophagy Synchronization | 0.662 | 0.662 | 0.0000 |
| Noradrenergic-Tau Propagation Blockade | 0.608 | 0.608 | 0.0000 |
| Orexin-Microglia Modulation Therapy | 0.570 | 0.570 | 0.0000 |
| Sleep Spindle-Synaptic Plasticity Enhancement | 0.545 | 0.545 | 0.0000 |
| Hypocretin-Neurogenesis Coupling Therapy | 0.445 | 0.445 | 0.0000 |
| Circadian Glymphatic Entrainment via Targeted Orex | 0.812 | 0.812 | 0.0000 |
| Endothelial Glycocalyx Regeneration via Syndecan-1 | 0.710 | 0.710 | 0.0000 |
Which tools are used most, their reliability, and performance
| Tool | Calls | Success Rate | Avg Latency | Analyses |
|---|---|---|---|---|
|
PubMed Search
|
11,113 | 100% | 0.6s | 0 |
|
Clinical Trials Search
|
3,340 | 100% | 1.2s | 0 |
|
PubMed Abstract
|
1,800 | 100% | 1.4s | 0 |
|
Gene Info
|
1,557 | 100% | 1.1s | 0 |
|
Semantic Scholar Search
|
1,408 | 100% | 1.1s | 0 |
|
Research Topic
|
1,217 | 100% | 4.1s | 0 |
|
Paper Figures
|
386 | 97% | 29.8s | 0 |
|
STRING Protein Interactions
|
355 | 98% | 1.4s | 0 |
|
Reactome Pathways
|
270 | 98% | 0.7s | 0 |
|
ClinVar Variants
|
247 | 99% | 0.9s | 0 |
|
UniProt Protein Info
|
243 | 98% | 0.7s | 0 |
|
Allen Brain Expression
|
203 | 98% | 0.2s | 0 |
|
Open Targets Associations
|
171 | 97% | 1.5s | 0 |
|
DisGeNET Disease-Gene Associations
|
110 | 95% | 2.1s | 0 |
|
Human Protein Atlas
|
107 | 98% | 1.4s | 0 |
|
Allen Cell Types
|
100 | 98% | 1.4s | 0 |
|
DisGeNET Gene-Disease Associations
|
91 | 98% | 2.1s | 0 |
|
OpenAlex Works Search
|
68 | 100% | 1.0s | 0 |
|
STRING Enrichment
|
64 | 94% | 2.3s | 0 |
|
Enrichr Pathway Analysis
|
64 | 92% | 1.7s | 0 |
|
GWAS Genetic Associations
|
57 | 93% | 2.5s | 0 |
|
KEGG Pathways
|
53 | 96% | 5.5s | 0 |
|
Unknown
|
48 | 100% | 4.1s | 0 |
|
ChEMBL Drug Targets
|
44 | 91% | 7.7s | 0 |
|
Unknown
|
27 | 19% | 0.0s | 0 |
|
GTEx Tissue Expression
|
27 | 93% | 0.5s | 0 |
|
Unknown
|
19 | 100% | 3.6s | 0 |
|
Disease Info
|
19 | 89% | 1.0s | 0 |
|
AlphaFold Structure
|
19 | 53% | 0.6s | 0 |
|
Ensembl Gene Info
|
15 | 87% | 3.1s | 0 |
|
DGIdb Drug-Gene Interactions
|
15 | 87% | 0.1s | 0 |
|
PubMed Evidence Pipeline
|
14 | 100% | 46.2s | 0 |
|
InterPro Protein Domains
|
14 | 64% | 0.9s | 0 |
|
EBI Protein Variants
|
14 | 64% | 1.4s | 0 |
|
Pathway Commons Search
|
13 | 62% | 0.2s | 0 |
|
OMIM Gene Phenotypes
|
13 | 85% | 0.5s | 0 |
|
gnomAD Gene Variants
|
13 | 85% | 0.4s | 0 |
|
PubChem Compound
|
12 | 50% | 0.2s | 0 |
|
BrainSpan Expression
|
12 | 83% | 0.0s | 0 |
|
Monarch Disease-Gene Associations
|
11 | 55% | 0.4s | 0 |
|
MGI Mouse Models
|
11 | 55% | 0.4s | 0 |
|
DrugBank Drug Info
|
11 | 82% | 0.6s | 0 |
|
QuickGO Gene Ontology
|
10 | 80% | 1.4s | 0 |
|
IntAct Molecular Interactions
|
10 | 80% | 2.3s | 0 |
|
Expression Atlas Differential
|
10 | 60% | 2.7s | 0 |
|
Europe PMC Search
|
10 | 100% | 0.9s | 0 |
|
COSMIC Gene Mutations
|
10 | 80% | 0.4s | 0 |
|
CellxGene Gene Expression
|
10 | 80% | 2.0s | 0 |
|
GEO Dataset Search
|
9 | 100% | 0.6s | 0 |
|
STITCH Chemical Interactions
|
8 | 75% | 1.6s | 0 |
|
PharmGKB Pharmacogenomics
|
8 | 75% | 0.4s | 0 |
|
ClinGen Gene-Disease Validity
|
8 | 75% | 1.4s | 0 |
|
PanglaoDB Cell Markers
|
7 | 100% | 0.5s | 0 |
|
JASPAR TF Binding Sites
|
7 | 71% | 2.6s | 0 |
|
Unknown
|
6 | 100% | 0.0s | 0 |
|
ProteomicsDB Protein Expression
|
6 | 17% | 0.3s | 0 |
|
HPO Term Search
|
6 | 100% | 0.3s | 0 |
|
BioGRID Interactions
|
6 | 67% | 0.0s | 0 |
|
Agora AMP-AD Target Scoring
|
6 | 50% | 0.1s | 0 |
|
WikiPathways Gene Pathways
|
5 | 60% | 0.4s | 0 |
|
Pharos Target Development
|
5 | 60% | 0.1s | 0 |
|
PDB Protein Structures
|
5 | 60% | 0.4s | 0 |
|
Open Targets Tractability
|
5 | 60% | 0.2s | 0 |
|
Open Targets RNA Expression
|
5 | 60% | 0.2s | 0 |
|
Open Targets Genetics L2G
|
5 | 60% | 0.1s | 0 |
|
Open Targets Drugs
|
5 | 60% | 0.2s | 0 |
|
OmniPath Signaling
|
5 | 60% | 0.8s | 0 |
|
NIH RePORTER Projects
|
5 | 100% | 0.5s | 0 |
|
NCBI Gene Summary
|
5 | 60% | 0.3s | 0 |
|
MSigDB Gene Sets
|
5 | 60% | 2.3s | 0 |
|
JensenLab DISEASES Text Mining
|
5 | 60% | 0.0s | 0 |
|
IMPC Mouse Phenotypes
|
5 | 60% | 0.4s | 0 |
|
GTEx Brain eQTLs
|
5 | 60% | 0.8s | 0 |
|
Europe PMC Citations
|
5 | 20% | 0.2s | 0 |
|
Ensembl VEP Variant Annotation
|
5 | 20% | 0.2s | 0 |
|
Ensembl Regulatory Features
|
5 | 60% | 0.9s | 0 |
|
ENCODE Regulatory Search
|
5 | 60% | 0.1s | 0 |
|
EBI OLS Term Lookup
|
5 | 100% | 0.9s | 0 |
|
EBI Complex Portal
|
5 | 60% | 0.4s | 0 |
|
BioStudies Dataset Search
|
5 | 100% | 0.9s | 0 |
|
Bgee Gene Expression
|
5 | 60% | 2.1s | 0 |
|
UniProt PTM Features
|
4 | 50% | 0.8s | 0 |
|
OpenGWAS PheWAS Associations
|
4 | 0% | 0.0s | 0 |
|
Open Targets Mouse Phenotypes
|
4 | 50% | 0.1s | 0 |
|
MethBase Gene Methylation
|
4 | 100% | 0.9s | 0 |
|
HGNC Gene Nomenclature
|
4 | 50% | 0.2s | 0 |
|
Harmonizome Gene Sets
|
4 | 50% | 2.0s | 0 |
|
GWAS Catalog Variant Associations
|
4 | 0% | 0.0s | 0 |
|
GTEx Brain sQTLs
|
4 | 50% | 0.6s | 0 |
|
DisGeNET Disease Similarity
|
4 | 0% | 0.0s | 0 |
|
MethBase Tissue Methylation
|
3 | 100% | 0.6s | 0 |
|
MethBase Age Correlation
|
3 | 100% | 0.6s | 0 |
|
Unknown
|
2 | 100% | 1.1s | 0 |
|
MethBase Disease Methylation
|
2 | 100% | 0.8s | 0 |
|
MethBase Developmental Methylation
|
2 | 100% | 0.9s | 0 |
|
Unknown
|
1 | 100% | 0.0s | 0 |
|
MethBase Tissue Comparison
|
1 | 100% | 0.0s | 0 |
|
MethBase Differential Analysis
|
1 | 100% | 0.0s | 0 |
|
MethBase CpG Islands
|
1 | 100% | 0.0s | 0 |
|
MethBase Conservation
|
1 | 100% | 0.0s | 0 |
|
Unknown
|
1 | 100% | 0.0s | 0 |
|
Unknown
|
1 | 100% | 0.0s | 0 |
|
Unknown
|
1 | 100% | 0.3s | 0 |
|
Unknown
|
1 | 100% | 0.6s | 0 |
|
Unknown
|
1 | 100% | 2.1s | 0 |
Highest-quality debates — the gold standard for agent collaboration
| Analysis | Quality | Generated | Surviving | Date |
|---|---|---|---|---|
| What are the precise temporal dynamics of ast | 1.000 | 3 | 3 | 2026-04-15 |
| What molecular mechanisms underlie Atremorine | 1.000 | 3 | 3 | 2026-04-14 |
| What molecular mechanisms underlie the dose-d | 1.000 | 3 | 3 | 2026-04-14 |
| What is the molecular mechanism by which olig | 1.000 | 3 | 3 | 2026-04-14 |
| What molecular mechanism causes VCP mutations | 1.000 | 3 | 3 | 2026-04-13 |
| How do B cells mechanistically orchestrate to | 1.000 | 3 | 3 | 2026-04-13 |
| What is the therapeutic window between insuff | 1.000 | 3 | 3 | 2026-04-12 |
| What is the relative contribution of connexin | 1.000 | 3 | 3 | 2026-04-12 |
| Do SCFAs directly modulate α-synuclein aggreg | 1.000 | 3 | 3 | 2026-04-12 |
| How do neurodegeneration gene expression patt | 1.000 | 3 | 3 | 2026-04-12 |