[Atlas] Surface and score 61 convergence reports — SciDEX's first scientific synthesis output

← All Specs

Context

As of 2026-04-29, SciDEX's convergence_reports table contains 61 rows.
These reports represent the system's attempts to synthesize evidence across
multiple hypotheses into coherent scientific narratives — this is potentially
the platform's highest-value scientific output.

However, these reports are not:

  • Quality-scored
  • Surfaced in the UI
  • Linked to supporting hypotheses or KG entities
  • Exported or cited in any discoverable format

With 88 high-score hypotheses (composite_score ≥ 0.8), 3,741 predictions,
19,753 causal edges, and 850 debate sessions, the convergence reports should
be drawing on this rich evidence base. If they are, they need to be surfaced.
If they aren't, they need to be rebuilt.

Goal

  • Audit all 61 convergence reports for quality and evidence density
  • Score each report on: evidence breadth, mechanistic specificity, falsifiability,
  • citation quality (PMIDs), novelty vs. consensus
  • Surface top 10 reports prominently in the Atlas wiki/UI
  • For low-quality reports: identify what evidence is available to improve them
  • Produce a "SciDEX Top Insights" index: top 10 convergences ranked by quality
  • What success looks like

    ☐ All 61 reports audited with quality scores (1-10 on each dimension)
    ☐ Top 10 reports identified and their quality dimensions described
    ☐ Each top report linked to supporting hypotheses, debate sessions, and KG edges
    ☐ A "SciDEX Top Insights" wiki page created with the top 10 synthesis reports
    ☐ At least 3 reports enriched to include PubMed-cited evidence for their claims

    What NOT to do

    • Do NOT create new convergence_reports rows without a quality threshold
    • Do NOT delete existing reports, even poor-quality ones — archive instead
    • Do NOT fabricate citations — all PMIDs must be real and verifiable

    Agent guidance

  • Query convergence_reports with SELECT * FROM convergence_reports LIMIT 5
  • to understand the schema first
  • Use the paper_cache to verify citations
  • Score reports using LLM evaluation (tools.py or llm.py)
  • Link to wiki_pages using existing wiki API
  • Spec notes

    • Created by quest task generator Cycle 4 (2026-04-29T03:05Z)
    • Priority 93: scientific output (criterion #3) + value proposition
    • 61 convergence reports represent significant accumulated work that may be
    invisible to users and operators

    Work Log

    Created 2026-04-29

    Spec created by ambitious quest task generator (Cycle 4). Convergence reports
    table was discovered during world-model snapshot. 61 reports exist but appear
    unsurfaced in UI. High potential for first scientific synthesis publication.

    File: quest_atlas_convergence_report_quality.md
    Modified: 2026-05-01 20:13
    Size: 2.9 KB