> ## Continuous-process anchor
>
> This spec describes an instance of one of the retired-script themes
> documented in docs/design/retired_scripts_patterns.md. Before
> implementing, read:
>
> 1. The "Design principles for continuous processes" section of that
> atlas — every principle is load-bearing. In particular:
> - LLMs for semantic judgment; rules for syntactic validation.
> - Gap-predicate driven, not calendar-driven.
> - Idempotent + version-stamped + observable.
> - No hardcoded entity lists, keyword lists, or canonical-name tables.
> - Three surfaces: FastAPI + orchestra + MCP.
> - Progressive improvement via outcome-feedback loop.
> 2. The theme entry in the atlas matching this task's capability:
> F1 (pick the closest from Atlas A1–A7, Agora AG1–AG5,
> Exchange EX1–EX4, Forge F1–F2, Senate S1–S8, Cross-cutting X1–X2).
> 3. If the theme is not yet rebuilt as a continuous process, follow
> docs/planning/specs/rebuild_theme_template_spec.md to scaffold it
> BEFORE doing the per-instance work.
>
> **Specific scripts named below in this spec are retired and must not
> be rebuilt as one-offs.** Implement (or extend) the corresponding
> continuous process instead.
Continuously reduce the backlog of papers missing abstracts or core PubMed metadata in the SciDEX papers table. This recurring task runs every 6 hours to fetch missing metadata (abstract, title, journal, year, authors, DOI, MeSH terms) from PubMed's efetch API, prioritizing papers that are most useful to hypotheses, wiki citations, and debate evidence.
scripts/enrich_papers_pubmed_backlog.py — Core enrichment script with retry logicNone
scripts/enrich_papers_pubmed_backlog.py with improved retry logic for database locksORDER BY created_at ASC to ORDER BY RANDOM() to prioritize papers that actually have abstracts in PubMed (oldest papers are often case reports/letters without abstracts)synthetic_27, synthetic_17)
scripts/enrich_papers_pubmed_backlog.py with batch PubMed efetch (XML parsing, 500 PMIDs/batch, 0.4s rate-limit)scripts/enrich_papers_pubmed_backlog.py to prevent HTTP 414 (URI Too Long) errors for large batches (≥100 PMIDs){
"requirements": {
"analysis": 6,
"reasoning": 6,
"safety": 9
},
"completion_shas": [
"197f9a8f0bcc06b10fa32850ee4a07f635be96f3"
],
"completion_shas_checked_at": "2026-04-13T00:16:23.686188+00:00",
"completion_shas_missing": [
"4b3192a7ed6d1cb75dcca6841e0a1b650b1ab4ef",
"d70754451ef637082305a3fef2dc70347198ef6a",
"c6bfd9a0f68cea171c74f7d8ec784a139ba35bb6",
"e1e5845068aed7b864d554b3aeb56d1fe8c74e5b",
"ca2b199490ec74ad271dbc679f15460ba079673b",
"8fe8c49b290025b32120d1d3bc37aa32b6345af3",
"3c9dfa675347c3063c885e379de392a22946f575",
"96888510f1fcd40d421ca7b0ea309011f31f5ffd",
"1bb6570e2b0ddc6ec3907f0068e830c67329e38d",
"a6514ad567aaece25fac7b9b7514af3306c34236",
"3fb5b26b49f824cdf6a1f33150a5fcb752d54f13",
"090aae6a78f2dcf2bbd2cb94f43f03cb39198777",
"96020d567c6fda3fd323013b2306f6d34801890f",
"c2860741ca77689e0f76347bb0bb578daae40ce8",
"c9fe958e6d1557e001d30e78d4babe7a98064542",
"d19e6a0685806f1aa514085668e0e9bf26a91cdb",
"573989561ddedcdffa0d0fa7c2825adffd3170a8",
"4aeb220d073ecde043fff339b155bcb297b3730f",
"992e6dbca38821e3f10e4b4eabe90c14af408a16",
"a844718d386e0065575abc47889a590dbca21cd2",
"6684dcfce61bef8c75b143c826ef1c062284f83b",
"f5565a723397ae689d7f377d05bae97d5d21b104",
"f7adc5a5b92c8fdcec629457d8f0480760e2ddb2",
"7d2ae8d6e6def4f99be2754f91acd8797cdb0183",
"fa1a00cc94bc7bfab8abbbd7267f8ee4b25c2d7b",
"e903afd8f731fe755d4cffd00ec83df00a3e0e29",
"1a9b23dc663f02be9a814d349379fb050cc33493",
"89b78ac13a3d49717e753e0594be4f2c50bd081a",
"b471b849edf6906b7ee408d5d0e95321ec92e675",
"29ef0b1fded4f1b6a95044fb60e4fe5414f193e1",
"9726694a3e0dcd14b5654b4a32d25f024c08ec18",
"fb9627a40edb4b609a7b05e622621581eb0eca31",
"94265a5b77c21b9f064fed9b931062796e24e1b0",
"ebd2dad83756632868343ffdfcec7c56f9cea093",
"4fa5c1a8326bdb1ef08b635f0ca9e742cb4c11e4",
"08ac8fef4c580482c39c7e959b5cf0d22f3b393e",
"b08a4ec3fcda2cae803d9d53dfd0dd360d523910",
"efe8ffb898f28e64e8270f348c85ccab7c4f4e2c",
"0b83b25d61fb5d16d1939fd0dc249694f5e8f984",
"cdbf18e5f13cd14cb04f6668c35cdcdb12cc830b",
"d9f9282803836a5e1d7b21759e0be3f2caae5115",
"3cff5d587c00d452a5903f2b1314a290d3f12d89",
"8d3906e704d85ba86bf70065be8c59ad09e2830d",
"46aad7bb0b0eeb22a523a003b4527724abbab8c8",
"3386f34f29bc96c9c5e53855ff89247862db5c4e",
"87bedd0e3740b85128054e69f2eb54229c471b15",
"1231eaceb7f1a3b949f45f55ef79d1e9f611d578",
"26cd5b4656fd1639ce0815fb9a5b499678b505be",
"6955776a4475bad7a068cfe28c38c5d4ffa0639b",
"c1f0d829365943b809a98c0cd72156f81a2e0f22",
"ee3be3b57982c730a9ce199fa65df476134d34c5",
"992d6eeb614238a188f21955c6948e6f5a36af53",
"6ac60bb56221dc7f8845d740ef62c53be24f262c",
"c560e8d15ebed14743dfbf3ec723c738cfcd9be0",
"e665bf7d887d1d7eec033d57f24ba573b08493f9",
"ec0ebea534e9f8e842f92af6147f254108eee991",
"2230cf70fdb66129c2d9ff0f3260a943988e6f3d",
"1e14965da8e8f7e9db220d1cea818d0357cae908",
"1b7042de0ed3ac728d451ccafe907b1308b92a75",
"53e29b1f7d45e29db5aa51eb75e877eae651f493",
"2d94bd3e9a58b728d8e35b7e0f5ec1b4b2d9cd5c",
"1d07815c8bd39597395458c400ffdb760c2c1df9",
"48c488abd3d538daaf0e7c8f05e2bcb04cfaa5e5",
"29875d927bf6c319e8853f82a3d8f901f605ed04",
"095536cde4492d7e30fefbf1a938a6a5d84e3db0",
"4866650b9b3a2b39944a09be6887211fc7ec7e65",
"d2f819a68329f9e3467afc3a4446e2bb3a9f0d30",
"d1c76f138f59a13926fb959826fd4ae14fb20e7e",
"b188583d0cccc8695217b3568c891664023f4735",
"2f729c0768724c109b63ff6f327d1d19430cc8b3",
"56ceea514c6e1d4a45328f47961065d617848eb7",
"b521a94e28c6d993a5ad69cfbc9fac7c1382384c",
"f963b41cb61e7194cf0f745836ef7d2c1ee9a0c8",
"0367880a29410c6b1180808f767adcbb954a72e9",
"7555b5e0711908e3250343e95dc3d086fcda991c",
"66ddcdf9f82912aac4534e0bbc8b1ccceeefd18a",
"2411c06af0f4d838579a65bf60b1bc5a6f8baa8c",
"eae760cce89299d85158f690c96b5b27f3c9dbbd",
"912df645a39f1187731db0758674d21ba02aa752",
"c2646e24a7eee8a900d31ee297e99618be905de8",
"95ae923c31373e75b2b39025ce1281de817083fc",
"2db99874cc3d39931879ee364749f180a965a7a5",
"107ff17680f048276c37151c7dfc18cd363ec234",
"ac143f757e73ceb7c875497061bdd89c8deb6b98",
"b1bc5ad369cad359e6942e1084de3e3dfd36f28b",
"322f4b8484c1a9b1717d8a77d0c2266ae1da545c",
"e68ee4e8616a1ae3335bba91399cb91f1ddbf684",
"26ec3a2852a3f80bd43b28b499cc56e89c8ec4e0",
"4d5371b07b5a9c160a642ebf5a2749e193d6f5fc",
"b9015acf922788fb0adc025170f8eaeaf552eeb2",
"7ed10f09b6c61a1374b38d951c4fc2f9f4f91f5c",
"4e7036a84f305e369ff7e243175859e89d6bbb2b",
"cb2f382375a87793785e6c7ca3b80f427e0e9859",
"300bbe6cf34ed20daf4a2a4a4863460da42772ea",
"0c8c1a6fa1a92e182ce10606e0d42d65ef252a41",
"e913eb516b54943a537f5c657eaff78114ad5f69",
"2658035bd87cc21a049b8b676ae88ba71f938620",
"27ffd7aecb22a1ee968c031c1b3517b9be439aa3",
"65eeaaf6455deac7709888ff9809c88e80c28743",
"45892f75fd0171a681da10b225e1c0c014ef61c0",
"5309c2cb1468079e02dd8802bdd8d962381aeee0",
"d684698db0c901c82d6ed9f9618bca2fc1edfeb5",
"0f8f02b1049f134226c3474ff4ca0189b418255a",
"29b864a2ebb849130c4d6e31e845a075ac31799d",
"858b09bf52dc88cfc7dcc9656d3fa3bb2a34ba7f",
"3e3970b3cd386ac9676e0d191b8e8f3c864d28a4",
"f42ffbcbede49a29224caf92fd981a3508160892",
"6cbe687ba36568cbc989f58594885d7833d48456",
"dea5f758489ed36e7eb4b11d8a7350c6fb28b612",
"11f2f095c3142249a7198ff63d58b84d0b07dc38",
"ea9835907f430c19c868eb32d431bd798f75f6ed",
"2b24b56dd0d9f3d12b3a8ab9aad428028a10947d",
"09315bf70dfb9f4f762fedf8fd6b41785a352a8b",
"41fbf3a15c91c40018205c3616aee3afd57304ad",
"c32229445676a4abdbf6141ac8fcfaeb17cbe280",
"ba3c7fe124eb9ffca831fbfb2e497b3d8cfc95ff",
"a421dfd0b78298b1611b3d76df12274cf6149e19",
"cd11bd9fd21e262a90cb1d0099777db7cd4c715f",
"a2e9eed05abf3a3e7595e313b744aac18172bb47",
"529c3f47edbd588049b3a9f8bbdee534ecc631f7",
"e5eab8e053949996167cc9a115896329a5354b9f",
"56927885e849d49dedef910f8f0af3fd2eebce59",
"23f83c54ebfdffaf4c7621d4160f0901924507a0",
"2c4f0f2f985f6de589fb1b70ed940f14889fff7a",
"38407066394d6680e092594067dca61ff6110867",
"262ebdfc99ea617d0d7f2d62854252643dd7181f",
"eabbd08c9e0a15c23d206c1758cfbb0814f02e5f",
"bf39b52406d316c06b8bfb037ce38a1e1012bd7b",
"5b827b61cc1d15bd157ffcdf1d17c7a4000e3d13",
"9f2d8de9138f492065ef97215c54766a41f11a36",
"66929ea929196de702ac27ce9433aa5bafd3f8ad",
"c00046eca2116dbc919e4589ca7520d5326f9027",
"3c48200cd5aa78b05996e001d3684c7c060c5e5c",
"15d28a8d06e9db25ca3436f94ed5a00160e108d6",
"c18ded818c4d7d7397f76c2f588391d84e970737",
"e16b7642e874eab0d2e72f1b9f8b112a41e2009c",
"a69499fcefec3683c4134f0f4ca0ee62efd42812",
"2ced8b3018c84ec28be12d3ba292d5062fec446d",
"bc2e92ff47e8b89465593254a0176c22015ffedc",
"10e03dd7ce39744b120abfa54ed1d59edfb116a0",
"91eb6b3413c1c54f30f467150cc6baaba8d516ff",
"62cad235b1f3cda3a7152b454eb3ff53d8c01451",
"517b91f927219a2dd48c19a8feda1efd5ea8543f",
"ffd14244bd3e608186e446042f60cc433bf42f08",
"926616dd202855a91e9448b3f99a2ec26bfdfaa1",
"d7b149ea259f9216ca09587e1998f0759a51fac1",
"66430b36d95bbfdeaecdff94898ad018c19fce07",
"65a2da4007a9a5fdd66c36c9337d350eda23665b",
"ae46514f80ebb68500e1c0727cd29660bb1f97d8",
"c21ce1fa2d7e189b80ebe85e45698164a4452137",
"80fa7ca2996604eff9412f8057a008f6ab9de36a",
"860d23ffbe8fbde1c409a5ea029c7cffe445d6c5",
"82f128b7834a97d5bbb4958c3134e70d82abad01",
"6795be0edad1967866d0ef1c55e2dc528a5e7b47",
"8c8f26d8c62726cd9f1ce2d8203bef89572ea9a8",
"5436b750eec66d00f533ac776d891c9b7d1d804a",
"ef7c819b6f0d3e72da0492b587bd7f0ccba824f6",
"06e668b7049156de4d28e3b4214bbaccfb1a1a48",
"2f88b9ada54f253009a466f0218fd1ca96a9f9ee",
"bb24907321e087643dd9ee2071dddb39b44276f1",
"fad327429dcf191428c47f910d5b811043e117b5",
"6ce4a87d5b9c28e1aa00475ab782039585138795",
"94ee4a2e5e4c1bebf282de3cb4a151bc2ac45b75",
"62b047a3a8c5526338b10a31fe836dec542d3e5f",
"37d2593140bafd81105c2702620d49e6b3735cb1",
"bac22fd67832d1c6dd82d288b618a8a871503c18",
"4f7406afee5c6a4f0dba5596d1135e45b39647d8",
"a4e7b0e1647f291db4ba4f325c2a67189ba4f6ca",
"c97f91cb24e2987ea038e0e9a08a8f9a120ecdb9",
"8391a4b7258225bdc38940778e100978497091e5",
"5a67a8d4981dbe904ace315f46391f00c902c735",
"4f05a029f5ee3a48ec3c41481565d18fa0bd6ef1",
"899e8babefd742c1847413d0520963b34a7b31dd",
"b28a38177933c9a8086b72118cee633ee254468f",
"5b63a7818ee6d25b6d314450f94cb2e5138c08df",
"c09803386b0c1459798ffd77ba64e546d7aca222",
"9cfc86038b6ac1512e5516d3b84b4e1a22a86425",
"a8028e5fcd2de83133b51a13b8a80d19e259f22a",
"e5a6eb45e76edf2df167aa7241117fcfca039272",
"870ed25f603b00bbb9a2b389e3233e50eaf16f33",
"8ea47f1310de60c20c6964dee577f5fcd14ad8bf",
"8c589c83470deedf5bef666c1fc6294aca4ffe5a",
"641762f00cefa80c4cf6c3ee3d95d3fb305b2b37",
"9308b21e29014ce6bcc378aae5bbd68ef2adbefa",
"d991ce7f34f94ca68b56e076246492076e01c50d",
"5e56e10453d1ae6cca12bb5ca9a2c1cd347cd0be",
"2dd3f0883d521cb224d0138f6f3c37e4e74a2e10",
"9ae22ef16a4dd737db8618bc13ba52b31733e098",
"3e295a0c2903268d26feb83838cd900257bb2ad3",
"0a85446637a3a7b587cfaa01e6d3747c7ef17646",
"488cece73025d5aec6e8ea5651796e9f1fc8d05f",
"901c7534d94555900ceaea1ebed29242905bffbb",
"10db2b5c69fb7cd63d30f540bdd905ff9a4287c6",
"4f259f2793d1aac41ca6ce519259fab1ef935fc7",
"1605bd2258691897de9e8ecf4a6e4bc1e78ed956",
"cdd54c5c5e16543c11ee48038143007ecdec6062",
"1647fa7df715cb19977a5023812abbec32051616",
"5fd257b2a235e8942cf7c757b41ee6e1ea616da0",
"76836603d0c486bfb1f26e65edb859d38ce71298",
"d5d369f4aa9fac237b88e30c39b7835cc9305507",
"1643a8b1b5a35b3a040de4ef6becb1bf74d2c521",
"f1e051e27a8beef8cdcd409b0abc7bec6f254681",
"578c9e2f9763722f2adfad80f2e1c18d514c3d11",
"0c9946681712511d9c3e7f265e0b9d5b53abb169",
"8b3def9bc0d5e755daaab8ecc6c8cb03b1511c91",
"1658b8002d45f24e533bd6956663662c110ac46c",
"70c83f55e00497c48a347a0460bfd68089c132df",
"7d2b9aaae757f79134ace8a3c20f6e643bda49c6",
"11d5916a46a76be353de1a83f1e0f355587e7cc0",
"9cc9f5fecac4a86c26983f087fb3c03bd6a6c37e",
"98ce130bfc014ecd1636f5f2de6e3e9451d3e102",
"78f3fb8667a2a6995ab6fe3a9ae563da0d6fa360",
"390902e9c34bd18340870ae43aed0d962e4fd7d6",
"faac00e40b25409c71acac771715f7ae39eb919e",
"9754768abf92b92f9d5ffc3aa17763ac8ba13998",
"9b4557320cd5912220eac166e5120efaa5b7da1f",
"cb0cc059608603784641f3e3a7ce1c9ca8df5afe",
"76a5619cd0b44160d53e269582d44b789bc83c02",
"32cf414bb1deb625d19132bee1a84fdd6f9f360c",
"09d0f1e00ba5ca4810a9a787fd614ed1a1bb062b",
"92686f8b7acc136afa4ad36916ba3b29e85e25fa",
"7993d8205576def3351c24b376e22930c4d58751",
"0bb90dfdfb74bd7b277c833d2220be68dfd60a6e",
"9161ca609c385d7c77ce85ee8b62664173ede53d",
"866fb2b4a1018b9fd831faa27f13d5231d064cae",
"a3803c548cfc12a26643d37924efb5408377e342",
"f80f245082f0adcb0ccd64da47f4d27e1f348138",
"28e8f4b8722432c3505640f6cbbd90544da60ec5",
"98c3f5ffbe380173595e84f67d16ffc5b9474a33",
"4cb0167f86fc3661a30179357ecd1a3d9b5049a7",
"0ede056b946e60b010f74ba76a58d361bc83a318",
"19d17dc3cf87357c6acbad5e943a90f96f875b6b",
"d666938c759c2a5ebfb87e70b764b2ee9b427514",
"7202c3346c92b97d3515aeffe617e107dce80e5a",
"95e66be8f1cef50536e5f32eb10d44b982d5c93d",
"85d1da3734a6d41dd2e7fdac0394cc7f57bcaddc",
"5f4e24d10fb83d7efc91f0b28bf1c6263e129935",
"4a42f8e6dad6989567789c6542bbe5322b6c4dcb",
"21af317e6fcb98208ab27eaf11e1e05652068b27",
"473f66121976d572d7fcd0001e5c3e9d557fe077",
"84c0e4a288e6f879aeccbf459a46c02e63458f18",
"cf5b77897d27e31c3afeeb3818de90292da54816",
"110224782cc5396ee687539eb27a77798cfa242d",
"3270d9e54f2d323b7cb24e1b38a062c165e37f60",
"5095b8601435b1bd46976bc0941f671df4e3434f",
"c2593f039e8a2a1ab1982ff798311c834967da7e",
"f4f04234313a02cd5399e8f33ffa2d5a5c8b5302",
"25d14209ecb8cc027a0d46c1a574f1e594099c0a",
"7cfa561fa1d02a209e048443c3bb78555c8b13af",
"8a00f4a1cde27b64f2f2ba6e5e1ce54812bf9457",
"3aedbec73c86b2bc8510ec13e303505db9521dc3",
"f7f69cda38e31497e7962d39fb5cc33c5dc58716",
"f34c44392982cd16edf7ef2dd6da9932868567d3",
"cc51c4469823eb33958481612d209636e8ac284f",
"56f5412925ec840f9db6869cde9d031627c32528",
"e8ff71c662ca9c128f2abb028a3dd78cc50f543a",
"af2fa1a40d75e36c1f333698a7328a64e0a02a0f",
"36f2d4bd54c54bc5efd4cde47a882eaf9a0390f5",
"c3681c040734ec676e6e51db375957465a2e8e75",
"1687f1b35cb50970481a54850bac18e66b1b9ebf",
"c9509c79c5dcbcbb988277008c5b1b3b73e7576a",
"e107aefe0e9dd9ea313009c9ac6faa22549a1939",
"5aed28ab27c7b03ecd0aaeb801cc90d28a65245c",
"cf7d276a96796c8a04c673c24227e80ad4bc8d7e",
"d34f65bcc702391712ae08abbb3f1a1c0cf45a53",
"e9f3718583502efa5905dc416a49200487c99d1f"
]
}