{"quest":{"id":"q-code-health","name":"Code Health","description":"Continuous code quality review without removing functionality. Archive dead code to cold storage (never delete), organize file sprawl into packages, consolidate duplicate functions, break apart api.py. Connected to artifact lifecycle governance — archival uses cold_store mechanism.","layer":"Senate","priority":88,"status":"active","created_at":"2026-04-03 23:17:24","updated_at":"2026-04-04 00:06:01"},"tasks":[{"id":"2e7f22a0-6730-4c8e-bb69-a0c06fb77e15","title":"[Senate] Recurring code health sweep","description":"Periodic (weekly) conservative code quality review. Scan for: dead code (unreferenced files, version-suffixed duplicates), code duplication (duplicate function definitions, copy-paste patterns), sprawl (root-level file count, god files), missing tests. Produce a prioritized findings report. NEVER remove code without verifying it is truly unused. NEVER destabilize the system.","status":"open","priority":94,"frequency":"every-12h","max_iterations":null,"assigned_slot":"","started_at":null,"completed_at":"2026-04-28T20:46:33.924428+00:00","updated_at":"2026-04-28T20:46:33.924428+00:00","summary":"","completion_summary":"**Code health sweep — Path B close**","completion_notes":"Auto-release: recurring task had no work this cycle","last_error":"","time_estimate_hours":0.0,"completion_count":1,"spec_path":"docs/planning/specs/2e7f22a0_673_code_health_sweep_spec.md","provider":"any","payload_json":"{\"requirements\": {\"coding\": 7, \"reasoning\": 6, \"safety\": 8}, \"completion_shas\": [\"afacf3ce1d194f4a35f32e21f984142ef99fb44a\", \"ac78a2f85e5e933f874741e3434845218e50312e\"], \"completion_shas_checked_at\": \"2026-04-12T19:02:20.119517+00:00\", \"completion_shas_missing\": [\"fdc3aa5d62851f13d5439220e315d874f25ae3d1\", \"14c1fb547a816a5e1847097267d5881c462e854b\", \"313665a15cf2f8015ecf9d5a6a9ca83875d1d704\", \"eae88887d598f851526a528f34fdcce971740589\", \"dd3fa66411aa824c759958a258b5d835cb47c71c\", \"6c008b204d0462985a40a8da56675a5e02693f34\", \"e997e6fa101bde3f3620d516a740b6148e8a9876\", \"a1d9245f4d5ff5a6454190bcd41ebb8db4df2ec7\", \"595b4c5832de68a61f04f07903c6f73eb9f753cd\", \"d28f4b208c6eb2e5a1e71df5e86a065dbedaa984\", \"24b6b3bceb967b03b242cfbb89b2c29f6da4771e\", \"7b112933bcedb6665493f8751da303604b9d66c9\", \"d380c7658efcd4c3f8df809954bf263e7f2ac02a\", \"3771e4f05fe0002d5c319b525fc293078d1458cb\", \"b54878be3a6274e675ddc5fce04f04b205757acc\", \"5d3f31efadeca1dc23af7b0e4bf9eed9e8f74222\", \"42abe5188d706b36bbe25946232a6dd6868deb8b\", \"3b31504421c3d3c5a11f59c48f9ec6cdd1753d29\", \"7eefd067e2612f49b12b1839b808c8817f03ea5d\", \"2f926e27ac59ae5097f2a38a04430fdb3d8a5cdd\", \"d63360deb1e45f8b317f908130ad637a085cab9b\", \"814a897a2212e40b1c28c4ec8c7d65e7660305d9\", \"b9f2918b6adea9d3f50110a52faca35141bb9063\", \"a28f92518ac86273cbeccd6841a7390a8986b78f\", \"1e775556c69176a8d019816c05a43ae389079fd2\", \"742cb90b572dcccb9e88f777183569f80948c55c\", \"ce24b1ab5d61e2a71da86e42436dfc93f8d1dc58\", \"9afc32f4b18248bc470041361c50df8b260dffeb\", \"ba830e33fa0172c70f21863335f659f4f44ae975\", \"c1d8ee1d6b22ac65f3142a475c5c1292933a6164\", \"5e6b44524b9a29802f81c60dc8957eb713198401\", \"fe717978854cb86cad07fecb53ba09c3fc4e5d5c\", \"7914f6ccd514f7a27497cabc85257dcc0c0bd33e\", \"9bfde4fa4fc65f4e0c31fab0341e84e985e468b1\", \"0e0079b2008098e66d344d195f1bd32af68e7728\", \"e55f9e02fe513938f2756b9c810c1766a44b7fac\", \"fe7bacd298ad7cbd60607cd2870d87a15cd61986\", \"61e3040760ac5c93bc7501efe5c6816d0552d898\", \"3324b6258c9d30b1936dbb1e97efe7aa763fdde2\", \"4014e957f89f9e8aad652b35034a2da68f9d8801\", \"1f318c520ee52a0b3a5780c21a24364965acbcbf\", \"ba9ff0e184265c58893c28462981db498c5dedc3\", \"861ecd145e420ddf29608885235b712394c62050\", \"e69c174620fc8fdadacab69d369b664772255319\", \"1269a4bd9675edfc90f0791ddcfc5cd7e1f44254\", \"d46172b20ed530a33b51153bbd978e5e7556f9a0\", \"f8e72b8bea7720ad945a58016647cb3784479fd2\", \"103e818b4ec11077ad11bc9544bdb4f51c7e37e0\", \"a5fbe0d618c7109ca3794ad682acbca1be6d4cf6\", \"0327dcb4245c0828e11a7e7a59f858bb6f653957\", \"4edceafdb38d5e5161d9837fe57ef80f04a1b295\", \"62cc000d7bace881a688e46fcde225927226f26c\", \"6c5ce2a2bd0261201175d86613833fc82ba60399\", \"23b411ea5964db9ad2174e07a0260ec807ace7c2\", \"3734b023147466f2c38bc120710bfe30a59f6e85\", \"2ab8862d32e74a849c2dd5501c6f4eb20542872a\", \"756a85a6420a22b3cd9fe8376dfa91c0f6360589\", \"7d72467b24d2471c89620b3ba8fc61feed55c0e1\", \"5a80fdf3061aebd88217ce4503fa6b2765393cf9\", \"5ae538a527c033e1f6a05c444596d2813daeb5c0\", \"2dcdc555717e69dc341fd560f5aec81c7e5aa5a0\", \"d496b92eb4f5ad5c65f7d43e5591d00bf2fa6bec\", \"563881398dd8de3764da7136183170239cc81382\", \"36f72f3b8d4b0d7c4066355843041ddaac66e30f\", \"0b59e608efaefcc78c65c7da30a748d0da822f2b\", \"7950fba2d004c236a6d6ac814eff149a36d86a2a\", \"86566572db04e44d3a1a3a4548e5796403577ce7\", \"4153baabaca069b4b3685ed2aef034aedc48ad6a\", \"ce505765f65222502ef247463a82eefa20f8b367\", \"fa4a1cd6f5b7e2df1638be0e451f6941de57f45b\", \"5fb424867db4c46a63f79f38d8e08a19871cfe6e\", \"d6fb93b3d598ba76a463af0fdd8ac25c2321338a\", \"854e59b2f8a5e4e0a957daa18e4b5bca2aaf57d6\", \"44810968d1304fdb1d4bfe610512f271c322126f\", \"86ee381282779d0acd8c1c89cd14654fee2e31c0\", \"bd4bd7d2b7f4ffc83d39f0fa7760436fc77dba7f\", \"28a7d900175fe48627aba9623b0aa6c12f47246a\", \"cc9d81f2cf095553cf7b80ef37003bf3ecc82215\", \"01dc7002e80eb3aa88a8416c72edeac81b909556\", \"ff5b5a5351675999c1f658a8ae6f19e5bca98ff3\", \"8fe712d8bf5bb4b95f54e309106d4f98ce3027de\", \"dc974435f1dc21ca1a6d98d6a36103c35849abd9\", \"5fa6dc6b194f29aea22905e182b0dde66256ba1c\", \"037255fb8e4bf35936a3cdb7d7a5d6a741da3ad0\", \"92e19eb46dc32186d9224c576ad9336571a3e4a4\", \"08835dbbe47958d6d00acca436cd75a21ac39114\", \"d7efb7504f84b693580fad204bdda33b99958e0e\", \"98bafa3e94904c341b986365fc1bde4cde477e51\", \"630f0b3788cb088744f0b3dccaccca27684d25cd\", \"32133335670f9d041c8f07d4e7854810ab672e6c\", \"a3cea1f017fb3131546e2b34042b54fad8073b90\", \"525517c9e454e06f8c37cf0198808aec1e1bfdf8\", \"3e733ca3b3c3fb93a94e58f1a11947a5ff61be7f\", \"b3088d5ee418286be83653993ee1ace342c6b23b\", \"deb6644bb1156f267f8985200b9b4743f017f586\", \"3bf304c0d9ddbea97cc06a26683841a0b30cac4a\", \"5133b73654452d5cc8ac6c7e0aa4734e54bbbcd4\", \"f7af5dee1bcbc9022c2eeaa0646bfab38e794111\", \"1621d2e564479a0f06fa775a1c0c3de7c1526473\", \"dbae52b1ecbbef881f6d65ea525588e3353410e2\", \"a8b49f17d8d91d93ddbc94f4dd30b96a262dda76\", \"1670f74065c3eeb51aad182aad4c713b7f4f8a56\", \"5c79cc792bc00840f19fc298a00d26a24b6d6c17\", \"88f4a3cd4ea81d63465010441e12b91b6279be00\", \"e6f0a0d3de27294262630af8a526fc3cb573effe\", \"db5edc52892944d6e50b03761a469d3073e08a63\", \"aad8306a91378c00c37230b01cd5ad57e2070a9b\", \"4113bd29b4074dc70e4deff019bac94a5270eb12\", \"3d5de17f63fe3d68a779f6d72e13eaa5c102bae8\", \"d81660712b5154f0a685558f300dc83a7753b1e3\", \"ae9260bfbbc64e345950d3d87f51c772d1701154\", \"823d5ab437d3332a22bb433cb18b6f1402073d0e\", \"21fc384198d02e8c273add73d25c7eda4652a8bb\", \"6e07fce4567d0107e3ea107cd9029e8094a979c4\", \"fcf4647af3d10925c973690c0a3e42bcdffd813e\", \"c26bb486037db0b35fbfaf1485191496f6f8c34c\", \"1d27ee28604290ee3fdd704a15d0d2877a619131\", \"77cb65edbd55db02aaf8f46cd2c586a465836e6a\", \"c54cc175ed1bc634fbbddd32a30c78565450d989\", \"2f8914a51611d85dcbaac5830b89d571d358a432\", \"95cac3dd55290d165997c76e0cd45be9dc28a161\", \"01462f3fbad4315e4cfbdb712ead62b83aeb1b72\", \"d6d3176b0bf3fb4d23d5154373c46d287709a9ab\", \"4cc034e261e76577d6623d29a1499271eb7b6d82\", \"2184b4d1cbe55a273c34cf98bf27ef45cd81d728\", \"fddd070a35f4a8ea472293626e2aff2c5780ff73\", \"cf13d35cce27e945e3390f4e36922c95a9eabd24\", \"ceb0879505dc09a4a2b07e7783d38573ad49d67d\", \"8a409b3ee75c08fd1b4b74d1d6d5a675d9208b7a\", \"1ab886b1afd3b60285ef8f9b6189755b59783795\", \"99b1d99bc038c292a8d8137f0dccb4aec34c3d87\", \"58bc1ac1cef8358fa693298cba711f2ab037fd73\"]}","pr_links_json":"[]","commit_links_json":"[]","merge_commit_sha":null,"merge_verified_at":null,"verification_result":null,"verification_notes":null,"task_type":"recurring","pr_links":[],"commit_links":[]},{"id":"6ff1aaab-2f9c-47aa-ad10-26e87cec177b","title":"[Forge] Type-checked tool wrappers - pydantic gate + standard error envelope","description":"Wrap every tool in pydantic.validate_call + ToolResult{ok,data,error}; bucket validation vs upstream errors distinctly.","status":"open","priority":87,"frequency":"","max_iterations":null,"assigned_slot":"","started_at":null,"completed_at":null,"updated_at":"2026-05-16T04:12:40.706507+00:00","summary":"","completion_summary":"","completion_notes":"","last_error":"Reopened by done-evidence audit pass 2: legacy done row had no-progress/requeue summary and no completion evidence.","time_estimate_hours":0.0,"completion_count":0,"spec_path":"docs/planning/specs/q-devx-typed-tool-wrappers_spec.md","provider":"any","payload_json":"{\"completion_shas\": [\"1dc92d178\"], \"completion_shas_checked_at\": \"\"}","pr_links_json":"[]","commit_links_json":"[]","merge_commit_sha":null,"merge_verified_at":null,"verification_result":null,"verification_notes":null,"task_type":"one_shot","pr_links":[],"commit_links":[]},{"id":"229313c6-62f7-41e2-bfe2-320e30d3e02d","title":"[Senate] Deferred-work queue - move heavy ops out of request path","description":"Postgres-backed deferred_jobs table with SKIP LOCKED claim; migrate three inline heavy paths (mat refresh, mermaid lint, citation recompute).","status":"done","priority":92,"frequency":"","max_iterations":null,"assigned_slot":"","started_at":null,"completed_at":"2026-04-27T22:47:52.185710+00:00","updated_at":"2026-04-27T22:47:52.185710+00:00","summary":"","completion_summary":"The task has been completed and merged to main. Here's the closing summary:","completion_notes":"Auto-release: work already on origin/main","last_error":"","time_estimate_hours":0.0,"completion_count":0,"spec_path":"docs/planning/specs/q-perf-deferred-work-queue_spec.md","provider":"any","payload_json":"{\"_stall_skip_providers\": [\"glm\"]}","pr_links_json":"[]","commit_links_json":"[]","merge_commit_sha":null,"merge_verified_at":null,"verification_result":"pass","verification_notes":"The task has been completed and merged to main. Here's the closing summary:","task_type":"one_shot","pr_links":[],"commit_links":[]},{"id":"25f7f7f2-e05b-4c08-8414-492b5aa4ccaa","title":"[Senate] Hot-path query optimizer for top-20 endpoints","description":"Sampled per-route DB-time instrumentation + EXPLAIN-driven index suggestions; senate page; CI gate against new seq-scans on top-20 routes.","status":"done","priority":90,"frequency":"","max_iterations":null,"assigned_slot":"","started_at":null,"completed_at":"2026-04-27T14:52:45.356293+00:00","updated_at":"2026-04-27T14:52:45.356293+00:00","summary":"","completion_summary":"[Senate] Hot-path query optimizer: instrumentation, aggregator, senate page, CI gate [task:25f7f7f2-e05b-4c08-8414-492b5aa4ccaa]","completion_notes":"Auto-completed by supervisor after successful deploy to main","last_error":"","time_estimate_hours":0.0,"completion_count":0,"spec_path":"docs/planning/specs/q-perf-hot-path-optimizer_spec.md","provider":"any","payload_json":"{}","pr_links_json":"[]","commit_links_json":"[]","merge_commit_sha":null,"merge_verified_at":null,"verification_result":null,"verification_notes":null,"task_type":"one_shot","pr_links":[],"commit_links":[]},{"id":"6172a849-6ae0-484e-aac2-cdc240b5a3fc","title":"[Atlas] HTTP ETag layer with artifact-mutation-aware invalidation","description":"Add version+last_mutated columns to artifact tables, ETag middleware on top GETs, FK-trigger invalidation when comments/scores change.","status":"done","priority":89,"frequency":"","max_iterations":null,"assigned_slot":"","started_at":null,"completed_at":"2026-04-27T22:43:05.164866+00:00","updated_at":"2026-04-27T22:43:05.164866+00:00","summary":"","completion_summary":"Already resolved in squash merge cc66abb4b (PR #834). The review-requested defensive fix (wrapping plain str cache hits in HTMLResponse before setting .headers[\"ETag\"]) is confirmed in origin/main's api_shared/etag_middleware.py at lines 71-72: `if isinstance(response, str): response = HTMLResponse(content=response)`. The squash merge commit message explicitly lists the defensive fix commit among the merged commits. All acceptance criteria except the optional frontend/load-evidence items are satisfied on main.","completion_notes":"","last_error":"","time_estimate_hours":0.0,"completion_count":0,"spec_path":"docs/planning/specs/q-perf-etag-smart-invalidation_spec.md","provider":"any","payload_json":"{}","pr_links_json":"[]","commit_links_json":"[]","merge_commit_sha":null,"merge_verified_at":null,"verification_result":"pass","verification_notes":"Verified by reading `git show origin/main:api_shared/etag_middleware.py` — isinstance check and HTMLResponse wrap are present. Squash merge cc66abb4b includes commit [Atlas] Defensively wrap str in HTMLResponse in add_etag_response [task:6172a849-6ae0-484e-aac2-cdc240b5a3fc].","task_type":"one_shot","pr_links":[],"commit_links":[]},{"id":"e58cdbeb-4317-494e-bfed-f101183b2a1a","title":"[Senate] Postgres pool autoscaler driven by concurrent-request load","description":"Histogram of pool-checkout-wait p95; resize psycopg-pool dynamically up to PG max_connections-5; cooldown, hard cap, freeze override.","status":"done","priority":88,"frequency":"","max_iterations":null,"assigned_slot":"","started_at":null,"completed_at":"2026-04-27T22:16:19.264393+00:00","updated_at":"2026-04-27T22:16:19.264393+00:00","summary":"","completion_summary":"[Senate] Update pool autoscaler spec with work log [task:e58cdbeb-4317-494e-bfed-f101183b2a1a]; [Senate] PG pool autoscaler driven by checkout-wait p95 [task:e58cdbeb-4317-494e-bfed-f101183b2a1a]","completion_notes":"Auto-completed by supervisor after successful deploy to main","last_error":"","time_estimate_hours":0.0,"completion_count":0,"spec_path":"docs/planning/specs/q-perf-pool-autoscaler_spec.md","provider":"any","payload_json":"{\"completion_shas\": [\"d64dcf6e0c50001ef37331ee821f377cbf43c7e3\", \"0a651d687d3f1448d4d3148a99a88b7f76a687df\"], \"completion_shas_checked_at\": \"\"}","pr_links_json":"[]","commit_links_json":"[]","merge_commit_sha":null,"merge_verified_at":null,"verification_result":null,"verification_notes":null,"task_type":"one_shot","pr_links":[],"commit_links":[]},{"id":"256e38e5-fc4f-4b92-91ec-0b1aa9ba180b","title":"[Senate] N+1 query detector + auto-batch helpers for hot paths","description":"Per-request query-template counter; senate dashboard of top offenders; batch_in/batch_lookup/prefetch helpers; pytest no_n_plus_one marker.","status":"done","priority":88,"frequency":"","max_iterations":null,"assigned_slot":"","started_at":null,"completed_at":"2026-04-27T15:44:54.008305+00:00","updated_at":"2026-04-27T15:44:54.008305+00:00","summary":"","completion_summary":"[Senate] N+1 query detector + auto-batch helpers (api.py, api_shared) [task:256e38e5-fc4f-4b92-91ec-0b1aa9ba180b]","completion_notes":"Auto-completed by supervisor after successful deploy to main","last_error":"","time_estimate_hours":0.0,"completion_count":0,"spec_path":"docs/planning/specs/q-perf-n-plus-one-detector_spec.md","provider":"any","payload_json":"{}","pr_links_json":"[]","commit_links_json":"[]","merge_commit_sha":null,"merge_verified_at":null,"verification_result":null,"verification_notes":null,"task_type":"one_shot","pr_links":[],"commit_links":[]},{"id":"6a532994-7b9d-4a77-a85e-d0c596f2779b","title":"[Senate] Break apart api.py god file into focused modules","description":"api.py is 30K lines — a monolithic god file. Extract logical sections into focused modules while preserving all functionality. Candidates: route handlers by layer (agora_routes.py, exchange_routes.py, atlas_routes.py, senate_routes.py, forge_routes.py), shared HTML helpers (html_helpers.py), database queries (db_queries.py). Use FastAPI APIRouter for clean separation. Test every endpoint after each extraction.\n\n\n## REOPENED TASK — CRITICAL CONTEXT\n\nThis task was previously marked 'done' but the audit could not verify\nthe work actually landed on main. The original work may have been:\n- Lost to an orphan branch / failed push\n- Only a spec-file edit (no code changes)\n- Already addressed by other agents in the meantime\n- Made obsolete by subsequent work\n\n**Before doing anything else:**\n\n1. **Re-evaluate the task in light of CURRENT main state.** Read the\n spec and the relevant files on origin/main NOW. The original task\n may have been written against a state of the code that no longer\n exists.\n\n2. **Verify the task still advances SciDEX's aims.** If the system\n has evolved past the need for this work (different architecture,\n different priorities), close the task with reason \"obsolete: \"\n instead of doing it.\n\n3. **Check if it's already done.** Run `git log --grep=''`\n and read the related commits. If real work landed, complete the\n task with `--no-sha-check --summary 'Already done in '`.\n\n4. **Make sure your changes don't regress recent functionality.** Many\n agents have been working on this codebase. Before committing, run\n `git log --since='24 hours ago' -- ` to see what\n changed in your area, and verify you don't undo any of it.\n\n5. **Stay scoped.** Only do what this specific task asks for. Do not\n refactor, do not \"fix\" unrelated issues, do not add features that\n weren't requested. Scope creep at this point is regression risk.\n\nIf you cannot do this task safely (because it would regress, conflict\nwith current direction, or the requirements no longer apply), escalate\nvia `orchestra escalate` with a clear explanation instead of committing.\n","status":"done","priority":87,"frequency":"","max_iterations":null,"assigned_slot":"","started_at":null,"completed_at":"2026-04-19T02:34:07.917875+00:00","updated_at":"2026-04-19T02:34:07.917875+00:00","summary":"","completion_summary":"[Senate] Document api.py modularization analysis findings [task:6a532994-7b9d-4a77-a85e-d0c596f2779b]","completion_notes":"Auto-completed by supervisor after successful deploy to main","last_error":"","time_estimate_hours":0.0,"completion_count":0,"spec_path":"docs/planning/specs/6a532994_7b9_spec.md","provider":"any","payload_json":"{\"requirements\": {\"coding\": 7, \"reasoning\": 6}, \"_reset_note\": \"This task was reset after a database incident on 2026-04-17.\\n\\n**Context:** SciDEX migrated from SQLite to PostgreSQL after recurring DB\\ncorruption. Some work done during Apr 16-17 may have been lost.\\n\\n**Before starting work:**\\n1. Check if the task's goal is ALREADY satisfied (run the relevant checks)\\n2. Check `git log --all --grep=task:YOUR_TASK_ID` for prior commits\\n3. If complete, verify and mark done. If partial, continue. If not done, proceed.\\n\\n**DB change:** SciDEX now uses PostgreSQL. `get_db()` auto-detects via\\nSCIDEX_DB_BACKEND=postgres env var.\", \"_reset_at\": \"2026-04-18T06:29:22.046013+00:00\", \"_reset_from_status\": \"done\"}","pr_links_json":"[]","commit_links_json":"[]","merge_commit_sha":null,"merge_verified_at":null,"verification_result":null,"verification_notes":null,"task_type":"one_shot","pr_links":[],"commit_links":[]},{"id":"00b6c032-111f-4f19-aaf0-6a72c7346ef3","title":"[Senate] Audit and archive versioned dead code","description":"27+ files with _v[N] suffixes (expand_kg_v3-v11, enrich_seaad_v4, add_mermaid_v3, etc.). For each: check git blame to find when superseded, verify no imports reference it, verify no cron/systemd uses it. Move confirmed dead files to archive/ directory (don't delete — preserve history). Also check scripts/ for duplicates of root-level files.\n\n\n## REOPENED TASK — CRITICAL CONTEXT\n\nThis task was previously marked 'done' but the audit could not verify\nthe work actually landed on main. The original work may have been:\n- Lost to an orphan branch / failed push\n- Only a spec-file edit (no code changes)\n- Already addressed by other agents in the meantime\n- Made obsolete by subsequent work\n\n**Before doing anything else:**\n\n1. **Re-evaluate the task in light of CURRENT main state.** Read the\n spec and the relevant files on origin/main NOW. The original task\n may have been written against a state of the code that no longer\n exists.\n\n2. **Verify the task still advances SciDEX's aims.** If the system\n has evolved past the need for this work (different architecture,\n different priorities), close the task with reason \"obsolete: \"\n instead of doing it.\n\n3. **Check if it's already done.** Run `git log --grep=''`\n and read the related commits. If real work landed, complete the\n task with `--no-sha-check --summary 'Already done in '`.\n\n4. **Make sure your changes don't regress recent functionality.** Many\n agents have been working on this codebase. Before committing, run\n `git log --since='24 hours ago' -- ` to see what\n changed in your area, and verify you don't undo any of it.\n\n5. **Stay scoped.** Only do what this specific task asks for. Do not\n refactor, do not \"fix\" unrelated issues, do not add features that\n weren't requested. Scope creep at this point is regression risk.\n\nIf you cannot do this task safely (because it would regress, conflict\nwith current direction, or the requirements no longer apply), escalate\nvia `orchestra escalate` with a clear explanation instead of committing.\n","status":"done","priority":85,"frequency":"","max_iterations":null,"assigned_slot":"","started_at":null,"completed_at":"2026-04-19T04:19:33.856423+00:00","updated_at":"2026-04-19T04:19:33.856423+00:00","summary":"","completion_summary":"[Verify] Audit and archive versioned dead code — FAIL [task:00b6c032-111f-4f19-aaf0-6a72c7346ef3]","completion_notes":"Auto-completed by supervisor after successful deploy to main","last_error":"","time_estimate_hours":0.0,"completion_count":0,"spec_path":"docs/planning/specs/00b6c032_111_spec.md","provider":"any","payload_json":"{\"requirements\": {\"coding\": 8, \"safety\": 9}, \"_reset_note\": \"This task was reset after a database incident on 2026-04-17.\\n\\n**Context:** SciDEX migrated from SQLite to PostgreSQL after recurring DB\\ncorruption. Some work done during Apr 16-17 may have been lost.\\n\\n**Before starting work:**\\n1. Check if the task's goal is ALREADY satisfied (run the relevant checks)\\n2. Check `git log --all --grep=task:YOUR_TASK_ID` for prior commits\\n3. If complete, verify and mark done. If partial, continue. If not done, proceed.\\n\\n**DB change:** SciDEX now uses PostgreSQL. `get_db()` auto-detects via\\nSCIDEX_DB_BACKEND=postgres env var.\", \"_reset_at\": \"2026-04-18T06:29:22.046013+00:00\", \"_reset_from_status\": \"done\"}","pr_links_json":"[]","commit_links_json":"[]","merge_commit_sha":null,"merge_verified_at":null,"verification_result":"pass","verification_notes":"[Verify] Audit and archive versioned dead code — FAIL [task:00b6c032-111f-4f19-aaf0-6a72c7346ef3]","task_type":"one_shot","pr_links":[],"commit_links":[]},{"id":"d0876690-7512-42ad-8848-389018a3b6bd","title":"[Senate] Postgres slow-query detector with remediation hints","description":"15-min cron pulling pg_stat_statements + EXPLAIN; suggests indexes for seq-scan offenders; auto-files Orchestra task.","status":"done","priority":84,"frequency":"","max_iterations":null,"assigned_slot":"","started_at":null,"completed_at":"2026-04-28T00:01:21.556489+00:00","updated_at":"2026-05-16T04:12:40.706507+00:00","summary":"","completion_summary":"[Senate] Postgres slow-query detector with remediation hints — migration, collector, Senate page, and 26 tests all committed and pushed [task:d0876690-7512-42ad-8848-389018a3b6bd]","completion_notes":"6 files changed, 1431 insertions. Migration enables pg_stat_statements + creates slow_query_history + history mirror. Collector script runs idempotently, computes deltas, generates remediation hints via EXPLAIN, and auto-files Orchestra tasks for persistent offenders (3 consecutive runs + 7-day cooldown). Senate page at /senate/slow-queries with modal, JSON API, and create-task button. 26 tests pass.","last_error":"","time_estimate_hours":0.0,"completion_count":0,"spec_path":"docs/planning/specs/q-obs-pg-slow-query-detector_spec.md","provider":"any","payload_json":"{}","pr_links_json":"[]","commit_links_json":"[]","merge_commit_sha":null,"merge_verified_at":null,"verification_result":"pass","verification_notes":"Legacy done-evidence audit pass 2 backfill: preserved historical done state with administrative/no-merge evidence from completion summary. Original summary: [Senate] Postgres slow-query detector with remediation hints — migration, collector, Senate page, and 26 tests all committed and pushed [task:d0876690-7512-42ad-8848-389018a3b6bd]","task_type":"one_shot","pr_links":[],"commit_links":[]},{"id":"eb06d3df-8328-49ce-a959-06e16002550d","title":"[Senate] scidex doctor - diagnose common dev-env issues","description":"15 health probes (PG, submodules, secrets, services, claude CLI, migrations) with PASS/FAIL/FIX commands; --json.","status":"done","priority":84,"frequency":"","max_iterations":null,"assigned_slot":"","started_at":null,"completed_at":"2026-04-27T23:53:29.467254+00:00","updated_at":"2026-04-27T23:53:29.467254+00:00","summary":"","completion_summary":"[Senate] scidex doctor — 15 health probes for dev-env diagnostics [task:eb06d3df-8328-49ce-a959-06e16002550d]","completion_notes":"Auto-completed by supervisor after successful deploy to main","last_error":"","time_estimate_hours":0.0,"completion_count":0,"spec_path":"docs/planning/specs/q-devx-scidex-doctor_spec.md","provider":"any","payload_json":"{}","pr_links_json":"[]","commit_links_json":"[]","merge_commit_sha":null,"merge_verified_at":null,"verification_result":null,"verification_notes":null,"task_type":"one_shot","pr_links":[],"commit_links":[]},{"id":"18157380-138a-4c4f-a642-4d0ef5af3b4a","title":"[Senate] Consolidate database connection patterns","description":"48 files define their own get_db(), 287 files use raw sqlite3.connect(). Create shared database.py module with: get_db() for read-heavy (WAL, busy_timeout), get_db_write() for write operations, connection pooling context manager. Migrate high-traffic files first (api.py, agent.py, orchestrator, exchange, market_dynamics). Leave standalone scripts for later.\n\n\n## REOPENED TASK — CRITICAL CONTEXT\n\nThis task was previously marked 'done' but the audit could not verify\nthe work actually landed on main. The original work may have been:\n- Lost to an orphan branch / failed push\n- Only a spec-file edit (no code changes)\n- Already addressed by other agents in the meantime\n- Made obsolete by subsequent work\n\n**Before doing anything else:**\n\n1. **Re-evaluate the task in light of CURRENT main state.** Read the\n spec and the relevant files on origin/main NOW. The original task\n may have been written against a state of the code that no longer\n exists.\n\n2. **Verify the task still advances SciDEX's aims.** If the system\n has evolved past the need for this work (different architecture,\n different priorities), close the task with reason \"obsolete: \"\n instead of doing it.\n\n3. **Check if it's already done.** Run `git log --grep=''`\n and read the related commits. If real work landed, complete the\n task with `--no-sha-check --summary 'Already done in '`.\n\n4. **Make sure your changes don't regress recent functionality.** Many\n agents have been working on this codebase. Before committing, run\n `git log --since='24 hours ago' -- ` to see what\n changed in your area, and verify you don't undo any of it.\n\n5. **Stay scoped.** Only do what this specific task asks for. Do not\n refactor, do not \"fix\" unrelated issues, do not add features that\n weren't requested. Scope creep at this point is regression risk.\n\nIf you cannot do this task safely (because it would regress, conflict\nwith current direction, or the requirements no longer apply), escalate\nvia `orchestra escalate` with a clear explanation instead of committing.\n","status":"done","priority":84,"frequency":"","max_iterations":null,"assigned_slot":"","started_at":null,"completed_at":"2026-04-19T05:20:38.033554+00:00","updated_at":"2026-04-19T05:20:38.033554+00:00","summary":"","completion_summary":"[Senate] Update spec: fix verification work log [task:18157380-138a-4c4f-a642-4d0ef5af3b4a]; [Senate] Fix import for database.get_db calls in exchange.py [task:18157380-138a-4c4f-a642-4d0ef5af3b4a]; [Verify] exchange.py migration: add verification work log [task:18157380-138a-4c4f-a642-4d0ef5af3b4a]","completion_notes":"Auto-completed by supervisor after successful deploy to main","last_error":"","time_estimate_hours":0.0,"completion_count":0,"spec_path":"docs/planning/specs/18157380_138_spec.md","provider":"any","payload_json":"{\"_reset_note\": \"This task was reset after a database incident on 2026-04-17.\\n\\n**Context:** SciDEX migrated from SQLite to PostgreSQL after recurring DB\\ncorruption. Some work done during Apr 16-17 may have been lost.\\n\\n**Before starting work:**\\n1. Check if the task's goal is ALREADY satisfied (run the relevant checks)\\n2. Check `git log --all --grep=task:YOUR_TASK_ID` for prior commits\\n3. If complete, verify and mark done. If partial, continue. If not done, proceed.\\n\\n**DB change:** SciDEX now uses PostgreSQL. `get_db()` auto-detects via\\nSCIDEX_DB_BACKEND=postgres env var.\", \"_reset_at\": \"2026-04-18T06:29:22.046013+00:00\", \"_reset_from_status\": \"done\"}","pr_links_json":"[]","commit_links_json":"[]","merge_commit_sha":null,"merge_verified_at":null,"verification_result":null,"verification_notes":null,"task_type":"one_shot","pr_links":[],"commit_links":[]},{"id":"a1e536d4-8c81-4e0b-b17e-2deae4e2b4c2","title":"[Senate] Consolidate duplicated utility functions","description":"Multiple functions are defined 7-15 times across codebase: search_pubmed() (15x), extract_edges_from_abstract() (12x), classify_relation() (9x), find_entities_in_text() (8x), generate_mermaid() (7x). Create shared modules: pubmed_utils.py, kg_extraction_utils.py, mermaid_utils.py. Replace duplicates with imports. Verify each replacement doesn't break callers.\n\n\n## REOPENED TASK — CRITICAL CONTEXT\n\nThis task was previously marked 'done' but the audit could not verify\nthe work actually landed on main. The original work may have been:\n- Lost to an orphan branch / failed push\n- Only a spec-file edit (no code changes)\n- Already addressed by other agents in the meantime\n- Made obsolete by subsequent work\n\n**Before doing anything else:**\n\n1. **Re-evaluate the task in light of CURRENT main state.** Read the\n spec and the relevant files on origin/main NOW. The original task\n may have been written against a state of the code that no longer\n exists.\n\n2. **Verify the task still advances SciDEX's aims.** If the system\n has evolved past the need for this work (different architecture,\n different priorities), close the task with reason \"obsolete: \"\n instead of doing it.\n\n3. **Check if it's already done.** Run `git log --grep=''`\n and read the related commits. If real work landed, complete the\n task with `--no-sha-check --summary 'Already done in '`.\n\n4. **Make sure your changes don't regress recent functionality.** Many\n agents have been working on this codebase. Before committing, run\n `git log --since='24 hours ago' -- ` to see what\n changed in your area, and verify you don't undo any of it.\n\n5. **Stay scoped.** Only do what this specific task asks for. Do not\n refactor, do not \"fix\" unrelated issues, do not add features that\n weren't requested. Scope creep at this point is regression risk.\n\nIf you cannot do this task safely (because it would regress, conflict\nwith current direction, or the requirements no longer apply), escalate\nvia `orchestra escalate` with a clear explanation instead of committing.\n","status":"done","priority":82,"frequency":"","max_iterations":null,"assigned_slot":"","started_at":null,"completed_at":"2026-04-19T05:55:12.739744+00:00","updated_at":"2026-04-19T05:55:12.739744+00:00","summary":"","completion_summary":"[Senate] Update spec work log: resolve merge failure, document rebase [task:a1e536d4-8c81-4e0b-b17e-2deae4e2b4c2]; [Senate] Update spec work log: consolidate 2 more kg_expansion files [task:a1e536d4-8c81-4e0b-b17e-2deae4e2b4c2]; [Senate] Consolidate duplicate extraction functions in kg_expansion [task:a1e536d4-8c81-4e0b-b17e-2deae4e2b4c2]","completion_notes":"Auto-completed by supervisor after successful deploy to main","last_error":"","time_estimate_hours":0.0,"completion_count":0,"spec_path":"docs/planning/specs/a1e536d4_8c8_spec.md","provider":"any","payload_json":"{\"_reset_note\": \"This task was reset after a database incident on 2026-04-17.\\n\\n**Context:** SciDEX migrated from SQLite to PostgreSQL after recurring DB\\ncorruption. Some work done during Apr 16-17 may have been lost.\\n\\n**Before starting work:**\\n1. Check if the task's goal is ALREADY satisfied (run the relevant checks)\\n2. Check `git log --all --grep=task:YOUR_TASK_ID` for prior commits\\n3. If complete, verify and mark done. If partial, continue. If not done, proceed.\\n\\n**DB change:** SciDEX now uses PostgreSQL. `get_db()` auto-detects via\\nSCIDEX_DB_BACKEND=postgres env var.\", \"_reset_at\": \"2026-04-18T06:29:22.046013+00:00\", \"_reset_from_status\": \"done\"}","pr_links_json":"[]","commit_links_json":"[]","merge_commit_sha":null,"merge_verified_at":null,"verification_result":null,"verification_notes":null,"task_type":"one_shot","pr_links":[],"commit_links":[]},{"id":"2eff3b68-7406-412f-8f40-1ce1035b546b","title":"[Senate] Organize root-level file sprawl into packages","description":"305 Python files at root level. Organize into logical packages: enrichment/ (68 enrich_*.py), kg_expansion/ (28 expand_kg_*.py), backfill/ (13 backfill_*.py), mermaid/ (11 add_mermaid_*.py). Keep core files at root (api.py, agent.py, cli.py, etc.). Update all imports. Fix scripts/ duplicates.\n\n\n## REOPENED TASK — CRITICAL CONTEXT\n\nThis task was previously marked 'done' but the audit could not verify\nthe work actually landed on main. The original work may have been:\n- Lost to an orphan branch / failed push\n- Only a spec-file edit (no code changes)\n- Already addressed by other agents in the meantime\n- Made obsolete by subsequent work\n\n**Before doing anything else:**\n\n1. **Re-evaluate the task in light of CURRENT main state.** Read the\n spec and the relevant files on origin/main NOW. The original task\n may have been written against a state of the code that no longer\n exists.\n\n2. **Verify the task still advances SciDEX's aims.** If the system\n has evolved past the need for this work (different architecture,\n different priorities), close the task with reason \"obsolete: \"\n instead of doing it.\n\n3. **Check if it's already done.** Run `git log --grep=''`\n and read the related commits. If real work landed, complete the\n task with `--no-sha-check --summary 'Already done in '`.\n\n4. **Make sure your changes don't regress recent functionality.** Many\n agents have been working on this codebase. Before committing, run\n `git log --since='24 hours ago' -- ` to see what\n changed in your area, and verify you don't undo any of it.\n\n5. **Stay scoped.** Only do what this specific task asks for. Do not\n refactor, do not \"fix\" unrelated issues, do not add features that\n weren't requested. Scope creep at this point is regression risk.\n\nIf you cannot do this task safely (because it would regress, conflict\nwith current direction, or the requirements no longer apply), escalate\nvia `orchestra escalate` with a clear explanation instead of committing.\n","status":"done","priority":80,"frequency":"","max_iterations":null,"assigned_slot":"","started_at":null,"completed_at":"2026-04-19T05:53:32.801187+00:00","updated_at":"2026-04-19T05:53:32.801187+00:00","summary":"","completion_summary":"Update spec work log: reorganized root-level file sprawl [task:2eff3b68-7406-412f-8f40-1ce1035b546b]; [Senate] Organize root-level file sprawl into packages [task:2eff3b68-7406-412f-8f40-1ce1035b546b]","completion_notes":"Auto-completed by supervisor after successful deploy to main","last_error":"","time_estimate_hours":0.0,"completion_count":0,"spec_path":"docs/planning/specs/2eff3b68_740_spec.md","provider":"any","payload_json":"{\"_reset_note\": \"This task was reset after a database incident on 2026-04-17.\\n\\n**Context:** SciDEX migrated from SQLite to PostgreSQL after recurring DB\\ncorruption. Some work done during Apr 16-17 may have been lost.\\n\\n**Before starting work:**\\n1. Check if the task's goal is ALREADY satisfied (run the relevant checks)\\n2. Check `git log --all --grep=task:YOUR_TASK_ID` for prior commits\\n3. If complete, verify and mark done. If partial, continue. If not done, proceed.\\n\\n**DB change:** SciDEX now uses PostgreSQL. `get_db()` auto-detects via\\nSCIDEX_DB_BACKEND=postgres env var.\", \"_reset_at\": \"2026-04-18T06:29:22.046013+00:00\", \"_reset_from_status\": \"done\"}","pr_links_json":"[]","commit_links_json":"[]","merge_commit_sha":null,"merge_verified_at":null,"verification_result":null,"verification_notes":null,"task_type":"one_shot","pr_links":[],"commit_links":[]},{"id":"9076b7ed-f770-4a79-aff9-5e8946118045","title":"[Senate] Add linting and formatting infrastructure","description":"Add pyproject.toml with ruff config (conservative — only flag clear issues, not style preferences). Add ruff check to quality_gates.py pre-merge gate. Focus on: unused imports, undefined variables, f-string issues, security issues (S101-S110). Do NOT enforce style formatting initially — too disruptive.\n\n\n## REOPENED TASK — CRITICAL CONTEXT\n\nThis task was previously marked 'done' but the audit could not verify\nthe work actually landed on main. The original work may have been:\n- Lost to an orphan branch / failed push\n- Only a spec-file edit (no code changes)\n- Already addressed by other agents in the meantime\n- Made obsolete by subsequent work\n\n**Before doing anything else:**\n\n1. **Re-evaluate the task in light of CURRENT main state.** Read the\n spec and the relevant files on origin/main NOW. The original task\n may have been written against a state of the code that no longer\n exists.\n\n2. **Verify the task still advances SciDEX's aims.** If the system\n has evolved past the need for this work (different architecture,\n different priorities), close the task with reason \"obsolete: \"\n instead of doing it.\n\n3. **Check if it's already done.** Run `git log --grep=''`\n and read the related commits. If real work landed, complete the\n task with `--no-sha-check --summary 'Already done in '`.\n\n4. **Make sure your changes don't regress recent functionality.** Many\n agents have been working on this codebase. Before committing, run\n `git log --since='24 hours ago' -- ` to see what\n changed in your area, and verify you don't undo any of it.\n\n5. **Stay scoped.** Only do what this specific task asks for. Do not\n refactor, do not \"fix\" unrelated issues, do not add features that\n weren't requested. Scope creep at this point is regression risk.\n\nIf you cannot do this task safely (because it would regress, conflict\nwith current direction, or the requirements no longer apply), escalate\nvia `orchestra escalate` with a clear explanation instead of committing.\n","status":"done","priority":78,"frequency":"","max_iterations":null,"assigned_slot":"","started_at":null,"completed_at":"2026-04-19T10:35:15.003456+00:00","updated_at":"2026-04-19T10:35:15.003456+00:00","summary":"","completion_summary":"[Senate] Fix ruff config for modern ruff, remove dead imports [task:9076b7ed-f770-4a79-aff9-5e8946118045]","completion_notes":"Auto-completed by supervisor after successful deploy to main","last_error":"","time_estimate_hours":0.0,"completion_count":0,"spec_path":"docs/planning/specs/9076b7ed_f77_spec.md","provider":"any","payload_json":"{\"_reset_note\": \"This task was reset after a database incident on 2026-04-17.\\n\\n**Context:** SciDEX migrated from SQLite to PostgreSQL after recurring DB\\ncorruption. Some work done during Apr 16-17 may have been lost.\\n\\n**Before starting work:**\\n1. Check if the task's goal is ALREADY satisfied (run the relevant checks)\\n2. Check `git log --all --grep=task:YOUR_TASK_ID` for prior commits\\n3. If complete, verify and mark done. If partial, continue. If not done, proceed.\\n\\n**DB change:** SciDEX now uses PostgreSQL. `get_db()` auto-detects via\\nSCIDEX_DB_BACKEND=postgres env var.\", \"_reset_at\": \"2026-04-18T06:29:22.046013+00:00\", \"_reset_from_status\": \"done\"}","pr_links_json":"[]","commit_links_json":"[]","merge_commit_sha":null,"merge_verified_at":null,"verification_result":null,"verification_notes":null,"task_type":"one_shot","pr_links":[],"commit_links":[]},{"id":"b350bf85-ce27-421a-97a7-dfabb488e650","title":"[Senate] Fix migration numbering and cleanup","description":"Fix migration number collisions: 002_add_resource_cost.py vs 002_add_resource_tracking.py, 025_add_backup_log_table.sql vs 025_add_last_evidence_update.py. Ensure migration_history table is consistent. Remove duplicate scripts/ copies of migration files.\n\n\n## REOPENED TASK — CRITICAL CONTEXT\n\nThis task was previously marked 'done' but the audit could not verify\nthe work actually landed on main. The original work may have been:\n- Lost to an orphan branch / failed push\n- Only a spec-file edit (no code changes)\n- Already addressed by other agents in the meantime\n- Made obsolete by subsequent work\n\n**Before doing anything else:**\n\n1. **Re-evaluate the task in light of CURRENT main state.** Read the\n spec and the relevant files on origin/main NOW. The original task\n may have been written against a state of the code that no longer\n exists.\n\n2. **Verify the task still advances SciDEX's aims.** If the system\n has evolved past the need for this work (different architecture,\n different priorities), close the task with reason \"obsolete: \"\n instead of doing it.\n\n3. **Check if it's already done.** Run `git log --grep=''`\n and read the related commits. If real work landed, complete the\n task with `--no-sha-check --summary 'Already done in '`.\n\n4. **Make sure your changes don't regress recent functionality.** Many\n agents have been working on this codebase. Before committing, run\n `git log --since='24 hours ago' -- ` to see what\n changed in your area, and verify you don't undo any of it.\n\n5. **Stay scoped.** Only do what this specific task asks for. Do not\n refactor, do not \"fix\" unrelated issues, do not add features that\n weren't requested. Scope creep at this point is regression risk.\n\nIf you cannot do this task safely (because it would regress, conflict\nwith current direction, or the requirements no longer apply), escalate\nvia `orchestra escalate` with a clear explanation instead of committing.\n","status":"done","priority":76,"frequency":"","max_iterations":null,"assigned_slot":"","started_at":null,"completed_at":"2026-04-19T10:56:41.068568+00:00","updated_at":"2026-04-19T10:56:41.068568+00:00","summary":"","completion_summary":"[Verify] Migration numbering fix verified on main — already resolved [task:b350bf85-ce27-421a-97a7-dfabb488e650]; [Senate] Fix migration number collisions and remove duplicates [task:b350bf85-ce27-421a-97a7-dfabb488e650]; [Senate] Implement automated task quality scoring [task:dcf8f1f1-4a41-4820-b377-2218cce3df29]","completion_notes":"Auto-completed by supervisor after successful deploy to main","last_error":"","time_estimate_hours":0.0,"completion_count":0,"spec_path":"docs/planning/specs/b350bf85_ce2_spec.md","provider":"any","payload_json":"{\"requirements\": {\"coding\": 8, \"safety\": 9}, \"_reset_note\": \"This task was reset after a database incident on 2026-04-17.\\n\\n**Context:** SciDEX migrated from SQLite to PostgreSQL after recurring DB\\ncorruption. Some work done during Apr 16-17 may have been lost.\\n\\n**Before starting work:**\\n1. Check if the task's goal is ALREADY satisfied (run the relevant checks)\\n2. Check `git log --all --grep=task:YOUR_TASK_ID` for prior commits\\n3. If complete, verify and mark done. If partial, continue. If not done, proceed.\\n\\n**DB change:** SciDEX now uses PostgreSQL. `get_db()` auto-detects via\\nSCIDEX_DB_BACKEND=postgres env var.\", \"_reset_at\": \"2026-04-18T06:29:22.046013+00:00\", \"_reset_from_status\": \"done\"}","pr_links_json":"[]","commit_links_json":"[]","merge_commit_sha":null,"merge_verified_at":null,"verification_result":null,"verification_notes":null,"task_type":"one_shot","pr_links":[],"commit_links":[]}],"reviews":[],"effectiveness":{},"related_quests":[{"name":"Artifact Governance & Lifecycle Management","layer":"Senate","priority":93,"status":"active","description":"Establish a unified artifact governance system across SciDEX. Every first-class entity (gap, hypothesis, analysis, paper, dataset, wiki page, debate, squad finding) gets a universal artifact identity, full history tracking, merge/split/archive operations with decision audit trails, and content ownership by agents or squads.\n\nEXISTING INFRASTRUCTURE (to build on, not replace):\n- dedup_recommendations table: 297 pending merge candidates, zero executed\n- artifact_transforms table: 15 records tracking versions/lifecycle/deprecation\n- API endpoints: /api/dedup/{recommendations,approve,reject,scan}, /api/artifact-transforms\n- Lifecycle states: hypotheses (7 states), gaps (6 states), datasets (versioned via git)\n- governance_config table: 3 entries (ALLOCATION_THRESHOLD, REQUIRED_SIGNATURES, AUTHORIZED_SIGNERS)\n- edit_history table: schema exists, zero rows (never wired up)\n- quality_gate_results table: schema exists, zero rows\n\nGAP ANALYSIS (what's missing):\n1. No universal artifact registry — each type has its own ID scheme\n2. edit_history never wired up — no who-changed-what audit trail\n3. 297 dedup recommendations pending forever — no execution pipeline\n4. Lifecycle enforcement is manual/absent — only 1 of 337 hypotheses archived\n5. No content ownership model — artifacts are unowned\n6. No governance decision tracking — decisions happen but aren't recorded\n7. No automated garden maintenance — stale gaps, redundant hypotheses accumulate\n\nDESIGN PRINCIPLES:\n- Clean system APIs: every operation available via /api/ endpoints\n- Documented governance processes adopted by ALL subsystems\n- Agent-compatible: agents and squads can propose, vote, and execute decisions\n- Incremental: builds on existing tables, doesn't require big-bang migration\n- Auditable: every state change has a who/when/why trail","task_count":28,"done_count":28},{"name":"Percolation Engine","layer":"Senate","priority":93,"status":"active","description":"Closes the loop: discussion comments and proposals percolate into concrete actions, edits, cross-links, and new artifacts — everything tracked end-to-end. Components: (1) comment classifier (LLM tags posts as proposal/action/evidence/dispute/question/ack); (2) action emitter — when N agents reach consensus on action-tagged thread, spawn Orchestra task with comment_id provenance; (3) edit emitter — when consensus on edit-proposal, bump artifact version applying the diff and credit contributors; (4) cross-link emitter — when comments link ≥3 artifacts, propose typed artifact_link; (5) proposal emitter — when discussion converges on a proposal shape, spawn the right artifact (analysis_proposal etc.); (6) percolation dashboard — daily flow rates of post→task→artifact-version. Audit + provenance preserved: every action references the originating comment_id and contributors, restoring full reproducibility from the discussion all the way to the merged change.","task_count":18,"done_count":18},{"name":"Autonomous Engines","layer":"Senate","priority":93,"status":"active","description":"Orchestra-managed recurring scripts: debate engine, link checker, orphan checker, convergence monitor, visual regression, pubmed pipeline, metrics, health checks","task_count":18,"done_count":14},{"name":"Resource Intelligence","layer":"Senate","priority":92,"status":"active","description":"Value-based resource allocation — continually evaluate the relative value of quests, tasks, \nhypotheses, gaps, and artifacts, then allocate LLM tokens, CPU, and disk proportionally.\n\nThis quest is the DECISION layer between:\n - Economics (pricing signals, token economy) → tells us what things are WORTH\n - Resource Governance (caps, quotas, enforcement) → tells us what we CAN spend\n - Resource Intelligence (THIS) → decides what we SHOULD spend on\n\nCore loop:\n 1. Score every open task/quest by expected-value-per-token:\n EV = (importance × tractability × downstream_impact) / estimated_cost\n 2. Rank by EV descending → priority queue\n 3. Allocate budget: top-k items get resources proportional to EV rank\n 4. After completion, measure actual impact → update EV model (feedback loop)\n\nSignals feeding the scorer:\n - Elo tournament ratings (hypothesis quality signal)\n - LMSR market prices (belief-weighted value)\n - Gap value_if_resolved scores\n - Quest priority × task count\n - Historical cost-per-completion from resource_usage + cost_ledger\n - Freshness: penalize stale items, boost newly-identified opportunities\n\nResources tracked:\n - LLM tokens (by provider: max, codex, bedrock)\n - CPU seconds (cgroup tracking via cgroup_isolation.py)\n - Disk (artifact storage)\n - Agent slots (concurrent execution capacity)\n\nConnects to:\n - resource_allocations table (currently empty → needs populating)\n - quest_resource_analyzer.py (correlates completion with consumption)\n - monthly_resource_adjustment.py (periodic rebalancing)\n - token_ledger.py (virtual economy)\n - cost_ledger in orchestra.db (real spend)\n\nSpec: docs/planning/specs/q-resource-intelligence_spec.md","task_count":9,"done_count":8},{"name":"Work Governance","layer":"Senate","priority":90,"status":"active","description":"Comprehensive governance framework for tracking all work added to SciDEX — who did what, when, why, and at what cost. Includes commit-level provenance, agent accountability scores, automated quality checks, approval workflows, contradiction detection before KG modifications, rollback capability via kg_modifications log, artifact transform audit trail (merge/split/deprecate/supersede operations), supersession tracking, and dashboards showing contribution patterns.","task_count":9,"done_count":6},{"name":"Resource Governance","layer":"Senate","priority":88,"status":"active","description":"Enforce hard resource limits on the VM — memory caps per analysis, CPU quotas, concurrent analysis limits, cumulative daily cost budgets, and auto-kill for runaway processes. Track and display resource usage in real-time. Prevent the VM from becoming unresponsive due to analysis load. Architecture should support future offloading to external compute (AWS Batch, Lambda, K8s) via a pluggable executor interface.\n\n[2026-04-09] See also q-resource-intelligence for the allocation DECISION layer (this quest handles enforcement/limits, that one handles value-based allocation).","task_count":9,"done_count":9}],"prs":[],"commits":[],"spec_content":"---\ntitle: \"Code Health — Conservative Quality, Consolidation & Dead Code Removal\"\ndescription: \"Recurring quest to continuously review SciDEX codebase for quality, sprawl, and consolidation\"\nstatus: active\npriority: 88\nlayer: Senate\nquest: q-code-health\n---\n\n# Quest: Code Health\n\n## Vision\n\nSciDEX grows fast — 367 Python files, 124K LOC, 30K-line god file, 48 duplicate\nfunction definitions. This quest applies conservative, continuous pressure to improve\ncode quality without removing important functionality or destabilizing the system.\n\n**Principles:**\n1. **Conservative first** — never remove code that might be in use; archive, don't delete\n2. **Verify before acting** — check git blame, imports, cron jobs, systemd before touching\n3. **Test after every change** — all pages return 200, services healthy, API responds\n4. **Incremental** — small, safe steps; never refactor everything at once\n5. **Never contradict SciDEX goals** — code health serves the mission, not the other way around\n\n## Current State (Baseline Metrics)\n\n| Metric | Current | Target |\n|--------|---------|--------|\n| Root-level Python files | 305 | <80 |\n| api.py line count | 30,283 | <5,000 (split into modules) |\n| Duplicate get_db() definitions | 48 | 1 (shared module) |\n| Duplicate search_pubmed() | 15 | 1 |\n| Duplicate extract_edges_from_abstract() | 12 | 1 |\n| Version-suffixed dead code files | 27+ | 0 (archived) |\n| Migration number collisions | 2 | 0 |\n| Linting config | None | ruff in pyproject.toml |\n| Test files | 7 (580 lines) | 20+ (2K+ lines) |\n| Files with raw sqlite3.connect() | 287 | <50 (core scripts only) |\n\n## 8 Tasks (Dependency Order)\n\n```\nRecurring Sweep ──> (informs priorities for all below)\n\nFix Migrations (independent, quick win)\n\nAdd Linting (independent, infrastructure)\n\nArchive Dead Code ──> Organize File Sprawl\n\nConsolidate DB Patterns ──┐\n ├──> Break Apart api.py\nConsolidate Utility Fns ──┘\n```\n\n## Safety Protocol\n\nEvery code health change MUST:\n\n1. **Check references** before removing/moving anything:\n ```bash\n # Is this file imported anywhere?\n grep -r \"import filename\" --include=\"*.py\" .\n grep -r \"from filename\" --include=\"*.py\" .\n # Is it in a systemd service?\n grep -r \"filename\" /etc/systemd/system/scidex-*.service\n # Is it in a cron job?\n crontab -l | grep filename\n ```\n\n2. **Test after changes**:\n ```bash\n for page in / /exchange /analyses/ /graph /gaps /senate /forge; do\n code=$(curl -s -o /dev/null -w '%{http_code}' \"http://localhost:8000${page}\")\n echo \"${code} ${page}\"\n done\n curl -s http://localhost:8000/api/status | python3 -m json.tool\n ```\n\n3. **Commit atomically** — one logical change per commit, easy to revert\n\n4. **Keep archive/** — moved files go to `archive/` directory, not deleted\n\n## Key Files\n\n- `quality_gates.py` — existing pre-merge quality gates (extend, don't replace)\n- `quality_review.py` — existing syntax validation for core files\n- `api.py` — primary refactoring target (30K lines)\n- `tools.py` — second largest file (3,337 lines)\n","spec_html":"

Quest: Code Health

Vision

SciDEX grows fast — 367 Python files, 124K LOC, 30K-line god file, 48 duplicate
function definitions. This quest applies conservative, continuous pressure to improve
code quality without removing important functionality or destabilizing the system.

Principles:\n

  • Conservative first — never remove code that might be in use; archive, don't delete
    • \n
  • Verify before acting — check git blame, imports, cron jobs, systemd before touching
    • \n
  • Test after every change — all pages return 200, services healthy, API responds
    • \n
  • Incremental — small, safe steps; never refactor everything at once
    • \n
  • Never contradict SciDEX goals — code health serves the mission, not the other way around

    • Current State (Baseline Metrics)

    MetricCurrentTarget
    Root-level Python files305<80
    api.py line count30,283<5,000 (split into modules)
    Duplicate get_db() definitions481 (shared module)
    Duplicate search_pubmed()151
    Duplicate extract_edges_from_abstract()121
    Version-suffixed dead code files27+0 (archived)
    Migration number collisions20
    Linting configNoneruff in pyproject.toml
    Test files7 (580 lines)20+ (2K+ lines)
    Files with raw sqlite3.connect()287<50 (core scripts only)
    \n

    8 Tasks (Dependency Order)

    Recurring Sweep ──> (informs priorities for all below)\n\nFix Migrations (independent, quick win)\n\nAdd Linting (independent, infrastructure)\n\nArchive Dead Code ──> Organize File Sprawl\n\nConsolidate DB Patterns ──┐\n                          ├──> Break Apart api.py\nConsolidate Utility Fns ──┘

    Safety Protocol

    Every code health change MUST:

  • Check references before removing/moving anything:
    • \n 
    # Is this file imported anywhere?\n   grep -r "import filename" --include="*.py" .\n   grep -r "from filename" --include="*.py" .\n   # Is it in a systemd service?\n   grep -r "filename" /etc/systemd/system/scidex-*.service\n   # Is it in a cron job?\n   crontab -l | grep filename

  • Test after changes:
    • \n 
    for page in / /exchange /analyses/ /graph /gaps /senate /forge; do\n     code=$(curl -s -o /dev/null -w '%{http_code}' "http://localhost:8000${page}")\n     echo "${code} ${page}"\n   done\n   curl -s http://localhost:8000/api/status | python3 -m json.tool

  • Commit atomically — one logical change per commit, easy to revert

  • Keep archive/ — moved files go to archive/ directory, not deleted

    • Key Files

    • quality_gates.py — existing pre-merge quality gates (extend, don't replace)
      • \n
    • quality_review.py — existing syntax validation for core files
      • \n
    • api.py — primary refactoring target (30K lines)
      • \n
    • tools.py — second largest file (3,337 lines)
      • \n

    ","spec_file":"quest_code_health.md"}