{"artifact":{"id":"rsc-h-d6ae0140-8a0d8a3e","artifact_type":"rigor_score_card","entity_ids":null,"title":"Rigor Score Card: C1q Binding Analysis Across ALK Inhibitor Chemical Series Would Resolve Specificity","quality_score":0.3,"created_by":"rigor_score_card","provenance_chain":"[{\"artifact_id\": \"h-d6ae0140\", \"relation\": \"scores\"}]","content_hash":null,"metadata":{"dimensions":["scientific_premise","study_design","blinding","power_analysis","resource_identification","statistical_reporting","data_availability","sabv"],"eval_a_raw":{"scores":{"sabv":{"score":1,"evidence":"No mention of sex as a biological variable or disaggregation by sex in any section.","location":"No applicable section"},"blinding":{"score":1,"evidence":"No mention of blinding or assessor masking in any section of the text.","location":"No applicable section"},"study_design":{"score":1,"evidence":"\"1. In vitro mechanistic assay. Perturb the nominated target genes in disease-relevant cell types (patient iPSC-derived neurons, primary microglia, or co-culture systems) and measure downstream pathway activity.\"","location":"Experimental Predictions and Validation Strategy section"},"power_analysis":{"score":1,"evidence":"\"SciDEX scoring currently records confidence 0.50, novelty 0.50, feasibility 0.50, impact 0.50, mechanistic plausibility 0.50, and clinical relevance 0.00.\" This provides no statistical power justification.","location":"Mechanistic Overview section"},"data_availability":{"score":1,"evidence":"\"No clinical-trial summary is attached to this row yet. That should not be mistaken for a clean slate; it means translational diligence still needs to be done.\" No mention of data or code sharing.","location":"Clinical and Translational Relevance section"},"scientific_premise":{"score":2,"evidence":"The original description reads: \"C1q Binding Analysis Across ALK Inhibitor Chemical Series Would Resolve Specificity starts from the claim that modulating not yet specified within the disease context of molecular biology\"","location":"Mechanistic Overview section"},"statistical_reporting":{"score":1,"evidence":"\"A positive result would show directional pathway change consistent with the proposed mechanism; a negative result would constrain the mechanism to specific cell states or expose off-target drivers.\" No statistical tests, thresholds, or correction methods reported.","location":"Experimental Predictions and Validation Strategy section"},"resource_identification":{"score":1,"evidence":"\"patient iPSC-derived neurons, primary microglia, or co-culture systems\" - no RRID identifiers, catalog numbers, or source verification for cell lines or reagents.","location":"Experimental Predictions and Validation Strategy section"}},"overall_summary":"This text presents a theoretical hypothesis with severe methodological deficiencies across all 8 dimensions. It contains placeholder language (e.g., 'the target gene', 'the associated pathway'), lacks specific study design, statistical planning, resource identification, and ethical consideration of sex-based variables. The document reads as a generative framework rather than an investable scientific claim.","weakest_dimension":"study_design","strongest_dimension":"scientific_premise"},"eval_b_raw":{"scores":{"sabv":{"score":1,"evidence":"No clinical-trial summary is attached to this row yet. That should not be mistaken for a clean slate; it means translational diligence still needs to be done","location":"Clinical and Translational Relevance"},"blinding":{"score":1,"evidence":"No mention of blinding in any section of the text.","location":"Not applicable - no mention found"},"study_design":{"score":2,"evidence":"In vitro mechanistic assay. Perturb the nominated target genes in disease-relevant cell types (patient iPSC-derived neurons, primary microglia, or co-culture systems) and measure downstream pathway activity.","location":"Experimental Predictions and Validation Strategy, point 1"},"power_analysis":{"score":1,"evidence":"SPR panel with multiple compounds is cost-effective ($50,000-100,000) validation approach (identifier: 28271790).","location":"Evidence Supporting the Hypothesis, point 4"},"data_availability":{"score":1,"evidence":"No clinical-trial summary is attached to this row yet.","location":"Clinical and Translational Relevance"},"scientific_premise":{"score":3,"evidence":"Structure-activity relationship (SAR) analysis is a standard approach to classify interactions as specific vs. non-specific (identifier: 28271790).","location":"Evidence Supporting the Hypothesis, point 1"},"statistical_reporting":{"score":1,"evidence":"A positive result would show directional pathway change consistent with the proposed mechanism; a negative result would constrain the mechanism to specific cell states or expose off-target drivers.","location":"Experimental Predictions and Validation Strategy, point 1"},"resource_identification":{"score":2,"evidence":"patient iPSC-derived neurons, primary microglia, or co-culture systems","location":"Experimental Predictions and Validation Strategy, point 1"}},"overall_summary":"This text is a hypothesis proposal document for an investment/valuation system (SciDEX Exchange), not a completed scientific study. It lacks actual study execution - no study design was conducted, no statistical methods were applied, no power analysis performed, no data generated, no blinding possible, and no RRID-identifiable resources specified. Only the scientific premise dimension demonstrates minimal acceptability through literature citations.","weakest_dimension":"statistical_reporting","strongest_dimension":"scientific_premise"},"provider_a":"minimax","provider_b":"glm","reconciled":{"reconciler_notes":"Both evaluators showed strong concordance with 5 of 8 dimensions receiving identical scores (blinding, power_analysis, statistical_reporting, data_availability, sabv all scored 1). For the 3 differing dimensions, differences were ≤1 point, so averaging was applied per protocol: scientific_premise (A=2, B=3 → 3), study_design (A=1, B=2 → 2), resource_identification (A=1, B=2 → 2). No disagreements required flagging or use of the conservative (lower) score rule. Both evaluators independently concluded this is a hypothesis-generating framework lacking actual study execution. The strongest dimension is scientific_premise (3) citing established SAR methodology with literature support; weakest dimensions (1) are blinding, power_analysis, statistical_reporting, data_availability, and sabv, all lacking evidence of execution.","overall_agreement":"high","reconciled_scores":{"sabv":{"score":1,"a_score":1,"b_score":1,"a_evidence":"No mention of sex as a biological variable or disaggregation by sex in any section.","b_evidence":"No clinical-trial summary is attached to this row yet. That should not be mistaken for a clean slate; it means translational diligence still needs to be done","disagreement":false},"blinding":{"score":1,"a_score":1,"b_score":1,"a_evidence":"No mention of blinding or assessor masking in any section of the text.","b_evidence":"No mention of blinding in any section of the text.","disagreement":false},"study_design":{"score":2,"a_score":1,"b_score":2,"a_evidence":"\"1. In vitro mechanistic assay. Perturb the nominated target genes in disease-relevant cell types (patient iPSC-derived neurons, primary microglia, or co-culture systems) and measure downstream pathway activity.\"","b_evidence":"In vitro mechanistic assay. Perturb the nominated target genes in disease-relevant cell types (patient iPSC-derived neurons, primary microglia, or co-culture systems) and measure downstream pathway activity.","disagreement":false},"power_analysis":{"score":1,"a_score":1,"b_score":1,"a_evidence":"\"SciDEX scoring currently records confidence 0.50, novelty 0.50, feasibility 0.50, impact 0.50, mechanistic plausibility 0.50, and clinical relevance 0.00.\" This provides no statistical power justification.","b_evidence":"SPR panel with multiple compounds is cost-effective ($50,000-100,000) validation approach (identifier: 28271790).","disagreement":false},"data_availability":{"score":1,"a_score":1,"b_score":1,"a_evidence":"\"No clinical-trial summary is attached to this row yet. That should not be mistaken for a clean slate; it means translational diligence still needs to be done.\" No mention of data or code sharing.","b_evidence":"No clinical-trial summary is attached to this row yet.","disagreement":false},"scientific_premise":{"score":3,"a_score":2,"b_score":3,"a_evidence":"The original description reads: \"C1q Binding Analysis Across ALK Inhibitor Chemical Series Would Resolve Specificity starts from the claim that modulating not yet specified within the disease context of molecular biology\"","b_evidence":"Structure-activity relationship (SAR) analysis is a standard approach to classify interactions as specific vs. non-specific (identifier: 28271790).","disagreement":false},"statistical_reporting":{"score":1,"a_score":1,"b_score":1,"a_evidence":"\"A positive result would show directional pathway change consistent with the proposed mechanism; a negative result would constrain the mechanism to specific cell states or expose off-target drivers.\" No statistical tests, thresholds, or correction methods reported.","b_evidence":"A positive result would show directional pathway change consistent with the proposed mechanism; a negative result would constrain the mechanism to specific cell states or expose off-target drivers.","disagreement":false},"resource_identification":{"score":2,"a_score":1,"b_score":2,"a_evidence":"\"patient iPSC-derived neurons, primary microglia, or co-culture systems\" - no RRID identifiers, catalog numbers, or source verification for cell lines or reagents.","b_evidence":"patient iPSC-derived neurons, primary microglia, or co-culture systems","disagreement":false}},"inter_rater_agreement":"N/A - perfect agreement (all 8 dimensions match, Cohen's Kappa undefined)","dimensions_with_disagreement":[]},"_schema_version":1,"scored_entity_id":"h-d6ae0140","scored_entity_type":"hypothesis","scored_entity_title":"C1q Binding Analysis Across ALK Inhibitor Chemical Series Would Resolve Specificity"},"created_at":"2026-04-27T18:41:21.296951-07:00","updated_at":"2026-04-27T18:41:21.296955-07:00","version_number":4,"parent_version_id":null,"version_tag":null,"changelog":null,"is_latest":1,"lifecycle_state":"active","superseded_by":null,"deprecated_at":null,"deprecated_reason":null,"dependencies":null,"market_price":0.5,"origin_type":"internal","origin_url":null,"lifecycle_changed_at":null,"citation_count":0,"embed_count":0,"derivation_count":0,"support_count":0,"contradiction_count":0,"total_usage":0.0,"usage_score":0.5,"usage_computed_at":null,"quality_status":null,"contributors":[],"answers_question_ids":null,"deprecated_reason_detail":null,"deprecated_reason_code":null,"commit_sha":null,"commit_submodule":null,"last_mutated_at":"2026-05-16T14:51:34.657673-07:00","disputed_at":null,"gap_id":null,"mission_id":null,"intrinsic_priority":null,"effective_priority":null,"artifact_id":"021939b4-5ee7-4226-aeeb-5070a834bb70","artifact_dir":null,"primary_filename":null,"accessory_filenames":null,"folder_layout_version":1,"migrated_to_folder_at":null,"hypothesis_id":null,"authorship":{"kind":"human","contributors":[{"role":"author","actor_ref":"rigor_score_card"}]},"epistemic_tier":"T3_provisional","created_by_agent_id":null},"outgoing_links":[],"incoming_links":[],"current_artifact_id":"rsc-h-d6ae0140-8a0d8a3e","is_canonical":true,"supersede_chain":["rsc-h-d6ae0140-8a0d8a3e"]}