Methodology
How Adcurare evaluates evidence.
Enough to judge the method, without publishing the prompts or orchestration behind it. Every report is built to be checked, and every finding traces back to its source.
Confidence, materiality, and decision impact are never one number.
Detection confidence
How strong is the internal evidence that this finding is real?
Scientific materiality
Could this change the scientific interpretation of the result?
Decision impact
Could this change a clinical, regulatory, or commercial decision?
Collapsing these into a single score hides exactly the distinction a decision-maker needs.
The method, section by section.
- Sources accepted
- Publications and preprints (as PDF, or resolved by DOI, PMCID, or URL), supplementary appendices, protocols and statistical-analysis plans, trial-registry records, and relevant regulatory documents. Related prior studies are retrieved to contextualize claims.
- Finding taxonomy
- Findings are typed: numerical and statistical consistency, protocol-to-publication concordance, claim-to-evidence support, reporting and ethics completeness, citation integrity, and reproducibility. Each carries a severity.
- Evidence-retrieval process
- Consequential claims are extracted with their exact source text and location, then cross-checked across the assembled documents and against external references (for example, Crossref and OpenAlex) so each claim is evaluated against the evidence that bears on it.
- Calculation & consistency checks
- Reported statistics are recomputed (statcheck-style), and internal quantities like denominators, counts, confidence intervals, and table totals are checked for consistency. Declared data and code links are probed for liveness and basic content consistency where present.
- Materiality framework
- Every finding is graded by whether it could change interpretation or a decision, separating typographical and reporting issues from findings that move conclusions.
- Confidence framework
- Detection confidence reflects the strength of the internal evidence for a finding. It is not a probability of misconduct, and it is deliberately kept separate from materiality.
- Human-adjudication process
- Consequential candidate findings are routed to independent human review. Authors or responsible parties are offered an opportunity to respond before a public record is finalized.
- Version control
- The engine version and finding taxonomy are stamped on every report. Public reports are versioned and retain the underlying evidence trail, so findings can be corrected, updated, or withdrawn as new evidence emerges.
- Known limitations
- The system is precision-first: it favors defensible candidate findings over exhaustive recall. Some flaw classes, for example image-based integrity issues or problems that require raw participant-level data, are outside its current scope. Candidate findings are not conclusions.
- Model & methodology update policy
- Model-stack and methodology changes that affect output are versioned; material changes are documented so results remain attributable to a specific release.
Measured, and reported honestly.
Performance is measured on curated corpora with human adjudication. Candidate, human-verified, and author- or journal-confirmed findings are reported separately, and headline rates are withheld until a corpus is fully adjudicated.
Designed to strengthen science, not sensationalize mistakes.
- AI outputs are candidate findings, not final judgments.
- Consequential findings require independent human review.
- Reporting omissions are not treated as evidence of misconduct.
- Authors and responsible parties are offered an opportunity to respond.
- Findings can be corrected, updated, or withdrawn as new evidence emerges.
- Conflicts of interest are disclosed.
- Public reports are versioned and retain the underlying evidence trail.
Reporting omissions are not treated as evidence of misconduct. Where a public record is created, authors and responsible parties are offered an opportunity to respond, and records can be corrected, updated, or withdrawn as new evidence emerges. Conflicts of interest are disclosed.