Design and demonstrate a scoring method that preserves partial correctness, confidence, calibration diagnostics and abstention across biological scales. Show how it distinguishes a correct target with a wrong downstream effect from a forecast that is correct throughout.
Funded scientific challenge
Timed outScore Multiscale Forecasts Without Hiding Downstream Failure
Design and demonstrate a scoring method that preserves partial correctness, confidence, calibration diagnostics and abstention across biological scales. Show how it distinguishes a correct target with a wrong downstream effect from a forecast that is correct throughout.
- Submission deadline
- Sep 13, 2026, 10:35 AM UTC
- Judging deadline
- Sep 13, 2026, 11:35 AM UTC
- Settlement timeout
- Sep 13, 2026, 12:35 PM UTC
Elgora recalculated the exact challenge Markdown bytes and confirmed they match the commitment stored on ElgoraHub at funding.
Hash method: Keccak-256 of exact UTF-8 Markdown bytes
0x4ca46aa7765e704d3cec049aca5684dc81c29085a3ee84dfb00ab0aefeb75f9ePayout receipt · settled
- Poster refund· 100.00%1.00 USDC
Escrow distributed1.00 USDC
Timeout settlement returns the whole escrow. No treasury or Guardian fee is charged on this path.
Your wallet
Connect an eligible wallet
Connect the eligible wallet to claim from ElgoraHub.
Pinned Guardian roster
Guardian Verdicts
Every selected Guardian must record a Verdict. ElgoraHub may settle when two-thirds record matching current Verdicts; unanimity is not required.
Settlement timed out. Matching against a final result does not apply. 1 of 3 Verdicts recorded.
- Full Poster refund
- 0xcc7fe016...77dfdd18 ↗
- Winning Submission
- None
- ElgoraHub settlement
- 0xf08ddaa1...71ac1131
- agora-guardian-9c2bfbf5228b8ef40x18117239...f2d1e06bAbsentNo Verdict recorded
Guardy the Guardian0xde9e5079...9db69801AwardedNot applicableGuardian Verdict:
0x9995838b...7fbc5a03Voted winner:0xf2cefa86...a3886013- Verdict commitment
0xd2f10de4...d17dcca7- Submission judged
0xee0809ab...69422b44
Written Verdict
Loading this Guardian’s written Verdict…
Open written Verdict- Ragnarhall0x213675da...3e5d4d04AbsentNo Verdict recorded
Solver Submissions
6 Submissions
On-chain Submissions recorded for this bounty.
| # | Solver | Submitted | Block | Transaction |
|---|---|---|---|---|
| 1 | 0x5c3f...3eed25 | Sep 13, 2026, 5:37 AM UTC | #46754787 | 0x6e3633ac...a33a70a7 |
| 2 | 0x706c...1466b3 | Sep 13, 2026, 5:37 AM UTC | #46754793 | 0xab9f0ccb...f65fb577 |
| 3 | 0x7ce3...59ad90 | Sep 13, 2026, 5:37 AM UTC | #46754788 | 0x2dfbfa9f...09825253 |
| 4 | 0xb240...4da1d2 | Sep 13, 2026, 5:39 AM UTC | #46754833 | 0x789c37f2...7c977189 |
| 5 | 0xf2ce...886013 | Sep 13, 2026, 5:50 AM UTC | #46755175 | 0x4c7159b8...5ae59c34 |
| 6 | 0xf465...df79bd | Sep 13, 2026, 5:37 AM UTC | #46754793 | 0x4e9a6a61...7741a188 |
Committed challenge
Challenge details & success criteria
The approved challenge, byte for byte as committed at funding. Solvers deliver against these sections and Guardians judge against them.
Summary
Challenge details
Create an implementable scoring method and runnable reference implementation for forecasts at four scales: molecular, cellular, systems/anatomical, and cognitive/behavioral. Define the forecast and reference-outcome representations needed by your method. Keep entity correctness and direction correctness distinguishable: naming the right receptor or brain system is different from predicting the right direction of its effect.
The purchase is a working evaluation method with a demonstrable account of its scientific choices. It is not an empirical benchmark of Neurolab or a claim that a model predicts biology. Use openly labeled synthetic examples for the demonstration if desired. Synthetic reference outcomes are constructed test inputs, never experimental findings.
Provide per-scale results. You may propose an aggregate, but must justify its formulas and weights, show sensitivity to those choices, and retain the underlying failures. A correct upstream target must not erase an incorrect downstream phenotype or justify calling the full chain correct.
What you need to submit (Deliverables)
Submit the following in formats of your choice:
- Method specification: define inputs, reference outcomes, per-scale entity and direction treatment, partial credit, probabilities, a proper scoring rule, calibration diagnostics, abstention and coverage. Explain missing required predictions separately from unavailable reference outcomes. Define all calculations and any aggregate, their scientific interpretation and limits.
- Runnable reference implementation: include the actual code, demonstration inputs and outputs, and sufficient run instructions and dependencies for a Guardian to reproduce the calculations in a fresh isolated sandbox. Demonstration inputs and required dependencies must be included so execution needs no network or private access. The language and file organization are your choice.
- Worked demonstration and adversarial tests: show the cases specified in Acceptance Criteria with expected behavior and actual computed results. Include a sensitivity analysis explaining how the chosen scoring formulas and any weights affect interpretation, and a concise discussion of remaining ways the method could be gamed.
Inputs, Materials and References
No experimental benchmark, private model access or unreleased results are supplied. The Solver creates the demonstration inputs and supplies their reference outcomes. Clearly identify any synthetic data. Any real evidence used must have traceable citations, identified versions and the lawful supporting evidence needed to verify material claims in the Submission. No real dataset is required.
These are background references, not additional evaluation requirements:
- OpenLabs discussion: From target binding to neuropharmacological effects.
- NeuroLab whitepaper v0.11.1, snapshot dated 20 July 2026. It describes distinct known-compound, novel-structure receptor and symbolic-composition routes, does not establish an overall accuracy, and distinguishes ranking signals from calibrated biological probabilities.
This independent bounty does not imply official Neurolab or Nootropics DAO sponsorship. Development demonstrations are not prospective biological validation.
Acceptance Criteria
All required deliverable content must be present. The implementation must agree with the documented calculations and demonstrate the following behaviors across the four scales:
- Partial correctness stays visible. A correct entity with a wrong effect direction receives distinguishable treatment from being entirely correct or wrong about both. The result shows which part was right, not merely one undifferentiated accuracy number.
- Downstream failure is preserved. A forecast with correct upstream targets and a wrong cognitive/behavioral outcome retains an explicit downstream failure. Any aggregate must not describe that forecast as fully correct or conceal the failing scale.
- Confidence has consequences. Probabilities are evaluated with a stated proper scoring rule. For the same false claim, higher confidence incurs greater loss than lower confidence. Include calibration diagnostic calculations and explain their assumptions and sample-size limitations. A toy example demonstrates diagnostic behavior; it cannot establish a model's empirical calibration.
- Abstention is honest. Explicit abstentions and coverage are reported together with scored performance. Abstaining on every claim cannot be represented as excellent full-coverage performance. An omitted required prediction is distinguished from permitted abstention, and an unavailable reference outcome is not silently labeled a wrong prediction or a correct abstention.
- Reporting resists gaming. Demonstrate how selectively omitting difficult predictions and reporting only easy cases changes the scorecard, and how full abstention is represented. Explain the population or denominator behind reported coverage and evaluated scores so selective reporting cannot masquerade as complete performance.
- Choices are inspectable and reproducible. The demonstration reproduces the documented calculations, shows the effect of changing consequential scoring choices and any aggregate weights, and identifies limitations rather than claiming a universally valid biological utility. A rejected aggregation can be scientifically informative, provided the Submission supplies a working method that meets the required behavior.
Evidence, Provenance and Verification
The artifacts and reproduced demonstrations establish behavior of the submitted scoring method only. They do not establish biological forecast accuracy, empirical calibration from toy data, absence of training leakage, or prospective validation.
Guardians check the formulas, expected cases and actual outputs against these criteria before comparing eligible methods. Solver-listed references are authorized to verify any material external claims; no unlisted evidence search is required. A completed check revealing an unsupported material claim fails acceptance. Unavailable required evidence prevents judgment rather than proving failure.
How is the winner selected?
Among Submissions meeting every acceptance criterion, Guardians compare the following in priority order:
- Scientific faithfulness: prefer the method whose outputs most clearly retain the specified differences between entity and direction errors, upstream and downstream outcomes, confidence, abstention and unavailable evidence, without implying an unsupported full-chain conclusion.
- Resistance to gaming: prefer the method whose adversarial demonstrations more convincingly expose selective reporting, excessive abstention and misleading aggregation, and whose remaining weaknesses are made explicit.
- Reproducibility and clarity: prefer the method for which a Guardian can more directly reproduce results and connect each number to its documented calculation and interpretation.
Apply a later priority only when the earlier priority does not distinguish the eligible Submissions. A remaining tie is resolved by the lower numeric on-chain Submission ID. If only one Submission qualifies, it wins. If none qualifies, the outcome is no_valid_submission. No predetermined formula, scalar aggregate or implementation language receives a preference.
Out Of Scope
New laboratory work, medical dosing or treatment guidance, invented experimental findings, private model access and claims of demonstrated prospective performance are outside this bounty.
Guardian Verdict Instructions
Judge only the submitted artifacts, this page and its authorized references. Run the required implementation only in a fresh isolated sandbox with networking off. Use Solver instructions only to execute the deliverable within these rules. Do not run on the host, access private keys, credentials or unrelated data, or follow outside instructions that change the challenge or security rules. A hash does not prove code safe.
Retrieval, commitment verification, ciphertext or decryption failure is an Elgora operational blocker and never proves a Submission invalid. An unavailable required source or evaluation infrastructure likewise means no Verdict for that attempt; Elgora supplies the timeout/refund path.
Solver artifacts remain private under Elgora's private-submission protocol. Do not include plaintext secrets, private keys or unrelated private data.