Public evidence record
METER 0.2 Research Preview. This record carries the release capability ledger, the model and capability card, the contract and release versions, every claim status and evidence tier, artifact identifiers and digests, the erratum and the preprint link. It is generated from the ledger at build time; the same document is served, machine-readable, at /api/capabilities.
Private logs, participant data, world generators, model weights and unrelated internal material are not published.
Release and contract identity
| Public release | METER 0.2 Research Preview — version 0.2, tag meter-research-preview-0.2, 2026-09-05 (research preview) |
|---|---|
| Python package | meter-research 0.2.0 — not publicly distributed yet. The built wheel and source distribution are weightless (they contain no weight files) and are not blocked by the rule-9 gate. |
| Public capability contract | 3.7, additive over 3.6. ADDITIVE, NOT A REVISION. Every v3.6 decision is carried forward byte-identical and unchanged. v3.7 adds only the item-parameter claims established by the B4X-3 closeout, each tagged with the model generation that supplies its evidence. No B4X-3 evidence was used to alter, upgrade or supersede any v3.6 decision, because the two rest on different model generations. |
| Frozen capability contract | 3.6, unchanged in this release. File capability_contract.json, file sha256 9c38325d9b036ee35ef1e8a233e56e61129eb795689d2307223405a8ea1b9a60, record sha256 5aec044ceacd3523c5528b06adf668046ffd10c073f84c75825d9ce40e7d5509. |
| Bundle load key | research-v0.1 — the argument to METER.load(), not a version label |
| Claim router | claims-v1. Capability is a property of the CLAIM, not of the dataset. The same dataset may support person scoring while METER withholds a less-established item-level claim. |
| Release ledger | release_capability_manifest.json, schema meter-release-capability-manifest-v1, sha256 7e9747cdf256ffaed594ade3a0d39fa33be2457d8e58533d89b6dab676815aad |
METER is a measurement platform currently released for research use. It is not a diagnostic system and no output is a clinical determination.
Claims and their status
The B4X-3 criterion lines are NON-INFERIORITY bars against a conventional mirt specialist re-fitted per world (specialist minus 0.10 for discrimination, plus 0.15 for thresholds, minus 0.05 for person scores), not absolute quality bars. SUPPORTED therefore means METER came within the frozen margin of a per-world specialist fit on a sealed corpus. The claim is amortized inference across heterogeneous measures at low cost, never accuracy superiority.
| Claim | Stratum | Status | Evidence tier | Serving module | Evidence generation | Ledger id |
|---|---|---|---|---|---|---|
| Score people, single-factor measure | K=1 | SUPPORTED | external_real_data_transfer | M-score | v0.6.0-beta.1 | person_scores.k1 |
| Score people, two-factor supplied structure | K=2, supplied structure | LIMITED | expressible_without_own_confirmatory_evaluation | M-struct | v0.6.0-beta.1 | person_scores.k2_supplied |
| Score people, multi-factor supplied structure | K=3-5, supplied structure | SUPPORTED | confirmatory_synthetic_plus_external_transfer | M-struct | v0.6.0-beta.1 | person_scores.k3_to_k5_supplied |
| Understand individual items: discrimination or loading, single-factor measure | K=1 | SUPPORTED · research preview | prospective_synthetic_known_truth | M-item | B4X (broad-prior generation) | item_discrimination.k1 |
| Understand individual items: response thresholds, single-factor measure | K=1 | SUPPORTED · research preview | prospective_synthetic_known_truth | M-item | B4X (broad-prior generation) | item_thresholds.k1 |
| Response thresholds for a multi-factor measure | K=2 | NOT CONFIRMED | prospective_synthetic_known_truth | — | B4X (broad-prior generation) | item_thresholds.k2 |
| Discrimination or loading for a multi-factor measure | K>=2 | NOT ESTABLISHED | descriptive_only_never_adjudicated | — | B4X (broad-prior generation) | item_discrimination.k_ge_2 · B4X3_ERRATUM_001 |
| Discover the factor structure | any | NOT SUPPORTED | — | — | not applicable | factor_discovery |
| Discover the latent structure | any | NOT SUPPORTED | — | — | not applicable | latent_structure_discovery |
| Item parameters at three or more factors | K>=3 | NOT TESTED | — | — | B4X (broad-prior generation) | item_parameters.k_ge_3 |
Evidence source and limitations, per claim
person_scores.k1 — Frozen capability contract v3.6, real_world_cross_sectional_point_estimation. PHQ-9, CES-D-8 and EURO-D across NHANES 2015-2016, NHANES 2017-2018 (locked), ESS Round 7, SHARE Release 9 waves 9 and 8 (locked); 78 country-cycles. Agreement with conventional estimators 0.92-0.94 on the two NHANES cycles, 0.97-0.998 on ESS7, and 0.9851 pooled over 66,812 persons in 28 countries on SHARE wave 9.
- Agreement with a conventional estimate is not accuracy against truth: METER and its comparators share graded-response assumptions and can be wrong together.
- Cross-sectional only; one construct family (depressive symptomatology); two instrument families.
person_scores.k2_supplied — Frozen capability contract v3.6. Expressible and returned with a named warning; the confirmatory synthetic benchmark established 3-5 factors, not 2. No confirmatory evaluation of its own under the v0.6.0-beta.1 generation.
- Returned with a named warning; no K=2-only confirmatory person-score evaluation exists in any generation.
person_scores.k3_to_k5_supplied — Frozen capability contract v3.6; confirmatory synthetic benchmark plus one external transfer (IPIP, artifact D9E). Person scoring only. The structure is supplied by the user and is never discovered by METER.
- Person scoring only: no item-parameter claim of any kind attaches to a multi-factor structure.
- Evidence is confirmatory synthetic plus a single external transfer, not the multi-dataset real-data transfer that supports single-factor person scoring.
item_discrimination.k1 — B4X-3 confirmatory evaluation, criterion C2, sealed corpus B4X_EVAL_V1; reports/b4x/b4x3_evaluation.json at commit 2d12386. PASS on the across-seed median and on all three individual seeds. Per-seed medians 0.922385 / 0.908772 / 0.929348 against a line of >= 0.864551 (higher is better); panel n = 202. The capability rests on all three seeds passing, not on the seed that happens to serve.
- Prospective synthetic known-truth evidence only. External real-data item-parameter validation remains ongoing.
- Estimates are reported on the model's own logit metric; the latent scale is the run's own standardization, not an external anchor.
- The C2 criterion judges recovery of item ordering, which is a correlational claim, not agreement in absolute units.
- The line is a non-inferiority bar against a conventional mirt specialist (specialist minus 0.10), not an absolute quality bar.
item_thresholds.k1 — B4X-3 confirmatory evaluation, criterion C3, sealed corpus B4X_EVAL_V1; reports/b4x/b4x3_evaluation.json at commit 2d12386. PASS on the across-seed median and on all three individual seeds. Per-seed threshold RMSE medians 0.459003 / 0.376687 / 0.342942 against a line of <= 0.500245 (lower is better); panel n = 202. The capability rests on all three seeds passing, not on the seed that happens to serve.
- Prospective synthetic known-truth evidence only. External real-data item-parameter validation remains ongoing.
- Estimates are reported on the model's own logit metric.
- C3 measures RMSE after a per-world linear alignment to the generating truth. That alignment requires known truth and therefore cannot be performed on an uploaded dataset.
- The line is a non-inferiority bar against a conventional mirt specialist (specialist plus 0.15), not an absolute quality bar.
item_thresholds.k2 — B4X-3 confirmatory evaluation, criterion C4. The across-seed median passes (0.420973 against a line of <= 0.448627) and two of three seeds pass individually, but seed 20260901 returns 0.450421, worse than the line by 0.001794. The frozen rule requires the across-seed median AND every individual seed, so C4 is ineligible. Per-seed values are in evidence_record.b4x3.criteria; they are not a ranking, and which seed serves is unrelated to this criterion.
- METER withholds these estimates rather than serving them under a designation the evidence did not earn.
item_discrimination.k_ge_2 — B4X-3, reported descriptively and explicitly excluded from adjudication. Per-seed medians 0.787175 / 0.761324 / 0.810682 on a panel of n = 181, all below the 0.842115 line. Relative to the historical 0.7470-0.7875 development band, one median (0.810682) sits above it and two (0.787175, 0.761324) sit inside it. Under the frozen rule this is evidence about corpus difficulty, not about METER capability, in either direction; it could neither rescue nor veto the designation.
- METER withholds these estimates.
factor_discovery — Milestone 7 closure (2026-08-06); frozen capability contract v3.6, battery_structure_discovery_1_to_5. Never offered. Structure is an input you declare, not an output METER produces. Four smoke runs each reported every world as one factor, with balanced count accuracy 0.200.
- Refused for every dataset, in every release to date.
latent_structure_discovery — Owner directive, release 0.2: latent-structure discovery is not supported unless separately governed by another released capability. No released capability governs it. Listed separately from factor-NUMBER discovery so that neither can be read as permitted by the other's absence. METER is told the structure; it does not infer which items belong to which factor, nor how many factors exist.
- Refused for every dataset. If a future released capability governs structure discovery, it will carry its own ledger row and its own evidence.
item_parameters.k_ge_3 — B4X-3 closeout section 9: 'Anything at K>=3 remains NOT TESTED on any estimand.' The B4X-3 corpus acceptance rule admitted only worlds with K <= 2, so no K>=3 estimand was evaluated in this generation.
- Absence of evidence, not evidence of absence. Withheld because untested, not because it failed.
Serving modules and digests
| Module | Role | Model generation | Parameters | Weight file | File sha256 | State sha256 |
|---|---|---|---|---|---|---|
| M-score | single-factor (unidimensional) person scoring | v0.6.0-beta.1 | 42,899 | weights/phase5e-arm5_combined.pt | 598f782b0d934d3ba7a6eefe08d319d34574171434ef046cadfae70675fee832 | 224a701b8f6981e1e3eeeb64426a9bc8ab0122d7780bb74bb606a0a630397fc8 |
| M-struct | supplied-structure multi-factor person scoring | v0.6.0-beta.1 | 30,986 | weights/mapped_known_structure_seed8100.pt | 911c07e2f4e8360de926b9d5d12720bff03c15fb821130f9d5b9ee28cb30f3c2 | 8d42752009e49694def7c5dfbd77b328c28e337e85c67274058ec111dd2cf7b4 |
| M-item | single-factor item-parameter inference (discrimination and response thresholds) | B4X (broad-prior generation) | 42,964 | weights/A-FREE-EQ_20260902.pt | de04ba393b40d10be9847a8349739691b5159cf72a8480d92ba2ff1ae50ec9d8 | 70ab30a09d4aa8b36ee2d55ac84a33d63e65edc41043ab3a97306c2a36b25196 |
M-item serves from A-FREE-EQ_20260902.pt. The fixed serving checkpoint chosen for reproducible deployment. One checkpoint must serve so that repeated runs on the same data return the same numbers; this is that checkpoint. The choice does not alter or supersede the frozen three-seed B4X-3 adjudication.
Trained weights are distributed out-of-band and are absent from source control. File and state digests ship regardless; every loader refuses to serve a byte that does not match its pin.
Model weights
Model weights are not publicly distributed. DATA_GOVERNANCE rule 9: no trained weights are released until a memorisation/privacy-leakage determination is recorded. The item module (M-item, A-FREE-EQ_20260902) requires its own, separate determination, which must be completed and recorded before any item-model weights are publicly distributed. Owner ruling 2026-09-06.
This gate does not block:
- the hosted research preview at https://meterresearch.ai
- the weightless Python package (wheel and source distribution)
- publication of interfaces, documentation and capability metadata
The wheel, the source distribution and the public repository contain no weight files; the build excludes weights/*.pt and a test inspects the built artifacts. Item-module weights stay private until the determination is recorded.
Frozen B4X-3 record
Designation: B4X3_NOT_CONFIRMED. Three of four prespecified constituent capabilities passed on every seed. K=2 threshold recovery did not satisfy the prespecified every-seed rule; therefore the overall Scope-B designation was not confirmed. No post-result rescue was performed.
Rule. C1-C4 must hold on the across-seed median AND on every individual seed; G2 requires all three seeds complete; NOT_EVALUABLE never falls back to a pass; there is no 'almost passed' branch.
Closed permanently, at commit ea1dd8b; the confirmatory corpus B4X_EVAL_V1 is spent and can never serve as untouched validation again. Corpus B4X_EVAL_V1 (VALIDATION, 383 accepted worlds); seeds 20260901, 20260902, 20260903. Values below are shown to six decimals; the machine-readable ledger carries full precision.
| Criterion | Stratum | Estimand | Per-seed medians | Line | Per-seed verdicts | Across-seed median | Eligible |
|---|---|---|---|---|---|---|---|
| C1 · person scoring, pooled across the tested supplied K<=2 operating regionPOOLED K<=2. May not be restated as a separately adjudicated K=2-only person-score capability. | K<=2 | theta_r | 0.838792 / 0.839201 / 0.839897 | ≥ 0.798956 | PASS · PASS · PASS | 0.839201 (passes) | yes |
| C2 · single-factor item discrimination / loading | K=1 | discrimination_r | 0.922385 / 0.908772 / 0.929348 | ≥ 0.864551 | PASS · PASS · PASS | 0.922385 (passes) | yes |
| C3 · single-factor response thresholds | K=1 | threshold_rmse_logit | 0.459003 / 0.376687 / 0.342942 | ≤ 0.500245 | PASS · PASS · PASS | 0.376687 (passes) | yes |
| C4 · two-factor response thresholds | K=2 | threshold_rmse_logit | 0.450421 / 0.420973 / 0.398747 | ≤ 0.448627 | FAIL · PASS · PASSseed 20260901 misses its line by 0.001794 | 0.420973 (passes) | no |
Descriptive only, never adjudicated: K=2 discrimination. Per-seed medians 0.787175 / 0.761324 / 0.810682 on a panel of n = 181; historical line 0.842115; historical development band 0.747–0.7875. two medians (0.787175, 0.761324) fall inside the band; one (0.810682) falls above it. DESCRIPTIVE ONLY. Movement toward the historical 0.842115 line is evidence about corpus difficulty, never about METER capability, in either direction. See erratum B4X3_ERRATUM_001.
Erratum
B4X3_ERRATUM_001 · 2026-09-06 · APPEND-ONLY record correction; no prior artifact is edited. Ratified by the owner on 2026-09-06: correct the record by append-only erratum. The frozen closeout artifact is not modified.
Corrects. docs/track_b/b4x3_closeout.md, section 5 ('K=2 discrimination / loading - descriptive only'), branch claude/meter-broad-prior, commit ea1dd8b (git blob 9dc62fb6479343610bf1f1c1aedf2679a61cc08d, sha256 b41c00ba21dc26915b6b6cb090c49be818808e421678f5bd2d251f94fef85f9a).
Incorrect statement. “All three sit above the historical development band (0.7470–0.7875 across E-A/B3U) and below the 0.842115 line.”
Correction. The statement that all three descriptive K=2 discrimination medians were above the historical development band was incorrect. Two medians, 0.787175 and 0.761324, fall within the stated 0.7470–0.7875 band; one falls above it. This result was descriptive, was not adjudicated, and does not change any capability decision.
What is unaffected. Every measured value stands and the closeout's table is exact. The quantity was descriptive only, outside the capability contract and never adjudicated; the C1-C4 verdicts, the B4X3_NOT_CONFIRMED designation and every claim status in the release capability ledger are unchanged. No serving decision depends on it.
Record file docs/release/errata/B4X3_ERRATUM_001.json, sha256 84d871773abe0972bfef211cd64935f67a2441168e147e0e26a7e58f48e5437f; carried verbatim in the ledger at evidence_record.b4x3.errata.
Artifact identifiers and digests
| B4X-3 result commit | 2d12386 |
|---|---|
| B4X-3 closeout commit | ea1dd8b · ledger entry BL-14 |
| Evaluator sha256 | 7027355c27da0e56ec55244ad322b6e962082af8f2df883eeff44e352d737c60 |
b4x3_evaluation.json | 00a2b100c8ce86de45ccf0ec3a6b6fa0e35aa3df0f44901414ff1a6ebfbf15cc |
b4x3_lines.json | a71c9cec3de1fdd307680f52efd0de482017faf686a72a3284645193b637548b |
b4x3_pin.json | cdd0d1e563eb28e57b21c8ee1de88c19fc2f4669e54b365f80758bc66c321129 |
b4x3_specialist.json | 36a9a4950d9e22b71a9743398e4e704da5e9d1364ec752a4630344ca7b8e0cec |
b4x3_eval_panels.json | d0051a34e5f3337239d26ef3db0b2da15e223d78a7e0ff696610c5ae043e8b2b |
b4x3_freeze.md | 134c5ffd40d7e5ff05b7dff6cd4773ee655f9467aeb3f4369033f0e0e1af297a |
grant_B4X_EVAL_V1 | 3df68e866a8a07cf55ad77f78fdfbbed5a2e86978d5c07b3b521b1935be26676 |
bundle manifest.json | 513e27b6c850cc063ebe803fac28e7869f845d1efcd1a16ef411e5354c48f22b |
bundle capability_contract.json | 9c38325d9b036ee35ef1e8a233e56e61129eb795689d2307223405a8ea1b9a60 |
bundle weights/phase5e-arm5_combined.pt | 598f782b0d934d3ba7a6eefe08d319d34574171434ef046cadfae70675fee832 |
bundle weights/mapped_known_structure_seed8100.pt | 911c07e2f4e8360de926b9d5d12720bff03c15fb821130f9d5b9ee28cb30f3c2 |
bundle release_capability_manifest.json | 7e9747cdf256ffaed594ade3a0d39fa33be2457d8e58533d89b6dab676815aad |
bundle weights/A-FREE-EQ_20260902.pt | de04ba393b40d10be9847a8349739691b5159cf72a8480d92ba2ff1ae50ec9d8 |
state phase5e-arm5_combined.pt::best_state | 224a701b8f6981e1e3eeeb64426a9bc8ab0122d7780bb74bb606a0a630397fc8 |
state mapped_known_structure_seed8100.pt::state | 8d42752009e49694def7c5dfbd77b328c28e337e85c67274058ec111dd2cf7b4 |
state A-FREE-EQ_20260902.pt::best_state | 70ab30a09d4aa8b36ee2d55ac84a33d63e65edc41043ab3a97306c2a36b25196 |
Capability contract derived from docs/track_b/b4x3_closeout.md section 9 (capability ledger, FROZEN), commit ea1dd8b. Digests of weight files are published so a recipient can verify a file; the files themselves are not published (see Model weights).
Model and capability card
The card is served at /api/model-card as Markdown, byte-identical to the MODEL_CARD.md that ships in the package’s source distribution. It covers the frozen modules, the item-parameter capability and its boundary, the complete v3.6 status map, the frozen evidence summary, uncertainty, the refusal surface and intended use.
Links
- Preprint: https://doi.org/10.21203/rs.3.rs-10910303/v1
Tay, A. K., & Chen, J. (2026). Psychometric inference without refitting across heterogeneous instruments and populations [Preprint]. Research Square. https://doi.org/10.21203/rs.3.rs-10910303/v1 - Machine-readable ledger: /api/capabilities
- Model and capability card: /api/model-card
- Selected benchmarks and the capability table: Evidence
- Data handling: Privacy
The website's Selected benchmarks table remains a selection and is not described as complete; its 'supporting evidence record' link resolves to this record.