Missionloops · research seat (open) · metacognition & calibration
Knowing what you actually know.
A research seat on the gap between how good people think they are and how good they actually are, and whether a second person watching can close it. The platform follows an operator's own self-monitoring across months of real, high-stakes decisions, a long-run complement to the one-shot lab measures the field relies on.
The faculty this seat studies
Metacognition, in the field's own terms, is the part of thinking that watches thinking: your read on what you know, the confidence you attach to an answer, the sense that you have grasped something or are ready to act on it. Calibration is whether that read is accurate, whether what you feel you know matches what you actually know. The two come apart more than people expect, and not at random. The gap is widest where it costs most, in the people least able to notice it.
Can an outside read close that gap? Or is it a stable trait that feedback does not move? That is the question this seat is open to study.
What the literature already shows
A body of research studies this faculty directly. Several of its findings are settled enough to build on.
- Calibration is generally poor, and poorest among the least skilled. They overestimate the most, and cannot close the gap without an outside read. That dissociation is the rival hypothesis any training claim has to beat.
- Metacognition is not the same as raw self-report. What people say about their confidence and a careful measure of their monitoring can diverge. How a soft signal is operationalised and scored decides whether you are measuring knowledge or only confidence.
- The feeling that an answer is right is a real, measurable cue. It drives whether a person stops to check or moves on, and it can be dissociated from whether the answer is actually right.
- Monitoring and control are separable. Noticing a gap is one thing, acting on it is another, and an intervention can move one without moving the other.
- The durability question is the open one. Can an outside read move a person's calibration for good, not just their confidence in the moment? That is the part the literature has least settled.
One boundary worth drawing. Whether self-report and behavioural measures of the same capacity agree is a real and hard problem, but it belongs to the volition seat. This seat is about the monitoring-and-control faculty itself, and whether a second observer can calibrate it.
The proposal's bet is that the guide is the outside read the literature says calibration needs: a second person who has watched the operator reason over many cycles, and can correct a self-read that has run too high or too low. Whether the bet is right is not assumed anywhere. It is the study.
The open questions
The sharpest question this seat owns is simple to state. Can a second observer train calibration, or is the confidence-accuracy gap a stable trait that feedback does not move? The pilot decides it by comparison. If operators who work with a guide see their self-ratings move toward their real proficiency over the cycles, while solo operators stay miscalibrated, calibration is trainable. If both stay equally off, the gap holds, and the self-assessment half of the platform's mastery model is measuring confidence, not knowledge. The guided-versus-solo trajectory tells the two apart.
- Measurement honesty. When does self-assessment track real proficiency, and when does it drift from it? And how do you score a soft signal so it reads as proficiency and not just confidence? This decides whether the platform can safely tell an operator what they are ready for.
- Calibration under social pressure. Can a person hold an accurate read of their own view when the group leans toward a claim the evidence does not support? What we measure is private-model accuracy: knowing exactly what you think and why, even while you stay quiet.
- Where defence names it. The IDEaS Cognition and Trust challenge sets real-time dynamic calibration as its target. That is where this seat meets the cognitive-sovereignty door.
Why the platform is the instrument
Calibration is hard to study over time. The one-shot tasks that measure it cleanly run into the reliability paradox: a task built to show the same effect in everyone leaves little difference between people to calibrate against. A real-stakes platform offers a different substrate for the same construct. It gives you months of the operator's own monitoring and revision, a guide who supplies the outside read, and a blind behavioural estimate to score the self-assessment against.
The platform's dual-path mastery model fuses a blind behavioural estimate with the operator's own self-assessment and scores how well the two agree. In the field's own terms, that is a meta-reasoning calibration study run at real-stakes scale.
The studies this seat can run
A menu, not a programme. Recast any toward your own published line, or bring a question we did not anticipate.
The seat, and the terms
The seat is open, and the ask is a conversation, not a commitment. The terms are a free option: tell us the question you would bring, and commit only if it is funded.
We are looking for the researcher whose line is metacognition and meta-reasoning: calibration, the confidence-accuracy relationship, the monitoring and control of one's own thinking. If that is your line, the instrument here is a long-run record of monitoring under real stakes, a complement to the one-shot measures, not a replacement for them.
scott (at) missionloops (dot) ca
See also: All research seats · Defence · Member · Investor