Skip to documentation content

Calibration and quality tiers

Informed by ../acoustic-survey-methodology.md: professional surveys use Class 1 instruments, pre/post calibration, fixed positions, station-to-station reporting, and layered metrics. Crowdsourced phone data is survey-grade at best and must be labelled accordingly.

Calibration hierarchy

LevelDescriptionTypical use
0Unknown consumer deviceInformal only
1Known model, no project profileTier C candidate
2Model profile from controlled experimentsTier B
3Individual field offset vs referenceTier B or Tier A eligibility under the documented protocol
4External calibrated microphoneTier A candidate
5Professional SLM survey protocolTier A / reference campaigns

Quiet-room / noise-floor check may detect obstruction or malfunction; it is not calibration.

Quality tiers (accepted working labels)

TierMeaning (working)
AReference equipment or validated external mic under documented protocol
BSupported consumer model with experimental correction profile
CProject app on unprofiled device; complete metadata; no major quality warnings
DImported recording (e.g. Voice Memos) or incomplete session
EManual/legacy/insufficient technical metadata

Low tiers must not silently appear equivalent to high tiers on the public map.

Uncertainty dimensions (not one score)

Report separately where possible:

  • Acoustic level confidence
  • Frequency content confidence
  • Journey assignment confidence
  • Device calibration confidence
  • User metadata confidence
  • Subjective response confidence (if present)

Quality flags (non-exhaustive)

Clipping, dropout, sample-rate change, Bluetooth input, voice-processing mode, AGC suspicion, obstructed mic, pocket/bag, call/interruption, too short, missing stations, implausible speed, walking mixed with train, route mismatch, duplicate, excessive speech, unknown device profile.

Recommendation

Gate public map colouring on tier + sample size; always show tier mix and uncertainty. Store raw derived values plus optional correction factor without baking corrections irreversibly into the only stored number.

Confidence: Medium (tier boundaries need pilot data).

Depends on experiment/legal/user-test? Experiments for model profiles; pilot for tier gates.

Links: ../research/04-calibration-uncertainty.md; ../research/02-acoustic-methodology.md; ../decisions/ADR-006-quality-tiers.md; H06 — Quality tiers.