Within Case Labels
Why One UFO Verdict Is Often Not Enough
Separating best-fit explanations from evidence reliability prevents uncertain sightings being treated as solved cases.
On this page
- Separating explanation strength from data quality
- Examples of balloon and aircraft classification splits
- Building transparent public case tables
Page outline Jump by section
Introduction
A single UFO verdict often hides two separate questions. First: how well does a proposed explanation fit the observed event? Second: how trustworthy is the underlying evidence? Modern AI-assisted UFO investigations increasingly separate those questions because many sighting reports contain mixed-quality data. A blurry mobile-phone video may strongly resemble a balloon, yet still lack enough metadata for a confirmed identification. Conversely, a detailed multi-sensor event may have excellent evidence quality while remaining difficult to explain.
This is why many contemporary UAP workflows are moving away from simple “explained” versus “unexplained” labels. NASA’s UAP study stressed that weak sensor quality, missing metadata, and incomplete measurements are major obstacles to reliable conclusions. NASA Science [Space AARO]space.comnasa ufo study group better data neededUFOs will remain mysterious without better data, NASA…31 May 2023 — NASA's UAP study team stressed that the biggest roadblock standing…, the Pentagon’s All-domain Anomaly Resolution Office, similarly separates high-confidence resolutions from unresolved reports where the data remain incomplete. [U.S. Department of War]war.govdepartment of war releases unidentified anomalous phenomena files in historic tDepartment of War Releases Unidentified Anomalous…8 May 2026 — Today, the Department of War announced the initial release of new, neve…(https://www.war.gov/News/Releases/Release/Article/4480582/department-of-war-releases-unidentified-anomalous-phenomena-files-in-historic-t/) [AARO]aaro.milAAROUAP ImageryAARO will continue to investigate this case should further information become available to enable a more conclusive attrib… [AARO]aaro.milAARO UAP Case Resolution ReportsAARO assesses with high confidence that the object was consistent with a cluster of fully and partially i…
A two-axis labelling system helps prevent ordinary but poorly documented sightings from being overstated as mysteries, while also preventing uncertain “best guess” explanations from being presented as proven facts.
Separating explanation strength from data quality
Traditional UFO catalogues often collapse several different judgements into one final status line. A case might be marked “aircraft”, “likely balloon”, or “unknown” without clarifying whether investigators were confident in the evidence itself.
A two-axis system treats explanation quality and evidence quality as separate dimensions:
Explanation axisMeaningConfirmed identificationStrong evidence directly matches a known causeHigh-confidence explanationBest-fit explanation accounts for most major featuresPlausible explanationOne or more ordinary explanations fit reasonably wellWeak explanationCandidate explanation conflicts with important detailsUnresolvedNo explanation currently fits the available evidence
Evidence axisMeaningExcellent evidenceMultiple calibrated sources with reliable timing/location dataStrong evidenceGood imagery or sensor data with supporting metadataModerate evidenceSome corroboration but important gaps remainWeak evidenceLimited witness detail, compressed video, or uncertain timingInsufficient evidenceToo little reliable information for meaningful analysis
The important point is that these axes are independent.
A sighting can therefore be classified as:
- Plausible aircraft explanation + weak evidence
- Confirmed balloon + strong evidence [dvidshub.net]dvidshub.netMiddle East Red Balloon 2024AARO bases its assessment on the object's strong morphological consistency with other resolved imagery depict…
- Unresolved + excellent evidence
- Likely satellite flare + insufficient evidence
- No good explanation + poor-quality data [youtube.com]youtube.comNASA UAP independent study data quality explanation Inside NASA’s UAP Report with Commission Chair David Spergel & Neil deGrasse Tyson St…
That distinction sounds technical, but it changes how the public understands a case. A report labelled merely “unexplained” may imply mystery when the real problem is inadequate information. Likewise, a report labelled “identified” may wrongly imply certainty when investigators only reached a probable match.
Recent proposals for formal UAP assessment frameworks increasingly use this kind of matrix structure. One 2025 paper proposed a “UAP Assessment Matrix” with separate dimensions for evidence quality and explanatory understanding specifically to avoid oversimplified verdicts. [ScienceDirect]sciencedirect.comScienceDirectThe UAP assessment matrix: A framework for evaluating…by T Lomas · 2025 · Cited by 5 — This paper aims to help address th…
Why AI systems especially need two-axis labels
AI-assisted UFO investigation systems are good at pattern matching. They can compare a witness report against databases of aircraft tracks, satellite passes, balloon launches, atmospheric conditions, astronomical objects, and earlier sightings. But those systems can create misleading certainty if the output label does not distinguish probability from proof.
For example, an automated workflow may find that:
- a Starlink satellite train passed nearby at roughly the correct time
- the witness described evenly spaced moving lights
- the movement direction broadly matched orbital motion
An AI system may correctly score “Starlink” as the best-fit explanation. But if the original report lacks exact timestamps, camera metadata, compass direction, or a clear duration estimate, the case still may not justify a confirmed identification.
Without a separate evidence-quality axis, the public may later see the sighting summarised simply as:
“Case solved: Starlink satellites.”
That is exactly the kind of overclaiming that modern classification systems are designed to prevent.
NASA’s UAP study repeatedly emphasised that poor-quality data remain one of the largest barriers to reliable interpretation. [WIRED]wired.comThe agency stressed the need to shift the conversation from sensationalism to science and eliminate the stigma associated with reporting… [NASA Science]science.nasa.govScience Independent Study Team ReportNASA ScienceIndependent Study Team ReportSeptember 13, 2023 — At present, analysis of UAP data is hampered by poor sensor calibration, th… [NASA]science.nasa.govScience Independent Study Team ReportNASA ScienceIndependent Study Team ReportSeptember 13, 2023 — At present, analysis of UAP data is hampered by poor sensor calibration, th… Reuters and other reporting on recent Pentagon releases also highlighted that many unresolved cases remain unresolved primarily because the available evidence is incomplete or degraded rather than obviously extraordinary. [Live Science]livescience.comDepartment of Defense released a second batch of UFO-related files, bringing the total number of newly declassified documents to 162. Spa…
In practical investigative workflows, AI should therefore support human assessment rather than replace it. The system can rank candidate explanations, but investigators still need to decide how much confidence the evidence deserves.
Examples of balloon and aircraft classification splits
The value of two-axis labels becomes clearer when looking at common UFO report types.
Balloon-like behaviour with poor imagery
Suppose a witness records a distant reflective object drifting slowly with the wind. The motion profile resembles a balloon. Weather conditions support that interpretation. Nearby balloon launches are documented.
However:
- the footage is heavily zoomed
- the object shape is unclear
- the timestamp may be inaccurate
- no altitude estimate exists
A binary system might force investigators into either “identified balloon” or “unknown”.
A two-axis system allows a more honest result:
- Explanation: High-confidence balloon explanation [aaro.mil]aaro.milAARO UAP Case Resolution ReportsAARO assesses with high confidence that the object was consistent with a cluster of fully and partially i…
- Evidence: Weak to moderate
That wording communicates that the explanation is probably correct without pretending the evidence proves it conclusively.
AARO has publicly released several cases assessed with high confidence as balloons or other ordinary objects while still noting the importance of continuing analysis where information remains incomplete. [AARO]aaro.milAARO UAP Imagery Acc Table29 Feb 2024 — The United States European Command submitted a report of an unidentified anomalous phenomenon to… [AARO]aaro.milAARO HomeThe official website for the All-domain Anomaly Resolution Office (AARO)… UAP Case Resolution Reports · UAP Reporting Trends…
Strong evidence of an aircraft but incomplete closure
Another case may involve:
- multiple witnesses
- radar correlation
- ADS-B flight tracking
- matching navigation-light configuration
- a known aircraft route [science.nasa.gov]science.nasa.govnasa.govUAP9 Jun 2022 — A study team to examine unidentified anomalous phenomena (UAPs) – that is, observations of events in the sky that…
Here, both axes score highly:
- Explanation: Confirmed aircraft
- Evidence: Strong or excellent
This distinction matters because the evidential foundation is very different from a single blurry clip uploaded anonymously online.
High-quality evidence but unresolved interpretation
The opposite pattern is also possible. A case may include:
- synchronised infrared and optical recordings
- reliable timestamps
- multiple observers
- instrument metadata
- geospatial consistency
Yet no current explanation fully fits the observed behaviour.
In that situation, the case may honestly deserve:
- Explanation: Unresolved
- Evidence: Strong
This is a much narrower and more interesting category than the enormous pile of low-quality “unknown” reports that simply lack usable data.
A two-axis model therefore helps investigators separate genuinely difficult cases from cases that are merely poorly documented.
Avoiding the “everything unexplained is anomalous” trap
One of the biggest public misunderstandings in UFO discourse is the assumption that unresolved automatically means extraordinary.
Government and scientific reviews repeatedly caution against this interpretation. NASA’s study team stressed that many unresolved reports reflect missing or degraded data rather than evidence of exotic technology. NASA Science [Scientific American]scientificamerican.combad data not aliens may be behind ufo surge nasa team saysBad Data, Not Aliens, May Be behind UFO Surge, NASA…9 Jun 2023 — Gaining any new clarity about surging reports of unidentified anomalo… AARO has similarly stated that most resolved cases involve ordinary objects such as balloons, drones, birds, satellites, and aircraft, while a smaller set remains unresolved because available information is incomplete. Reuters [JBSA]jbsa.mildod examining unidentified anomalous phenomenaJBSADOD examining unidentified anomalous phenomena15 Nov 2024 — "AARO has successfully resolved hundreds of cases in its holdings to comm… [3U.S.]media.defense.govFY24 CONSOLIDATED ANNUAL REPORT ON UAP 508Department of WarFiscal Year 2024 Consolidated Annual Report on…14 Nov 2024 — AARO resolved 118 cases during the reporting period, all… Department of War
This is exactly why evidence quality needs its own public-facing label.
Without it, three fundamentally different cases become mixed together:
- Weak evidence + unresolved
- Moderate evidence + unresolved
- Excellent evidence + unresolved
Those categories have very different investigative value.
A dark speck in a shaky ten-second clip is unresolved in a trivial sense: there is simply not enough information. A calibrated multi-sensor event that still resists explanation after environmental checks is a different class of problem entirely.
Two-axis labels make that distinction visible immediately.
Building transparent public case tables
The clearest public UFO databases increasingly resemble incident-analysis systems rather than mystery archives. Instead of presenting a dramatic verdict, they expose the logic behind the classification.
A useful public case table may therefore include:
FieldExampleProposed explanationCommercial aircraftExplanation confidenceHighEvidence qualityModerateSupporting dataADS-B track, witness videoMissing dataExact altitude, raw metadataRemaining inconsistenciesReported acceleration uncertainReview statusOpen pending further evidence
This structure gives readers a clearer sense of what investigators actually know.
It also works well with AI-assisted workflows because machine systems can populate much of the supporting context automatically:
- satellite visibility checks
- weather reconstruction
- astronomical object correlation
- aircraft and drone traffic
- wind profile analysis
- local launch activity
- similarity matching with prior cases
But the final human-readable labels still matter. They determine whether the public sees a cautious probabilistic assessment or a misleadingly definitive claim.
Transparent tables also make later reassessment easier. If new evidence appears, investigators can update one axis without rewriting the entire case history. A “plausible aircraft + weak evidence” case may later become “confirmed aircraft + strong evidence” once radar or metadata emerge.
Why this approach improves public trust
UFO debates are often damaged by the collapse of uncertainty into certainty. Skeptics sometimes overstate tentative mundane explanations as definitive resolutions, while believers sometimes treat every unresolved report as evidence of something extraordinary.
Two-axis labels reduce pressure toward both extremes.
They allow investigators to say:
- “The balloon explanation fits best, but the evidence is weak.”
- “The data are strong, but the interpretation remains unresolved.”
- “The imagery is poor, so no reliable conclusion is possible.”
- “The case is probably ordinary, but not conclusively identified.”
That kind of language may sound less dramatic than traditional UFO verdicts, but it is far more useful for serious investigation.
It also aligns with the broader direction of modern UAP analysis. NASA, AARO, and emerging academic assessment frameworks increasingly emphasise calibrated uncertainty, evidence quality, and transparent confidence levels over simplistic solved-versus-unsolved narratives. [Scientific American]scientificamerican.combad data not aliens may be behind ufo surge nasa team saysBad Data, Not Aliens, May Be behind UFO Surge, NASA…9 Jun 2023 — Gaining any new clarity about surging reports of unidentified anomalo… [NASA Science]science.nasa.govScience Independent Study Team ReportNASA ScienceIndependent Study Team ReportSeptember 13, 2023 — At present, analysis of UAP data is hampered by poor sensor calibration, th… [ScienceDirect]sciencedirect.comScienceDirectThe UAP assessment matrix: A framework for evaluating…by T Lomas · 2025 · Cited by 5 — This paper aims to help address th…
Endnotes
-
Source: science.nasa.gov
Title: Science Independent Study Team Report
Link: https://science.nasa.gov/wp-content/uploads/2023/09/uap-independent-study-team-final-report.pdfSource snippet
NASA ScienceIndependent Study Team ReportSeptember 13, 2023 — At present, analysis of UAP data is hampered by poor sensor calibration, th...
Published: September 13, 2023
-
Source: space.com
Title: nasa ufo study group better data needed
Link: https://www.space.com/nasa-ufo-study-group-better-data-neededSource snippet
UFOs will remain mysterious without better data, NASA...31 May 2023 — NASA's UAP study team stressed that the biggest roadblock standing...
Published: May 2023
-
Source: aaro.mil
Link: https://www.aaro.mil/UAP-Cases/Official-UAP-Imagery/Source snippet
AAROUAP ImageryAARO will continue to investigate this case should further information become available to enable a more conclusive attrib...
-
Source: aaro.mil
Link: https://www.aaro.mil/UAP-Cases/UAP-Case-Resolution-Reports/Source snippet
AARO UAP Case Resolution ReportsAARO assesses with high confidence that the object was consistent with a cluster of fully and partially i...
-
Source: jbsa.mil
Title: dod examining unidentified anomalous phenomena
Link: https://www.jbsa.mil/News/News/Article/3966080/dod-examining-unidentified-anomalous-phenomena/Source snippet
JBSADOD examining unidentified anomalous phenomena15 Nov 2024 — "AARO has successfully [resolved]({{ 'solved-later/' | relative_url }}) hundreds of cases in its holdings to comm...
-
Source: media.defense.gov
Title: FY24 CONSOLIDATED ANNUAL REPORT ON UAP 508
Link: https://media.defense.gov/2024/Nov/14/2003583603/-1/-1/0/FY24-CONSOLIDATED-ANNUAL-REPORT-ON-UAP-508.PDFSource snippet
Department of WarFiscal Year 2024 Consolidated Annual Report on...14 Nov 2024 — AARO resolved 118 cases during the reporting period, all...
-
Source: sciencedirect.com
Link: https://www.sciencedirect.com/science/article/abs/pii/S0094576525002127Source snippet
ScienceDirectThe UAP assessment matrix: A framework for evaluating...by T Lomas · 2025 · Cited by 5 — This paper aims to help address th...
-
Source: nasa.gov
Link: https://www.nasa.gov/news-release/nasa-to-release-discuss-unidentified-anomalous-phenomena-report/Source snippet
NASA to Release, Discuss Unidentified Anomalous...NASA commissioned the study to examine UAP from a scientific perspective and create a...
-
Source: wired.com
Link: https://www.wired.com/story/nasa-ufos-aliens-report-2023Source snippet
The agency stressed the need to shift the conversation from sensationalism to science and eliminate the stigma associated with reporting...
-
Source: reuters.com
Link: https://www.reuters.com/world/us/us-releases-second-batch-government-declassified-ufo-files-2026-05-22/Source snippet
Defense Department released a second batch of declassified government files detailing alleged UFO sightings. These documents include repo...
-
Source: reuters.com
Link: https://www.reuters.com/technology/space/pentagon-ufo-report-says-most-sightings-ordinary-objects-phenomena-2024-03-08/Source snippet
Most sightings were identified as ordinary objects or phenomena. The All-domain Anomaly Resolution Office (AARO) released this conclusion...
-
Source: war.gov
Link: https://www.war.gov/ufo/Source snippet
to make a definitive determination on the nature of the observed phenomena.Read more...
-
Source: war.gov
Title: department of war releases unidentified anomalous phenomena files in historic t
Link: https://www.war.gov/News/Releases/Release/Article/4480582/department-of-war-releases-unidentified-anomalous-phenomena-files-in-historic-t/Source snippet
Department of War Releases Unidentified Anomalous...8 May 2026 — Today, the Department of War announced the initial release of new, neve...
Published: May 2026
-
Source: aaro.mil
Link: https://www.aaro.mil/Next-AARO-Home-redesign/Next-AARO-UAP-Imagery-Acc-Table/Source snippet
AARO UAP Imagery Acc Table29 Feb 2024 — The United States European Command submitted a report of an unidentified anomalous phenomenon to...
-
Source: aaro.mil
Link: https://www.aaro.mil/Source snippet
AARO HomeThe official website for the All-domain Anomaly Resolution Office (AARO)... UAP Case Resolution Reports · UAP Reporting Trends...
-
Source: aaro.mil
Title: Al Taqaddam Case Resolution Final
Link: https://www.aaro.mil/Portals/136/PDFs/case_resolution_reports/AARO_Al_Taqaddam_Case_Resolution_Final.pdfSource snippet
Al Taqaddam Case Resolution8 Sept 2025 — AARO assesses with high confidence that the object was consistent with a cluster of fully and pa...
-
Source: science.nasa.gov
Link: https://science.nasa.gov/uap/faqs/Source snippet
8 May 2026 — The UAP independent study team's main focus for the report was to come up with a way in which to evaluate and study UAPs goi...
Published: May 2026
-
Source: science.nasa.gov
Link: https://science.nasa.gov/uap/Source snippet
nasa.govUAP9 Jun 2022 — A study team to examine unidentified anomalous phenomena (UAPs) – that is, observations of events in the sky that...
-
Source: archives.gov
Link: https://www.archives.gov/research/topics/uapsSource snippet
Records Related to Unidentified Flying Objects (UFOs) and...NARA has records related to unidentified flying objects (UFO) and unidentifi...
-
Source: scientificamerican.com
Title: bad data not aliens may be behind ufo surge nasa team says
Link: https://www.scientificamerican.com/article/bad-data-not-aliens-may-be-behind-ufo-surge-nasa-team-says/Source snippet
Bad Data, Not Aliens, May Be behind UFO Surge, NASA...9 Jun 2023 — Gaining any new clarity about surging reports of unidentified anomalo...
-
Source: livescience.com
Link: https://www.livescience.com/space/extraterrestrial-life/us-government-declassifies-nearly-200-uap-files-including-strange-sightings-from-apollo-astronautsSource snippet
Department of Defense released a second batch of UFO-related files, bringing the total number of newly declassified documents to 162. Spa...
-
Source: dvidshub.net
Link: https://www.dvidshub.net/video/964843/middle-east-red-balloon-2024Source snippet
Middle East Red Balloon 2024AARO bases its assessment on the object's strong morphological consistency with other resolved imagery depict...
Additional References
-
Source: pbs.org
Link: https://www.pbs.org/newshour/science/3-ways-scientists-use-math-to-help-debunk-ufo-videosSource snippet
3 ways scientists use math to help debunk UFO videosMath, citizen science and the scientific method are all tools researchers use to inve...
-
Source: researchgate.net
Link: https://www.researchgate.net/publication/390980555_The_UAP_Assessment_Matrix_A_proposed_framework_for_evaluating_evidence_and_understanding_regarding_Unidentified_Anomalous_PhenomenaSource snippet
(PDF) The UAP Assessment Matrix: A proposed framework...9 May 2025 — PDF | On Apr 1, 2025, Tim Lomas and others published The UAP Assess...
Published: May 2025
-
Source: reddit.com
Link: https://www.reddit.com/r/UFOs/comments/1ccnj6t/aaro_does_not_have_a_100_confidence_in_its_report/Source snippet
AARO does not have a 100% confidence in its report, so...According to the Key Findings section of the report, "AARO has moderate confide...
-
Source: reddit.com
Link: https://www.reddit.com/r/nasa/comments/16ij1ym/nasa_has_released_the_unidentified_anomalous/Source snippet
NASA has released the Unidentified Anomalous...This report, commissioned by but produced independently of NASA, is not a [review]({{ 'review/' | relative_url }}) or asses...
-
Source: axios.com
Link: https://www.axios.com/2023/09/14/nasa-uap-report-releaseSource snippet
government efforts in understanding UAPs. Unlike the Department of Defense's often classified data, NASA emphasizes transparency and publ...
-
Source: usaherald.com
Link: https://usaherald.com/us-government-pentagon-releases-new-ufo-files-sparking-fresh-questions-as-declassified-uap-evidence-surges/Source snippet
US Government: Pentagon Releases New UFO Files...22 hours ago — The Pentagon's All-domain Anomaly Resolution Office, known as AARO, main...
-
Source: twz.com
Title: balloons no ufos found by satellites shoot down video coming says aaro chief
Link: https://www.twz.com/balloons-no-ufos-found-by-satellites-shoot-down-video-coming-says-aaro-chiefSource snippet
Balloons, No UFOs, Found By Satellites, Shoot Down...31 Oct 2023 — The head of AARO said that he has all the overhead imagery he needs t...
-
Source: youtube.com
Link: https://www.youtube.com/watch?v=7sg8BEGBUWUSource snippet
NASA UAP independent study data quality explanation Inside NASA’s UAP Report with Commission Chair David Spergel & Neil deGrasse Tyson St...
Published: October 2023
-
Source: youtube.com
Link: https://www.youtube.com/watch?v=TQcqOW39kskSource snippet
Unidentified Anomalous Phenomena Independent Study ReportNASA commissioned an independent study team to examine unidentified anomalous ph...
-
Source: news.clearancejobs.com
Title: ufos or u s secrets the mystery behind the pentagons 757 new uap reports
Link: https://news.clearancejobs.com/2024/11/20/ufos-or-u-s-secrets-the-mystery-behind-the-pentagons-757-new-uap-reports/Source snippet
or U.S. Secrets? The Mystery Behind the Pentagon's...20 Nov 2024 — The Pentagon's latest UAP report tackles 757 mysterious sightings, re...
Amazon book picks
Further Reading
Books and field guides related to Why One UFO Verdict Is Often Not Enough. Use these as the next step if you want deeper reading beyond the article.
Topic Tree



