Within Case Labels

Why One UFO Verdict Is Often Not Enough

Separating best-fit explanations from evidence reliability prevents uncertain sightings being treated as solved cases.

On this page

  • Separating explanation strength from data quality
  • Examples of balloon and aircraft classification splits
  • Building transparent public case tables
Preview for Why One UFO Verdict Is Often Not Enough

Introduction

A single UFO verdict often hides two separate questions. First: how well does a proposed explanation fit the observed event? Second: how trustworthy is the underlying evidence? Modern AI-assisted UFO investigations increasingly separate those questions because many sighting reports contain mixed-quality data. A blurry mobile-phone video may strongly resemble a balloon, yet still lack enough metadata for a confirmed identification. Conversely, a detailed multi-sensor event may have excellent evidence quality while remaining difficult to explain.

Two Axis Labels illustration 1 This is why many contemporary UAP workflows are moving away from simple “explained” versus “unexplained” labels. NASA’s UAP study stressed that weak sensor quality, missing metadata, and incomplete measurements are major obstacles to reliable conclusions. NASA Science [Space AARO]space.comnasa ufo study group better data neededUFOs will remain mysterious without better data, NASA…31 May 2023 — NASA's UAP study team stressed that the biggest roadblock standing…Published: May 2023, the Pentagon’s All-domain Anomaly Resolution Office, similarly separates high-confidence resolutions from unresolved reports where the data remain incomplete. [U.S. Department of War]war.govdepartment of war releases unidentified anomalous phenomena files in historic tDepartment of War Releases Unidentified Anomalous…8 May 2026 — Today, the Department of War announced the initial release of new, neve…Published: May 2026(https://www.war.gov/News/Releases/Release/Article/4480582/department-of-war-releases-unidentified-anomalous-phenomena-files-in-historic-t/) [AARO]aaro.milAAROUAP ImageryAARO will continue to investigate this case should further information become available to enable a more conclusive attrib… [AARO]aaro.milAARO UAP Case Resolution ReportsAARO assesses with high confidence that the object was consistent with a cluster of fully and partially i…

A two-axis labelling system helps prevent ordinary but poorly documented sightings from being overstated as mysteries, while also preventing uncertain “best guess” explanations from being presented as proven facts.

Separating explanation strength from data quality

Traditional UFO catalogues often collapse several different judgements into one final status line. A case might be marked “aircraft”, “likely balloon”, or “unknown” without clarifying whether investigators were confident in the evidence itself.

A two-axis system treats explanation quality and evidence quality as separate dimensions:

Explanation axisMeaningConfirmed identificationStrong evidence directly matches a known causeHigh-confidence explanationBest-fit explanation accounts for most major featuresPlausible explanationOne or more ordinary explanations fit reasonably wellWeak explanationCandidate explanation conflicts with important detailsUnresolvedNo explanation currently fits the available evidence

Evidence axisMeaningExcellent evidenceMultiple calibrated sources with reliable timing/location dataStrong evidenceGood imagery or sensor data with supporting metadataModerate evidenceSome corroboration but important gaps remainWeak evidenceLimited witness detail, compressed video, or uncertain timingInsufficient evidenceToo little reliable information for meaningful analysis

The important point is that these axes are independent.

A sighting can therefore be classified as:

  • Plausible aircraft explanation + weak evidence
  • Confirmed balloon + strong evidence [dvidshub.net]dvidshub.netMiddle East Red Balloon 2024AARO bases its assessment on the object's strong morphological consistency with other resolved imagery depict…
  • Unresolved + excellent evidence
  • Likely satellite flare + insufficient evidence
  • No good explanation + poor-quality data [youtube.com]youtube.comNASA UAP independent study data quality explanation Inside NASA’s UAP Report with Commission Chair David Spergel & Neil deGrasse Tyson St…Published: October 2023

That distinction sounds technical, but it changes how the public understands a case. A report labelled merely “unexplained” may imply mystery when the real problem is inadequate information. Likewise, a report labelled “identified” may wrongly imply certainty when investigators only reached a probable match.

Recent proposals for formal UAP assessment frameworks increasingly use this kind of matrix structure. One 2025 paper proposed a “UAP Assessment Matrix” with separate dimensions for evidence quality and explanatory understanding specifically to avoid oversimplified verdicts. [ScienceDirect]sciencedirect.comScienceDirectThe UAP assessment matrix: A framework for evaluating…by T Lomas · 2025 · Cited by 5 — This paper aims to help address th…

Why AI systems especially need two-axis labels

AI-assisted UFO investigation systems are good at pattern matching. They can compare a witness report against databases of aircraft tracks, satellite passes, balloon launches, atmospheric conditions, astronomical objects, and earlier sightings. But those systems can create misleading certainty if the output label does not distinguish probability from proof.

For example, an automated workflow may find that:

  • a Starlink satellite train passed nearby at roughly the correct time
  • the witness described evenly spaced moving lights
  • the movement direction broadly matched orbital motion

An AI system may correctly score “Starlink” as the best-fit explanation. But if the original report lacks exact timestamps, camera metadata, compass direction, or a clear duration estimate, the case still may not justify a confirmed identification.

Without a separate evidence-quality axis, the public may later see the sighting summarised simply as:

“Case solved: Starlink satellites.”

That is exactly the kind of overclaiming that modern classification systems are designed to prevent.

NASA’s UAP study repeatedly emphasised that poor-quality data remain one of the largest barriers to reliable interpretation. [WIRED]wired.comThe agency stressed the need to shift the conversation from sensationalism to science and eliminate the stigma associated with reporting… [NASA Science]science.nasa.govScience Independent Study Team ReportNASA ScienceIndependent Study Team ReportSeptember 13, 2023 — At present, analysis of UAP data is hampered by poor sensor calibration, th…Published: September 13, 2023 [NASA]science.nasa.govScience Independent Study Team ReportNASA ScienceIndependent Study Team ReportSeptember 13, 2023 — At present, analysis of UAP data is hampered by poor sensor calibration, th…Published: September 13, 2023 Reuters and other reporting on recent Pentagon releases also highlighted that many unresolved cases remain unresolved primarily because the available evidence is incomplete or degraded rather than obviously extraordinary. [Live Science]livescience.comDepartment of Defense released a second batch of UFO-related files, bringing the total number of newly declassified documents to 162. Spa…

In practical investigative workflows, AI should therefore support human assessment rather than replace it. The system can rank candidate explanations, but investigators still need to decide how much confidence the evidence deserves.

Examples of balloon and aircraft classification splits

The value of two-axis labels becomes clearer when looking at common UFO report types.

Balloon-like behaviour with poor imagery

Suppose a witness records a distant reflective object drifting slowly with the wind. The motion profile resembles a balloon. Weather conditions support that interpretation. Nearby balloon launches are documented.

However:

  • the footage is heavily zoomed
  • the object shape is unclear
  • the timestamp may be inaccurate
  • no altitude estimate exists

A binary system might force investigators into either “identified balloon” or “unknown”.

A two-axis system allows a more honest result:

  • Explanation: High-confidence balloon explanation [aaro.mil]aaro.milAARO UAP Case Resolution ReportsAARO assesses with high confidence that the object was consistent with a cluster of fully and partially i…
  • Evidence: Weak to moderate

That wording communicates that the explanation is probably correct without pretending the evidence proves it conclusively.

AARO has publicly released several cases assessed with high confidence as balloons or other ordinary objects while still noting the importance of continuing analysis where information remains incomplete. [AARO]aaro.milAARO UAP Imagery Acc Table29 Feb 2024 — The United States European Command submitted a report of an unidentified anomalous phenomenon to… [AARO]aaro.milAARO HomeThe official website for the All-domain Anomaly Resolution Office (AARO)… UAP Case Resolution Reports · UAP Reporting Trends…

Strong evidence of an aircraft but incomplete closure

Another case may involve:

  • multiple witnesses
  • radar correlation
  • ADS-B flight tracking
  • matching navigation-light configuration
  • a known aircraft route [science.nasa.gov]science.nasa.govnasa.govUAP9 Jun 2022 — A study team to examine unidentified anomalous phenomena (UAPs) – that is, observations of events in the sky that…

Here, both axes score highly:

  • Explanation: Confirmed aircraft
  • Evidence: Strong or excellent

This distinction matters because the evidential foundation is very different from a single blurry clip uploaded anonymously online.

Two Axis Labels illustration 2

High-quality evidence but unresolved interpretation

The opposite pattern is also possible. A case may include:

  • synchronised infrared and optical recordings
  • reliable timestamps
  • multiple observers
  • instrument metadata
  • geospatial consistency

Yet no current explanation fully fits the observed behaviour.

In that situation, the case may honestly deserve:

  • Explanation: Unresolved
  • Evidence: Strong

This is a much narrower and more interesting category than the enormous pile of low-quality “unknown” reports that simply lack usable data.

A two-axis model therefore helps investigators separate genuinely difficult cases from cases that are merely poorly documented.

Avoiding the “everything unexplained is anomalous” trap

One of the biggest public misunderstandings in UFO discourse is the assumption that unresolved automatically means extraordinary.

Government and scientific reviews repeatedly caution against this interpretation. NASA’s study team stressed that many unresolved reports reflect missing or degraded data rather than evidence of exotic technology. NASA Science [Scientific American]scientificamerican.combad data not aliens may be behind ufo surge nasa team saysBad Data, Not Aliens, May Be behind UFO Surge, NASA…9 Jun 2023 — Gaining any new clarity about surging reports of unidentified anomalo… AARO has similarly stated that most resolved cases involve ordinary objects such as balloons, drones, birds, satellites, and aircraft, while a smaller set remains unresolved because available information is incomplete. Reuters [JBSA]jbsa.mildod examining unidentified anomalous phenomenaJBSADOD examining unidentified anomalous phenomena15 Nov 2024 — "AARO has successfully resolved hundreds of cases in its holdings to comm… [3U.S.]media.defense.govFY24 CONSOLIDATED ANNUAL REPORT ON UAP 508Department of WarFiscal Year 2024 Consolidated Annual Report on…14 Nov 2024 — AARO resolved 118 cases during the reporting period, all… Department of War

This is exactly why evidence quality needs its own public-facing label.

Without it, three fundamentally different cases become mixed together:

  1. Weak evidence + unresolved
  2. Moderate evidence + unresolved
  3. Excellent evidence + unresolved

Those categories have very different investigative value.

A dark speck in a shaky ten-second clip is unresolved in a trivial sense: there is simply not enough information. A calibrated multi-sensor event that still resists explanation after environmental checks is a different class of problem entirely.

Two-axis labels make that distinction visible immediately.

Two Axis Labels illustration 3

Building transparent public case tables

The clearest public UFO databases increasingly resemble incident-analysis systems rather than mystery archives. Instead of presenting a dramatic verdict, they expose the logic behind the classification.

A useful public case table may therefore include:

FieldExampleProposed explanationCommercial aircraftExplanation confidenceHighEvidence qualityModerateSupporting dataADS-B track, witness videoMissing dataExact altitude, raw metadataRemaining inconsistenciesReported acceleration uncertainReview statusOpen pending further evidence

This structure gives readers a clearer sense of what investigators actually know.

It also works well with AI-assisted workflows because machine systems can populate much of the supporting context automatically:

  • satellite visibility checks
  • weather reconstruction
  • astronomical object correlation
  • aircraft and drone traffic
  • wind profile analysis
  • local launch activity
  • similarity matching with prior cases

But the final human-readable labels still matter. They determine whether the public sees a cautious probabilistic assessment or a misleadingly definitive claim.

Transparent tables also make later reassessment easier. If new evidence appears, investigators can update one axis without rewriting the entire case history. A “plausible aircraft + weak evidence” case may later become “confirmed aircraft + strong evidence” once radar or metadata emerge.

Why this approach improves public trust

UFO debates are often damaged by the collapse of uncertainty into certainty. Skeptics sometimes overstate tentative mundane explanations as definitive resolutions, while believers sometimes treat every unresolved report as evidence of something extraordinary.

Two-axis labels reduce pressure toward both extremes.

They allow investigators to say:

  • “The balloon explanation fits best, but the evidence is weak.”
  • “The data are strong, but the interpretation remains unresolved.”
  • “The imagery is poor, so no reliable conclusion is possible.”
  • “The case is probably ordinary, but not conclusively identified.”

That kind of language may sound less dramatic than traditional UFO verdicts, but it is far more useful for serious investigation.

It also aligns with the broader direction of modern UAP analysis. NASA, AARO, and emerging academic assessment frameworks increasingly emphasise calibrated uncertainty, evidence quality, and transparent confidence levels over simplistic solved-versus-unsolved narratives. [Scientific American]scientificamerican.combad data not aliens may be behind ufo surge nasa team saysBad Data, Not Aliens, May Be behind UFO Surge, NASA…9 Jun 2023 — Gaining any new clarity about surging reports of unidentified anomalo… [NASA Science]science.nasa.govScience Independent Study Team ReportNASA ScienceIndependent Study Team ReportSeptember 13, 2023 — At present, analysis of UAP data is hampered by poor sensor calibration, th…Published: September 13, 2023 [ScienceDirect]sciencedirect.comScienceDirectThe UAP assessment matrix: A framework for evaluating…by T Lomas · 2025 · Cited by 5 — This paper aims to help address th…

Endnotes

  1. Source: science.nasa.gov
    Title: Science Independent Study Team Report
    Link: https://science.nasa.gov/wp-content/uploads/2023/09/uap-independent-study-team-final-report.pdf
    Source snippet

    NASA ScienceIndependent Study Team ReportSeptember 13, 2023 — At present, analysis of UAP data is hampered by poor sensor calibration, th...

    Published: September 13, 2023

  2. Source: space.com
    Title: nasa ufo study group better data needed
    Link: https://www.space.com/nasa-ufo-study-group-better-data-needed
    Source snippet

    UFOs will remain mysterious without better data, NASA...31 May 2023 — NASA's UAP study team stressed that the biggest roadblock standing...

    Published: May 2023

  3. Source: aaro.mil
    Link: https://www.aaro.mil/UAP-Cases/Official-UAP-Imagery/
    Source snippet

    AAROUAP ImageryAARO will continue to investigate this case should further information become available to enable a more conclusive attrib...

  4. Source: aaro.mil
    Link: https://www.aaro.mil/UAP-Cases/UAP-Case-Resolution-Reports/
    Source snippet

    AARO UAP Case Resolution ReportsAARO assesses with high confidence that the object was consistent with a cluster of fully and partially i...

  5. Source: jbsa.mil
    Title: dod examining unidentified anomalous phenomena
    Link: https://www.jbsa.mil/News/News/Article/3966080/dod-examining-unidentified-anomalous-phenomena/
    Source snippet

    JBSADOD examining unidentified anomalous phenomena15 Nov 2024 — "AARO has successfully [resolved]({{ 'solved-later/' | relative_url }}) hundreds of cases in its holdings to comm...

  6. Source: media.defense.gov
    Title: FY24 CONSOLIDATED ANNUAL REPORT ON UAP 508
    Link: https://media.defense.gov/2024/Nov/14/2003583603/-1/-1/0/FY24-CONSOLIDATED-ANNUAL-REPORT-ON-UAP-508.PDF
    Source snippet

    Department of WarFiscal Year 2024 Consolidated Annual Report on...14 Nov 2024 — AARO resolved 118 cases during the reporting period, all...

  7. Source: sciencedirect.com
    Link: https://www.sciencedirect.com/science/article/abs/pii/S0094576525002127
    Source snippet

    ScienceDirectThe UAP assessment matrix: A framework for evaluating...by T Lomas · 2025 · Cited by 5 — This paper aims to help address th...

  8. Source: nasa.gov
    Link: https://www.nasa.gov/news-release/nasa-to-release-discuss-unidentified-anomalous-phenomena-report/
    Source snippet

    NASA to Release, Discuss Unidentified Anomalous...NASA commissioned the study to examine UAP from a scientific perspective and create a...

  9. Source: wired.com
    Link: https://www.wired.com/story/nasa-ufos-aliens-report-2023
    Source snippet

    The agency stressed the need to shift the conversation from sensationalism to science and eliminate the stigma associated with reporting...

  10. Source: reuters.com
    Link: https://www.reuters.com/world/us/us-releases-second-batch-government-declassified-ufo-files-2026-05-22/
    Source snippet

    Defense Department released a second batch of declassified government files detailing alleged UFO sightings. These documents include repo...

  11. Source: reuters.com
    Link: https://www.reuters.com/technology/space/pentagon-ufo-report-says-most-sightings-ordinary-objects-phenomena-2024-03-08/
    Source snippet

    Most sightings were identified as ordinary objects or phenomena. The All-domain Anomaly Resolution Office (AARO) released this conclusion...

  12. Source: war.gov
    Link: https://www.war.gov/ufo/
    Source snippet

    to make a definitive determination on the nature of the observed phenomena.Read more...

  13. Source: war.gov
    Title: department of war releases unidentified anomalous phenomena files in historic t
    Link: https://www.war.gov/News/Releases/Release/Article/4480582/department-of-war-releases-unidentified-anomalous-phenomena-files-in-historic-t/
    Source snippet

    Department of War Releases Unidentified Anomalous...8 May 2026 — Today, the Department of War announced the initial release of new, neve...

    Published: May 2026

  14. Source: aaro.mil
    Link: https://www.aaro.mil/Next-AARO-Home-redesign/Next-AARO-UAP-Imagery-Acc-Table/
    Source snippet

    AARO UAP Imagery Acc Table29 Feb 2024 — The United States European Command submitted a report of an unidentified anomalous phenomenon to...

  15. Source: aaro.mil
    Link: https://www.aaro.mil/
    Source snippet

    AARO HomeThe official website for the All-domain Anomaly Resolution Office (AARO)... UAP Case Resolution Reports · UAP Reporting Trends...

  16. Source: aaro.mil
    Title: Al Taqaddam Case Resolution Final
    Link: https://www.aaro.mil/Portals/136/PDFs/case_resolution_reports/AARO_Al_Taqaddam_Case_Resolution_Final.pdf
    Source snippet

    Al Taqaddam Case Resolution8 Sept 2025 — AARO assesses with high confidence that the object was consistent with a cluster of fully and pa...

  17. Source: science.nasa.gov
    Link: https://science.nasa.gov/uap/faqs/
    Source snippet

    8 May 2026 — The UAP independent study team's main focus for the report was to come up with a way in which to evaluate and study UAPs goi...

    Published: May 2026

  18. Source: science.nasa.gov
    Link: https://science.nasa.gov/uap/
    Source snippet

    nasa.govUAP9 Jun 2022 — A study team to examine unidentified anomalous phenomena (UAPs) – that is, observations of events in the sky that...

  19. Source: archives.gov
    Link: https://www.archives.gov/research/topics/uaps
    Source snippet

    Records Related to Unidentified Flying Objects (UFOs) and...NARA has records related to unidentified flying objects (UFO) and unidentifi...

  20. Source: scientificamerican.com
    Title: bad data not aliens may be behind ufo surge nasa team says
    Link: https://www.scientificamerican.com/article/bad-data-not-aliens-may-be-behind-ufo-surge-nasa-team-says/
    Source snippet

    Bad Data, Not Aliens, May Be behind UFO Surge, NASA...9 Jun 2023 — Gaining any new clarity about surging reports of unidentified anomalo...

  21. Source: livescience.com
    Link: https://www.livescience.com/space/extraterrestrial-life/us-government-declassifies-nearly-200-uap-files-including-strange-sightings-from-apollo-astronauts
    Source snippet

    Department of Defense released a second batch of UFO-related files, bringing the total number of newly declassified documents to 162. Spa...

  22. Source: dvidshub.net
    Link: https://www.dvidshub.net/video/964843/middle-east-red-balloon-2024
    Source snippet

    Middle East Red Balloon 2024AARO bases its assessment on the object's strong morphological consistency with other resolved imagery depict...

Additional References

  1. Source: pbs.org
    Link: https://www.pbs.org/newshour/science/3-ways-scientists-use-math-to-help-debunk-ufo-videos
    Source snippet

    3 ways scientists use math to help debunk UFO videosMath, citizen science and the scientific method are all tools researchers use to inve...

  2. Source: researchgate.net
    Link: https://www.researchgate.net/publication/390980555_The_UAP_Assessment_Matrix_A_proposed_framework_for_evaluating_evidence_and_understanding_regarding_Unidentified_Anomalous_Phenomena
    Source snippet

    (PDF) The UAP Assessment Matrix: A proposed framework...9 May 2025 — PDF | On Apr 1, 2025, Tim Lomas and others published The UAP Assess...

    Published: May 2025

  3. Source: reddit.com
    Link: https://www.reddit.com/r/UFOs/comments/1ccnj6t/aaro_does_not_have_a_100_confidence_in_its_report/
    Source snippet

    AARO does not have a 100% confidence in its report, so...According to the Key Findings section of the report, "AARO has moderate confide...

  4. Source: reddit.com
    Link: https://www.reddit.com/r/nasa/comments/16ij1ym/nasa_has_released_the_unidentified_anomalous/
    Source snippet

    NASA has released the Unidentified Anomalous...This report, commissioned by but produced independently of NASA, is not a [review]({{ 'review/' | relative_url }}) or asses...

  5. Source: axios.com
    Link: https://www.axios.com/2023/09/14/nasa-uap-report-release
    Source snippet

    government efforts in understanding UAPs. Unlike the Department of Defense's often classified data, NASA emphasizes transparency and publ...

  6. Source: usaherald.com
    Link: https://usaherald.com/us-government-pentagon-releases-new-ufo-files-sparking-fresh-questions-as-declassified-uap-evidence-surges/
    Source snippet

    US Government: Pentagon Releases New UFO Files...22 hours ago — The Pentagon's All-domain Anomaly Resolution Office, known as AARO, main...

  7. Source: twz.com
    Title: balloons no ufos found by satellites shoot down video coming says aaro chief
    Link: https://www.twz.com/balloons-no-ufos-found-by-satellites-shoot-down-video-coming-says-aaro-chief
    Source snippet

    Balloons, No UFOs, Found By Satellites, Shoot Down...31 Oct 2023 — The head of AARO said that he has all the overhead imagery he needs t...

  8. Source: youtube.com
    Link: https://www.youtube.com/watch?v=7sg8BEGBUWU
    Source snippet

    NASA UAP independent study data quality explanation Inside NASA’s UAP Report with Commission Chair David Spergel & Neil deGrasse Tyson St...

    Published: October 2023

  9. Source: youtube.com
    Link: https://www.youtube.com/watch?v=TQcqOW39ksk
    Source snippet

    Unidentified Anomalous Phenomena Independent Study ReportNASA commissioned an independent study team to examine unidentified anomalous ph...

  10. Source: news.clearancejobs.com
    Title: ufos or u s secrets the mystery behind the pentagons 757 new uap reports
    Link: https://news.clearancejobs.com/2024/11/20/ufos-or-u-s-secrets-the-mystery-behind-the-pentagons-757-new-uap-reports/
    Source snippet

    or U.S. Secrets? The Mystery Behind the Pentagon's...20 Nov 2024 — The Pentagon's latest UAP report tackles 757 mysterious sightings, re...

Amazon book picks

Further Reading

Books and field guides related to Why One UFO Verdict Is Often Not Enough. Use these as the next step if you want deeper reading beyond the article.

BookCover for UFOs

UFOs

By Leslie Kean

Directly matches evidence-based UFO investigation, witness cases, and analytical treatment of sightings.

eBay marketplace picks

Marketplace Samples

Example marketplace items related to this page. Use the search link to explore similar finds on eBay.

Using USA

Topic Tree

Follow this branch

Parent topic

Case Labels

Related pages 2